2023-11-24T07:43:07.232 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T07:43:07.233 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} --name rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/orig.config.yaml 2023-11-24T07:43:07.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T07:43:07.365 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} email: null first_in_suite: false job_id: '7465574' kernel: flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: mgr-vol-tests sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9764 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: mgr-vol-tests suite_path: /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa suite_relpath: qa suite_repo: https://github.com/rishabh-d-dave/ceph suite_sha1: 73843baf45f8a92d8e3fcbea3f024c97e73036da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9rBWDJYPE9yZQLLjcjH5h/SMQD+VIcu5fTVxOHU0ujqeR3HV/q1aWOXSbNnn5BoiuA7jUUBlHINzO6FMXKvXA= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW/wDml/gXEudHmG4LjrgrhKTGbD8SdKwcdLWYRDpRJmvRO48Eol3SYWzYqC4KifslRR4uoSyfjg0+HMn5w14I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_07:31:48 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T07:43:07.366 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa; will attempt to use it 2023-11-24T07:43:07.367 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks 2023-11-24T07:43:07.367 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T07:43:07.368 INFO:teuthology.task.internal:Checking packages... 2023-11-24T07:43:07.393 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T07:43:07.393 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T07:43:07.393 INFO:teuthology.packaging:ref: None 2023-11-24T07:43:07.393 INFO:teuthology.packaging:tag: None 2023-11-24T07:43:07.393 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T07:43:07.393 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:43:07.394 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T07:43:07.547 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.ga13ea5ff 2023-11-24T07:43:07.547 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T07:43:07.553 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T07:43:07.554 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T07:43:07.561 INFO:teuthology.task.internal:Saving configuration 2023-11-24T07:43:07.577 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T07:43:07.583 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T07:43:07.609 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:37:53.634779', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9rBWDJYPE9yZQLLjcjH5h/SMQD+VIcu5fTVxOHU0ujqeR3HV/q1aWOXSbNnn5BoiuA7jUUBlHINzO6FMXKvXA='} 2023-11-24T07:43:07.631 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:37:53.636920', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW/wDml/gXEudHmG4LjrgrhKTGbD8SdKwcdLWYRDpRJmvRO48Eol3SYWzYqC4KifslRR4uoSyfjg0+HMn5w14I='} 2023-11-24T07:43:07.632 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T07:43:07.638 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T07:43:07.638 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T07:43:07.638 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T07:43:07.713 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdf3cea8b80>, signals=[15]) 2023-11-24T07:43:07.713 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T07:43:07.719 INFO:teuthology.task.internal:Opening connections... 2023-11-24T07:43:07.719 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T07:43:07.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:43:07.806 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T07:43:07.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:43:07.889 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T07:43:07.896 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-11-24T07:43:07.913 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-11-24T07:43:07.913 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-11-24T07:43:07.969 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-11-24T07:43:07.970 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T07:43:07.971 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T07:43:07.971 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T07:43:07.971 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-11-24T07:43:07.997 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-11-24T07:43:08.014 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-11-24T07:43:08.014 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-11-24T07:43:08.072 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-24T07:43:08.073 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2023-11-24T07:43:08.074 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T07:43:08.074 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-24T07:43:08.074 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-24T07:43:08.074 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-11-24T07:43:08.096 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T07:43:08.106 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T07:43:08.111 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T07:43:08.111 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:43:08.113 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2023-11-24T07:43:08.129 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T07:43:08.136 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T07:43:08.136 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:43:08.170 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2023-11-24T07:43:08.274 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T07:43:08.328 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T07:43:08.343 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T07:43:08.344 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, timeout 300 2023-11-24T07:43:08.344 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:43:08.344 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T07:43:08.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:43:08.361 DEBUG:teuthology.task.kernel:sha1 for mon.b is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:08.361 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:43:08.361 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-11-24T07:43:08.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:43:08.362 DEBUG:teuthology.task.kernel:sha1 for mon.a is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:08.363 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-24T07:43:08.363 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-11-24T07:43:08.418 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-361.el9.x86_64 2023-11-24T07:43:08.419 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:08.419 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:43:08.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:08.423 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-361.el9.x86_64 2023-11-24T07:43:08.423 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:08.423 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-24T07:43:08.423 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:08.562 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum upgrade -y linux-firmware 2023-11-24T07:43:08.565 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum upgrade -y linux-firmware 2023-11-24T07:43:10.676 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-11-24T07:43:10.763 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-11-24T07:43:12.143 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2023-11-24T07:43:12.603 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - BaseOS 2.5 MB/s | 2.0 MB 00:00 2023-11-24T07:43:13.402 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 7.9 MB 00:00 2023-11-24T07:43:14.208 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 7.9 MB 00:01 2023-11-24T07:43:16.447 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 18 MB 00:01 2023-11-24T07:43:18.301 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 18 MB 00:02 2023-11-24T07:43:20.404 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-11-24T07:43:21.696 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 15 kB 00:00 2023-11-24T07:43:22.815 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 20 MB/s | 20 MB 00:00 2023-11-24T07:43:23.187 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 5.8 MB 00:01 2023-11-24T07:43:24.952 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 15 kB 00:00 2023-11-24T07:43:27.589 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2023-11-24T07:43:28.863 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 5.2 MB/s | 20 MB 00:03 2023-11-24T07:43:30.067 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 1 Package 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:43:30.080 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 328 M 2023-11-24T07:43:30.081 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-11-24T07:43:33.801 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 6.8 kB/s | 1.7 kB 00:00 2023-11-24T07:43:34.882 INFO:teuthology.orchestra.run.smithi161.stdout:linux-firmware-20231030-141.el9.noarch.rpm 68 MB/s | 328 MB 00:04 2023-11-24T07:43:34.883 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-11-24T07:43:34.883 INFO:teuthology.orchestra.run.smithi161.stdout:Total 68 MB/s | 328 MB 00:04 2023-11-24T07:43:34.883 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-11-24T07:43:34.957 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-11-24T07:43:34.957 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-11-24T07:43:36.236 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-11-24T07:43:36.250 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 1 Package 2023-11-24T07:43:36.251 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:43:36.252 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 328 M 2023-11-24T07:43:36.252 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-11-24T07:43:37.084 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-11-24T07:43:37.084 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-11-24T07:43:41.260 INFO:teuthology.orchestra.run.smithi175.stdout:linux-firmware-20231030-141.el9.noarch.rpm 66 MB/s | 328 MB 00:05 2023-11-24T07:43:41.261 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-11-24T07:43:41.262 INFO:teuthology.orchestra.run.smithi175.stdout:Total 66 MB/s | 328 MB 00:05 2023-11-24T07:43:41.262 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-11-24T07:43:41.346 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-11-24T07:43:41.346 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-11-24T07:43:42.935 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-11-24T07:43:43.376 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:43:43.479 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-11-24T07:43:43.480 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-11-24T07:43:43.496 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:43:44.621 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:43:44.621 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:43:45.057 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:43:45.058 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:43:45.058 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-11-24T07:43:45.058 INFO:teuthology.orchestra.run.smithi161.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T07:43:45.058 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:43:45.058 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-11-24T07:43:45.334 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-24T07:43:45.334 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:45.553 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T07:43:45.553 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T07:43:45.556 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi161.front.sepia.ceph.com to complete... 2023-11-24T07:43:49.148 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-11-24T07:43:49.660 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:43:49.748 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:43:50.615 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:43:50.615 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-11-24T07:43:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-11-24T07:43:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:43:51.019 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2023-11-24T07:43:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: linux-firmware-20231030-141.el9.noarch 2023-11-24T07:43:51.019 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:43:51.020 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-11-24T07:43:51.325 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-24T07:43:51.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-24T07:43:51.471 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ 2023-11-24T07:43:51.472 DEBUG:teuthology.orchestra.run.smithi175:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/ --input-file=- 2023-11-24T07:43:51.474 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi175.front.sepia.ceph.com to complete... 2023-11-24T07:44:02.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24 07:44:02 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T07:44:02.119 INFO:teuthology.orchestra.run.smithi161.stderr:FINISHED --2023-11-24 07:44:02-- 2023-11-24T07:44:02.119 INFO:teuthology.orchestra.run.smithi161.stderr:Total wall clock time: 17s 2023-11-24T07:44:02.119 INFO:teuthology.orchestra.run.smithi161.stderr:Downloaded: 1 files, 306M in 16s (18.9 MB/s) 2023-11-24T07:44:02.120 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.a... 2023-11-24T07:44:02.121 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T07:44:03.964 INFO:teuthology.orchestra.run.smithi161.stdout:Verifying... ######################################## 2023-11-24T07:44:04.073 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing... ######################################## 2023-11-24T07:44:04.152 INFO:teuthology.orchestra.run.smithi161.stdout:Updating / installing... 2023-11-24T07:44:11.259 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T07:44:18.828 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24 07:44:18 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/centos/9/flavors/default/x86_64/kernel-6.6.0_g8247bbb5b470-1.x86_64.rpm [320493731/320493731] -> "/tmp/kernel.x86_64.rpm" [1] 2023-11-24T07:44:18.828 INFO:teuthology.orchestra.run.smithi175.stderr:FINISHED --2023-11-24 07:44:18-- 2023-11-24T07:44:18.829 INFO:teuthology.orchestra.run.smithi175.stderr:Total wall clock time: 27s 2023-11-24T07:44:18.829 INFO:teuthology.orchestra.run.smithi175.stderr:Downloaded: 1 files, 306M in 27s (11.5 MB/s) 2023-11-24T07:44:18.830 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on mon.b... 2023-11-24T07:44:18.830 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-11-24T07:44:20.660 INFO:teuthology.orchestra.run.smithi175.stdout:Verifying... ######################################## 2023-11-24T07:44:20.713 INFO:teuthology.orchestra.run.smithi175.stdout:Preparing... ######################################## 2023-11-24T07:44:20.792 INFO:teuthology.orchestra.run.smithi175.stdout:Updating / installing... 2023-11-24T07:44:26.219 INFO:teuthology.orchestra.run.smithi161.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T07:44:27.790 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-6.6.0_g8247bbb5b470-1 ######################################## 2023-11-24T07:44:41.613 INFO:teuthology.orchestra.run.smithi175.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-11-24T07:44:47.612 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T07:44:47.613 DEBUG:teuthology.orchestra.run.smithi161:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T07:44:47.680 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:44:47.680 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:44:47.680 INFO:teuthology.orchestra.run.smithi161.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:44:47.680 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:44:47.681 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:44:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T07:44:47.687 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:44:47.688 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:44:47.689 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:44:47.690 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:44:47.691 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:44:47.692 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:44:47.693 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:44:47.694 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:44:47.695 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:44:47.696 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:44:47.697 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:44:47.698 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:44:47.699 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:44:47.700 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:44:47.701 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T07:44:47.702 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T07:44:47.703 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T07:44:47.704 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:44:47.705 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T07:44:47.706 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:44:47.707 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:44:47.708 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:44:47.709 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:44:47.710 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:44:47.711 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:44:47.712 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:44:47.713 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:44:47.714 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:44:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:44:47.716 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:44:47.717 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:44:47.718 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:44:47.719 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:44:47.720 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:44:47.721 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:44:47.722 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:44:47.723 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:44:47.724 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:44:47.725 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:44:47.726 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:44:47.727 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T07:44:47.728 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:44:47.729 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:44:47.730 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:44:47.731 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:44:47.732 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:44:47.733 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:44:47.734 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T07:44:47.735 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T07:44:47.736 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:44:47.737 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:44:47.738 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:44:47.739 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:44:47.740 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T07:44:47.741 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T07:44:47.742 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:44:47.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T07:44:47.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:44:47.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:44:47.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T07:44:47.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:44:47.743 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T07:44:47.744 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T07:44:47.745 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:44:47.746 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T07:44:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:44:47.748 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:44:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T07:44:47.750 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T07:44:47.751 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:44:47.752 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:44:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:44:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:44:47.755 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:44:47.756 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:44:47.757 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:44:47.758 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:44:47.759 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:44:47.760 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:44:47.761 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:44:47.762 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:44:47.763 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:44:47.764 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:44:47.765 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:44:47.766 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:44:47.767 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:44:47.768 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:44:47.769 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:44:47.770 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T07:44:47.771 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:44:47.772 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:44:47.773 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T07:44:47.774 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:44:47.775 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:44:47.776 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:44:47.777 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:44:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:44:47.779 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T07:44:47.780 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:44:47.781 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:44:47.782 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:44:47.783 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:44:47.784 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:44:47.785 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:44:47.786 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T07:44:47.787 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:44:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:44:47.789 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T07:44:47.790 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:44:47.791 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T07:44:47.792 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:44:47.793 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:44:47.794 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:44:47.795 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T07:44:47.796 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T07:44:47.797 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:44:47.798 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T07:44:47.799 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:44:47.800 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:44:47.801 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:44:47.802 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:44:47.803 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:44:47.804 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:44:47.805 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:44:47.806 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:44:47.807 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T07:44:47.808 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T07:44:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T07:44:47.810 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:44:47.811 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:44:47.812 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:44:47.813 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:44:47.814 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:44:47.815 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:44:47.816 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:44:47.817 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:44:47.818 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:44:47.819 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:44:47.820 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:44:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:44:47.822 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:44:47.823 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T07:44:47.824 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:44:47.825 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T07:44:47.826 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:44:47.827 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:44:47.828 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:44:47.829 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:44:47.830 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:44:47.831 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:44:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:44:47.833 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:44:47.834 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:44:47.835 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:44:47.836 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T07:44:47.837 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:44:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:44:47.839 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:44:47.840 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:44:47.841 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T07:44:47.842 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:44:47.843 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T07:44:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:44:47.845 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:44:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:44:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:44:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:44:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:44:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:44:47.846 INFO:teuthology.orchestra.run.smithi161.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:44:47.846 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:44:47.847 DEBUG:teuthology.orchestra.run.smithi161:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:44:47.869 INFO:teuthology.orchestra.run.smithi161.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T07:44:47.870 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-11-24T07:44:47.871 INFO:teuthology.orchestra.run.smithi161.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T07:44:47.871 INFO:teuthology.orchestra.run.smithi161.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T07:44:47.871 INFO:teuthology.orchestra.run.smithi161.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T07:44:47.871 INFO:teuthology.orchestra.run.smithi161.stdout:fi 2023-11-24T07:44:47.872 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2023-11-24T07:44:47.949 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2023-11-24T07:44:47.949 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2023-11-24T07:44:47.949 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2023-11-24T07:44:47.949 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 68.el9 2023-11-24T07:44:47.949 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2023-11-24T07:44:47.950 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T07:44:47.950 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2023-11-24T07:44:47.950 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8264254 2023-11-24T07:44:47.950 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2023-11-24T07:44:47.950 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T07:44:47.950 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2023-11-24T07:44:47.951 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:44:47.952 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T07:44:47.953 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T07:44:47.953 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 6.6.0-g8247bbb5b470 2023-11-24T07:44:47.953 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T07:44:48.592 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2023-11-24T07:44:49.962 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T07:44:49.998 INFO:teuthology.orchestra.run.smithi161.stderr:done 2023-11-24T07:44:50.001 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-24T07:44:50.016 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.FBNWzeDN80 2023-11-24T07:44:50.016 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FBNWzeDN80 2023-11-24T07:44:50.091 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.FBNWzeDN80 2023-11-24T07:44:50.234 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.FBNWzeDN80 is 6KB 2023-11-24T07:44:50.282 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.FBNWzeDN80 2023-11-24T07:44:50.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T07:44:50.371 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T07:44:50.371 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T07:44:50.371 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T07:44:50.371 INFO:teuthology.orchestra.run.smithi161.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T07:44:50.372 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T07:44:50.521 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2023-11-24T07:45:02.871 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi175.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-11-24T07:45:02.871 DEBUG:teuthology.orchestra.run.smithi175:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-11-24T07:45:02.945 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/config-6.6.0-g8247bbb5b470 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-24T07:45:02.946 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32c-intel.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-24T07:45:02.947 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-24T07:45:02.948 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-24T07:45:02.949 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-24T07:45:02.950 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-24T07:45:02.951 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-24T07:45:02.952 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/custom_method.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-24T07:45:02.953 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ata_generic.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-24T07:45:02.954 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-24T07:45:02.955 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sis.ko 2023-11-24T07:45:02.956 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-24T07:45:02.957 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-i2c.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/base/regmap/regmap-mmio.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-24T07:45:02.958 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/brd.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/loop.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk 2023-11-24T07:45:02.959 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/virtio_blk.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkfront.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-24T07:45:02.960 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-24T07:45:02.961 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis.ko 2023-11-24T07:45:02.962 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/uv_mmtimer.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/virtio_console.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/powernow-k8.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-24T07:45:02.963 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca 2023-11-24T07:45:02.964 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-24T07:45:02.965 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-24T07:45:02.966 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/edd.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-24T07:45:02.967 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-24T07:45:02.968 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-24T07:45:02.969 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-24T07:45:02.970 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-24T07:45:02.971 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv 2023-11-24T07:45:02.972 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-24T07:45:02.973 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-24T07:45:02.974 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-24T07:45:02.975 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-24T07:45:02.976 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-24T07:45:02.977 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-24T07:45:02.978 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-24T07:45:02.979 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-24T07:45:02.980 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-24T07:45:02.981 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-24T07:45:02.982 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses 2023-11-24T07:45:02.983 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-24T07:45:02.984 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-dev.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-24T07:45:02.985 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-24T07:45:02.986 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib 2023-11-24T07:45:02.987 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-24T07:45:02.988 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-24T07:45:02.989 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds 2023-11-24T07:45:02.990 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-24T07:45:02.991 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-24T07:45:02.992 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-24T07:45:02.993 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-24T07:45:02.994 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mfd-core.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-24T07:45:02.995 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-24T07:45:02.996 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-gru/gru.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xp.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpc.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-24T07:45:02.997 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-24T07:45:02.998 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-24T07:45:02.999 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-24T07:45:03.000 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-24T07:45:03.001 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-24T07:45:03.002 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec 2023-11-24T07:45:03.003 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet 2023-11-24T07:45:03.004 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e 2023-11-24T07:45:03.005 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell 2023-11-24T07:45:03.006 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-24T07:45:03.007 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-24T07:45:03.008 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-24T07:45:03.009 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-24T07:45:03.010 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-24T07:45:03.011 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-24T07:45:03.012 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-24T07:45:03.013 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/net_failover.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-24T07:45:03.014 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/dp83640.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-24T07:45:03.015 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_generic.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-24T07:45:03.016 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slhc.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-24T07:45:03.017 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tun.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/virtio_net.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netfront.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme 2023-11-24T07:45:03.018 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pcie/aer_inject.ko 2023-11-24T07:45:03.019 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-24T07:45:03.020 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-24T07:45:03.021 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap 2023-11-24T07:45:03.022 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc 2023-11-24T07:45:03.023 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-24T07:45:03.024 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-24T07:45:03.025 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-24T07:45:03.026 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa 2023-11-24T07:45:03.027 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-24T07:45:03.028 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe 2023-11-24T07:45:03.029 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-24T07:45:03.030 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-24T07:45:03.031 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-24T07:45:03.032 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-24T07:45:03.033 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-24T07:45:03.034 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-24T07:45:03.035 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-24T07:45:03.036 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs 2023-11-24T07:45:03.037 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-24T07:45:03.038 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-24T07:45:03.039 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-24T07:45:03.040 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-24T07:45:03.041 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-24T07:45:03.042 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-24T07:45:03.043 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-24T07:45:03.044 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-24T07:45:03.045 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-24T07:45:03.046 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_balloon.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_mmio.ko 2023-11-24T07:45:03.047 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/virtio/virtio_ring.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-24T07:45:03.048 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-24T07:45:03.049 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-24T07:45:03.050 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-acpi-processor.ko 2023-11-24T07:45:03.051 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-24T07:45:03.052 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs 2023-11-24T07:45:03.053 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ecryptfs/ecryptfs.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/fat.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/vfat.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-24T07:45:03.054 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/fuse.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-24T07:45:03.055 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout 2023-11-24T07:45:03.056 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-24T07:45:03.057 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-24T07:45:03.058 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-24T07:45:03.059 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-24T07:45:03.060 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-24T07:45:03.061 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs 2023-11-24T07:45:03.062 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-24T07:45:03.063 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/rcu/rcutorture.ko 2023-11-24T07:45:03.064 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/asn1_encoder.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4 2023-11-24T07:45:03.065 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-24T07:45:03.066 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/lib/zstd/zstd_compress.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-24T07:45:03.067 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-24T07:45:03.068 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-24T07:45:03.069 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-24T07:45:03.070 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/failover.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp 2023-11-24T07:45:03.071 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dns_resolver/dns_resolver.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154 2023-11-24T07:45:03.072 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-24T07:45:03.073 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-24T07:45:03.074 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-24T07:45:03.075 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-24T07:45:03.076 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-24T07:45:03.077 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-24T07:45:03.078 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-24T07:45:03.079 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-24T07:45:03.080 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-24T07:45:03.081 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs 2023-11-24T07:45:03.082 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-24T07:45:03.083 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-24T07:45:03.084 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-24T07:45:03.085 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-24T07:45:03.086 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_quota.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tunnel.ko 2023-11-24T07:45:03.087 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-24T07:45:03.088 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-24T07:45:03.089 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-24T07:45:03.090 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-24T07:45:03.091 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-24T07:45:03.092 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch 2023-11-24T07:45:03.093 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-24T07:45:03.094 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-24T07:45:03.095 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-24T07:45:03.096 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-24T07:45:03.097 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma 2023-11-24T07:45:03.098 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-24T07:45:03.099 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/security/keys/trusted-keys/trusted.ko 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-24T07:45:03.100 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-24T07:45:03.101 INFO:teuthology.orchestra.run.smithi175.stdout:/lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-24T07:45:03.102 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-24T07:45:03.102 DEBUG:teuthology.orchestra.run.smithi175:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-11-24T07:45:03.124 INFO:teuthology.orchestra.run.smithi175.stdout:postinstall scriptlet (using /bin/sh): 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g8247bbb5b470 -a -r /boot/System.map-6.6.0-g8247bbb5b470 ]; then 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:cp /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:cp /boot/System.map-6.6.0-g8247bbb5b470 /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:rm -f /boot/vmlinuz-6.6.0-g8247bbb5b470 /boot/System.map-6.6.0-g8247bbb5b470 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:/sbin/installkernel 6.6.0-g8247bbb5b470 /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:rm -f /boot/.vmlinuz-6.6.0-g8247bbb5b470-rpm /boot/.System.map-6.6.0-g8247bbb5b470-rpm 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:preuninstall scriptlet (using /bin/sh): 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:new-kernel-pkg --remove 6.6.0-g8247bbb5b470 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g8247bbb5b470.img 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-11-24T07:45:03.125 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-install remove 6.6.0-g8247bbb5b470 2023-11-24T07:45:03.126 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2023-11-24T07:45:03.126 INFO:teuthology.orchestra.run.smithi175.stdout:postuninstall scriptlet (using /bin/sh): 2023-11-24T07:45:03.126 INFO:teuthology.orchestra.run.smithi175.stdout:if [ -x /sbin/update-bootloader ]; then 2023-11-24T07:45:03.126 INFO:teuthology.orchestra.run.smithi175.stdout:/sbin/update-bootloader --remove 6.6.0-g8247bbb5b470 2023-11-24T07:45:03.126 INFO:teuthology.orchestra.run.smithi175.stdout:fi 2023-11-24T07:45:03.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo rpm -qi grub2-tools 2023-11-24T07:45:03.202 INFO:teuthology.orchestra.run.smithi175.stdout:Name : grub2-tools 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Epoch : 1 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Version : 2.06 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Release : 68.el9 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Architecture: x86_64 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Group : Unspecified 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Size : 8264254 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:License : GPLv3+ 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-24T07:45:03.203 INFO:teuthology.orchestra.run.smithi175.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:Packager : builder@centos.org 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:Vendor : CentOS 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:Summary : Support tools for GRUB. 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:Description : 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:hardware devices. 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:45:03.204 INFO:teuthology.orchestra.run.smithi175.stdout:This subpackage provides tools for support of all platforms. 2023-11-24T07:45:03.205 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-24T07:45:03.205 INFO:teuthology.task.kernel:Updating grub on smithi175 to boot 6.6.0-g8247bbb5b470 2023-11-24T07:45:03.206 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-24T07:45:03.790 INFO:teuthology.orchestra.run.smithi175.stderr:Generating grub configuration file ... 2023-11-24T07:45:05.226 INFO:teuthology.orchestra.run.smithi175.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-24T07:45:05.257 INFO:teuthology.orchestra.run.smithi175.stderr:done 2023-11-24T07:45:05.268 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-11-24T07:45:05.288 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.yBVFUq4k3y 2023-11-24T07:45:05.288 DEBUG:teuthology.orchestra.run.smithi175:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yBVFUq4k3y 2023-11-24T07:45:05.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.yBVFUq4k3y 2023-11-24T07:45:05.503 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.yBVFUq4k3y is 6KB 2023-11-24T07:45:05.552 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.yBVFUq4k3y 2023-11-24T07:45:05.566 DEBUG:teuthology.orchestra.run.smithi175:> sudo /bin/ls /boot/loader/entries || true 2023-11-24T07:45:05.630 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-24T07:45:05.631 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-24T07:45:05.631 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-24T07:45:05.631 INFO:teuthology.orchestra.run.smithi175.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470.conf 2023-11-24T07:45:05.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g8247bbb5b470 2023-11-24T07:45:05.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo shutdown -r now 2023-11-24T07:45:20.534 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-24T07:45:20.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:45:20.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:45:35.806 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-24T07:45:35.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-24T07:45:35.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:45:38.914 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-24T07:45:47.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:45:48.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:45:51.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-24T07:46:03.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:46:03.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:46:21.666 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-24T07:46:35.822 DEBUG:teuthology.orchestra.remote:timed out 2023-11-24T07:46:36.669 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:46:36.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:46:39.746 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-11-24T07:46:44.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-24T07:46:44.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:46:48.269 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-11-24T07:46:48.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-24T07:46:48.882 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:46:48.883 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2023-11-24T07:46:48.919 INFO:teuthology.orchestra.run.smithi175.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:46:48.920 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:46:48.920 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:46:48.920 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T07:46:49.921 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-24T07:46:49.921 DEBUG:teuthology.orchestra.run.smithi175:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-24T07:46:50.071 INFO:teuthology.orchestra.run.smithi175.stdout:ttyS1 2023-11-24T07:46:50.119 DEBUG:teuthology.parallel:result is None 2023-11-24T07:46:57.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:46:57.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:46:58.174 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-11-24T07:46:59.005 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:46:59.005 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-g8247bbb5b470"... 2023-11-24T07:46:59.005 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2023-11-24T07:46:59.086 INFO:teuthology.orchestra.run.smithi161.stdout:6.6.0-g8247bbb5b470 2023-11-24T07:46:59.087 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-24T07:46:59.087 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-24T07:46:59.087 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-24T07:47:00.088 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-24T07:47:00.088 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-24T07:47:00.227 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2023-11-24T07:47:00.269 DEBUG:teuthology.parallel:result is None 2023-11-24T07:47:00.269 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T07:47:00.278 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T07:47:00.278 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:47:00.283 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T07:47:00.328 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T07:47:00.334 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T07:47:00.344 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T07:47:00.344 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:47:00.350 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T07:47:00.414 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T07:47:00.421 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T07:47:00.421 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:47:00.430 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T07:47:00.511 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:47:00.529 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:47:00.545 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:47:00.562 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T07:47:00.566 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T07:47:00.573 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T07:47:00.573 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:47:00.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T07:47:00.652 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T07:47:00.662 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T07:47:00.662 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:47:00.666 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T07:47:00.705 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:47:00.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:47:00.919 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:47:00.993 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:47:01.068 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:47:01.068 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:47:01.145 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:47:01.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T07:47:01.315 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:47:01.382 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T07:47:01.475 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:47:01.475 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T07:47:01.547 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-11-24T07:47:01.555 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2023-11-24T07:47:01.674 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T07:47:01.686 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T07:47:02.115 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T07:47:02.123 INFO:teuthology.task.internal:Starting timer... 2023-11-24T07:47:02.123 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T07:47:02.133 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T07:47:02.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2023-11-24T07:47:02.267 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2023-11-24T07:47:02.272 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2023-11-24T07:47:02.405 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2023-11-24T07:47:02.409 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T07:47:02.410 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2023-11-24T07:47:02.476 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2023-11-24T07:47:02.476 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2023-11-24T07:47:02.531 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2023-11-24T07:47:02.531 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi161.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2023-11-24T07:47:02.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T07:47:02.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:47:02.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T07:47:02.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T07:47:02.712 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T07:47:02.712 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2023-11-24T07:47:02.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2023-11-24T07:47:02.979 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T07:47:02.989 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-24T07:47:02.989 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T07:47:03.006 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T07:47:03.007 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi161.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T07:57:07.039 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2023-11-24T07:57:07.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:57:07.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:57:07.181 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-11-24T07:57:07.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-11-24T07:57:07.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-24T07:57:07.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T07:57:07.469 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-11-24T07:57:07.628 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-11-24T07:57:07.628 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T07:57:07.638 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T07:57:07.638 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T07:57:07.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:57:07.647 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T07:57:07.648 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T07:57:07.748 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T07:57:07.749 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T07:57:07.800 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T07:57:07.801 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T07:57:07.888 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2023-11-24T07:57:07.894 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2023-11-24T07:57:07.927 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2023-11-24T07:57:07.939 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2023-11-24T07:57:07.976 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T07:57:07.988 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T07:57:08.027 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T07:57:08.041 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T07:57:08.147 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2023-11-24T07:57:08.157 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T07:57:08.158 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-11-24T07:57:08.158 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.158 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.158 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.158 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.165 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2023-11-24T07:57:08.174 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T07:57:08.174 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-11-24T07:57:08.174 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.174 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.174 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.174 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T07:57:08.175 INFO:teuthology.run_tasks:Running task install... 2023-11-24T07:57:08.183 DEBUG:teuthology.task.install:project ceph 2023-11-24T07:57:08.183 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T07:57:08.184 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T07:57:08.184 INFO:teuthology.task.install:Using flavor: default 2023-11-24T07:57:08.190 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T07:57:08.190 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T07:57:08.190 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T07:57:08.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:57:08.192 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T07:57:08.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:57:08.413 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T07:57:08.413 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T07:57:08.418 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/ 2023-11-24T07:57:08.418 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T07:57:08.538 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T07:57:08.539 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:57:08.539 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T07:57:08.582 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T07:57:08.582 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:57:08.582 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T07:57:08.640 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T07:57:08.640 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T07:57:08.687 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T07:57:08.687 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T07:57:08.781 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T07:57:08.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T07:57:08.913 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T07:57:08.955 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T07:57:09.005 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2023-11-24T07:57:09.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2023-11-24T07:57:09.043 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2023-11-24T07:57:09.047 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2023-11-24T07:57:09.377 INFO:teuthology.orchestra.run.smithi175.stdout:73 files removed 2023-11-24T07:57:09.412 INFO:teuthology.orchestra.run.smithi161.stdout:73 files removed 2023-11-24T07:57:09.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T07:57:09.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T07:57:10.469 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 154 kB/s | 78 kB 00:00 2023-11-24T07:57:10.892 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 134 kB/s | 78 kB 00:00 2023-11-24T07:57:10.927 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-24T07:57:10.985 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-11-24T07:57:11.428 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2023-11-24T07:57:11.503 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 4.2 kB/s | 1.9 kB 00:00 2023-11-24T07:57:12.122 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-11-24T07:57:12.232 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.4 MB 00:00 2023-11-24T07:57:13.797 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2023-11-24T07:57:13.907 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2023-11-24T07:57:16.311 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 7.9 MB 00:01 2023-11-24T07:57:16.435 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 7.9 MB 00:02 2023-11-24T07:57:18.421 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 22 MB/s | 18 MB 00:00 2023-11-24T07:57:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-11-24T07:57:23.495 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 5.8 MB 00:01 2023-11-24T07:57:23.777 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.8 MB 00:01 2023-11-24T07:57:25.063 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2023-11-24T07:57:25.314 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2023-11-24T07:57:26.666 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2023-11-24T07:57:27.222 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-11-24T07:57:32.291 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2023-11-24T07:57:32.847 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2023-11-24T07:57:35.207 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T07:57:35.209 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T07:57:35.230 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T07:57:35.232 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T07:57:35.233 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T07:57:35.235 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T07:57:35.237 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T07:57:35.241 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T07:57:35.242 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T07:57:35.419 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2023-11-24T07:57:35.444 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================================ 2023-11-24T07:57:35.444 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================================ 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T07:57:35.445 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T07:57:35.446 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T07:57:35.447 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T07:57:35.448 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T07:57:35.449 INFO:teuthology.orchestra.run.smithi175.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T07:57:35.450 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T07:57:35.451 INFO:teuthology.orchestra.run.smithi175.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T07:57:35.452 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T07:57:35.453 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T07:57:35.454 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T07:57:35.455 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T07:57:35.456 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T07:57:35.457 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T07:57:35.458 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout:============================================================================================ 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout:Install 132 Packages 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 15 Packages 2023-11-24T07:57:35.459 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:57:35.486 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 204 M 2023-11-24T07:57:35.486 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2023-11-24T07:57:35.735 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T07:57:35.737 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-24T07:57:35.757 INFO:teuthology.orchestra.run.smithi161.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-24T07:57:35.758 INFO:teuthology.orchestra.run.smithi161.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-24T07:57:35.759 INFO:teuthology.orchestra.run.smithi161.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-24T07:57:35.760 INFO:teuthology.orchestra.run.smithi161.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-24T07:57:35.763 INFO:teuthology.orchestra.run.smithi161.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-24T07:57:35.767 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-24T07:57:35.768 INFO:teuthology.orchestra.run.smithi161.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-24T07:57:35.851 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 6.5 k 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 5.2 M 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 859 k 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 141 k 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 1.5 M 2023-11-24T07:57:35.876 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 133 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 1.8 M 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 7.4 M 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 50 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 8.6 M 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 41 M 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 262 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 772 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 217 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 18 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-24T07:57:35.877 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 31 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 719 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 126 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 162 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 319 k 2023-11-24T07:57:35.878 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 298 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 99 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 85 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 170 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-24T07:57:35.879 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.3 M 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 3.0 M 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-24T07:57:35.880 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 19 M 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 28 k 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 2.1 M 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 243 k 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.4 M 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 18 M 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el9 ceph-noarch 15 k 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 24 k 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-24T07:57:35.881 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 163 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-24T07:57:35.882 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 476 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 4.8 M 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-24T07:57:35.883 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 45 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el9 ceph 129 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-24T07:57:35.884 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-24T07:57:35.885 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-24T07:57:35.886 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-24T07:57:35.887 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-24T07:57:35.888 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================================ 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout:Install 132 Packages 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 15 Packages 2023-11-24T07:57:35.889 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:57:35.890 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 204 M 2023-11-24T07:57:35.890 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2023-11-24T07:57:36.509 INFO:teuthology.orchestra.run.smithi175.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 19 kB/s | 6.5 kB 00:00 2023-11-24T07:57:36.950 INFO:teuthology.orchestra.run.smithi175.stdout:(2/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 6.6 MB/s | 5.2 MB 00:00 2023-11-24T07:57:37.002 INFO:teuthology.orchestra.run.smithi161.stdout:(1/147): ceph-18.0.0-7484.ga13ea5ff.el9.x86_64. 18 kB/s | 6.5 kB 00:00 2023-11-24T07:57:37.017 INFO:teuthology.orchestra.run.smithi175.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 2.1 MB/s | 141 kB 00:00 2023-11-24T07:57:37.184 INFO:teuthology.orchestra.run.smithi175.stdout:(4/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.2 MB/s | 859 kB 00:00 2023-11-24T07:57:37.293 INFO:teuthology.orchestra.run.smithi175.stdout:(5/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 7.6 MB/s | 2.1 MB 00:00 2023-11-24T07:57:37.843 INFO:teuthology.orchestra.run.smithi175.stdout:(6/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 8.0 MB/s | 4.4 MB 00:00 2023-11-24T07:57:37.865 INFO:teuthology.orchestra.run.smithi161.stdout:(2/147): ceph-fuse-18.0.0-7484.ga13ea5ff.el9.x8 997 kB/s | 859 kB 00:00 2023-11-24T07:57:37.966 INFO:teuthology.orchestra.run.smithi161.stdout:(3/147): ceph-immutable-object-cache-18.0.0-748 1.4 MB/s | 141 kB 00:00 2023-11-24T07:57:38.094 INFO:teuthology.orchestra.run.smithi175.stdout:(7/147): ceph-common-18.0.0-7484.ga13ea5ff.el9. 9.8 MB/s | 19 MB 00:01 2023-11-24T07:57:38.154 INFO:teuthology.orchestra.run.smithi175.stdout:(8/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 1.5 MB/s | 1.5 MB 00:00 2023-11-24T07:57:38.278 INFO:teuthology.orchestra.run.smithi175.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 194 kB/s | 24 kB 00:00 2023-11-24T07:57:38.941 INFO:teuthology.orchestra.run.smithi161.stdout:(4/147): ceph-mds-18.0.0-7484.ga13ea5ff.el9.x86 2.1 MB/s | 2.1 MB 00:00 2023-11-24T07:57:38.953 INFO:teuthology.orchestra.run.smithi175.stdout:(10/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 10 MB/s | 8.6 MB 00:00 2023-11-24T07:57:39.045 INFO:teuthology.orchestra.run.smithi175.stdout:(11/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 2.3 MB/s | 217 kB 00:00 2023-11-24T07:57:39.120 INFO:teuthology.orchestra.run.smithi175.stdout:(12/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 421 kB/s | 31 kB 00:00 2023-11-24T07:57:39.228 INFO:teuthology.orchestra.run.smithi175.stdout:(13/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 6.6 MB/s | 719 kB 00:00 2023-11-24T07:57:39.304 INFO:teuthology.orchestra.run.smithi175.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 2.1 MB/s | 163 kB 00:00 2023-11-24T07:57:39.391 INFO:teuthology.orchestra.run.smithi161.stdout:(5/147): ceph-mgr-18.0.0-7484.ga13ea5ff.el9.x86 3.3 MB/s | 1.5 MB 00:00 2023-11-24T07:57:39.396 INFO:teuthology.orchestra.run.smithi175.stdout:(15/147): librados-devel-18.0.0-7484.ga13ea5ff. 1.4 MB/s | 126 kB 00:00 2023-11-24T07:57:39.499 INFO:teuthology.orchestra.run.smithi161.stdout:(6/147): ceph-base-18.0.0-7484.ga13ea5ff.el9.x8 1.8 MB/s | 5.2 MB 00:02 2023-11-24T07:57:39.630 INFO:teuthology.orchestra.run.smithi175.stdout:(16/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 9.9 MB/s | 18 MB 00:01 2023-11-24T07:57:39.671 INFO:teuthology.orchestra.run.smithi175.stdout:(17/147): libradosstriper1-18.0.0-7484.ga13ea5f 1.7 MB/s | 476 kB 00:00 2023-11-24T07:57:39.747 INFO:teuthology.orchestra.run.smithi175.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 606 kB/s | 45 kB 00:00 2023-11-24T07:57:39.830 INFO:teuthology.orchestra.run.smithi175.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 1.5 MB/s | 129 kB 00:00 2023-11-24T07:57:39.923 INFO:teuthology.orchestra.run.smithi175.stdout:(20/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 1.7 MB/s | 162 kB 00:00 2023-11-24T07:57:40.023 INFO:teuthology.orchestra.run.smithi175.stdout:(21/147): python3-rados-18.0.0-7484.ga13ea5ff.e 3.1 MB/s | 319 kB 00:00 2023-11-24T07:57:40.181 INFO:teuthology.orchestra.run.smithi175.stdout:(22/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 8.7 MB/s | 4.8 MB 00:00 2023-11-24T07:57:40.193 INFO:teuthology.orchestra.run.smithi161.stdout:(7/147): ceph-mon-18.0.0-7484.ga13ea5ff.el9.x86 5.5 MB/s | 4.4 MB 00:00 2023-11-24T07:57:40.223 INFO:teuthology.orchestra.run.smithi175.stdout:(23/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 1.5 MB/s | 298 kB 00:00 2023-11-24T07:57:40.257 INFO:teuthology.orchestra.run.smithi175.stdout:(24/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 1.3 MB/s | 99 kB 00:00 2023-11-24T07:57:40.290 INFO:teuthology.orchestra.run.smithi175.stdout:(25/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.3 MB/s | 85 kB 00:00 2023-11-24T07:57:40.391 INFO:teuthology.orchestra.run.smithi175.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-24T07:57:40.491 INFO:teuthology.orchestra.run.smithi175.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7484.g 283 kB/s | 28 kB 00:00 2023-11-24T07:57:40.583 INFO:teuthology.orchestra.run.smithi175.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 1.4 MB/s | 133 kB 00:00 2023-11-24T07:57:40.710 INFO:teuthology.orchestra.run.smithi175.stdout:(29/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 6.7 MB/s | 3.0 MB 00:00 2023-11-24T07:57:40.968 INFO:teuthology.orchestra.run.smithi175.stdout:(30/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 4.6 MB/s | 1.8 MB 00:00 2023-11-24T07:57:41.144 INFO:teuthology.orchestra.run.smithi175.stdout:(31/147): ceph-mgr-modules-core-18.0.0-7484.ga1 1.4 MB/s | 243 kB 00:00 2023-11-24T07:57:41.217 INFO:teuthology.orchestra.run.smithi175.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 694 kB/s | 50 kB 00:00 2023-11-24T07:57:41.268 INFO:teuthology.orchestra.run.smithi175.stdout:(33/147): ceph-prometheus-alerts-18.0.0-7484.ga 305 kB/s | 15 kB 00:00 2023-11-24T07:57:41.311 INFO:teuthology.orchestra.run.smithi161.stdout:(8/147): ceph-radosgw-18.0.0-7484.ga13ea5ff.el9 7.7 MB/s | 8.6 MB 00:01 2023-11-24T07:57:41.393 INFO:teuthology.orchestra.run.smithi175.stdout:(34/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 2.1 MB/s | 262 kB 00:00 2023-11-24T07:57:41.394 INFO:teuthology.orchestra.run.smithi161.stdout:(9/147): ceph-selinux-18.0.0-7484.ga13ea5ff.el9 292 kB/s | 24 kB 00:00 2023-11-24T07:57:41.727 INFO:teuthology.orchestra.run.smithi175.stdout:(35/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 2.3 MB/s | 772 kB 00:00 2023-11-24T07:57:41.802 INFO:teuthology.orchestra.run.smithi175.stdout:(36/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 245 kB/s | 18 kB 00:00 2023-11-24T07:57:42.061 INFO:teuthology.orchestra.run.smithi175.stdout:(37/147): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 662 kB 00:00 2023-11-24T07:57:42.211 INFO:teuthology.orchestra.run.smithi175.stdout:(38/147): ceph-mgr-diskprediction-local-18.0.0- 4.9 MB/s | 7.4 MB 00:01 2023-11-24T07:57:42.253 INFO:teuthology.orchestra.run.smithi175.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 4.7 MB/s | 920 kB 00:00 2023-11-24T07:57:42.279 INFO:teuthology.orchestra.run.smithi175.stdout:(40/147): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-11-24T07:57:42.304 INFO:teuthology.orchestra.run.smithi175.stdout:(41/147): elfutils-libelf-devel-0.190-1.el9.x86 448 kB/s | 21 kB 00:00 2023-11-24T07:57:42.346 INFO:teuthology.orchestra.run.smithi175.stdout:(42/147): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 307 kB 00:00 2023-11-24T07:57:42.371 INFO:teuthology.orchestra.run.smithi175.stdout:(43/147): flexiblas-3.0.4-8.el9.x86_64.rpm 498 kB/s | 32 kB 00:00 2023-11-24T07:57:42.488 INFO:teuthology.orchestra.run.smithi175.stdout:(44/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2023-11-24T07:57:42.505 INFO:teuthology.orchestra.run.smithi175.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 135 kB/s | 17 kB 00:00 2023-11-24T07:57:42.555 INFO:teuthology.orchestra.run.smithi175.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 3.7 MB/s | 186 kB 00:00 2023-11-24T07:57:42.572 INFO:teuthology.orchestra.run.smithi175.stdout:(47/147): libaio-devel-0.3.111-13.el9.x86_64.rp 153 kB/s | 10 kB 00:00 2023-11-24T07:57:42.622 INFO:teuthology.orchestra.run.smithi175.stdout:(48/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2023-11-24T07:57:42.648 INFO:teuthology.orchestra.run.smithi175.stdout:(49/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 597 kB/s | 44 kB 00:00 2023-11-24T07:57:42.715 INFO:teuthology.orchestra.run.smithi175.stdout:(50/147): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 661 kB 00:00 2023-11-24T07:57:42.748 INFO:teuthology.orchestra.run.smithi175.stdout:(51/147): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 578 kB 00:00 2023-11-24T07:57:42.798 INFO:teuthology.orchestra.run.smithi175.stdout:(52/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 498 kB/s | 24 kB 00:00 2023-11-24T07:57:42.824 INFO:teuthology.orchestra.run.smithi175.stdout:(53/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 626 kB/s | 46 kB 00:00 2023-11-24T07:57:42.882 INFO:teuthology.orchestra.run.smithi175.stdout:(54/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-24T07:57:42.916 INFO:teuthology.orchestra.run.smithi175.stdout:(55/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2023-11-24T07:57:42.974 INFO:teuthology.orchestra.run.smithi175.stdout:(56/147): openblas-0.3.21-2.el9.x86_64.rpm 597 kB/s | 34 kB 00:00 2023-11-24T07:57:43.100 INFO:teuthology.orchestra.run.smithi175.stdout:(57/147): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2023-11-24T07:57:43.190 INFO:teuthology.orchestra.run.smithi175.stdout:(58/147): postgresql-13.11-1.el9.x86_64.rpm 7.6 MB/s | 1.5 MB 00:00 2023-11-24T07:57:43.242 INFO:teuthology.orchestra.run.smithi175.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 6.2 MB/s | 811 kB 00:00 2023-11-24T07:57:43.267 INFO:teuthology.orchestra.run.smithi175.stdout:(60/147): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-11-24T07:57:43.418 INFO:teuthology.orchestra.run.smithi175.stdout:(61/147): postgresql-server-13.11-1.el9.x86_64. 33 MB/s | 5.7 MB 00:00 2023-11-24T07:57:43.552 INFO:teuthology.orchestra.run.smithi175.stdout:(62/147): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2023-11-24T07:57:43.577 INFO:teuthology.orchestra.run.smithi175.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-24T07:57:43.627 INFO:teuthology.orchestra.run.smithi175.stdout:(64/147): python3-jsonpointer-2.0-4.el9.noarch. 372 kB/s | 18 kB 00:00 2023-11-24T07:57:43.652 INFO:teuthology.orchestra.run.smithi175.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 329 kB/s | 24 kB 00:00 2023-11-24T07:57:43.680 INFO:teuthology.orchestra.run.smithi175.stdout:(66/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.7 MB/s | 144 kB 00:00 2023-11-24T07:57:43.705 INFO:teuthology.orchestra.run.smithi175.stdout:(67/147): python3-markupsafe-1.1.1-12.el9.x86_6 626 kB/s | 32 kB 00:00 2023-11-24T07:57:43.830 INFO:teuthology.orchestra.run.smithi175.stdout:(68/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-11-24T07:57:43.855 INFO:teuthology.orchestra.run.smithi175.stdout:(69/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-11-24T07:57:43.906 INFO:teuthology.orchestra.run.smithi175.stdout:(70/147): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 174 kB 00:00 2023-11-24T07:57:43.931 INFO:teuthology.orchestra.run.smithi175.stdout:(71/147): python3-prettytable-0.7.2-27.el9.noar 559 kB/s | 41 kB 00:00 2023-11-24T07:57:43.981 INFO:teuthology.orchestra.run.smithi175.stdout:(72/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-11-24T07:57:44.006 INFO:teuthology.orchestra.run.smithi175.stdout:(73/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-11-24T07:57:44.027 INFO:teuthology.orchestra.run.smithi161.stdout:(10/147): ceph-osd-18.0.0-7484.ga13ea5ff.el9.x8 3.9 MB/s | 18 MB 00:04 2023-11-24T07:57:44.056 INFO:teuthology.orchestra.run.smithi175.stdout:(74/147): python3-pytz-2021.1-5.el9.noarch.rpm 968 kB/s | 47 kB 00:00 2023-11-24T07:57:44.082 INFO:teuthology.orchestra.run.smithi175.stdout:(75/147): python3-requests-oauthlib-1.3.0-12.el 580 kB/s | 43 kB 00:00 2023-11-24T07:57:44.140 INFO:teuthology.orchestra.run.smithi175.stdout:(76/147): python3-toml-0.10.2-6.el9.noarch.rpm 677 kB/s | 39 kB 00:00 2023-11-24T07:57:44.278 INFO:teuthology.orchestra.run.smithi161.stdout:(11/147): ceph-common-18.0.0-7484.ga13ea5ff.el9 2.5 MB/s | 19 MB 00:07 2023-11-24T07:57:44.320 INFO:teuthology.orchestra.run.smithi161.stdout:(12/147): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 748 kB/s | 217 kB 00:00 2023-11-24T07:57:44.345 INFO:teuthology.orchestra.run.smithi161.stdout:(13/147): libcephfs-devel-18.0.0-7484.ga13ea5ff 475 kB/s | 31 kB 00:00 2023-11-24T07:57:44.416 INFO:teuthology.orchestra.run.smithi175.stdout:(77/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2023-11-24T07:57:44.449 INFO:teuthology.orchestra.run.smithi175.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2023-11-24T07:57:44.453 INFO:teuthology.orchestra.run.smithi161.stdout:(14/147): libcephsqlite-18.0.0-7484.ga13ea5ff.e 1.5 MB/s | 163 kB 00:00 2023-11-24T07:57:44.474 INFO:teuthology.orchestra.run.smithi175.stdout:(79/147): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-11-24T07:57:44.500 INFO:teuthology.orchestra.run.smithi175.stdout:(80/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-11-24T07:57:44.521 INFO:teuthology.orchestra.run.smithi161.stdout:(15/147): libcephfs2-18.0.0-7484.ga13ea5ff.el9. 3.5 MB/s | 719 kB 00:00 2023-11-24T07:57:44.562 INFO:teuthology.orchestra.run.smithi161.stdout:(16/147): librados-devel-18.0.0-7484.ga13ea5ff. 1.1 MB/s | 126 kB 00:00 2023-11-24T07:57:44.625 INFO:teuthology.orchestra.run.smithi175.stdout:(81/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 421 kB/s | 63 kB 00:00 2023-11-24T07:57:44.651 INFO:teuthology.orchestra.run.smithi175.stdout:(82/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 295 kB/s | 44 kB 00:00 2023-11-24T07:57:44.654 INFO:teuthology.orchestra.run.smithi161.stdout:(17/147): libradosstriper1-18.0.0-7484.ga13ea5f 3.5 MB/s | 476 kB 00:00 2023-11-24T07:57:44.676 INFO:teuthology.orchestra.run.smithi175.stdout:(83/147): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-11-24T07:57:44.718 INFO:teuthology.orchestra.run.smithi175.stdout:(84/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-11-24T07:57:44.721 INFO:teuthology.orchestra.run.smithi161.stdout:(18/147): python3-ceph-argparse-18.0.0-7484.ga1 684 kB/s | 45 kB 00:00 2023-11-24T07:57:44.751 INFO:teuthology.orchestra.run.smithi175.stdout:(85/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-11-24T07:57:44.785 INFO:teuthology.orchestra.run.smithi175.stdout:(86/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2023-11-24T07:57:44.835 INFO:teuthology.orchestra.run.smithi175.stdout:(87/147): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-24T07:57:44.838 INFO:teuthology.orchestra.run.smithi161.stdout:(19/147): python3-ceph-common-18.0.0-7484.ga13e 1.1 MB/s | 129 kB 00:00 2023-11-24T07:57:44.861 INFO:teuthology.orchestra.run.smithi175.stdout:(88/147): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-11-24T07:57:44.886 INFO:teuthology.orchestra.run.smithi175.stdout:(89/147): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-11-24T07:57:44.905 INFO:teuthology.orchestra.run.smithi161.stdout:(20/147): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.4 MB/s | 162 kB 00:00 2023-11-24T07:57:44.911 INFO:teuthology.orchestra.run.smithi175.stdout:(90/147): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-11-24T07:57:44.945 INFO:teuthology.orchestra.run.smithi175.stdout:(91/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-24T07:57:45.339 INFO:teuthology.orchestra.run.smithi161.stdout:(21/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 10 MB/s | 41 MB 00:03 2023-11-24T07:57:45.381 INFO:teuthology.orchestra.run.smithi161.stdout:(22/147): python3-rados-18.0.0-7484.ga13ea5ff.e 673 kB/s | 319 kB 00:00 2023-11-24T07:57:45.404 INFO:teuthology.orchestra.run.smithi175.stdout:(92/147): ceph-test-18.0.0-7484.ga13ea5ff.el9.x 5.8 MB/s | 41 MB 00:07 2023-11-24T07:57:45.431 INFO:teuthology.orchestra.run.smithi161.stdout:(23/147): python3-rgw-18.0.0-7484.ga13ea5ff.el9 2.0 MB/s | 99 kB 00:00 2023-11-24T07:57:45.465 INFO:teuthology.orchestra.run.smithi161.stdout:(24/147): python3-rbd-18.0.0-7484.ga13ea5ff.el9 2.3 MB/s | 298 kB 00:00 2023-11-24T07:57:45.498 INFO:teuthology.orchestra.run.smithi161.stdout:(25/147): rbd-fuse-18.0.0-7484.ga13ea5ff.el9.x8 1.3 MB/s | 85 kB 00:00 2023-11-24T07:57:45.520 INFO:teuthology.orchestra.run.smithi175.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 427 kB/s | 245 kB 00:00 2023-11-24T07:57:45.548 INFO:teuthology.orchestra.run.smithi161.stdout:(26/147): rbd-nbd-18.0.0-7484.ga13ea5ff.el9.x86 3.4 MB/s | 170 kB 00:00 2023-11-24T07:57:45.599 INFO:teuthology.orchestra.run.smithi161.stdout:(27/147): ceph-grafana-dashboards-18.0.0-7484.g 567 kB/s | 28 kB 00:00 2023-11-24T07:57:45.666 INFO:teuthology.orchestra.run.smithi161.stdout:(28/147): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 2.0 MB/s | 133 kB 00:00 2023-11-24T07:57:45.696 INFO:teuthology.orchestra.run.smithi175.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 5.3 MB/s | 4.1 MB 00:00 2023-11-24T07:57:45.729 INFO:teuthology.orchestra.run.smithi175.stdout:(95/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 952 kB/s | 309 kB 00:00 2023-11-24T07:57:45.774 INFO:teuthology.orchestra.run.smithi161.stdout:(29/147): rbd-mirror-18.0.0-7484.ga13ea5ff.el9. 9.8 MB/s | 3.0 MB 00:00 2023-11-24T07:57:45.788 INFO:teuthology.orchestra.run.smithi175.stdout:(96/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 273 kB/s | 24 kB 00:00 2023-11-24T07:57:45.821 INFO:teuthology.orchestra.run.smithi175.stdout:(97/147): liboath-2.6.7-2.el9.x86_64.rpm 548 kB/s | 49 kB 00:00 2023-11-24T07:57:46.005 INFO:teuthology.orchestra.run.smithi175.stdout:(98/147): libarrow-9.0.0-9.el9.x86_64.rpm 9.2 MB/s | 4.4 MB 00:00 2023-11-24T07:57:46.016 INFO:teuthology.orchestra.run.smithi161.stdout:(30/147): librgw2-18.0.0-7484.ga13ea5ff.el9.x86 3.3 MB/s | 4.8 MB 00:01 2023-11-24T07:57:46.039 INFO:teuthology.orchestra.run.smithi175.stdout:(99/147): libunwind-1.6.2-1.el9.x86_64.rpm 279 kB/s | 67 kB 00:00 2023-11-24T07:57:46.072 INFO:teuthology.orchestra.run.smithi175.stdout:(100/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.3 MB/s | 837 kB 00:00 2023-11-24T07:57:46.075 INFO:teuthology.orchestra.run.smithi161.stdout:(31/147): ceph-mgr-dashboard-18.0.0-7484.ga13ea 4.3 MB/s | 1.8 MB 00:00 2023-11-24T07:57:46.114 INFO:teuthology.orchestra.run.smithi175.stdout:(101/147): python3-asyncssh-2.13.2-3.el9.noarch 5.3 MB/s | 548 kB 00:00 2023-11-24T07:57:46.125 INFO:teuthology.orchestra.run.smithi161.stdout:(32/147): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 1.0 MB/s | 50 kB 00:00 2023-11-24T07:57:46.156 INFO:teuthology.orchestra.run.smithi175.stdout:(102/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 560 kB/s | 43 kB 00:00 2023-11-24T07:57:46.159 INFO:teuthology.orchestra.run.smithi161.stdout:(33/147): ceph-mgr-modules-core-18.0.0-7484.ga1 1.7 MB/s | 243 kB 00:00 2023-11-24T07:57:46.181 INFO:teuthology.orchestra.run.smithi175.stdout:(103/147): python3-cachetools-4.2.4-1.el9.noarc 314 kB/s | 32 kB 00:00 2023-11-24T07:57:46.193 INFO:teuthology.orchestra.run.smithi161.stdout:(34/147): ceph-prometheus-alerts-18.0.0-7484.ga 228 kB/s | 15 kB 00:00 2023-11-24T07:57:46.206 INFO:teuthology.orchestra.run.smithi175.stdout:(104/147): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2023-11-24T07:57:46.240 INFO:teuthology.orchestra.run.smithi175.stdout:(105/147): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-11-24T07:57:46.251 INFO:teuthology.orchestra.run.smithi161.stdout:(35/147): ceph-volume-18.0.0-7484.ga13ea5ff.el9 2.8 MB/s | 262 kB 00:00 2023-11-24T07:57:46.274 INFO:teuthology.orchestra.run.smithi175.stdout:(106/147): python3-cherrypy-18.6.1-2.el9.noarch 5.4 MB/s | 358 kB 00:00 2023-11-24T07:57:46.318 INFO:teuthology.orchestra.run.smithi161.stdout:(36/147): cephfs-top-18.0.0-7484.ga13ea5ff.el9. 278 kB/s | 18 kB 00:00 2023-11-24T07:57:46.332 INFO:teuthology.orchestra.run.smithi175.stdout:(107/147): python3-google-auth-2.23.4-1.el9.noa 1.6 MB/s | 197 kB 00:00 2023-11-24T07:57:46.358 INFO:teuthology.orchestra.run.smithi175.stdout:(108/147): python3-jaraco-8.2.1-3.el9.noarch.rp 94 kB/s | 11 kB 00:00 2023-11-24T07:57:46.399 INFO:teuthology.orchestra.run.smithi175.stdout:(109/147): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2023-11-24T07:57:46.425 INFO:teuthology.orchestra.run.smithi175.stdout:(110/147): python3-jaraco-collections-3.0.0-8.e 255 kB/s | 23 kB 00:00 2023-11-24T07:57:46.452 INFO:teuthology.orchestra.run.smithi161.stdout:(37/147): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-11-24T07:57:46.458 INFO:teuthology.orchestra.run.smithi175.stdout:(111/147): python3-jaraco-functools-3.5.0-2.el9 340 kB/s | 19 kB 00:00 2023-11-24T07:57:46.525 INFO:teuthology.orchestra.run.smithi175.stdout:(112/147): python3-jaraco-text-3.2.0-6.el9.noar 159 kB/s | 20 kB 00:00 2023-11-24T07:57:46.550 INFO:teuthology.orchestra.run.smithi175.stdout:(113/147): python3-jwt+crypto-2.4.0-1.el9.noarc 72 kB/s | 9.0 kB 00:00 2023-11-24T07:57:46.560 INFO:teuthology.orchestra.run.smithi161.stdout:(38/147): cephadm-18.0.0-7484.ga13ea5ff.el9.noa 2.1 MB/s | 772 kB 00:00 2023-11-24T07:57:46.576 INFO:teuthology.orchestra.run.smithi175.stdout:(114/147): python3-jwt-2.4.0-1.el9.noarch.rpm 351 kB/s | 41 kB 00:00 2023-11-24T07:57:46.642 INFO:teuthology.orchestra.run.smithi175.stdout:(115/147): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2023-11-24T07:57:46.668 INFO:teuthology.orchestra.run.smithi175.stdout:(116/147): python3-logutils-0.3.5-21.el9.noarch 512 kB/s | 46 kB 00:00 2023-11-24T07:57:46.693 INFO:teuthology.orchestra.run.smithi175.stdout:(117/147): python3-more-itertools-8.12.0-2.el9. 683 kB/s | 79 kB 00:00 2023-11-24T07:57:46.718 INFO:teuthology.orchestra.run.smithi175.stdout:(118/147): python3-natsort-7.1.1-5.el9.noarch.r 785 kB/s | 58 kB 00:00 2023-11-24T07:57:46.785 INFO:teuthology.orchestra.run.smithi175.stdout:(119/147): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2023-11-24T07:57:46.810 INFO:teuthology.orchestra.run.smithi175.stdout:(120/147): python3-portend-3.1.0-2.el9.noarch.r 142 kB/s | 16 kB 00:00 2023-11-24T07:57:46.827 INFO:teuthology.orchestra.run.smithi161.stdout:(39/147): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 920 kB 00:00 2023-11-24T07:57:46.835 INFO:teuthology.orchestra.run.smithi175.stdout:(121/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 771 kB/s | 90 kB 00:00 2023-11-24T07:57:46.861 INFO:teuthology.orchestra.run.smithi175.stdout:(122/147): python3-repoze-lru-0.7-16.el9.noarch 413 kB/s | 31 kB 00:00 2023-11-24T07:57:46.869 INFO:teuthology.orchestra.run.smithi161.stdout:(40/147): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 662 kB 00:00 2023-11-24T07:57:46.894 INFO:teuthology.orchestra.run.smithi175.stdout:(123/147): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-11-24T07:57:46.895 INFO:teuthology.orchestra.run.smithi161.stdout:(41/147): boost-program-options-1.75.0-8.el9.x8 383 kB/s | 106 kB 00:00 2023-11-24T07:57:46.911 INFO:teuthology.orchestra.run.smithi175.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-11-24T07:57:46.920 INFO:teuthology.orchestra.run.smithi161.stdout:(42/147): elfutils-libelf-devel-0.190-1.el9.x86 243 kB/s | 21 kB 00:00 2023-11-24T07:57:46.928 INFO:teuthology.orchestra.run.smithi175.stdout:(125/147): python3-tempora-5.0.0-2.el9.noarch.r 559 kB/s | 36 kB 00:00 2023-11-24T07:57:46.945 INFO:teuthology.orchestra.run.smithi175.stdout:(126/147): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2023-11-24T07:57:46.962 INFO:teuthology.orchestra.run.smithi161.stdout:(43/147): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 307 kB 00:00 2023-11-24T07:57:46.987 INFO:teuthology.orchestra.run.smithi161.stdout:(44/147): flexiblas-3.0.4-8.el9.x86_64.rpm 493 kB/s | 32 kB 00:00 2023-11-24T07:57:46.987 INFO:teuthology.orchestra.run.smithi175.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2023-11-24T07:57:47.029 INFO:teuthology.orchestra.run.smithi175.stdout:(128/147): python3-websocket-client-1.2.3-2.el9 900 kB/s | 90 kB 00:00 2023-11-24T07:57:47.063 INFO:teuthology.orchestra.run.smithi175.stdout:(129/147): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-11-24T07:57:47.088 INFO:teuthology.orchestra.run.smithi175.stdout:(130/147): python3-zc-lockfile-2.0-10.el9.noarc 210 kB/s | 20 kB 00:00 2023-11-24T07:57:47.104 INFO:teuthology.orchestra.run.smithi161.stdout:(45/147): flexiblas-openblas-openmp-3.0.4-8.el9 123 kB/s | 17 kB 00:00 2023-11-24T07:57:47.137 INFO:teuthology.orchestra.run.smithi161.stdout:(46/147): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 186 kB 00:00 2023-11-24T07:57:47.147 INFO:teuthology.orchestra.run.smithi175.stdout:(131/147): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2023-11-24T07:57:47.222 INFO:teuthology.orchestra.run.smithi175.stdout:(132/147): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-11-24T07:57:47.229 INFO:teuthology.orchestra.run.smithi161.stdout:(47/147): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.8 MB/s | 3.0 MB 00:00 2023-11-24T07:57:47.255 INFO:teuthology.orchestra.run.smithi161.stdout:(48/147): libaio-devel-0.3.111-13.el9.x86_64.rp 70 kB/s | 10 kB 00:00 2023-11-24T07:57:47.272 INFO:teuthology.orchestra.run.smithi175.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T07:57:47.288 INFO:teuthology.orchestra.run.smithi161.stdout:(49/147): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2023-11-24T07:57:47.313 INFO:teuthology.orchestra.run.smithi161.stdout:(50/147): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 44 kB 00:00 2023-11-24T07:57:47.381 INFO:teuthology.orchestra.run.smithi175.stdout:(134/147): NetworkManager-1.45.6-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-11-24T07:57:47.397 INFO:teuthology.orchestra.run.smithi161.stdout:(51/147): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2023-11-24T07:57:47.431 INFO:teuthology.orchestra.run.smithi161.stdout:(52/147): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 578 kB 00:00 2023-11-24T07:57:47.456 INFO:teuthology.orchestra.run.smithi161.stdout:(53/147): libuuid-devel-2.37.4-15.el9.x86_64.rp 174 kB/s | 24 kB 00:00 2023-11-24T07:57:47.473 INFO:teuthology.orchestra.run.smithi175.stdout:(135/147): NetworkManager-libnm-1.45.6-1.el9.x8 19 MB/s | 1.8 MB 00:00 2023-11-24T07:57:47.481 INFO:teuthology.orchestra.run.smithi161.stdout:(54/147): libzstd-devel-1.5.1-2.el9.x86_64.rpm 572 kB/s | 46 kB 00:00 2023-11-24T07:57:47.515 INFO:teuthology.orchestra.run.smithi161.stdout:(55/147): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-11-24T07:57:47.523 INFO:teuthology.orchestra.run.smithi175.stdout:(136/147): NetworkManager-team-1.45.6-1.el9.x86 855 kB/s | 42 kB 00:00 2023-11-24T07:57:47.548 INFO:teuthology.orchestra.run.smithi161.stdout:(56/147): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2023-11-24T07:57:47.565 INFO:teuthology.orchestra.run.smithi161.stdout:(57/147): openblas-0.3.21-2.el9.x86_64.rpm 416 kB/s | 34 kB 00:00 2023-11-24T07:57:47.573 INFO:teuthology.orchestra.run.smithi175.stdout:(137/147): NetworkManager-tui-1.45.6-1.el9.x86_ 4.9 MB/s | 245 kB 00:00 2023-11-24T07:57:47.624 INFO:teuthology.orchestra.run.smithi175.stdout:(138/147): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-11-24T07:57:47.715 INFO:teuthology.orchestra.run.smithi175.stdout:(139/147): librados2-18.0.0-7484.ga13ea5ff.el9. 5.3 MB/s | 3.3 MB 00:00 2023-11-24T07:57:47.741 INFO:teuthology.orchestra.run.smithi175.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 314 kB/s | 36 kB 00:00 2023-11-24T07:57:47.816 INFO:teuthology.orchestra.run.smithi175.stdout:(141/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 4.5 MB/s | 3.0 MB 00:00 2023-11-24T07:57:47.832 INFO:teuthology.orchestra.run.smithi161.stdout:(58/147): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2023-11-24T07:57:47.841 INFO:teuthology.orchestra.run.smithi175.stdout:(142/147): elfutils-libelf-0.190-1.el9.x86_64.r 1.5 MB/s | 192 kB 00:00 2023-11-24T07:57:47.875 INFO:teuthology.orchestra.run.smithi175.stdout:(143/147): elfutils-libs-0.190-1.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2023-11-24T07:57:47.891 INFO:teuthology.orchestra.run.smithi161.stdout:(59/147): postgresql-contrib-13.11-1.el9.x86_64 2.5 MB/s | 811 kB 00:00 2023-11-24T07:57:47.900 INFO:teuthology.orchestra.run.smithi175.stdout:(144/147): libacl-2.3.1-4.el9.x86_64.rpm 397 kB/s | 22 kB 00:00 2023-11-24T07:57:47.925 INFO:teuthology.orchestra.run.smithi175.stdout:(145/147): xfsdump-3.1.12-4.el9.x86_64.rpm 3.9 MB/s | 321 kB 00:00 2023-11-24T07:57:47.974 INFO:teuthology.orchestra.run.smithi161.stdout:(60/147): postgresql-13.11-1.el9.x86_64.rpm 3.8 MB/s | 1.5 MB 00:00 2023-11-24T07:57:47.999 INFO:teuthology.orchestra.run.smithi161.stdout:(61/147): postgresql-private-libs-13.11-1.el9.x 840 kB/s | 134 kB 00:00 2023-11-24T07:57:48.134 INFO:teuthology.orchestra.run.smithi175.stdout:(146/147): openssl-3.0.7-25.el9.x86_64.rpm 4.8 MB/s | 1.2 MB 00:00 2023-11-24T07:57:48.174 INFO:teuthology.orchestra.run.smithi161.stdout:(62/147): postgresql-server-13.11-1.el9.x86_64. 21 MB/s | 5.7 MB 00:00 2023-11-24T07:57:48.208 INFO:teuthology.orchestra.run.smithi161.stdout:(63/147): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-11-24T07:57:48.234 INFO:teuthology.orchestra.run.smithi175.stdout:(147/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.0 MB/s | 2.2 MB 00:00 2023-11-24T07:57:48.244 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2023-11-24T07:57:48.245 INFO:teuthology.orchestra.run.smithi175.stdout:Total 16 MB/s | 204 MB 00:12 2023-11-24T07:57:48.342 INFO:teuthology.orchestra.run.smithi161.stdout:(64/147): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-11-24T07:57:48.358 INFO:teuthology.orchestra.run.smithi161.stdout:(65/147): python3-jsonpatch-1.21-16.el9.noarch. 134 kB/s | 24 kB 00:00 2023-11-24T07:57:48.375 INFO:teuthology.orchestra.run.smithi161.stdout:(66/147): python3-jsonpointer-2.0-4.el9.noarch. 118 kB/s | 18 kB 00:00 2023-11-24T07:57:48.426 INFO:teuthology.orchestra.run.smithi161.stdout:(67/147): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-11-24T07:57:48.443 INFO:teuthology.orchestra.run.smithi161.stdout:(68/147): python3-markupsafe-1.1.1-12.el9.x86_6 483 kB/s | 32 kB 00:00 2023-11-24T07:57:48.465 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2023-11-24T07:57:48.576 INFO:teuthology.orchestra.run.smithi161.stdout:(69/147): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-11-24T07:57:48.602 INFO:teuthology.orchestra.run.smithi161.stdout:(70/147): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2023-11-24T07:57:48.627 INFO:teuthology.orchestra.run.smithi161.stdout:(71/147): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2023-11-24T07:57:48.669 INFO:teuthology.orchestra.run.smithi161.stdout:(72/147): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-11-24T07:57:48.702 INFO:teuthology.orchestra.run.smithi161.stdout:(73/147): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-11-24T07:57:48.728 INFO:teuthology.orchestra.run.smithi161.stdout:(74/147): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2023-11-24T07:57:48.741 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2023-11-24T07:57:48.741 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2023-11-24T07:57:48.744 INFO:teuthology.orchestra.run.smithi161.stdout:(75/147): python3-pytz-2021.1-5.el9.noarch.rpm 655 kB/s | 47 kB 00:00 2023-11-24T07:57:48.770 INFO:teuthology.orchestra.run.smithi161.stdout:(76/147): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-11-24T07:57:48.870 INFO:teuthology.orchestra.run.smithi161.stdout:(77/147): python3-toml-0.10.2-6.el9.noarch.rpm 309 kB/s | 39 kB 00:00 2023-11-24T07:57:48.937 INFO:teuthology.orchestra.run.smithi161.stdout:(78/147): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 300 kB 00:00 2023-11-24T07:57:49.146 INFO:teuthology.orchestra.run.smithi161.stdout:(79/147): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2023-11-24T07:57:49.162 INFO:teuthology.orchestra.run.smithi161.stdout:(80/147): uuid-1.6.2-55.el9.x86_64.rpm 200 kB/s | 56 kB 00:00 2023-11-24T07:57:49.196 INFO:teuthology.orchestra.run.smithi161.stdout:(81/147): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 336 kB/s | 85 kB 00:00 2023-11-24T07:57:49.213 INFO:teuthology.orchestra.run.smithi161.stdout:(82/147): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-11-24T07:57:49.230 INFO:teuthology.orchestra.run.smithi161.stdout:(83/147): zlib-devel-1.2.11-40.el9.x86_64.rpm 680 kB/s | 44 kB 00:00 2023-11-24T07:57:49.255 INFO:teuthology.orchestra.run.smithi161.stdout:(84/147): fuse-2.9.9-15.el9.x86_64.rpm 1.4 MB/s | 79 kB 00:00 2023-11-24T07:57:49.305 INFO:teuthology.orchestra.run.smithi161.stdout:(85/147): libgfortran-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 803 kB 00:00 2023-11-24T07:57:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:(86/147): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2023-11-24T07:57:49.364 INFO:teuthology.orchestra.run.smithi161.stdout:(87/147): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.4 MB/s | 241 kB 00:00 2023-11-24T07:57:49.406 INFO:teuthology.orchestra.run.smithi161.stdout:(88/147): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-11-24T07:57:49.456 INFO:teuthology.orchestra.run.smithi161.stdout:(89/147): python3-cryptography-36.0.1-4.el9.x86 9.4 MB/s | 1.1 MB 00:00 2023-11-24T07:57:49.481 INFO:teuthology.orchestra.run.smithi161.stdout:(90/147): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2023-11-24T07:57:49.507 INFO:teuthology.orchestra.run.smithi161.stdout:(91/147): python3-requests-2.25.1-7.el9.noarch. 1.2 MB/s | 113 kB 00:00 2023-11-24T07:57:49.540 INFO:teuthology.orchestra.run.smithi161.stdout:(92/147): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-11-24T07:57:49.691 INFO:teuthology.orchestra.run.smithi161.stdout:(93/147): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2023-11-24T07:57:49.941 INFO:teuthology.orchestra.run.smithi161.stdout:(94/147): openssl-devel-3.0.7-25.el9.x86_64.rpm 9.0 MB/s | 4.1 MB 00:00 2023-11-24T07:57:50.266 INFO:teuthology.orchestra.run.smithi161.stdout:(95/147): libarrow-doc-9.0.0-9.el9.noarch.rpm 75 kB/s | 24 kB 00:00 2023-11-24T07:57:50.475 INFO:teuthology.orchestra.run.smithi161.stdout:(96/147): liboath-2.6.7-2.el9.x86_64.rpm 234 kB/s | 49 kB 00:00 2023-11-24T07:57:50.767 INFO:teuthology.orchestra.run.smithi161.stdout:(97/147): libunwind-1.6.2-1.el9.x86_64.rpm 231 kB/s | 67 kB 00:00 2023-11-24T07:57:50.851 INFO:teuthology.orchestra.run.smithi161.stdout:(98/147): gperftools-libs-2.9.1-2.el9.x86_64.rp 236 kB/s | 309 kB 00:01 2023-11-24T07:57:50.931 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2023-11-24T07:57:50.932 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2023-11-24T07:57:52.150 INFO:teuthology.orchestra.run.smithi161.stdout:(99/147): python3-asyncssh-2.13.2-3.el9.noarch. 422 kB/s | 548 kB 00:01 2023-11-24T07:57:52.351 INFO:teuthology.orchestra.run.smithi161.stdout:(100/147): python3-bcrypt-3.2.2-1.el9.x86_64.rp 218 kB/s | 43 kB 00:00 2023-11-24T07:57:52.459 INFO:teuthology.orchestra.run.smithi161.stdout:(101/147): python3-cachetools-4.2.4-1.el9.noarc 299 kB/s | 32 kB 00:00 2023-11-24T07:57:52.585 INFO:teuthology.orchestra.run.smithi161.stdout:(102/147): python3-certifi-2021.10.8-2.el9.noar 120 kB/s | 15 kB 00:00 2023-11-24T07:57:53.085 INFO:teuthology.orchestra.run.smithi161.stdout:(103/147): parquet-libs-9.0.0-9.el9.x86_64.rpm 361 kB/s | 837 kB 00:02 2023-11-24T07:57:53.142 INFO:teuthology.orchestra.run.smithi161.stdout:(104/147): python3-cheroot-8.6.0-4.el9.noarch.r 309 kB/s | 172 kB 00:00 2023-11-24T07:57:53.627 INFO:teuthology.orchestra.run.smithi161.stdout:(105/147): python3-google-auth-2.23.4-1.el9.noa 408 kB/s | 197 kB 00:00 2023-11-24T07:57:53.744 INFO:teuthology.orchestra.run.smithi161.stdout:(106/147): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2023-11-24T07:57:53.861 INFO:teuthology.orchestra.run.smithi161.stdout:(107/147): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2023-11-24T07:57:53.961 INFO:teuthology.orchestra.run.smithi161.stdout:(108/147): python3-cherrypy-18.6.1-2.el9.noarch 410 kB/s | 358 kB 00:00 2023-11-24T07:57:53.978 INFO:teuthology.orchestra.run.smithi161.stdout:(109/147): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2023-11-24T07:57:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:(110/147): python3-jaraco-functools-3.5.0-2.el9 181 kB/s | 19 kB 00:00 2023-11-24T07:57:54.087 INFO:teuthology.orchestra.run.smithi161.stdout:(111/147): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2023-11-24T07:57:54.179 INFO:teuthology.orchestra.run.smithi161.stdout:(112/147): python3-jwt+crypto-2.4.0-1.el9.noarc 84 kB/s | 9.0 kB 00:00 2023-11-24T07:57:54.196 INFO:teuthology.orchestra.run.smithi161.stdout:(113/147): python3-jwt-2.4.0-1.el9.noarch.rpm 379 kB/s | 41 kB 00:00 2023-11-24T07:57:54.405 INFO:teuthology.orchestra.run.smithi161.stdout:(114/147): python3-logutils-0.3.5-21.el9.noarch 222 kB/s | 46 kB 00:00 2023-11-24T07:57:54.613 INFO:teuthology.orchestra.run.smithi161.stdout:(115/147): python3-more-itertools-8.12.0-2.el9. 380 kB/s | 79 kB 00:00 2023-11-24T07:57:54.822 INFO:teuthology.orchestra.run.smithi161.stdout:(116/147): python3-natsort-7.1.1-5.el9.noarch.r 278 kB/s | 58 kB 00:00 2023-11-24T07:57:55.445 INFO:teuthology.orchestra.run.smithi161.stdout:(117/147): python3-pecan-1.4.2-3.el9.noarch.rpm 438 kB/s | 272 kB 00:00 2023-11-24T07:57:55.564 INFO:teuthology.orchestra.run.smithi161.stdout:(118/147): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2023-11-24T07:57:55.781 INFO:teuthology.orchestra.run.smithi161.stdout:(119/147): python3-pyOpenSSL-21.0.0-1.el9.noarc 416 kB/s | 90 kB 00:00 2023-11-24T07:57:55.906 INFO:teuthology.orchestra.run.smithi161.stdout:(120/147): python3-repoze-lru-0.7-16.el9.noarch 248 kB/s | 31 kB 00:00 2023-11-24T07:57:56.298 INFO:teuthology.orchestra.run.smithi161.stdout:(121/147): python3-routes-2.5.1-5.el9.noarch.rp 482 kB/s | 188 kB 00:00 2023-11-24T07:57:56.340 INFO:teuthology.orchestra.run.smithi161.stdout:(122/147): python3-kubernetes-26.1.0-2.el9.noar 484 kB/s | 1.0 MB 00:02 2023-11-24T07:57:56.457 INFO:teuthology.orchestra.run.smithi161.stdout:(123/147): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2023-11-24T07:57:56.507 INFO:teuthology.orchestra.run.smithi161.stdout:(124/147): python3-rsa-4.9-2.el9.noarch.rpm 284 kB/s | 59 kB 00:00 2023-11-24T07:57:56.666 INFO:teuthology.orchestra.run.smithi161.stdout:(125/147): python3-typing-extensions-4.4.0-2.el 245 kB/s | 51 kB 00:00 2023-11-24T07:57:56.883 INFO:teuthology.orchestra.run.smithi161.stdout:(126/147): python3-websocket-client-1.2.3-2.el9 416 kB/s | 90 kB 00:00 2023-11-24T07:57:56.979 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2023-11-24T07:57:57.008 INFO:teuthology.orchestra.run.smithi161.stdout:(127/147): python3-webob-1.8.7-6.el9.noarch.rpm 459 kB/s | 230 kB 00:00 2023-11-24T07:57:57.113 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T07:57:57.134 INFO:teuthology.orchestra.run.smithi161.stdout:(128/147): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2023-11-24T07:57:57.148 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T07:57:57.230 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T07:57:57.287 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T07:57:57.308 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T07:57:57.387 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T07:57:57.526 INFO:teuthology.orchestra.run.smithi161.stdout:(129/147): re2-20211101-3.el9.x86_64.rpm 490 kB/s | 192 kB 00:00 2023-11-24T07:57:57.759 INFO:teuthology.orchestra.run.smithi161.stdout:(130/147): python3-werkzeug-2.0.3-3.el9.1.noarc 488 kB/s | 427 kB 00:00 2023-11-24T07:57:57.795 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T07:57:57.873 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T07:57:58.158 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T07:57:58.190 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T07:57:58.201 INFO:teuthology.orchestra.run.smithi161.stdout:(131/147): librados2-18.0.0-7484.ga13ea5ff.el9. 7.5 MB/s | 3.3 MB 00:00 2023-11-24T07:57:58.313 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T07:57:58.354 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T07:57:58.426 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T07:57:58.451 INFO:teuthology.orchestra.run.smithi161.stdout:(132/147): librbd1-18.0.0-7484.ga13ea5ff.el9.x8 12 MB/s | 3.0 MB 00:00 2023-11-24T07:57:58.502 INFO:teuthology.orchestra.run.smithi161.stdout:(133/147): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-11-24T07:57:58.685 INFO:teuthology.orchestra.run.smithi161.stdout:(134/147): libarrow-9.0.0-9.el9.x86_64.rpm 503 kB/s | 4.4 MB 00:08 2023-11-24T07:57:58.705 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T07:57:58.762 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T07:57:58.777 INFO:teuthology.orchestra.run.smithi161.stdout:(135/147): NetworkManager-1.45.6-1.el9.x86_64.r 8.2 MB/s | 2.2 MB 00:00 2023-11-24T07:57:58.787 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T07:57:58.844 INFO:teuthology.orchestra.run.smithi161.stdout:(136/147): NetworkManager-libnm-1.45.6-1.el9.x8 12 MB/s | 1.8 MB 00:00 2023-11-24T07:57:58.903 INFO:teuthology.orchestra.run.smithi161.stdout:(137/147): NetworkManager-team-1.45.6-1.el9.x86 377 kB/s | 42 kB 00:00 2023-11-24T07:57:58.936 INFO:teuthology.orchestra.run.smithi161.stdout:(138/147): NetworkManager-tui-1.45.6-1.el9.x86_ 2.6 MB/s | 245 kB 00:00 2023-11-24T07:57:58.940 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T07:57:58.962 INFO:teuthology.orchestra.run.smithi161.stdout:(139/147): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-11-24T07:57:58.971 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T07:57:58.987 INFO:teuthology.orchestra.run.smithi161.stdout:(140/147): elfutils-debuginfod-client-0.190-1.e 750 kB/s | 36 kB 00:00 2023-11-24T07:57:59.021 INFO:teuthology.orchestra.run.smithi161.stdout:(141/147): elfutils-libelf-0.190-1.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2023-11-24T07:57:59.054 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T07:57:59.055 INFO:teuthology.orchestra.run.smithi161.stdout:(142/147): elfutils-libs-0.190-1.el9.x86_64.rpm 3.9 MB/s | 255 kB 00:00 2023-11-24T07:57:59.079 INFO:teuthology.orchestra.run.smithi161.stdout:(143/147): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 22 kB 00:00 2023-11-24T07:57:59.114 INFO:teuthology.orchestra.run.smithi161.stdout:(144/147): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-11-24T07:57:59.371 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T07:57:59.497 INFO:teuthology.orchestra.run.smithi161.stdout:(145/147): openssl-3.0.7-25.el9.x86_64.rpm 2.9 MB/s | 1.2 MB 00:00 2023-11-24T07:57:59.534 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T07:57:59.622 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T07:57:59.655 INFO:teuthology.orchestra.run.smithi161.stdout:(146/147): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.0 MB/s | 2.2 MB 00:00 2023-11-24T07:57:59.825 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T07:57:59.871 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T07:58:00.313 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T07:58:00.359 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T07:58:00.372 INFO:teuthology.orchestra.run.smithi161.stdout:(147/147): thrift-0.15.0-2.el9.x86_64.rpm 569 kB/s | 1.6 MB 00:02 2023-11-24T07:58:00.380 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2023-11-24T07:58:00.381 INFO:teuthology.orchestra.run.smithi161.stdout:Total 8.3 MB/s | 204 MB 00:24 2023-11-24T07:58:00.461 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T07:58:00.523 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T07:58:00.555 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T07:58:00.606 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2023-11-24T07:58:00.607 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T07:58:00.654 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T07:58:00.764 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T07:58:00.813 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T07:58:00.847 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T07:58:00.883 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2023-11-24T07:58:00.883 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2023-11-24T07:58:00.945 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T07:58:00.977 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T07:58:01.025 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T07:58:01.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T07:58:01.299 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T07:58:01.379 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T07:58:02.047 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T07:58:02.142 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T07:58:02.194 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T07:58:02.253 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T07:58:02.300 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T07:58:02.363 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T07:58:02.561 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T07:58:02.619 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T07:58:02.760 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T07:58:02.806 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T07:58:02.862 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T07:58:02.945 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T07:58:03.090 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2023-11-24T07:58:03.091 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2023-11-24T07:58:03.160 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T07:58:03.214 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T07:58:03.309 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T07:58:03.377 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T07:58:03.446 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T07:58:03.644 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T07:58:03.688 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T07:58:03.734 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T07:58:03.861 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T07:58:03.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T07:58:03.955 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T07:58:03.987 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T07:58:04.139 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T07:58:04.192 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T07:58:04.259 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T07:58:04.330 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T07:58:04.584 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T07:58:04.646 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T07:58:04.827 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T07:58:04.881 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T07:58:04.906 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T07:58:04.945 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T07:58:04.980 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T07:58:05.016 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T07:58:05.058 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T07:58:05.113 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T07:58:05.173 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T07:58:05.217 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T07:58:05.346 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T07:58:05.380 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T07:58:05.402 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T07:58:05.455 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T07:58:05.499 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T07:58:05.651 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T07:58:05.699 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T07:58:05.840 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T07:58:05.904 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T07:58:06.876 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T07:58:06.928 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T07:58:06.962 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T07:58:06.995 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T07:58:07.239 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T07:58:07.275 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T07:58:07.368 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T07:58:08.182 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T07:58:08.319 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T07:58:09.536 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2023-11-24T07:58:09.774 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/162 2023-11-24T07:58:09.846 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/162 2023-11-24T07:58:09.898 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T07:58:09.948 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/162 2023-11-24T07:58:10.003 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T07:58:10.031 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/162 2023-11-24T07:58:10.042 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T07:58:10.065 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/162 2023-11-24T07:58:10.072 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T07:58:10.117 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T07:58:10.158 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T07:58:10.167 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/162 2023-11-24T07:58:10.520 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T07:58:10.552 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T07:58:10.574 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/162 2023-11-24T07:58:10.620 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T07:58:10.711 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T07:58:10.784 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T07:58:10.821 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T07:58:10.925 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T07:58:10.977 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T07:58:11.084 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/162 2023-11-24T07:58:11.126 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T07:58:11.210 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T07:58:11.413 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/162 2023-11-24T07:58:11.476 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/162 2023-11-24T07:58:11.501 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T07:58:11.676 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 14/162 2023-11-24T07:58:11.702 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T07:58:11.739 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T07:58:11.763 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T07:58:11.768 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 15/162 2023-11-24T07:58:11.889 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T07:58:11.907 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T07:58:12.074 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/162 2023-11-24T07:58:12.260 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T07:58:12.353 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/162 2023-11-24T07:58:12.549 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T07:58:12.610 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T07:58:13.049 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/162 2023-11-24T07:58:13.089 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/162 2023-11-24T07:58:13.189 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/162 2023-11-24T07:58:13.261 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/162 2023-11-24T07:58:13.293 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/162 2023-11-24T07:58:13.347 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/162 2023-11-24T07:58:13.394 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/162 2023-11-24T07:58:13.518 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/162 2023-11-24T07:58:13.563 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/162 2023-11-24T07:58:13.597 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/162 2023-11-24T07:58:13.710 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/162 2023-11-24T07:58:13.759 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 29/162 2023-11-24T07:58:13.820 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 30/162 2023-11-24T07:58:13.936 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 31/162 2023-11-24T07:58:14.148 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/162 2023-11-24T07:58:14.210 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/162 2023-11-24T07:58:14.384 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T07:58:14.420 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T07:58:14.919 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/162 2023-11-24T07:58:15.017 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/162 2023-11-24T07:58:15.045 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T07:58:15.075 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/162 2023-11-24T07:58:15.090 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T07:58:15.134 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/162 2023-11-24T07:58:15.190 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 38/162 2023-11-24T07:58:15.254 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/162 2023-11-24T07:58:15.292 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T07:58:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T07:58:15.293 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T07:58:15.293 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:15.341 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T07:58:15.451 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/162 2023-11-24T07:58:15.509 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/162 2023-11-24T07:58:15.648 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/162 2023-11-24T07:58:15.687 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 43/162 2023-11-24T07:58:15.781 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/162 2023-11-24T07:58:15.872 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/162 2023-11-24T07:58:15.921 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/162 2023-11-24T07:58:15.962 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/162 2023-11-24T07:58:16.028 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/162 2023-11-24T07:58:16.085 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/162 2023-11-24T07:58:16.143 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/162 2023-11-24T07:58:16.345 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/162 2023-11-24T07:58:16.403 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/162 2023-11-24T07:58:16.448 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/162 2023-11-24T07:58:16.574 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/162 2023-11-24T07:58:16.628 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/162 2023-11-24T07:58:16.681 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/162 2023-11-24T07:58:16.719 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/162 2023-11-24T07:58:16.877 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 58/162 2023-11-24T07:58:16.940 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/162 2023-11-24T07:58:17.010 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/162 2023-11-24T07:58:17.088 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/162 2023-11-24T07:58:17.347 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/162 2023-11-24T07:58:17.400 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/162 2023-11-24T07:58:17.586 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/162 2023-11-24T07:58:17.635 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/162 2023-11-24T07:58:17.662 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/162 2023-11-24T07:58:17.700 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/162 2023-11-24T07:58:17.743 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/162 2023-11-24T07:58:17.789 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/162 2023-11-24T07:58:17.831 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/162 2023-11-24T07:58:17.890 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/162 2023-11-24T07:58:17.957 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/162 2023-11-24T07:58:18.008 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/162 2023-11-24T07:58:18.167 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/162 2023-11-24T07:58:18.212 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/162 2023-11-24T07:58:18.255 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/162 2023-11-24T07:58:18.318 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/162 2023-11-24T07:58:18.357 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/162 2023-11-24T07:58:18.500 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/162 2023-11-24T07:58:18.538 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/162 2023-11-24T07:58:18.677 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/162 2023-11-24T07:58:18.743 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/162 2023-11-24T07:58:19.716 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/162 2023-11-24T07:58:19.793 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/162 2023-11-24T07:58:19.827 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/162 2023-11-24T07:58:19.861 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/162 2023-11-24T07:58:20.106 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/162 2023-11-24T07:58:20.132 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/162 2023-11-24T07:58:20.233 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/162 2023-11-24T07:58:21.030 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/162 2023-11-24T07:58:21.161 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/162 2023-11-24T07:58:22.706 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/162 2023-11-24T07:58:22.801 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/162 2023-11-24T07:58:22.839 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/162 2023-11-24T07:58:22.870 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : jq-1.6-16.el9.x86_64 95/162 2023-11-24T07:58:22.913 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/162 2023-11-24T07:58:22.956 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 97/162 2023-11-24T07:58:23.320 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/162 2023-11-24T07:58:23.359 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T07:58:23.471 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 99/162 2023-11-24T07:58:23.515 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 100/162 2023-11-24T07:58:23.571 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/162 2023-11-24T07:58:24.057 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 102/162 2023-11-24T07:58:24.087 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T07:58:24.177 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 103/162 2023-11-24T07:58:24.206 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 104/162 2023-11-24T07:58:26.728 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T07:58:26.777 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T07:58:27.404 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 105/162 2023-11-24T07:58:27.447 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T07:58:27.631 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 106/162 2023-11-24T07:58:27.631 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-24T07:58:27.631 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-24T07:58:27.631 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:27.681 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T07:58:27.779 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2023-11-24T07:58:27.780 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:27.985 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T07:58:28.034 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T07:58:28.034 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:28.034 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T07:58:28.034 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:29.732 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:31.882 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T07:58:31.883 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T07:58:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T07:58:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T07:58:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T07:58:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T07:58:31.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T07:58:31.943 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T07:58:31.970 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T07:58:33.060 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T07:58:33.087 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T07:58:33.228 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T07:58:33.395 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T07:58:33.422 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T07:58:33.495 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T07:58:33.495 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:33.496 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T07:58:33.496 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T07:58:33.496 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T07:58:33.496 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:33.556 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T07:58:33.595 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T07:58:33.676 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T07:58:34.591 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T07:58:34.625 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T07:58:34.700 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T07:58:34.701 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:34.701 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T07:58:34.701 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:58:34.701 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:58:34.701 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:34.751 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T07:58:34.824 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T07:58:34.824 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:34.824 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T07:58:34.825 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:34.893 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T07:58:34.969 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T07:58:34.969 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:34.969 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T07:58:34.969 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:58:34.969 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:58:34.969 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:35.327 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T07:58:35.405 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T07:58:35.405 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:35.405 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T07:58:35.405 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T07:58:35.405 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T07:58:35.405 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:39.523 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T07:58:39.568 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T07:58:39.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T07:58:39.655 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T07:58:39.924 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T07:58:40.065 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T07:58:40.101 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T07:58:40.134 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T07:58:40.191 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T07:58:40.211 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 107/162 2023-11-24T07:58:40.211 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2023-11-24T07:58:40.211 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2023-11-24T07:58:40.211 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2023-11-24T07:58:40.212 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2023-11-24T07:58:40.212 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2023-11-24T07:58:40.212 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2023-11-24T07:58:40.212 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2023-11-24T07:58:40.212 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:40.228 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T07:58:40.354 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T07:58:40.430 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T07:58:40.443 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T07:58:40.486 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T07:58:40.491 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 108/162 2023-11-24T07:58:40.491 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:40.492 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-24T07:58:40.492 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:41.328 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T07:58:41.378 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T07:58:41.437 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T07:58:42.186 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T07:58:42.268 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 109/162 2023-11-24T07:58:42.269 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:42.269 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-24T07:58:42.269 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T07:58:42.269 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-24T07:58:42.269 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:42.495 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T07:58:42.567 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 110/162 2023-11-24T07:58:42.567 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:42.567 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-24T07:58:42.568 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T07:58:42.568 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-24T07:58:42.568 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:42.756 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T07:58:42.884 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T07:58:42.965 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T07:58:43.040 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T07:58:43.046 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T07:58:43.127 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 111/162 2023-11-24T07:58:43.128 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:43.128 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-24T07:58:43.128 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T07:58:43.128 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-24T07:58:43.128 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:43.224 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T07:58:43.256 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : automake-1.16.2-8.el9.noarch 112/162 2023-11-24T07:58:43.261 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T07:58:43.294 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T07:58:43.337 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T07:58:43.380 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T07:58:43.381 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T07:58:43.936 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T07:58:43.948 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T07:58:43.975 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 113/162 2023-11-24T07:58:43.994 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T07:58:44.021 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 114/162 2023-11-24T07:58:44.067 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T07:58:44.106 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T07:58:44.107 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T07:58:44.116 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 115/162 2023-11-24T07:58:44.146 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T07:58:44.219 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T07:58:44.250 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T07:58:44.296 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T07:58:44.296 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T07:58:44.466 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 116/162 2023-11-24T07:58:44.496 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T07:58:44.615 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T07:58:44.615 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T07:58:44.790 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T07:58:44.827 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T07:58:44.861 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T07:58:44.895 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T07:58:45.022 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T07:58:45.301 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T07:58:45.301 INFO:teuthology.orchestra.run.smithi175.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T07:58:45.302 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:45.625 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 117/162 2023-11-24T07:58:45.655 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T07:58:45.797 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 118/162 2023-11-24T07:58:45.971 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 119/162 2023-11-24T07:58:46.016 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T07:58:46.103 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 120/162 2023-11-24T07:58:46.103 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:46.103 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-24T07:58:46.103 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T07:58:46.103 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-24T07:58:46.103 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:46.166 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T07:58:46.206 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 121/162 2023-11-24T07:58:46.284 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 122/162 2023-11-24T07:58:47.154 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libtool-2.4.6-45.el9.x86_64 123/162 2023-11-24T07:58:47.185 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T07:58:47.264 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 124/162 2023-11-24T07:58:47.265 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:47.265 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-24T07:58:47.265 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:58:47.265 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-24T07:58:47.265 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:47.319 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T07:58:47.415 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 125/162 2023-11-24T07:58:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:47.415 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-24T07:58:47.415 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:47.486 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T07:58:47.585 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 126/162 2023-11-24T07:58:47.585 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:47.585 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-24T07:58:47.586 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:58:47.586 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-24T07:58:47.586 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:47.962 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T07:58:48.050 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 127/162 2023-11-24T07:58:48.051 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-24T07:58:48.051 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-24T07:58:48.051 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T07:58:48.051 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-24T07:58:48.051 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:58:49.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T07:58:49.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T07:58:49.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T07:58:49.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T07:58:49.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T07:58:49.651 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T07:58:49.652 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T07:58:49.653 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T07:58:49.664 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T07:58:49.665 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T07:58:49.666 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T07:58:49.667 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T07:58:49.668 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T07:58:49.669 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T07:58:49.670 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T07:58:49.671 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T07:58:49.672 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T07:58:49.673 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T07:58:49.674 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T07:58:49.675 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T07:58:51.846 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T07:58:51.846 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T07:58:51.847 INFO:teuthology.orchestra.run.smithi175.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.848 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.849 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T07:58:51.850 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: jq-1.6-16.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.851 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T07:58:51.852 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T07:58:51.853 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T07:58:51.854 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T07:58:51.855 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T07:58:51.856 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T07:58:51.857 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T07:58:51.858 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T07:58:51.859 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T07:58:51.860 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T07:58:51.860 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:58:51.860 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2023-11-24T07:58:52.234 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 128/162 2023-11-24T07:58:52.289 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 129/162 2023-11-24T07:58:52.374 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 130/162 2023-11-24T07:58:52.417 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/162 2023-11-24T07:58:52.418 DEBUG:teuthology.parallel:result is None 2023-11-24T07:58:52.703 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 132/162 2023-11-24T07:58:52.824 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 133/162 2023-11-24T07:58:52.869 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 134/162 2023-11-24T07:58:52.920 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 135/162 2023-11-24T07:58:52.960 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 136/162 2023-11-24T07:58:52.998 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 137/162 2023-11-24T07:58:53.110 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 138/162 2023-11-24T07:58:53.181 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/162 2023-11-24T07:58:53.222 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/162 2023-11-24T07:58:54.155 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T07:58:54.202 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T07:58:54.269 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 141/162 2023-11-24T07:58:55.616 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 142/162 2023-11-24T07:58:55.748 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 143/162 2023-11-24T07:58:55.823 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 144/162 2023-11-24T07:58:55.914 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 145/162 2023-11-24T07:58:56.471 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flex-2.6.4-9.el9.x86_64 146/162 2023-11-24T07:58:56.511 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : bison-3.7.4-5.el9.x86_64 147/162 2023-11-24T07:58:56.544 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 148/162 2023-11-24T07:58:56.578 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/162 2023-11-24T07:58:56.620 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 150/162 2023-11-24T07:58:56.620 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T07:58:56.748 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/162 2023-11-24T07:58:56.796 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 152/162 2023-11-24T07:58:56.841 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 153/162 2023-11-24T07:58:56.873 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 154/162 2023-11-24T07:58:56.873 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T07:58:57.019 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/162 2023-11-24T07:58:57.050 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 156/162 2023-11-24T07:58:57.090 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T07:58:57.091 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T07:58:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 157/162 2023-11-24T07:58:57.432 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T07:58:57.616 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/162 2023-11-24T07:58:57.652 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 159/162 2023-11-24T07:58:57.686 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 160/162 2023-11-24T07:58:57.720 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 161/162 2023-11-24T07:58:57.846 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T07:58:58.100 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 162/162 2023-11-24T07:58:58.100 INFO:teuthology.orchestra.run.smithi161.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-11-24T07:58:58.100 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:02.339 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 1/162 2023-11-24T07:59:02.339 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2/162 2023-11-24T07:59:02.339 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 3/162 2023-11-24T07:59:02.339 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 4/162 2023-11-24T07:59:02.339 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 6/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 7/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 8/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 9/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 10/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 11/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 12/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 13/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_ 14/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 15/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 16/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_6 17/162 2023-11-24T07:59:02.340 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86 18/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 19/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9. 21/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_6 22/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 23/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 24/162 2023-11-24T07:59:02.341 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 25/162 2023-11-24T07:59:02.353 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 26/162 2023-11-24T07:59:02.353 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 27/162 2023-11-24T07:59:02.353 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 28/162 2023-11-24T07:59:02.354 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/162 2023-11-24T07:59:02.354 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noa 30/162 2023-11-24T07:59:02.354 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.n 31/162 2023-11-24T07:59:02.354 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/162 2023-11-24T07:59:02.354 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/162 2023-11-24T07:59:02.355 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 34/162 2023-11-24T07:59:02.355 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/162 2023-11-24T07:59:02.355 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 36/162 2023-11-24T07:59:02.355 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 37/162 2023-11-24T07:59:02.355 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 38/162 2023-11-24T07:59:02.355 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/162 2023-11-24T07:59:02.356 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/162 2023-11-24T07:59:02.356 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/162 2023-11-24T07:59:02.356 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/162 2023-11-24T07:59:02.356 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/162 2023-11-24T07:59:02.356 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/162 2023-11-24T07:59:02.357 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/162 2023-11-24T07:59:02.357 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/162 2023-11-24T07:59:02.357 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : jq-1.6-16.el9.x86_64 47/162 2023-11-24T07:59:02.357 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/162 2023-11-24T07:59:02.357 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/162 2023-11-24T07:59:02.357 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/162 2023-11-24T07:59:02.358 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/162 2023-11-24T07:59:02.358 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/162 2023-11-24T07:59:02.358 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/162 2023-11-24T07:59:02.358 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/162 2023-11-24T07:59:02.358 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/162 2023-11-24T07:59:02.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 56/162 2023-11-24T07:59:02.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/162 2023-11-24T07:59:02.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/162 2023-11-24T07:59:02.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-13.11-1.el9.x86_64 59/162 2023-11-24T07:59:02.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 60/162 2023-11-24T07:59:02.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 61/162 2023-11-24T07:59:02.360 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 62/162 2023-11-24T07:59:02.360 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 63/162 2023-11-24T07:59:02.360 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 64/162 2023-11-24T07:59:02.360 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/162 2023-11-24T07:59:02.360 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/162 2023-11-24T07:59:02.361 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/162 2023-11-24T07:59:02.361 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/162 2023-11-24T07:59:02.361 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/162 2023-11-24T07:59:02.361 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/162 2023-11-24T07:59:02.361 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/162 2023-11-24T07:59:02.361 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 72/162 2023-11-24T07:59:02.362 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 73/162 2023-11-24T07:59:02.362 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 74/162 2023-11-24T07:59:02.362 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 75/162 2023-11-24T07:59:02.362 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 76/162 2023-11-24T07:59:02.362 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 77/162 2023-11-24T07:59:02.363 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 78/162 2023-11-24T07:59:02.363 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 79/162 2023-11-24T07:59:02.363 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 80/162 2023-11-24T07:59:02.363 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 81/162 2023-11-24T07:59:02.363 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 82/162 2023-11-24T07:59:02.363 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 83/162 2023-11-24T07:59:02.364 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 84/162 2023-11-24T07:59:02.364 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 85/162 2023-11-24T07:59:02.364 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 86/162 2023-11-24T07:59:02.364 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/162 2023-11-24T07:59:02.364 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/162 2023-11-24T07:59:02.365 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/162 2023-11-24T07:59:02.365 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/162 2023-11-24T07:59:02.365 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 91/162 2023-11-24T07:59:02.365 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 92/162 2023-11-24T07:59:02.365 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 93/162 2023-11-24T07:59:02.365 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 94/162 2023-11-24T07:59:02.366 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 95/162 2023-11-24T07:59:02.366 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 96/162 2023-11-24T07:59:02.366 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 97/162 2023-11-24T07:59:02.366 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/162 2023-11-24T07:59:02.366 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/162 2023-11-24T07:59:02.367 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 100/162 2023-11-24T07:59:02.367 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 101/162 2023-11-24T07:59:02.367 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/162 2023-11-24T07:59:02.367 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/162 2023-11-24T07:59:02.367 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 104/162 2023-11-24T07:59:02.367 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/162 2023-11-24T07:59:02.368 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/162 2023-11-24T07:59:02.368 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 107/162 2023-11-24T07:59:02.368 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/162 2023-11-24T07:59:02.368 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/162 2023-11-24T07:59:02.368 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/162 2023-11-24T07:59:02.369 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/162 2023-11-24T07:59:02.369 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/162 2023-11-24T07:59:02.369 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 113/162 2023-11-24T07:59:02.369 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 114/162 2023-11-24T07:59:02.369 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/162 2023-11-24T07:59:02.369 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/162 2023-11-24T07:59:02.370 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/162 2023-11-24T07:59:02.370 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/162 2023-11-24T07:59:02.370 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/162 2023-11-24T07:59:02.370 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/162 2023-11-24T07:59:02.370 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/162 2023-11-24T07:59:02.371 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/162 2023-11-24T07:59:02.371 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/162 2023-11-24T07:59:02.371 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/162 2023-11-24T07:59:02.371 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/162 2023-11-24T07:59:02.371 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/162 2023-11-24T07:59:02.371 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/162 2023-11-24T07:59:02.372 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/162 2023-11-24T07:59:02.372 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/162 2023-11-24T07:59:02.372 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/162 2023-11-24T07:59:02.372 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/162 2023-11-24T07:59:02.372 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/162 2023-11-24T07:59:02.373 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 133/162 2023-11-24T07:59:02.373 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/162 2023-11-24T07:59:02.373 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 135/162 2023-11-24T07:59:02.373 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/162 2023-11-24T07:59:02.373 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 137/162 2023-11-24T07:59:02.373 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 138/162 2023-11-24T07:59:02.374 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 139/162 2023-11-24T07:59:02.374 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/162 2023-11-24T07:59:02.374 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 141/162 2023-11-24T07:59:02.374 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/162 2023-11-24T07:59:02.374 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 143/162 2023-11-24T07:59:02.375 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/162 2023-11-24T07:59:02.375 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 145/162 2023-11-24T07:59:02.375 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/162 2023-11-24T07:59:02.375 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/162 2023-11-24T07:59:02.375 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/162 2023-11-24T07:59:02.375 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 149/162 2023-11-24T07:59:02.376 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/162 2023-11-24T07:59:02.376 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 151/162 2023-11-24T07:59:02.376 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/162 2023-11-24T07:59:02.376 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 153/162 2023-11-24T07:59:02.377 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/162 2023-11-24T07:59:02.377 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/162 2023-11-24T07:59:02.377 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/162 2023-11-24T07:59:02.377 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 157/162 2023-11-24T07:59:02.377 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 158/162 2023-11-24T07:59:02.377 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 159/162 2023-11-24T07:59:02.378 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 160/162 2023-11-24T07:59:02.378 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 161/162 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 162/162 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: acl-2.3.1-4.el9.x86_64 2023-11-24T07:59:04.543 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2023-11-24T07:59:04.544 INFO:teuthology.orchestra.run.smithi161.stdout: automake-1.16.2-8.el9.noarch 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: bison-3.7.4-5.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.545 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.546 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el9.noarch 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: flex-2.6.4-9.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-24T07:59:04.547 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: jq-1.6-16.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-24T07:59:04.548 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-24T07:59:04.549 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-13.11-1.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-24T07:59:04.550 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-24T07:59:04.551 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-24T07:59:04.552 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-24T07:59:04.553 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.554 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-24T07:59:04.555 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el9.x86_64 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: re2-1:20211101-3.el9.x86_64 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-24T07:59:04.556 INFO:teuthology.orchestra.run.smithi161.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-24T07:59:04.557 INFO:teuthology.orchestra.run.smithi161.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-24T07:59:04.557 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-24T07:59:04.557 INFO:teuthology.orchestra.run.smithi161.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-24T07:59:04.557 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:04.557 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2023-11-24T07:59:05.136 DEBUG:teuthology.parallel:result is None 2023-11-24T07:59:05.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:59:05.349 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T07:59:05.408 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T07:59:05.408 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T07:59:05.409 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T07:59:05.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T07:59:05.621 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T07:59:05.698 INFO:teuthology.orchestra.run.smithi175.stdout:18.0.0-7484.ga13ea5ff.el9 2023-11-24T07:59:05.702 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el9 2023-11-24T07:59:05.702 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T07:59:05.702 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T07:59:05.703 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:05.703 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T07:59:05.801 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:05.801 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T07:59:05.909 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T07:59:05.910 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:05.910 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T07:59:05.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T07:59:06.108 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:06.108 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T07:59:06.215 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T07:59:06.301 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T07:59:06.301 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:06.301 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T07:59:06.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T07:59:06.498 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:06.498 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T07:59:06.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T07:59:06.705 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T07:59:06.705 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:06.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T07:59:06.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T07:59:06.903 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:06.903 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T07:59:06.991 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T07:59:07.078 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T07:59:07.158 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T07:59:07.158 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2023-11-24T07:59:07.163 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2023-11-24T07:59:07.247 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T07:59:07.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T07:59:07.252 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T07:59:07.329 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T07:59:07.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T07:59:07.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T07:59:07.421 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T07:59:07.422 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T07:59:07.422 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T07:59:07.422 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:07.422 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T07:59:07.468 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T07:59:07.700 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T07:59:07.771 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:07.771 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T07:59:07.828 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T07:59:08.099 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T07:59:08.207 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T07:59:08.208 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T07:59:08.208 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}}', 'email': None, 'first_in_suite': False, 'job_id': '7465574', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'mgr-vol-tests', 'sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9764, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'mgr-vol-tests', 'suite_path': '/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/rishabh-d-dave/ceph', 'suite_sha1': '73843baf45f8a92d8e3fcbea3f024c97e73036da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9rBWDJYPE9yZQLLjcjH5h/SMQD+VIcu5fTVxOHU0ujqeR3HV/q1aWOXSbNnn5BoiuA7jUUBlHINzO6FMXKvXA=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW/wDml/gXEudHmG4LjrgrhKTGbD8SdKwcdLWYRDpRJmvRO48Eol3SYWzYqC4KifslRR4uoSyfjg0+HMn5w14I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_07:31:48', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T07:59:08.210 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T07:59:08.220 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T07:59:08.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T07:59:08.302 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T07:59:08.400 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:08.400 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T07:59:08.444 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T07:59:08.445 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-11-24T07:59:08.528 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T07:59:08.528 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:08.528 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-11-24T07:59:08.528 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:08.528 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:08.529 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-24 07:58:58.558513963 +0000 2023-11-24T07:59:08.529 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-24 07:56:17.046076384 +0000 2023-11-24T07:59:08.529 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-24 07:56:17.046076384 +0000 2023-11-24T07:59:08.529 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-24 07:56:17.046076384 +0000 2023-11-24T07:59:08.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T07:59:08.650 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-24T07:59:08.650 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-24T07:59:08.650 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000383905 s, 1.3 MB/s 2023-11-24T07:59:08.653 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T07:59:08.699 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-24 07:58:58.559513941 +0000 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-24 07:56:18.096053957 +0000 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-24 07:56:18.096053957 +0000 2023-11-24T07:59:08.782 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-24 07:56:18.096053957 +0000 2023-11-24T07:59:08.783 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T07:59:08.893 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-24T07:59:08.893 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-24T07:59:08.894 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000321452 s, 1.6 MB/s 2023-11-24T07:59:08.897 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T07:59:08.939 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-11-24T07:59:09.025 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T07:59:09.025 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:09.025 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-11-24T07:59:09.026 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:09.026 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:09.026 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-24 07:58:58.560513920 +0000 2023-11-24T07:59:09.026 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-24 07:56:19.097032577 +0000 2023-11-24T07:59:09.026 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-24 07:56:19.097032577 +0000 2023-11-24T07:59:09.026 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-24 07:56:19.097032577 +0000 2023-11-24T07:59:09.027 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T07:59:09.140 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-24T07:59:09.140 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-24T07:59:09.140 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000341634 s, 1.5 MB/s 2023-11-24T07:59:09.144 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T07:59:09.187 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-11-24T07:59:09.271 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-11-24 07:58:58.561513898 +0000 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-11-24 07:56:20.107011005 +0000 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-11-24 07:56:20.107011005 +0000 2023-11-24T07:59:09.272 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2023-11-24 07:56:20.107011005 +0000 2023-11-24T07:59:09.272 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T07:59:09.383 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-11-24T07:59:09.384 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-11-24T07:59:09.384 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000295042 s, 1.7 MB/s 2023-11-24T07:59:09.386 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T07:59:09.431 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:09.431 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:09.432 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T07:59:09.493 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T07:59:09.493 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2023-11-24T07:59:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T07:59:09.546 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:09.546 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-11-24T07:59:09.546 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:09.546 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:09.547 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-24 07:58:45.763806478 +0000 2023-11-24T07:59:09.547 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-24 07:56:09.753569466 +0000 2023-11-24T07:59:09.547 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-24 07:56:09.753569466 +0000 2023-11-24T07:59:09.547 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-24 07:56:09.753569466 +0000 2023-11-24T07:59:09.547 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T07:59:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-24T07:59:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-24T07:59:09.638 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000340573 s, 1.5 MB/s 2023-11-24T07:59:09.642 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T07:59:09.699 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2023-11-24T07:59:09.747 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T07:59:09.747 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:09.747 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-11-24T07:59:09.747 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:09.748 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:09.748 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-24 07:58:45.764806463 +0000 2023-11-24T07:59:09.748 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-24 07:56:10.786553563 +0000 2023-11-24T07:59:09.748 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-24 07:56:10.786553563 +0000 2023-11-24T07:59:09.748 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-24 07:56:10.786553563 +0000 2023-11-24T07:59:09.749 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T07:59:09.825 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-24T07:59:09.826 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-24T07:59:09.826 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.0003646 s, 1.4 MB/s 2023-11-24T07:59:09.828 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T07:59:09.878 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2023-11-24T07:59:09.928 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T07:59:09.928 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:09.928 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 672 Links: 1 2023-11-24T07:59:09.928 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:09.929 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:09.929 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-24 07:58:45.765806447 +0000 2023-11-24T07:59:09.929 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-24 07:56:11.786538168 +0000 2023-11-24T07:59:09.929 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-24 07:56:11.786538168 +0000 2023-11-24T07:59:09.929 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-24 07:56:11.786538168 +0000 2023-11-24T07:59:09.930 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T07:59:10.013 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-24T07:59:10.014 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-24T07:59:10.014 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000289771 s, 1.8 MB/s 2023-11-24T07:59:10.017 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T07:59:10.072 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2023-11-24 07:58:45.766806432 +0000 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2023-11-24 07:56:12.817522296 +0000 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2023-11-24 07:56:12.817522296 +0000 2023-11-24T07:59:10.125 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2023-11-24 07:56:12.817522296 +0000 2023-11-24T07:59:10.126 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T07:59:10.218 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2023-11-24T07:59:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2023-11-24T07:59:10.219 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000347025 s, 1.5 MB/s 2023-11-24T07:59:10.222 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T07:59:10.282 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:10.282 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T07:59:10.282 INFO:tasks.ceph:Generating config... 2023-11-24T07:59:10.283 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T07:59:10.284 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T07:59:10.284 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T07:59:10.284 INFO:tasks.ceph:[client] pid file = 2023-11-24T07:59:10.284 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T07:59:10.284 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T07:59:10.284 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T07:59:10.284 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T07:59:10.284 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T07:59:10.284 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T07:59:10.285 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T07:59:10.286 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T07:59:10.286 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T07:59:10.286 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T07:59:10.287 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T07:59:10.288 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T07:59:10.289 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T07:59:10.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T07:59:10.396 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T07:59:10.403 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T07:59:10.525 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T07:59:10.604 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.161'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2023-11-24T07:59:10.605 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.161,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T07:59:10.606 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:10.606 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T07:59:10.653 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.161 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:10.786 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: generated fsid 2e355083-a16f-42dd-a3ed-5276a3fda4f7 2023-11-24T07:59:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:setting min_mon_release = pacific 2023-11-24T07:59:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:epoch 0 2023-11-24T07:59:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:fsid 2e355083-a16f-42dd-a3ed-5276a3fda4f7 2023-11-24T07:59:10.787 INFO:teuthology.orchestra.run.smithi161.stdout:last_changed 2023-11-24T07:59:10.785709+0000 2023-11-24T07:59:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:created 2023-11-24T07:59:10.785709+0000 2023-11-24T07:59:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:min_mon_release 16 (pacific) 2023-11-24T07:59:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:election_strategy: 1 2023-11-24T07:59:10.788 INFO:teuthology.orchestra.run.smithi161.stdout:0: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.a 2023-11-24T07:59:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2023-11-24T07:59:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2023-11-24T07:59:10.790 INFO:teuthology.orchestra.run.smithi161.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T07:59:10.791 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T07:59:10.839 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2e355083-a16f-42dd-a3ed-5276a3fda4f7... 2023-11-24T07:59:10.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T07:59:10.885 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.039 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T07:59:11.040 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2023-11-24T07:59:11.041 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.161,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-11-24T07:59:11.042 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 2e355083-a16f-42dd-a3ed-5276a3fda4f7 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.043 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.044 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2023-11-24T07:59:11.045 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2023-11-24T07:59:11.046 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-11-24T07:59:11.047 INFO:teuthology.orchestra.run.smithi161.stdout: debug finisher = 20 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.048 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2023-11-24T07:59:11.049 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = "" 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2023-11-24T07:59:11.050 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2023-11-24T07:59:11.051 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2023-11-24T07:59:11.052 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-11-24T07:59:11.052 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-11-24T07:59:11.052 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-11-24T07:59:11.064 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2023-11-24T07:59:11.064 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2023-11-24T07:59:11.065 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.066 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2023-11-24T07:59:11.066 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2023-11-24T07:59:11.067 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.068 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.161,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 2e355083-a16f-42dd-a3ed-5276a3fda4f7 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2023-11-24T07:59:11.069 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.070 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2023-11-24T07:59:11.071 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-11-24T07:59:11.072 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug finisher = 20 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2023-11-24T07:59:11.073 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.074 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2023-11-24T07:59:11.075 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2023-11-24T07:59:11.076 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-24T07:59:11.077 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = "" 2023-11-24T07:59:11.077 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-11-24T07:59:11.077 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-11-24T07:59:11.077 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2023-11-24T07:59:11.078 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2023-11-24T07:59:11.079 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2023-11-24T07:59:11.079 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2023-11-24T07:59:11.079 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2023-11-24T07:59:11.079 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2023-11-24T07:59:11.109 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T07:59:11.109 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T07:59:11.254 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T07:59:11.255 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:11.255 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T07:59:11.305 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:11.305 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T07:59:11.399 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T07:59:11.399 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:11.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T07:59:11.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T07:59:11.542 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:11.542 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:11.588 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T07:59:11.588 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:11.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T07:59:11.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T07:59:11.747 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:11.747 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:11.845 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T07:59:11.845 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T07:59:11.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T07:59:12.014 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T07:59:12.025 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T07:59:12.239 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T07:59:12.251 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T07:59:12.251 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T07:59:12.448 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T07:59:12.457 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T07:59:12.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T07:59:12.735 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T07:59:12.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T07:59:12.843 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T07:59:13.031 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T07:59:13.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T07:59:13.137 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T07:59:13.314 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T07:59:13.323 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T07:59:13.418 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T07:59:13.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T07:59:13.555 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T07:59:13.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T07:59:13.757 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T07:59:13.803 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T07:59:13.935 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T07:59:13.987 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T07:59:14.108 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T07:59:14.167 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T07:59:14.167 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T07:59:14.167 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T07:59:14.271 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:14.271 INFO:tasks.ceph:role: osd.0 2023-11-24T07:59:14.271 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T07:59:14.271 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:14.372 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:14.885 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-24T07:59:14.892 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-24T07:59:14.892 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T07:59:15.092 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T07:59:15.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T07:59:15.294 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:15.294 INFO:tasks.ceph:role: osd.1 2023-11-24T07:59:15.294 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T07:59:15.295 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T07:59:15.394 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:15.395 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:15.888 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-24T07:59:15.894 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-24T07:59:15.894 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T07:59:16.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T07:59:16.132 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T07:59:16.216 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:16.216 INFO:tasks.ceph:role: osd.2 2023-11-24T07:59:16.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T07:59:16.217 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:16.310 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:16.311 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:16.311 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:16.311 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:16.832 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-24T07:59:16.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-24T07:59:16.839 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T07:59:17.032 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T07:59:17.137 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T07:59:17.231 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:17.231 INFO:tasks.ceph:role: osd.3 2023-11-24T07:59:17.231 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T07:59:17.231 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T07:59:17.330 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:17.331 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:17.791 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-11-24T07:59:17.797 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-11-24T07:59:17.798 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T07:59:17.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T07:59:18.041 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:18.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:18.227+0000 7f9f8c014500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T07:59:18.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:18.232+0000 7f9f8c014500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T07:59:18.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:18.232+0000 7f9f8c014500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T07:59:18.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:18.232+0000 7f9f8c014500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T07:59:18.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:18.232+0000 7f9f8c014500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T07:59:18.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:18.242+0000 7f9f8c014500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T07:59:21.428 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T07:59:21.522 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:21.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:21.658+0000 7f8706da9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T07:59:21.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:21.659+0000 7f8706da9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T07:59:21.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:21.659+0000 7f8706da9500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T07:59:21.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:21.659+0000 7f8706da9500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T07:59:21.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:21.659+0000 7f8706da9500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T07:59:21.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:21.661+0000 7f8706da9500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T07:59:24.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T07:59:24.925 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:25.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:25.064+0000 7f6079710500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T07:59:25.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:25.064+0000 7f6079710500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T07:59:25.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:25.064+0000 7f6079710500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T07:59:25.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:25.065+0000 7f6079710500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T07:59:25.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:25.065+0000 7f6079710500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T07:59:25.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:25.067+0000 7f6079710500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T07:59:28.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T07:59:28.343 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:28.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:28.481+0000 7fee1dcd4500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T07:59:28.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:28.482+0000 7fee1dcd4500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T07:59:28.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:28.482+0000 7fee1dcd4500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T07:59:28.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:28.482+0000 7fee1dcd4500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T07:59:28.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:28.482+0000 7fee1dcd4500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T07:59:28.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:28.484+0000 7fee1dcd4500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T07:59:31.653 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T07:59:31.755 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T07:59:31.856 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:31.857 INFO:tasks.ceph:role: osd.4 2023-11-24T07:59:31.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T07:59:31.857 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:31.957 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:31.958 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:31.958 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:32.455 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-24T07:59:32.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-24T07:59:32.462 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T07:59:32.629 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T07:59:32.733 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T07:59:32.817 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:32.817 INFO:tasks.ceph:role: osd.5 2023-11-24T07:59:32.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T07:59:32.817 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T07:59:32.903 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:32.904 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:33.364 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-24T07:59:33.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-24T07:59:33.369 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T07:59:33.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T07:59:33.578 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T07:59:33.652 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:33.652 INFO:tasks.ceph:role: osd.6 2023-11-24T07:59:33.652 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T07:59:33.652 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T07:59:33.737 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:33.738 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:33.739 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:33.739 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:34.260 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-24T07:59:34.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-24T07:59:34.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T07:59:34.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T07:59:34.552 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T07:59:34.636 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T07:59:34.636 INFO:tasks.ceph:role: osd.7 2023-11-24T07:59:34.636 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T07:59:34.636 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2023-11-24T07:59:34.726 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T07:59:34.727 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-24T07:59:34.727 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T07:59:34.727 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T07:59:35.178 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2023-11-24T07:59:35.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2023-11-24T07:59:35.184 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T07:59:35.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T07:59:35.389 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:35.563 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:35.562+0000 7f59d23ad500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T07:59:35.564 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:35.563+0000 7f59d23ad500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T07:59:35.564 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:35.563+0000 7f59d23ad500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T07:59:35.564 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:35.563+0000 7f59d23ad500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T07:59:35.564 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:35.563+0000 7f59d23ad500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T07:59:35.567 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:35.566+0000 7f59d23ad500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T07:59:38.213 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:59:38.222 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T07:59:38.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T07:59:38.591 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:38.730 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:38.727+0000 7f1d78c14500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T07:59:38.730 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:38.727+0000 7f1d78c14500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T07:59:38.730 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:38.727+0000 7f1d78c14500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T07:59:38.730 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:38.728+0000 7f1d78c14500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T07:59:38.730 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:38.728+0000 7f1d78c14500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T07:59:38.732 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:38.730+0000 7f1d78c14500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T07:59:41.646 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T07:59:41.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:41.882 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:41.880+0000 7faad0e8c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T07:59:41.883 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:41.880+0000 7faad0e8c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T07:59:41.883 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:41.881+0000 7faad0e8c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T07:59:41.883 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:41.881+0000 7faad0e8c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T07:59:41.884 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:41.881+0000 7faad0e8c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T07:59:41.885 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:41.883+0000 7faad0e8c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T07:59:45.068 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T07:59:45.165 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:45.307 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:45.305+0000 7f913c770500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T07:59:45.308 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:45.306+0000 7f913c770500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T07:59:45.308 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:45.306+0000 7f913c770500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T07:59:45.308 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:45.306+0000 7f913c770500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T07:59:45.308 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:45.306+0000 7f913c770500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T07:59:45.310 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T07:59:45.308+0000 7f913c770500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T07:59:48.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T07:59:48.588 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T07:59:48.588 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:48.588 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T07:59:48.690 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:48.690 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T07:59:48.785 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:48.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T07:59:48.866 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:48.867 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T07:59:49.001 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:49.001 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T07:59:49.132 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:49.132 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T07:59:49.217 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:49.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T07:59:49.361 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.362 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T07:59:49.467 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.467 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T07:59:49.567 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.567 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T07:59:49.665 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.665 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T07:59:49.756 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.756 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T07:59:49.851 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T07:59:49.992 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:49.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T07:59:50.090 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:50.090 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T07:59:50.143 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T07:59:50.143 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T07:59:50.193 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:50.193 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T07:59:50.251 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T07:59:50.252 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T07:59:50.305 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T07:59:50.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T07:59:50.314 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T07:59:50.400 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2023-11-24T07:59:50.400 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDQV2BlNxTcABAApZPsFQs537yAkIv0IJhzOg== 2023-11-24T07:59:50.400 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDQV2BlHD6tGhAAHgfwFnLRAnZJYkP/R6LkDA== 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDQV2BlBOzLKxAAodBeIc6gxGOmd7u2xqJcNQ== 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDWV2BlYGGZDRAAw5WGhgWYIelaXgs35FbP6Q== 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDZV2Bl7LRAJxAA/0jx7Tz254+nQpLEHq0DHw== 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDdV2BlGxntAxAAlq53dwY33JyEdL1bA4A4qg== 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2023-11-24T07:59:50.401 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDgV2BleVHNHBAA5WTP8GdbwtsQqAQGlBltKA== 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDQV2BlaY9ADhAA3F3uUt8RpzSr7R2IgBLQYA== 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlhwvbARAAhTRWPeXbP0Z85pAw4aEhzw== 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.d] 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2Blgdy3EhAATujalM2qKRTbZsSDt9Klkg== 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDnV2BlnBePIRAAiBKoHmbq5RakHSkloIHXiA== 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2023-11-24T07:59:50.402 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDqV2BlPvd0KxAA0NN6x6VMmoheCO+k1+9Pqw== 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDtV2Bl93CTNBAAQciFc0K2H/YECC3VtUaz6A== 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDxV2Bl4WVOEhAA05ppVcoEr6QDrGDWYMXoWQ== 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA== 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout:[client.2] 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlbNQdLRAAgt8XlhFRtS6ykHldSR/mTg== 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout:[client.1] 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlsuSyNxAAzKRQWIED6Y00//mN8k2A2A== 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout:[client.3] 2023-11-24T07:59:50.403 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDSV2BlFoFzBhAATWeUEX1fhVTvj03CuGTO/w== 2023-11-24T07:59:50.414 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2023-11-24T07:59:50.414 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDQV2BlNxTcABAApZPsFQs537yAkIv0IJhzOg== 2023-11-24T07:59:50.414 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDQV2BlHD6tGhAAHgfwFnLRAnZJYkP/R6LkDA== 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDQV2BlBOzLKxAAodBeIc6gxGOmd7u2xqJcNQ== 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDWV2BlYGGZDRAAw5WGhgWYIelaXgs35FbP6Q== 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDZV2Bl7LRAJxAA/0jx7Tz254+nQpLEHq0DHw== 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDdV2BlGxntAxAAlq53dwY33JyEdL1bA4A4qg== 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2023-11-24T07:59:50.415 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDgV2BleVHNHBAA5WTP8GdbwtsQqAQGlBltKA== 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDQV2BlaY9ADhAA3F3uUt8RpzSr7R2IgBLQYA== 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDRV2BlhwvbARAAhTRWPeXbP0Z85pAw4aEhzw== 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDRV2Blgdy3EhAATujalM2qKRTbZsSDt9Klkg== 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDnV2BlnBePIRAAiBKoHmbq5RakHSkloIHXiA== 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDqV2BlPvd0KxAA0NN6x6VMmoheCO+k1+9Pqw== 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2023-11-24T07:59:50.416 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDtV2Bl93CTNBAAQciFc0K2H/YECC3VtUaz6A== 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDxV2Bl4WVOEhAA05ppVcoEr6QDrGDWYMXoWQ== 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA== 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout:[client.2] 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDRV2BlbNQdLRAAgt8XlhFRtS6ykHldSR/mTg== 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDRV2BlsuSyNxAAzKRQWIED6Y00//mN8k2A2A== 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout:[client.3] 2023-11-24T07:59:50.417 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDSV2BlFoFzBhAATWeUEX1fhVTvj03CuGTO/w== 2023-11-24T07:59:50.419 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:59:50.454 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:59:50.606 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:50.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:50.757 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:50.765 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:50.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:50.914 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.058 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.065 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.212 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.218 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.364 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.511 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:59:51.518 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T07:59:51.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:51.678 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:51.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:51.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T07:59:51.983 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:51.992 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.144 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.288 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.293 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.440 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T07:59:52.590 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:52.596 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:52.739 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:52.746 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:52.891 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:52.897 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:53.045 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:53.053 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T07:59:53.200 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T07:59:53.200 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T07:59:53.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T07:59:53.460 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T07:59:53.536 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T07:59:53.638 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T07:59:53.795 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T07:59:53.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T07:59:53.971 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T07:59:54.132 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T07:59:54.211 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:54.220 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T07:59:54.277 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T07:59:54.277 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T07:59:54.277 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T07:59:54.283 INFO:tasks.ceph.mon.a:Started 2023-11-24T07:59:54.283 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T07:59:54.284 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T07:59:54.289 INFO:tasks.ceph.mon.b:Started 2023-11-24T07:59:54.290 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T07:59:54.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T07:59:54.296 INFO:tasks.ceph.mon.c:Started 2023-11-24T07:59:54.296 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T07:59:54.296 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T07:59:54.296 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T07:59:54.305 INFO:tasks.ceph.mgr.y:Started 2023-11-24T07:59:54.305 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T07:59:54.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T07:59:54.309 INFO:tasks.ceph.mgr.x:Started 2023-11-24T07:59:54.309 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T07:59:54.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T07:59:54.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.485+0000 7fafb8248640 1 Processor -- start 2023-11-24T07:59:54.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.485+0000 7fafb8248640 1 -- start start 2023-11-24T07:59:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.486+0000 7fafb8248640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:59:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.486+0000 7fafb8248640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:59:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.486+0000 7fafb8248640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.486+0000 7fafb8248640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb006c470 con 0x7fafb013df80 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.486+0000 7fafb8248640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb006c750 con 0x7fafb013e360 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.486+0000 7fafb8248640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb006ca30 con 0x7fafb015f9c0 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb67e5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:59616/0 (socket says 172.21.15.161:59616) 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb67e5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:40792/0 (socket says 172.21.15.161:40792) 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 learned_addr learned my addr 172.21.15.161:0/2850932596 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:59:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:54.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.487+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T07:59:54.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.688+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:54.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.688+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:54.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.688+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:54.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.688+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:59:54.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.688+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:54.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.688+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:54.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:54.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T07:59:54.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:54.689+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-24T07:59:55.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.090+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:55.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.090+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:55.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.090+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:55.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:59:55.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.091+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-24T07:59:55.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.892+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:55.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.892+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:55.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T07:59:55.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb57e3640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T07:59:55.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T07:59:55.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:55.893+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-24T07:59:57.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.486+0000 7fafa77fe640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb00cf7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:00:04.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.486+0000 7fafa77fe640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb00cf7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:04.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.486+0000 7fafa77fe640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 msgr2=0x7fafb00cf290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.486+0000 7fafa77fe640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.175:3300/0 conn(0x7fafb013e360 0x7fafb00cf290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.487+0000 7fafa77fe640 1 -- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 msgr2=0x7fafb015bee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.487+0000 7fafa77fe640 1 --2- 172.21.15.161:0/2850932596 >> v2:172.21.15.161:3300/0 conn(0x7fafb013df80 0x7fafb015bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.487+0000 7fafa77fe640 1 -- 172.21.15.161:0/2850932596 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb006cd10 con 0x7faf9c003670 2023-11-24T08:00:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:57.487+0000 7fafa77fe640 1 -- 172.21.15.161:0/2850932596 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c00c070 con 0x7faf9c007300 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:00.339+0000 7f185742e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:00.404+0000 7f185742e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:00.979+0000 7f185742e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.039+0000 7f185742e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.090+0000 7f185742e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.152+0000 7f185742e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.202+0000 7f185742e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.316+0000 7f185742e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T08:00:05.004 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.395+0000 7f185742e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.449+0000 7f185742e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.508+0000 7f185742e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:01.563+0000 7f185742e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.013+0000 7f185742e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.172+0000 7f185742e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.313+0000 7f185742e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.366+0000 7f185742e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.475+0000 7f185742e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.587+0000 7f185742e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.748+0000 7f185742e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:00:05.005 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.797+0000 7f185742e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:00:05.006 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:02.954+0000 7f185742e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:00:05.006 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:04.021+0000 7f185742e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:00:05.006 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:04.324+0000 7f185742e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:00:05.010 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:04.383+0000 7f185742e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:00:05.010 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:04.498+0000 7f185742e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:00:05.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.744+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980714417 0 0) 0x7fafb006cd10 con 0x7faf9c003670 2023-11-24T08:00:05.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.744+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf94003520 con 0x7faf9c003670 2023-11-24T08:00:05.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.746+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690565005 0 0) 0x7faf9c00c070 con 0x7faf9c007300 2023-11-24T08:00:05.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.746+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb006cd10 con 0x7faf9c007300 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.747+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 475209020 0 0) 0x7faf94003520 con 0x7faf9c003670 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.747+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 >> v1:172.21.15.175:6789/0 conn(0x7faf9c007300 legacy=0x7faf9c0097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.747+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c00d270 con 0x7faf9c003670 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.747+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fafac00d580 con 0x7faf9c003670 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 >> v1:172.21.15.161:6789/0 conn(0x7faf9c003670 legacy=0x7faf9c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7faf94003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7faf940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7faf9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa000c1b0 con 0x7faf94003bb0 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf94005670 con 0x7faf94004eb0 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9400bf40 con 0x7fafb015f9c0 2023-11-24T08:00:05.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.748+0000 7fafb67e5640 1 -- 172.21.15.161:0/2850932596 reap_dead start 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7faf94003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb57e3640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7faf940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb67e5640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7faf9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7faf940047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7faf940047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 msgr2=0x7faf9400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7faf9400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.749+0000 7fafb5fe4640 1 -- 172.21.15.161:0/2850932596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94003520 con 0x7faf94003bb0 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.751+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7faf94003f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fafac013410 tx=0x7faf940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7956b54071d22ada server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.751+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac02d590 con 0x7faf94003bb0 2023-11-24T08:00:05.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.752+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac031070 con 0x7faf94003bb0 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.752+0000 7fafb4fe2640 1 -- 172.21.15.161:0/2850932596 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac02d950 con 0x7faf94003bb0 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.752+0000 7fafb8248640 1 -- 172.21.15.161:0/2850932596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 msgr2=0x7faf94003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.752+0000 7fafb8248640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7faf94003f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fafac013410 tx=0x7faf940057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 -- 172.21.15.161:0/2850932596 shutdown_connections 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7faf9400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7faf940047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 --2- 172.21.15.161:0/2850932596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7faf94003f90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 -- 172.21.15.161:0/2850932596 >> 172.21.15.161:0/2850932596 conn(0x7fafb006a800 msgr2=0x7fafb006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:05.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 -- 172.21.15.161:0/2850932596 shutdown_connections 2023-11-24T08:00:05.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.753+0000 7fafb8248640 1 -- 172.21.15.161:0/2850932596 wait complete. 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.755+0000 7fafb8248640 1 Processor -- start 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.755+0000 7fafb8248640 1 -- start start 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.756+0000 7fafb8248640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7fafb01f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb8248640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7fafb014b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb8248640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb014fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb8248640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb01f0a00 con 0x7faf94003bb0 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb8248640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb0150ab0 con 0x7faf94004eb0 2023-11-24T08:00:05.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb8248640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb014a3c0 con 0x7fafb015f9c0 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7fafb01f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7fafb01f04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42292/0 (socket says 172.21.15.161:42292) 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 -- 172.21.15.161:0/1051951859 learned_addr learned my addr 172.21.15.161:0/1051951859 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb67e5640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb014fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb57e3640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7fafb014b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 -- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 msgr2=0x7fafb014fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb014fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 -- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 msgr2=0x7fafb014b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7fafb014b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.757+0000 7fafb5fe4640 1 -- 172.21.15.161:0/1051951859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb014bba0 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.758+0000 7fafb5fe4640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7fafb01f04c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafac039040 tx=0x7fafac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.758+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac02daa0 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.759+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac02dc20 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.759+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00b19f0 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.759+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac040440 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.759+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb0150210 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.759+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fafac0408a0 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.759+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fafac000e40 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.760+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb015c560 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.765+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fafac045020 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.852+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fafb00675d0 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.856+0000 7fafa67fc640 1 -- 172.21.15.161:0/1051951859 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fafac057020 con 0x7faf94003bb0 2023-11-24T08:00:05.032 INFO:teuthology.orchestra.run.smithi161.stderr:adjusted tunables profile to default 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 msgr2=0x7fafb01f04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7fafb01f04c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fafac039040 tx=0x7fafac0046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 shutdown_connections 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafb015f9c0 0x7fafb014fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf94004eb0 0x7fafb014b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 --2- 172.21.15.161:0/1051951859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf94003bb0 0x7fafb01f04c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 >> 172.21.15.161:0/1051951859 conn(0x7fafb006a800 msgr2=0x7fafb006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 shutdown_connections 2023-11-24T08:00:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T07:59:59.858+0000 7fafb8248640 1 -- 172.21.15.161:0/1051951859 wait complete. 2023-11-24T08:00:05.034 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T08:00:05.034 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T08:00:05.034 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:00:05.034 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:00.304+0000 7fc6a9c41040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:00.370+0000 7fc6a9c41040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.014+0000 7fc6a9c41040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.074+0000 7fc6a9c41040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.124+0000 7fc6a9c41040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.186+0000 7fc6a9c41040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.236+0000 7fc6a9c41040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.349+0000 7fc6a9c41040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.429+0000 7fc6a9c41040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.482+0000 7fc6a9c41040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.542+0000 7fc6a9c41040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T08:00:05.037 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:01.597+0000 7fc6a9c41040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T08:00:05.038 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.047+0000 7fc6a9c41040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T08:00:05.038 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.205+0000 7fc6a9c41040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T08:00:05.038 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.336+0000 7fc6a9c41040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.390+0000 7fc6a9c41040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.499+0000 7fc6a9c41040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.611+0000 7fc6a9c41040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.770+0000 7fc6a9c41040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.820+0000 7fc6a9c41040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:02.977+0000 7fc6a9c41040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:04.062+0000 7fc6a9c41040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:04.364+0000 7fc6a9c41040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:04.423+0000 7fc6a9c41040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T08:00:05.039 INFO:tasks.ceph.mgr.y.smithi161.stderr:2023-11-24T08:00:04.538+0000 7fc6a9c41040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T08:00:05.142 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:00:05.142 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T08:00:05.243 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:00:05.243 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T08:00:05.338 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:00:05.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T08:00:05.437 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:00:05.438 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T08:00:05.542 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:00:05.543 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T08:00:05.548 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:05.544+0000 7f17f80d7640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T08:00:05.548 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:00:05.544+0000 7f17f80d7640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T08:00:05.624 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:00:05.624 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T08:00:05.761 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:00:05.762 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T08:00:05.853 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 46f41f23-320c-498b-91f5-49a7b529ac6b 0 2023-11-24T08:00:06.059 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.058+0000 7f9978a64640 1 Processor -- start 2023-11-24T08:00:06.059 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.058+0000 7f9978a64640 1 -- start start 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.059+0000 7f9978a64640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997413e360 0x7f99740cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.059+0000 7f9978a64640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997415c5f0 con 0x7f997413df80 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.059+0000 7f9978a64640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997406c470 con 0x7f997415f9c0 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.059+0000 7f9978a64640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997406c750 con 0x7f997413e360 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.060+0000 7f996bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997413e360 0x7f99740cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.060+0000 7f9972d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f997415f9c0 0x7f99740cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:58514/0 (socket says 172.21.15.175:58514) 2023-11-24T08:00:06.061 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.060+0000 7f9972d9d640 1 -- 172.21.15.175:0/24556097 learned_addr learned my addr 172.21.15.175:0/24556097 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-24T08:00:06.062 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.060+0000 7f996bfff640 1 -- 172.21.15.175:0/24556097 >> v1:172.21.15.175:6789/0 conn(0x7f997415f9c0 legacy=0x7f99740cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.062 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.060+0000 7f996bfff640 1 -- 172.21.15.175:0/24556097 >> v1:172.21.15.161:6789/0 conn(0x7f997413df80 legacy=0x7f997415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:06.062 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.060+0000 7f996bfff640 1 -- 172.21.15.175:0/24556097 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997406ca30 con 0x7f997413e360 2023-11-24T08:00:06.063 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.061+0000 7f996bfff640 1 --2- 172.21.15.175:0/24556097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997413e360 0x7f99740cf290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f995c0097d0 tx=0x7f995c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19ae6c572ddc73ca server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.063 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9971d9b640 1 -- 172.21.15.175:0/24556097 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c031890 con 0x7f997413e360 2023-11-24T08:00:06.063 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9971d9b640 1 -- 172.21.15.175:0/24556097 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c0319f0 con 0x7f997413e360 2023-11-24T08:00:06.063 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9971d9b640 1 -- 172.21.15.175:0/24556097 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c031d80 con 0x7f997413e360 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 -- 172.21.15.175:0/24556097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997413e360 msgr2=0x7f99740cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 --2- 172.21.15.175:0/24556097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997413e360 0x7f99740cf290 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f995c0097d0 tx=0x7f995c02b930 comp rx=0 tx=0).stop 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 -- 172.21.15.175:0/24556097 shutdown_connections 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 --2- 172.21.15.175:0/24556097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997413e360 0x7f99740cf290 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 -- 172.21.15.175:0/24556097 >> 172.21.15.175:0/24556097 conn(0x7f997406a800 msgr2=0x7f997406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 -- 172.21.15.175:0/24556097 shutdown_connections 2023-11-24T08:00:06.064 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.062+0000 7f9978a64640 1 -- 172.21.15.175:0/24556097 wait complete. 2023-11-24T08:00:06.065 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.064+0000 7f9978a64640 1 Processor -- start 2023-11-24T08:00:06.065 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.064+0000 7f9978a64640 1 -- start start 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.065+0000 7f9978a64640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 0x7f997413d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.065+0000 7f9978a64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997413e360 0x7f99740a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.065+0000 7f9978a64640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997415f9c0 0x7f99741593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.065+0000 7f9978a64640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974158880 con 0x7f997413e360 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.065+0000 7f9978a64640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974157c70 con 0x7f997413df80 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.065+0000 7f9978a64640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9974157f50 con 0x7f997415f9c0 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 0x7f997413d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f9972d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997415f9c0 0x7f99741593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 0x7f997413d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40498/0 (socket says 172.21.15.175:40498) 2023-11-24T08:00:06.067 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 -- 172.21.15.175:0/1637817714 learned_addr learned my addr 172.21.15.175:0/1637817714 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:06.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f996bfff640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997413e360 0x7f99740a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.068 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 -- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997415f9c0 msgr2=0x7f99741593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997415f9c0 0x7f99741593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 -- 172.21.15.175:0/1637817714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997413e360 msgr2=0x7f99740a9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997413e360 0x7f99740a9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 -- 172.21.15.175:0/1637817714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c009400 con 0x7f997413df80 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.066+0000 7f997259c640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 0x7f997413d150 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f996400c400 tx=0x7f996400c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.067+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640052d0 con 0x7f997413df80 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.067+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964005430 con 0x7f997413df80 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.067+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964003830 con 0x7f997413df80 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.067+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9974158230 con 0x7f997413df80 2023-11-24T08:00:06.069 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.067+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997413d690 con 0x7f997413df80 2023-11-24T08:00:06.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.068+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740675d0 con 0x7f997413df80 2023-11-24T08:00:06.070 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.069+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 3) v1 ==== 89069+0+0 (secure 0 0 0) 0x7f9964003990 con 0x7f997413df80 2023-11-24T08:00:06.071 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.070+0000 7f996affd640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f995406ac90 0x7f995406d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.071 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.070+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9964087460 con 0x7f997413df80 2023-11-24T08:00:06.071 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.070+0000 7f996bfff640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f995406ac90 0x7f995406d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.071 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.070+0000 7f996bfff640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f995406ac90 0x7f995406d150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f995c036000 tx=0x7f995c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.076 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.075+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9964053ba0 con 0x7f997413df80 2023-11-24T08:00:06.278 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.276+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46f41f23-320c-498b-91f5-49a7b529ac6b", "id": 0} v 0) v1 -- 0x7f99740cc270 con 0x7f997413df80 2023-11-24T08:00:06.285 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.283+0000 7f996affd640 1 -- 172.21.15.175:0/1637817714 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46f41f23-320c-498b-91f5-49a7b529ac6b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9964017020 con 0x7f997413df80 2023-11-24T08:00:06.285 INFO:teuthology.orchestra.run.smithi175.stdout:0 2023-11-24T08:00:06.288 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f995406ac90 msgr2=0x7f995406d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.288 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f995406ac90 0x7f995406d150 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f995c036000 tx=0x7f995c03c040 comp rx=0 tx=0).stop 2023-11-24T08:00:06.288 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 msgr2=0x7f997413d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 0x7f997413d150 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f996400c400 tx=0x7f996400c8c0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 shutdown_connections 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f995406ac90 0x7f995406d150 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f997415f9c0 0x7f99741593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f997413e360 0x7f99740a9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 --2- 172.21.15.175:0/1637817714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f997413df80 0x7f997413d150 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 >> 172.21.15.175:0/1637817714 conn(0x7f997406a800 msgr2=0x7f997406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 shutdown_connections 2023-11-24T08:00:06.289 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.287+0000 7f9978a64640 1 -- 172.21.15.175:0/1637817714 wait complete. 2023-11-24T08:00:06.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new c0e9552a-d166-4735-83e3-1d79a7d22341 1 2023-11-24T08:00:06.504 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.502+0000 7f0b4b59e640 1 Processor -- start 2023-11-24T08:00:06.504 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.503+0000 7f0b4b59e640 1 -- start start 2023-11-24T08:00:06.506 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0b4c13cf10 0x7f0b4c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.506 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.506 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4b59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b4c0cdc20 0x7f0b4c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.506 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c13ff60 con 0x7f0b4c13cf10 2023-11-24T08:00:06.506 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4b59e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c0ce440 con 0x7f0b4c0cdc20 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0ce720 con 0x7f0b4c13fae0 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4ad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b4c0cdc20 0x7f0b4c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4ad9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b4c0cdc20 0x7f0b4c15d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40504/0 (socket says 172.21.15.175:40504) 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/3932606719 learned_addr learned my addr 172.21.15.175:0/3932606719 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.504+0000 7f0b41d9b640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4a59c640 1 --2- 172.21.15.175:0/3932606719 >> v2:172.21.15.161:3300/0 conn(0x7f0b4c13cf10 0x7f0b4c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 msgr2=0x7f0b4c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4ad9d640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/3932606719 >> v2:172.21.15.161:3300/0 conn(0x7f0b4c13cf10 msgr2=0x7f0b4c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4ad9d640 1 --2- 172.21.15.175:0/3932606719 >> v2:172.21.15.161:3300/0 conn(0x7f0b4c13cf10 0x7f0b4c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/3932606719 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0cea00 con 0x7f0b4c0cdc20 2023-11-24T08:00:06.507 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b4a59c640 1 --2- 172.21.15.175:0/3932606719 >> v2:172.21.15.161:3300/0 conn(0x7f0b4c13cf10 0x7f0b4c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:06.508 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.505+0000 7f0b41d9b640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.506+0000 7f0b4ad9d640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15d9b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c154a00 tx=0x7f0b4402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffc3aa198e9e5201 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.506+0000 7f0b49d9b640 1 -- 172.21.15.175:0/3932606719 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4402ca80 con 0x7f0b4c0cdc20 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.506+0000 7f0b49d9b640 1 -- 172.21.15.175:0/3932606719 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4402cbe0 con 0x7f0b4c0cdc20 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.506+0000 7f0b49d9b640 1 -- 172.21.15.175:0/3932606719 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b440343f0 con 0x7f0b4c0cdc20 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 -- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 msgr2=0x7f0b4c15d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15d9b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c154a00 tx=0x7f0b4402bee0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 -- 172.21.15.175:0/3932606719 shutdown_connections 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15d9b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.509 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/3932606719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/3932606719 >> v2:172.21.15.161:3300/0 conn(0x7f0b4c13cf10 0x7f0b4c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 -- 172.21.15.175:0/3932606719 >> 172.21.15.175:0/3932606719 conn(0x7f0b4c06a7d0 msgr2=0x7f0b4c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 -- 172.21.15.175:0/3932606719 shutdown_connections 2023-11-24T08:00:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.507+0000 7f0b4b59e640 1 -- 172.21.15.175:0/3932606719 wait complete. 2023-11-24T08:00:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.509+0000 7f0b4b59e640 1 Processor -- start 2023-11-24T08:00:06.510 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.509+0000 7f0b4b59e640 1 -- start start 2023-11-24T08:00:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b4c13cf10 0x7f0b4c071b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c136160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1366a0 con 0x7f0b4c13cf10 2023-11-24T08:00:06.512 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c15d330 con 0x7f0b4c0cdc20 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c15d5d0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4ad9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c136160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4ad9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c136160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:56250/0 (socket says 172.21.15.175:56250) 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/2048540936 learned_addr learned my addr 172.21.15.175:0/2048540936 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.510+0000 7f0b4a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40514/0 (socket says 172.21.15.175:40514) 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b41d9b640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b4c13cf10 0x7f0b4c071b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 msgr2=0x7f0b4c15b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4ad9d640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/2048540936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b4c13cf10 msgr2=0x7f0b4c071b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4ad9d640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b4c13cf10 0x7f0b4c071b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.513 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4ad9d640 1 -- 172.21.15.175:0/2048540936 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34009400 con 0x7f0b4c13fae0 2023-11-24T08:00:06.514 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4a59c640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:06.514 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4ad9d640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c136160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b44036040 tx=0x7f0b44004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44009510 con 0x7f0b4c13fae0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4403e450 con 0x7f0b4c13fae0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b44009b30 con 0x7f0b4c13fae0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4403e800 con 0x7f0b4c13fae0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.511+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c15d8b0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.513+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c1564e0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.515 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.513+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 3) v1 ==== 89069+0+0 (secure 0 0 0) 0x7f0b4402cd50 con 0x7f0b4c13fae0 2023-11-24T08:00:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.514+0000 7f0b437fe640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2c06ac90 0x7f0b2c06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.514+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0b440aa9a0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.515+0000 7f0b4a59c640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2c06ac90 0x7f0b2c06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.516 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.515+0000 7f0b4a59c640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2c06ac90 0x7f0b2c06d150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0afc70 tx=0x7f0b3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.521 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.520+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b4c1564e0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.727 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.726+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0e9552a-d166-4735-83e3-1d79a7d22341", "id": 1} v 0) v1 -- 0x7f0b4c1564e0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.737 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.736+0000 7f0b437fe640 1 -- 172.21.15.175:0/2048540936 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0e9552a-d166-4735-83e3-1d79a7d22341", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0b4c1564e0 con 0x7f0b4c13fae0 2023-11-24T08:00:06.738 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-24T08:00:06.741 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2c06ac90 msgr2=0x7f0b2c06d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.741 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2c06ac90 0x7f0b2c06d150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0afc70 tx=0x7f0b3c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:06.741 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 msgr2=0x7f0b4c136160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.741 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c136160 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0b44036040 tx=0x7f0b44004a40 comp rx=0 tx=0).stop 2023-11-24T08:00:06.741 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 shutdown_connections 2023-11-24T08:00:06.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2c06ac90 0x7f0b2c06d150 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b4c13fae0 0x7f0b4c136160 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.742 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b4c13cf10 0x7f0b4c071b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.743 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 --2- 172.21.15.175:0/2048540936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b4c0cdc20 0x7f0b4c15b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.743 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 >> 172.21.15.175:0/2048540936 conn(0x7f0b4c06a7d0 msgr2=0x7f0b4c06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:06.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 shutdown_connections 2023-11-24T08:00:06.744 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.739+0000 7f0b4b59e640 1 -- 172.21.15.175:0/2048540936 wait complete. 2023-11-24T08:00:06.759 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 16771a82-8008-4c02-bce5-cafc171f8a77 2 2023-11-24T08:00:06.956 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.955+0000 7f1b78e5c640 1 Processor -- start 2023-11-24T08:00:06.957 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.955+0000 7f1b78e5c640 1 -- start start 2023-11-24T08:00:06.958 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b78e5c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b7413e360 0x7f1b740cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.959 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b78e5c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1b7415f9c0 0x7f1b740cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.959 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b78e5c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7415c5f0 con 0x7f1b7413df80 2023-11-24T08:00:06.959 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b78e5c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7406c470 con 0x7f1b7415f9c0 2023-11-24T08:00:06.959 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b78e5c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7406c750 con 0x7f1b7413e360 2023-11-24T08:00:06.959 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b6bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b7413e360 0x7f1b740cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.960 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b6bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1b7413e360 0x7f1b740cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40528/0 (socket says 172.21.15.175:40528) 2023-11-24T08:00:06.960 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.957+0000 7f1b6bfff640 1 -- 172.21.15.175:0/3852918857 learned_addr learned my addr 172.21.15.175:0/3852918857 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:06.967 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.958+0000 7f1b6bfff640 1 -- 172.21.15.175:0/3852918857 >> v2:172.21.15.161:3300/0 conn(0x7f1b7415f9c0 msgr2=0x7f1b740cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:06.968 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.958+0000 7f1b6bfff640 1 --2- 172.21.15.175:0/3852918857 >> v2:172.21.15.161:3300/0 conn(0x7f1b7415f9c0 0x7f1b740cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.969 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.958+0000 7f1b6bfff640 1 -- 172.21.15.175:0/3852918857 >> v1:172.21.15.161:6789/0 conn(0x7f1b7413df80 legacy=0x7f1b7415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:06.969 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.958+0000 7f1b6bfff640 1 -- 172.21.15.175:0/3852918857 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7406ca30 con 0x7f1b7413e360 2023-11-24T08:00:06.969 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.959+0000 7f1b6bfff640 1 --2- 172.21.15.175:0/3852918857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7413e360 0x7f1b740cf290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b740ccae0 tx=0x7f1b5c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e67714220dbcf65d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.969 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.959+0000 7f1b71d9b640 1 -- 172.21.15.175:0/3852918857 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c031640 con 0x7f1b7413e360 2023-11-24T08:00:06.969 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.959+0000 7f1b71d9b640 1 -- 172.21.15.175:0/3852918857 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5c0317a0 con 0x7f1b7413e360 2023-11-24T08:00:06.969 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.959+0000 7f1b71d9b640 1 -- 172.21.15.175:0/3852918857 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5c031b30 con 0x7f1b7413e360 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.959+0000 7f1b78e5c640 1 -- 172.21.15.175:0/3852918857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7413e360 msgr2=0x7f1b740cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.959+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/3852918857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7413e360 0x7f1b740cf290 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1b740ccae0 tx=0x7f1b5c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.960+0000 7f1b78e5c640 1 -- 172.21.15.175:0/3852918857 shutdown_connections 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.960+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/3852918857 >> v2:172.21.15.161:3300/0 conn(0x7f1b7415f9c0 0x7f1b740cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.960+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/3852918857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7413e360 0x7f1b740cf290 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.960+0000 7f1b78e5c640 1 -- 172.21.15.175:0/3852918857 >> 172.21.15.175:0/3852918857 conn(0x7f1b7406a800 msgr2=0x7f1b7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.960+0000 7f1b78e5c640 1 -- 172.21.15.175:0/3852918857 shutdown_connections 2023-11-24T08:00:06.970 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.960+0000 7f1b78e5c640 1 -- 172.21.15.175:0/3852918857 wait complete. 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.961+0000 7f1b78e5c640 1 Processor -- start 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.961+0000 7f1b78e5c640 1 -- start start 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.962+0000 7f1b78e5c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b7413df80 0x7f1b740b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.962+0000 7f1b78e5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b7413e360 0x7f1b740b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.962+0000 7f1b78e5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 0x7f1b741e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.962+0000 7f1b78e5c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741e7160 con 0x7f1b7413df80 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.962+0000 7f1b78e5c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741e7580 con 0x7f1b7415f9c0 2023-11-24T08:00:06.971 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.962+0000 7f1b78e5c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741e64e0 con 0x7f1b7413e360 2023-11-24T08:00:06.972 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 0x7f1b741e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.972 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b6bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b7413e360 0x7f1b740b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.972 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 0x7f1b741e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40530/0 (socket says 172.21.15.175:40530) 2023-11-24T08:00:06.972 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 -- 172.21.15.175:0/146003531 learned_addr learned my addr 172.21.15.175:0/146003531 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:06.972 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b7259c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b7413df80 0x7f1b740b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.972 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 -- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b7413e360 msgr2=0x7f1b740b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b7413e360 0x7f1b740b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 -- 172.21.15.175:0/146003531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b7413df80 msgr2=0x7f1b740b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b7413df80 0x7f1b740b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 -- 172.21.15.175:0/146003531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0094d0 con 0x7f1b7415f9c0 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b6bfff640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b7413e360 0x7f1b740b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.963+0000 7f1b72d9d640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 0x7f1b741e4b00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00b9e0 tx=0x7f1b6c00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.964+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00cb20 con 0x7f1b7415f9c0 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.964+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c00cc80 con 0x7f1b7415f9c0 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.964+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c014440 con 0x7f1b7415f9c0 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.964+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b741e67c0 con 0x7f1b7415f9c0 2023-11-24T08:00:06.973 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.964+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b741e6d80 con 0x7f1b7415f9c0 2023-11-24T08:00:06.974 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.965+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b741e72a0 con 0x7f1b7415f9c0 2023-11-24T08:00:06.974 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.966+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 3) v1 ==== 89069+0+0 (secure 0 0 0) 0x7f1b6c01d3b0 con 0x7f1b7415f9c0 2023-11-24T08:00:06.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.967+0000 7f1b6affd640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1b5406acc0 0x7f1b5406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:06.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.967+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f1b6c087e80 con 0x7f1b7415f9c0 2023-11-24T08:00:06.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.967+0000 7f1b7259c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1b5406acc0 0x7f1b5406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:06.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.968+0000 7f1b7259c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1b5406acc0 0x7f1b5406d180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b64006fd0 tx=0x7f1b64008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:06.975 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:06.971+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b741e72a0 con 0x7f1b7415f9c0 2023-11-24T08:00:07.174 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.172+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16771a82-8008-4c02-bce5-cafc171f8a77", "id": 2} v 0) v1 -- 0x7f1b741e72a0 con 0x7f1b7415f9c0 2023-11-24T08:00:07.182 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.181+0000 7f1b6affd640 1 -- 172.21.15.175:0/146003531 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16771a82-8008-4c02-bce5-cafc171f8a77", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1b741e72a0 con 0x7f1b7415f9c0 2023-11-24T08:00:07.183 INFO:teuthology.orchestra.run.smithi175.stdout:2 2023-11-24T08:00:07.186 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1b5406acc0 msgr2=0x7f1b5406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.186 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1b5406acc0 0x7f1b5406d180 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b64006fd0 tx=0x7f1b64008040 comp rx=0 tx=0).stop 2023-11-24T08:00:07.186 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 msgr2=0x7f1b741e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.186 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 0x7f1b741e4b00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c00b9e0 tx=0x7f1b6c00bea0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.186 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 shutdown_connections 2023-11-24T08:00:07.186 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1b5406acc0 0x7f1b5406d180 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.187 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1b7415f9c0 0x7f1b741e4b00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.187 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1b7413e360 0x7f1b740b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.187 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 --2- 172.21.15.175:0/146003531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1b7413df80 0x7f1b740b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.187 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 >> 172.21.15.175:0/146003531 conn(0x7f1b7406a800 msgr2=0x7f1b741539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:07.187 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 shutdown_connections 2023-11-24T08:00:07.187 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.184+0000 7f1b78e5c640 1 -- 172.21.15.175:0/146003531 wait complete. 2023-11-24T08:00:07.203 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6 3 2023-11-24T08:00:07.406 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.404+0000 7f2058830640 1 Processor -- start 2023-11-24T08:00:07.406 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.404+0000 7f2058830640 1 -- start start 2023-11-24T08:00:07.409 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.406+0000 7f2058830640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20540b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.409 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.406+0000 7f2058830640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f205406cb10 0x7f205406cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.409 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.406+0000 7f2058830640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20540708d0 con 0x7f2054070160 2023-11-24T08:00:07.410 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.406+0000 7f2058830640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2054070bb0 con 0x7f205406cb10 2023-11-24T08:00:07.410 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.406+0000 7f2058830640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2054070e90 con 0x7f205406c730 2023-11-24T08:00:07.410 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f205406cb10 0x7f205406cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.410 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f2052d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20540b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.410 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f205406cb10 0x7f205406cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40536/0 (socket says 172.21.15.175:40536) 2023-11-24T08:00:07.410 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 -- 172.21.15.175:0/172505983 learned_addr learned my addr 172.21.15.175:0/172505983 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:07.411 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 -- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 msgr2=0x7f20540b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:07.411 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 --2- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20540b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.411 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 -- 172.21.15.175:0/172505983 >> v1:172.21.15.161:6789/0 conn(0x7f2054070160 legacy=0x7f2054071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.411 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.407+0000 7f205359e640 1 -- 172.21.15.175:0/172505983 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2054071170 con 0x7f205406cb10 2023-11-24T08:00:07.417 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.409+0000 7f205359e640 1 --2- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f205406cb10 0x7f205406cf80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f204c009e50 tx=0x7f204c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cffada5afc431521 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:07.418 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.409+0000 7f205259c640 1 -- 172.21.15.175:0/172505983 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c02cb00 con 0x7f205406cb10 2023-11-24T08:00:07.418 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.409+0000 7f205259c640 1 -- 172.21.15.175:0/172505983 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c02cc60 con 0x7f205406cb10 2023-11-24T08:00:07.418 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.409+0000 7f205259c640 1 -- 172.21.15.175:0/172505983 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c0343f0 con 0x7f205406cb10 2023-11-24T08:00:07.418 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 -- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f205406cb10 msgr2=0x7f205406cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.418 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 --2- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f205406cb10 0x7f205406cf80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f204c009e50 tx=0x7f204c02bf60 comp rx=0 tx=0).stop 2023-11-24T08:00:07.418 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 -- 172.21.15.175:0/172505983 shutdown_connections 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 --2- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f205406cb10 0x7f205406cf80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 --2- 172.21.15.175:0/172505983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20540b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 -- 172.21.15.175:0/172505983 >> 172.21.15.175:0/172505983 conn(0x7f205406a7d0 msgr2=0x7f205406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 -- 172.21.15.175:0/172505983 shutdown_connections 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.410+0000 7f2058830640 1 -- 172.21.15.175:0/172505983 wait complete. 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.412+0000 7f2058830640 1 Processor -- start 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.412+0000 7f2058830640 1 -- start start 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.413+0000 7f2058830640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20541449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.413+0000 7f2058830640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f205406cb10 0x7f2054146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.413+0000 7f2058830640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 0x7f20540ad510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.419 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f2058830640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2054147fb0 con 0x7f205406cb10 2023-11-24T08:00:07.420 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f2058830640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20541452b0 con 0x7f2054070160 2023-11-24T08:00:07.420 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f2058830640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2054147500 con 0x7f205406c730 2023-11-24T08:00:07.420 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 0x7f20540ad510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.420 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f2052d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20541449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.420 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 0x7f20540ad510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40546/0 (socket says 172.21.15.175:40546) 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 -- 172.21.15.175:0/187387954 learned_addr learned my addr 172.21.15.175:0/187387954 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f204bfff640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f205406cb10 0x7f2054146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 -- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 msgr2=0x7f20541449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20541449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 -- 172.21.15.175:0/187387954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f205406cb10 msgr2=0x7f2054146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f205406cb10 0x7f2054146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f205359e640 1 -- 172.21.15.175:0/187387954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c009b30 con 0x7f2054070160 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.414+0000 7f204bfff640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f205406cb10 0x7f2054146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.415+0000 7f205359e640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 0x7f20540ad510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f204c009e50 tx=0x7f204c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.415+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c009510 con 0x7f2054070160 2023-11-24T08:00:07.421 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.415+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c03e450 con 0x7f2054070160 2023-11-24T08:00:07.422 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.415+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c03e800 con 0x7f2054070160 2023-11-24T08:00:07.422 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.415+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20541f6ea0 con 0x7f2054070160 2023-11-24T08:00:07.422 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.415+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20541479f0 con 0x7f2054070160 2023-11-24T08:00:07.422 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.416+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2054067450 con 0x7f2054070160 2023-11-24T08:00:07.423 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.417+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f204c03e960 con 0x7f2054070160 2023-11-24T08:00:07.423 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.418+0000 7f204b7fe640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f203406adb0 0x7f203406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.423 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.419+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f204c0aafd0 con 0x7f2054070160 2023-11-24T08:00:07.423 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.419+0000 7f2052d9d640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f203406adb0 0x7f203406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.423 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.419+0000 7f2052d9d640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f203406adb0 0x7f203406d270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20540ae560 tx=0x7f2044009190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:07.425 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.424+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f204c0772e0 con 0x7f2054070160 2023-11-24T08:00:07.632 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.630+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6", "id": 3} v 0) v1 -- 0x7f20541ed8d0 con 0x7f2054070160 2023-11-24T08:00:07.640 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.638+0000 7f204b7fe640 1 -- 172.21.15.175:0/187387954 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f204c07a900 con 0x7f2054070160 2023-11-24T08:00:07.640 INFO:teuthology.orchestra.run.smithi175.stdout:3 2023-11-24T08:00:07.643 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.641+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f203406adb0 msgr2=0x7f203406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.643 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.641+0000 7f2058830640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f203406adb0 0x7f203406d270 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20540ae560 tx=0x7f2044009190 comp rx=0 tx=0).stop 2023-11-24T08:00:07.644 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.641+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 msgr2=0x7f20540ad510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.644 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.641+0000 7f2058830640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 0x7f20540ad510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f204c009e50 tx=0x7f204c004a40 comp rx=0 tx=0).stop 2023-11-24T08:00:07.644 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 shutdown_connections 2023-11-24T08:00:07.644 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f203406adb0 0x7f203406d270 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.644 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2054070160 0x7f20540ad510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.644 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f205406cb10 0x7f2054146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.645 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 --2- 172.21.15.175:0/187387954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f205406c730 0x7f20541449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.645 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 >> 172.21.15.175:0/187387954 conn(0x7f205406a7d0 msgr2=0x7f20540ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:07.645 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 shutdown_connections 2023-11-24T08:00:07.645 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.642+0000 7f2058830640 1 -- 172.21.15.175:0/187387954 wait complete. 2023-11-24T08:00:07.662 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 5d00fb16-0ce1-4464-a1e6-c255f0a1482f 4 2023-11-24T08:00:07.865 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.863+0000 7f4cf6259640 1 Processor -- start 2023-11-24T08:00:07.865 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.863+0000 7f4cf6259640 1 -- start start 2023-11-24T08:00:07.866 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.865+0000 7f4cf6259640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4cf013fcb0 0x7f4cf00cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.866 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.865+0000 7f4cf6259640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf00ce440 con 0x7f4cf00cdc20 2023-11-24T08:00:07.867 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.865+0000 7f4cf6259640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf00ce720 con 0x7f4cf013cf10 2023-11-24T08:00:07.867 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.865+0000 7f4cf6259640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf00cea00 con 0x7f4cf013fcb0 2023-11-24T08:00:07.867 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.865+0000 7f4cf5257640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4cf013cf10 0x7f4cf013f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:58522/0 (socket says 172.21.15.175:58522) 2023-11-24T08:00:07.867 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.865+0000 7f4cf5257640 1 -- 172.21.15.175:0/1252377546 learned_addr learned my addr 172.21.15.175:0/1252377546 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-24T08:00:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4cf4a56640 1 --2- 172.21.15.175:0/1252377546 >> v2:172.21.15.161:3300/0 conn(0x7f4cf013fcb0 0x7f4cf00cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958875141 0 0) 0x7f4cf00ce720 con 0x7f4cf013cf10 2023-11-24T08:00:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cdc003520 con 0x7f4cf013cf10 2023-11-24T08:00:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 367371702 0 0) 0x7f4cdc003520 con 0x7f4cf013cf10 2023-11-24T08:00:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 >> v2:172.21.15.161:3300/0 conn(0x7f4cf013fcb0 msgr2=0x7f4cf00cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:07.871 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 --2- 172.21.15.175:0/1252377546 >> v2:172.21.15.161:3300/0 conn(0x7f4cf013fcb0 0x7f4cf00cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 >> v1:172.21.15.161:6789/0 conn(0x7f4cf00cdc20 legacy=0x7f4cf00b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00b1d90 con 0x7f4cf013cf10 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f4cec001670 con 0x7f4cf013cf10 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 >> v1:172.21.15.175:6789/0 conn(0x7f4cf013cf10 legacy=0x7f4cf013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cdc003970 0x7f4cdc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc0047c0 0x7f4cdc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cdc005180 0x7f4cdc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00cea00 con 0x7f4cdc003970 2023-11-24T08:00:07.872 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc00c020 con 0x7f4cdc005180 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.866+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc00e3f0 con 0x7f4cdc0047c0 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5a58640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cdc005180 0x7f4cdc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf4a56640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc0047c0 0x7f4cdc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5257640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cdc003970 0x7f4cdc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5a58640 1 -- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc0047c0 msgr2=0x7f4cdc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5a58640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc0047c0 0x7f4cdc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5a58640 1 -- 172.21.15.175:0/1252377546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cdc003970 msgr2=0x7f4cdc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5a58640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cdc003970 0x7f4cdc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.873 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.867+0000 7f4cf5a58640 1 -- 172.21.15.175:0/1252377546 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc003520 con 0x7f4cdc005180 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.868+0000 7f4cf5a58640 1 -- 172.21.15.175:0/1252377546 reap_dead start 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.868+0000 7f4cf5a58640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cdc005180 0x7f4cdc00b980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8001e50 tx=0x7f4cdc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14632c81a471787f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.868+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8003b70 con 0x7f4cdc005180 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.868+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8003d10 con 0x7f4cdc005180 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.868+0000 7f4ce7fff640 1 -- 172.21.15.175:0/1252377546 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8005310 con 0x7f4cdc005180 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 -- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cdc005180 msgr2=0x7f4cdc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cdc005180 0x7f4cdc00b980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8001e50 tx=0x7f4cdc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 -- 172.21.15.175:0/1252377546 shutdown_connections 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 --2- 172.21.15.175:0/1252377546 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cdc005180 0x7f4cdc00b980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 -- 172.21.15.175:0/1252377546 >> 172.21.15.175:0/1252377546 conn(0x7f4cf006a7d0 msgr2=0x7f4cf006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 -- 172.21.15.175:0/1252377546 shutdown_connections 2023-11-24T08:00:07.874 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.869+0000 7f4cf6259640 1 -- 172.21.15.175:0/1252377546 wait complete. 2023-11-24T08:00:07.877 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.871+0000 7f4cf6259640 1 Processor -- start 2023-11-24T08:00:07.877 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.871+0000 7f4cf6259640 1 -- start start 2023-11-24T08:00:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf6259640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 0x7f4cf015d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf6259640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0153730 0x7f4cf01f5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.878 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf6259640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0151d80 0x7f4cf00af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf6259640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf015ce30 con 0x7f4cf0153730 2023-11-24T08:00:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf6259640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01f6380 con 0x7f4cf0151d80 2023-11-24T08:00:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf6259640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf01f6670 con 0x7f4cdc005180 2023-11-24T08:00:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf5257640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 0x7f4cf015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.879 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf5a58640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0151d80 0x7f4cf00af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf5257640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 0x7f4cf015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:56272/0 (socket says 172.21.15.175:56272) 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.872+0000 7f4cf5257640 1 -- 172.21.15.175:0/833101941 learned_addr learned my addr 172.21.15.175:0/833101941 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf4a56640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0153730 0x7f4cf01f5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf5257640 1 -- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0151d80 msgr2=0x7f4cf00af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf5257640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0151d80 0x7f4cf00af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf5257640 1 -- 172.21.15.175:0/833101941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0153730 msgr2=0x7f4cf01f5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:07.880 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf5257640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0153730 0x7f4cf01f5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:07.881 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf5257640 1 -- 172.21.15.175:0/833101941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf015dcf0 con 0x7f4cdc005180 2023-11-24T08:00:07.881 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf4a56640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0153730 0x7f4cf01f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:07.881 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf5257640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 0x7f4cf015d630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00e7e0 tx=0x7f4cec00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:07.881 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00c870 con 0x7f4cdc005180 2023-11-24T08:00:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec00c9d0 con 0x7f4cdc005180 2023-11-24T08:00:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00cd80 con 0x7f4cdc005180 2023-11-24T08:00:07.882 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf015dfd0 con 0x7f4cdc005180 2023-11-24T08:00:07.883 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.873+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf0153bb0 con 0x7f4cdc005180 2023-11-24T08:00:07.883 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.875+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf01f6870 con 0x7f4cdc005180 2023-11-24T08:00:07.884 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.875+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f4cec01d460 con 0x7f4cdc005180 2023-11-24T08:00:07.885 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.876+0000 7f4ce5ffb640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4cd406adb0 0x7f4cd406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:07.885 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.876+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4cec0882c0 con 0x7f4cdc005180 2023-11-24T08:00:07.885 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.877+0000 7f4cf4a56640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4cd406adb0 0x7f4cd406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:07.886 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.877+0000 7f4cf4a56640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4cd406adb0 0x7f4cd406d270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00093d0 tx=0x7f4ce0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:07.886 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:07.882+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4cf01f6870 con 0x7f4cdc005180 2023-11-24T08:00:08.089 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.087+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5d00fb16-0ce1-4464-a1e6-c255f0a1482f", "id": 4} v 0) v1 -- 0x7f4cf01f6870 con 0x7f4cdc005180 2023-11-24T08:00:08.097 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.096+0000 7f4ce5ffb640 1 -- 172.21.15.175:0/833101941 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5d00fb16-0ce1-4464-a1e6-c255f0a1482f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4cf01f6870 con 0x7f4cdc005180 2023-11-24T08:00:08.098 INFO:teuthology.orchestra.run.smithi175.stdout:4 2023-11-24T08:00:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4cd406adb0 msgr2=0x7f4cd406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4cd406adb0 0x7f4cd406d270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4ce00093d0 tx=0x7f4ce0008040 comp rx=0 tx=0).stop 2023-11-24T08:00:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 msgr2=0x7f4cf015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 0x7f4cf015d630 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00e7e0 tx=0x7f4cec00eca0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 shutdown_connections 2023-11-24T08:00:08.101 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4cd406adb0 0x7f4cd406d270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cf0151d80 0x7f4cf00af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4cf0153730 0x7f4cf01f5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 --2- 172.21.15.175:0/833101941 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cdc005180 0x7f4cf015d630 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 >> 172.21.15.175:0/833101941 conn(0x7f4cf006a7d0 msgr2=0x7f4cf015a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 shutdown_connections 2023-11-24T08:00:08.102 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.099+0000 7f4cf6259640 1 -- 172.21.15.175:0/833101941 wait complete. 2023-11-24T08:00:08.117 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c 5 2023-11-24T08:00:08.323 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.321+0000 7f18e00ad640 1 Processor -- start 2023-11-24T08:00:08.323 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.321+0000 7f18e00ad640 1 -- start start 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18e00ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 0x7f18d815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18e00ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d8070c40 con 0x7f18d80b3ae0 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18e00ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d806c470 con 0x7f18d80cf290 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18e00ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8071450 con 0x7f18d80ae5a0 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18dde49640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 0x7f18d815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18dde49640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 0x7f18d815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:56274/0 (socket says 172.21.15.175:56274) 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18dde49640 1 -- 172.21.15.175:0/4263015446 learned_addr learned my addr 172.21.15.175:0/4263015446 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:08.325 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.323+0000 7f18de64a640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f18d80cf290 0x7f18d80b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:58534/0 (socket says 172.21.15.175:58534) 2023-11-24T08:00:08.326 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.324+0000 7f18dde49640 1 -- 172.21.15.175:0/4263015446 >> v1:172.21.15.175:6789/0 conn(0x7f18d80cf290 legacy=0x7f18d80b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.326 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.324+0000 7f18dde49640 1 -- 172.21.15.175:0/4263015446 >> v1:172.21.15.161:6789/0 conn(0x7f18d80b3ae0 legacy=0x7f18d806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.326 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.324+0000 7f18dce47640 1 -- 172.21.15.175:0/4263015446 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336303502 0 0) 0x7f18d806c470 con 0x7f18d80cf290 2023-11-24T08:00:08.326 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.324+0000 7f18dde49640 1 -- 172.21.15.175:0/4263015446 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d806c750 con 0x7f18d80ae5a0 2023-11-24T08:00:08.326 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.325+0000 7f18dde49640 1 --2- 172.21.15.175:0/4263015446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 0x7f18d815e430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009e80 tx=0x7f18cc02c060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d0bc04488c952ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:08.327 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.325+0000 7f18dce47640 1 -- 172.21.15.175:0/4263015446 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc02cc00 con 0x7f18d80ae5a0 2023-11-24T08:00:08.327 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.325+0000 7f18dce47640 1 -- 172.21.15.175:0/4263015446 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc02cd60 con 0x7f18d80ae5a0 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.325+0000 7f18dce47640 1 -- 172.21.15.175:0/4263015446 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc034610 con 0x7f18d80ae5a0 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 -- 172.21.15.175:0/4263015446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 msgr2=0x7f18d815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 --2- 172.21.15.175:0/4263015446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 0x7f18d815e430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009e80 tx=0x7f18cc02c060 comp rx=0 tx=0).stop 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 -- 172.21.15.175:0/4263015446 shutdown_connections 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 --2- 172.21.15.175:0/4263015446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80ae5a0 0x7f18d815e430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 -- 172.21.15.175:0/4263015446 >> 172.21.15.175:0/4263015446 conn(0x7f18d806a800 msgr2=0x7f18d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 -- 172.21.15.175:0/4263015446 shutdown_connections 2023-11-24T08:00:08.328 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.326+0000 7f18e00ad640 1 -- 172.21.15.175:0/4263015446 wait complete. 2023-11-24T08:00:08.329 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.328+0000 7f18e00ad640 1 Processor -- start 2023-11-24T08:00:08.329 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.328+0000 7f18e00ad640 1 -- start start 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18e00ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18d80ae5a0 0x7f18d8148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18e00ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 0x7f18d80cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18e00ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80cf290 0x7f18d81f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18e00ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8149540 con 0x7f18d80ae5a0 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18e00ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8148930 con 0x7f18d80b3ae0 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18e00ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8148c10 con 0x7f18d80cf290 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 0x7f18d80cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 0x7f18d80cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40568/0 (socket says 172.21.15.175:40568) 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 -- 172.21.15.175:0/1089951286 learned_addr learned my addr 172.21.15.175:0/1089951286 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:08.332 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18de64a640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80cf290 0x7f18d81f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dde49640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18d80ae5a0 0x7f18d8148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 -- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80cf290 msgr2=0x7f18d81f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80cf290 0x7f18d81f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 -- 172.21.15.175:0/1089951286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18d80ae5a0 msgr2=0x7f18d8148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18d80ae5a0 0x7f18d8148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.330+0000 7f18dd648640 1 -- 172.21.15.175:0/1089951286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009b30 con 0x7f18d80b3ae0 2023-11-24T08:00:08.333 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.331+0000 7f18dd648640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 0x7f18d80cacc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18c400c450 tx=0x7f18c400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:08.334 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.331+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40052d0 con 0x7f18d80b3ae0 2023-11-24T08:00:08.334 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.331+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4005430 con 0x7f18d80b3ae0 2023-11-24T08:00:08.334 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.331+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d8148ef0 con 0x7f18d80b3ae0 2023-11-24T08:00:08.334 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.331+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4012870 con 0x7f18d80b3ae0 2023-11-24T08:00:08.334 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.331+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d80cb200 con 0x7f18d80b3ae0 2023-11-24T08:00:08.334 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.332+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d80675d0 con 0x7f18d80b3ae0 2023-11-24T08:00:08.335 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.333+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f18c40129d0 con 0x7f18d80b3ae0 2023-11-24T08:00:08.336 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.334+0000 7f18d67fc640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18bc06adb0 0x7f18bc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.336 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.334+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f18c4087ea0 con 0x7f18d80b3ae0 2023-11-24T08:00:08.336 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.334+0000 7f18dde49640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18bc06adb0 0x7f18bc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.336 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.335+0000 7f18dde49640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18bc06adb0 0x7f18bc06d270 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18cc035000 tx=0x7f18cc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:08.341 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.339+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18c4054140 con 0x7f18d80b3ae0 2023-11-24T08:00:08.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:00:08.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:00:08.548 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.547+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c", "id": 5} v 0) v1 -- 0x7f18d806daa0 con 0x7f18d80b3ae0 2023-11-24T08:00:08.557 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.556+0000 7f18d67fc640 1 -- 172.21.15.175:0/1089951286 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f18c4057760 con 0x7f18d80b3ae0 2023-11-24T08:00:08.558 INFO:teuthology.orchestra.run.smithi175.stdout:5 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18bc06adb0 msgr2=0x7f18bc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18bc06adb0 0x7f18bc06d270 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f18cc035000 tx=0x7f18cc030000 comp rx=0 tx=0).stop 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 msgr2=0x7f18d80cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 0x7f18d80cacc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18c400c450 tx=0x7f18c400c910 comp rx=0 tx=0).stop 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 shutdown_connections 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18bc06adb0 0x7f18bc06d270 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18d80cf290 0x7f18d81f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18d80b3ae0 0x7f18d80cacc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.561 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 --2- 172.21.15.175:0/1089951286 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18d80ae5a0 0x7f18d8148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.559+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 >> 172.21.15.175:0/1089951286 conn(0x7f18d806a800 msgr2=0x7f18d80b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.560+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 shutdown_connections 2023-11-24T08:00:08.562 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.560+0000 7f18e00ad640 1 -- 172.21.15.175:0/1089951286 wait complete. 2023-11-24T08:00:08.576 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new fd1f3893-8cce-4403-8702-f45955ee137d 6 2023-11-24T08:00:08.765 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.763+0000 7fd2526ea640 1 Processor -- start 2023-11-24T08:00:08.765 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.763+0000 7fd2526ea640 1 -- start start 2023-11-24T08:00:08.767 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd2526ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.767 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd2526ea640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd24c0ae170 0x7fd24c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.767 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd2526ea640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24c06c730 con 0x7fd24c15d770 2023-11-24T08:00:08.767 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd2526ea640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24c143bf0 con 0x7fd24c0ae170 2023-11-24T08:00:08.768 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd2526ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0ae5f0 con 0x7fd24c143810 2023-11-24T08:00:08.768 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd2516e8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.768 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd251ee9640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fd24c15d770 0x7fd24c15dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:58536/0 (socket says 172.21.15.175:58536) 2023-11-24T08:00:08.769 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.765+0000 7fd251ee9640 1 -- 172.21.15.175:0/849378647 learned_addr learned my addr 172.21.15.175:0/849378647 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-24T08:00:08.769 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.766+0000 7fd250ee7640 1 --2- 172.21.15.175:0/849378647 >> v2:172.21.15.161:3300/0 conn(0x7fd24c0ae170 0x7fd24c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.770 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.766+0000 7fd2516e8640 1 -- 172.21.15.175:0/849378647 >> v2:172.21.15.161:3300/0 conn(0x7fd24c0ae170 msgr2=0x7fd24c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:08.770 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.766+0000 7fd2516e8640 1 --2- 172.21.15.175:0/849378647 >> v2:172.21.15.161:3300/0 conn(0x7fd24c0ae170 0x7fd24c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.770 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.766+0000 7fd2516e8640 1 -- 172.21.15.175:0/849378647 >> v1:172.21.15.175:6789/0 conn(0x7fd24c15d770 legacy=0x7fd24c15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.770 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.766+0000 7fd243fff640 1 -- 172.21.15.175:0/849378647 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215030316 0 0) 0x7fd24c06c730 con 0x7fd24c15d770 2023-11-24T08:00:08.771 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.766+0000 7fd2516e8640 1 -- 172.21.15.175:0/849378647 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0724d0 con 0x7fd24c143810 2023-11-24T08:00:08.771 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.767+0000 7fd2516e8640 1 --2- 172.21.15.175:0/849378647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c071e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097a0 tx=0x7fd24802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=573690a4a1cb5d1b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:08.771 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.767+0000 7fd243fff640 1 -- 172.21.15.175:0/849378647 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248031780 con 0x7fd24c143810 2023-11-24T08:00:08.772 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.767+0000 7fd243fff640 1 -- 172.21.15.175:0/849378647 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2480318e0 con 0x7fd24c143810 2023-11-24T08:00:08.772 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.767+0000 7fd243fff640 1 -- 172.21.15.175:0/849378647 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248031c70 con 0x7fd24c143810 2023-11-24T08:00:08.774 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 -- 172.21.15.175:0/849378647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 msgr2=0x7fd24c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.774 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 --2- 172.21.15.175:0/849378647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c071e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd2480097a0 tx=0x7fd24802b820 comp rx=0 tx=0).stop 2023-11-24T08:00:08.775 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 -- 172.21.15.175:0/849378647 shutdown_connections 2023-11-24T08:00:08.776 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 --2- 172.21.15.175:0/849378647 >> v2:172.21.15.161:3300/0 conn(0x7fd24c0ae170 0x7fd24c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.776 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 --2- 172.21.15.175:0/849378647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c071e40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.777 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 -- 172.21.15.175:0/849378647 >> 172.21.15.175:0/849378647 conn(0x7fd24c06a7d0 msgr2=0x7fd24c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:08.777 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 -- 172.21.15.175:0/849378647 shutdown_connections 2023-11-24T08:00:08.779 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.768+0000 7fd2526ea640 1 -- 172.21.15.175:0/849378647 wait complete. 2023-11-24T08:00:08.781 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.770+0000 7fd2526ea640 1 Processor -- start 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.770+0000 7fd2526ea640 1 -- start start 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2526ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0ae170 0x7fd24c1f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2526ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2526ea640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd24c15d770 0x7fd24c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2526ea640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0b1950 con 0x7fd24c15d770 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2526ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0cc990 con 0x7fd24c0ae170 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2526ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c0cc500 con 0x7fd24c143810 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd250ee7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.782 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd2516e8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0ae170 0x7fd24c1f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd250ee7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c0cd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:56320/0 (socket says 172.21.15.175:56320) 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.771+0000 7fd250ee7640 1 -- 172.21.15.175:0/3550954157 learned_addr learned my addr 172.21.15.175:0/3550954157 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd251ee9640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd24c15d770 0x7fd24c0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd250ee7640 1 -- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0ae170 msgr2=0x7fd24c1f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd250ee7640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0ae170 0x7fd24c1f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd250ee7640 1 -- 172.21.15.175:0/3550954157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd24c15d770 msgr2=0x7fd24c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd250ee7640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd24c15d770 0x7fd24c0cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd250ee7640 1 -- 172.21.15.175:0/3550954157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009400 con 0x7fd24c143810 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd2516e8640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0ae170 0x7fd24c1f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd251ee9640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd24c15d770 0x7fd24c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd250ee7640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c0cd1d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d800 tx=0x7fd23c00dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:08.783 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00b6c0 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00b820 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c13d590 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.772+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c00bbb0 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.773+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c0b1390 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.774+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24c0cc670 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.774+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd23c00bd10 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.776+0000 7fd241ffb640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd23006adb0 0x7fd23006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.776+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd23c088910 con 0x7fd24c143810 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.776+0000 7fd2516e8640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd23006adb0 0x7fd23006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.777+0000 7fd2516e8640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd23006adb0 0x7fd23006d270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd248036000 tx=0x7fd24803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:08.784 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.780+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd23c054b50 con 0x7fd24c143810 2023-11-24T08:00:08.982 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.981+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fd1f3893-8cce-4403-8702-f45955ee137d", "id": 6} v 0) v1 -- 0x7fd24c067450 con 0x7fd24c143810 2023-11-24T08:00:08.992 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.991+0000 7fd241ffb640 1 -- 172.21.15.175:0/3550954157 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd1f3893-8cce-4403-8702-f45955ee137d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd23c058170 con 0x7fd24c143810 2023-11-24T08:00:08.993 INFO:teuthology.orchestra.run.smithi175.stdout:6 2023-11-24T08:00:08.995 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd23006adb0 msgr2=0x7fd23006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.995 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd23006adb0 0x7fd23006d270 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd248036000 tx=0x7fd24803d040 comp rx=0 tx=0).stop 2023-11-24T08:00:08.995 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 msgr2=0x7fd24c0cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c0cd1d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd23c00d800 tx=0x7fd23c00dcc0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 shutdown_connections 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd23006adb0 0x7fd23006d270 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd24c15d770 0x7fd24c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd24c143810 0x7fd24c0cd1d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 --2- 172.21.15.175:0/3550954157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd24c0ae170 0x7fd24c1f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 >> 172.21.15.175:0/3550954157 conn(0x7fd24c06a7d0 msgr2=0x7fd24c06abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 shutdown_connections 2023-11-24T08:00:08.996 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:08.994+0000 7fd2526ea640 1 -- 172.21.15.175:0/3550954157 wait complete. 2023-11-24T08:00:09.013 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 10f19481-8ef8-4199-a1e3-5f2bd70d891d 7 2023-11-24T08:00:09.200 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.198+0000 7f34c0444640 1 Processor -- start 2023-11-24T08:00:09.200 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.199+0000 7f34c0444640 1 -- start start 2023-11-24T08:00:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34c0444640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34b80cf9a0 0x7f34b8070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34c0444640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f34b8070ea0 0x7f34b80cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34c0444640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b8071690 con 0x7f34b814b2c0 2023-11-24T08:00:09.202 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34c0444640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b814b6a0 con 0x7f34b80cf9a0 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34c0444640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b8071970 con 0x7f34b8070ea0 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34be1e0640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f34b814b2c0 0x7f34b80cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:58546/0 (socket says 172.21.15.175:58546) 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34be1e0640 1 -- 172.21.15.175:0/3449681957 learned_addr learned my addr 172.21.15.175:0/3449681957 (peer_addr_for_me v1:172.21.15.175:0/0) 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.200+0000 7f34be9e1640 1 --2- 172.21.15.175:0/3449681957 >> v2:172.21.15.175:3300/0 conn(0x7f34b8070ea0 0x7f34b80cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34bd9df640 1 --2- 172.21.15.175:0/3449681957 >> v2:172.21.15.161:3300/0 conn(0x7f34b80cf9a0 0x7f34b8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34bd1de640 1 -- 172.21.15.175:0/3449681957 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754801853 0 0) 0x7f34b8071690 con 0x7f34b814b2c0 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34bd1de640 1 -- 172.21.15.175:0/3449681957 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34a4003520 con 0x7f34b814b2c0 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34be9e1640 1 -- 172.21.15.175:0/3449681957 >> v2:172.21.15.161:3300/0 conn(0x7f34b80cf9a0 msgr2=0x7f34b8070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34be9e1640 1 --2- 172.21.15.175:0/3449681957 >> v2:172.21.15.161:3300/0 conn(0x7f34b80cf9a0 0x7f34b8070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34be9e1640 1 -- 172.21.15.175:0/3449681957 >> v1:172.21.15.175:6789/0 conn(0x7f34b814b2c0 legacy=0x7f34b80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.203 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.201+0000 7f34be9e1640 1 -- 172.21.15.175:0/3449681957 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b8071c50 con 0x7f34b8070ea0 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.202+0000 7f34be9e1640 1 --2- 172.21.15.175:0/3449681957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b80cc160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34b8165330 tx=0x7f34b002bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a1d8d440bfdb3d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.202+0000 7f34bd1de640 1 -- 172.21.15.175:0/3449681957 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b002cc80 con 0x7f34b8070ea0 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34bd1de640 1 -- 172.21.15.175:0/3449681957 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b002cde0 con 0x7f34b8070ea0 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34bd1de640 1 -- 172.21.15.175:0/3449681957 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0034660 con 0x7f34b8070ea0 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 -- 172.21.15.175:0/3449681957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 msgr2=0x7f34b80cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 --2- 172.21.15.175:0/3449681957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b80cc160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f34b8165330 tx=0x7f34b002bed0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 -- 172.21.15.175:0/3449681957 shutdown_connections 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 --2- 172.21.15.175:0/3449681957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b80cc160 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 --2- 172.21.15.175:0/3449681957 >> v2:172.21.15.161:3300/0 conn(0x7f34b80cf9a0 0x7f34b8070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 -- 172.21.15.175:0/3449681957 >> 172.21.15.175:0/3449681957 conn(0x7f34b806a800 msgr2=0x7f34b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:09.205 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 -- 172.21.15.175:0/3449681957 shutdown_connections 2023-11-24T08:00:09.206 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.203+0000 7f34c0444640 1 -- 172.21.15.175:0/3449681957 wait complete. 2023-11-24T08:00:09.206 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.205+0000 7f34c0444640 1 Processor -- start 2023-11-24T08:00:09.206 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.205+0000 7f34c0444640 1 -- start start 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34c0444640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b815e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34c0444640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34b80cf9a0 0x7f34b8144a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34c0444640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b814b2c0 0x7f34b81600c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34c0444640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81626f0 con 0x7f34b80cf9a0 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34c0444640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81481f0 con 0x7f34b8070ea0 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34c0444640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81484d0 con 0x7f34b814b2c0 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34be1e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b815e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34be1e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b815e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:40588/0 (socket says 172.21.15.175:40588) 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34be1e0640 1 -- 172.21.15.175:0/3316864059 learned_addr learned my addr 172.21.15.175:0/3316864059 (peer_addr_for_me v2:172.21.15.175:0/0) 2023-11-24T08:00:09.209 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.206+0000 7f34be9e1640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b814b2c0 0x7f34b81600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34be1e0640 1 -- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b814b2c0 msgr2=0x7f34b81600c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34bd9df640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34b80cf9a0 0x7f34b8144a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34be1e0640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b814b2c0 0x7f34b81600c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34be1e0640 1 -- 172.21.15.175:0/3316864059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34b80cf9a0 msgr2=0x7f34b8144a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34be1e0640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34b80cf9a0 0x7f34b8144a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34be1e0640 1 -- 172.21.15.175:0/3316864059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b0009a70 con 0x7f34b8070ea0 2023-11-24T08:00:09.210 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34bd9df640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34b80cf9a0 0x7f34b8144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:09.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34be1e0640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b815e180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c410 tx=0x7f34b400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:09.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b4005ce0 con 0x7f34b8070ea0 2023-11-24T08:00:09.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b4005e40 con 0x7f34b8070ea0 2023-11-24T08:00:09.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b40072f0 con 0x7f34b8070ea0 2023-11-24T08:00:09.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b81487b0 con 0x7f34b8070ea0 2023-11-24T08:00:09.211 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.207+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b8147da0 con 0x7f34b8070ea0 2023-11-24T08:00:09.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.209+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b8162860 con 0x7f34b8070ea0 2023-11-24T08:00:09.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.210+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f34b4007510 con 0x7f34b8070ea0 2023-11-24T08:00:09.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.210+0000 7f34aaffd640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f349c06adb0 0x7f349c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.210+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f34b4087ae0 con 0x7f34b8070ea0 2023-11-24T08:00:09.212 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.211+0000 7f34bd9df640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f349c06adb0 0x7f349c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.213 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.211+0000 7f34bd9df640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f349c06adb0 0x7f349c06d270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34b8164fd0 tx=0x7f34ac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:09.216 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.215+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34b8162860 con 0x7f34b8070ea0 2023-11-24T08:00:09.402 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.401+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10f19481-8ef8-4199-a1e3-5f2bd70d891d", "id": 7} v 0) v1 -- 0x7f34b8162860 con 0x7f34b8070ea0 2023-11-24T08:00:09.411 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.410+0000 7f34aaffd640 1 -- 172.21.15.175:0/3316864059 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10f19481-8ef8-4199-a1e3-5f2bd70d891d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f34b8162860 con 0x7f34b8070ea0 2023-11-24T08:00:09.411 INFO:teuthology.orchestra.run.smithi175.stdout:7 2023-11-24T08:00:09.414 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.412+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f349c06adb0 msgr2=0x7f349c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.415 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.412+0000 7f34c0444640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f349c06adb0 0x7f349c06d270 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f34b8164fd0 tx=0x7f34ac008040 comp rx=0 tx=0).stop 2023-11-24T08:00:09.415 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.412+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 msgr2=0x7f34b815e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.415 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.412+0000 7f34c0444640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b815e180 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f34b400c410 tx=0x7f34b400c8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.415 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 shutdown_connections 2023-11-24T08:00:09.415 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f349c06adb0 0x7f349c06d270 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.415 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34b814b2c0 0x7f34b81600c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.416 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34b80cf9a0 0x7f34b8144a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.416 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 --2- 172.21.15.175:0/3316864059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34b8070ea0 0x7f34b815e180 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.416 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 >> 172.21.15.175:0/3316864059 conn(0x7f34b806a800 msgr2=0x7f34b80aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:09.416 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 shutdown_connections 2023-11-24T08:00:09.416 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:09.413+0000 7f34c0444640 1 -- 172.21.15.175:0/3316864059 wait complete. 2023-11-24T08:00:09.431 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T08:00:09.431 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T08:00:09.440 INFO:tasks.ceph.osd.0:Started 2023-11-24T08:00:09.440 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T08:00:09.440 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T08:00:09.448 INFO:tasks.ceph.osd.1:Started 2023-11-24T08:00:09.449 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T08:00:09.449 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T08:00:09.457 INFO:tasks.ceph.osd.2:Started 2023-11-24T08:00:09.457 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T08:00:09.457 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T08:00:09.464 INFO:tasks.ceph.osd.3:Started 2023-11-24T08:00:09.464 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T08:00:09.464 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T08:00:09.472 INFO:tasks.ceph.osd.4:Started 2023-11-24T08:00:09.472 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T08:00:09.472 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T08:00:09.481 INFO:tasks.ceph.osd.5:Started 2023-11-24T08:00:09.481 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T08:00:09.481 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T08:00:09.488 INFO:tasks.ceph.osd.6:Started 2023-11-24T08:00:09.488 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T08:00:09.489 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T08:00:09.494 INFO:tasks.ceph.osd.7:Started 2023-11-24T08:00:09.495 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:09.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.686+0000 7f2bb2013640 1 Processor -- start 2023-11-24T08:00:09.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.686+0000 7f2bb2013640 1 -- start start 2023-11-24T08:00:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.687+0000 7f2bb2013640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac162430 0x7f2bac0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.687+0000 7f2bb2013640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2bac0b3650 0x7f2bac06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.687+0000 7f2bb2013640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0702e0 con 0x7f2bac162810 2023-11-24T08:00:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.687+0000 7f2bb2013640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0705c0 con 0x7f2bac0b3650 2023-11-24T08:00:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.687+0000 7f2bb2013640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0708a0 con 0x7f2bac162430 2023-11-24T08:00:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.687+0000 7f2bb1812640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2bac0b3650 0x7f2bac06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb1011640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac162430 0x7f2bac0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb0810640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f2bac162810 0x7f2bac071240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:53932/0 (socket says 172.21.15.161:53932) 2023-11-24T08:00:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb0810640 1 -- 172.21.15.161:0/4095760945 learned_addr learned my addr 172.21.15.161:0/4095760945 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2ba3fff640 1 -- 172.21.15.161:0/4095760945 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646886961 0 0) 0x7f2bac0702e0 con 0x7f2bac162810 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb1812640 1 -- 172.21.15.161:0/4095760945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac162430 msgr2=0x7f2bac0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb1812640 1 --2- 172.21.15.161:0/4095760945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac162430 0x7f2bac0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb1812640 1 -- 172.21.15.161:0/4095760945 >> v1:172.21.15.175:6789/0 conn(0x7f2bac162810 legacy=0x7f2bac071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb1812640 1 -- 172.21.15.161:0/4095760945 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac070b80 con 0x7f2bac0b3650 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.688+0000 7f2bb1011640 1 --2- 172.21.15.161:0/4095760945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac162430 0x7f2bac0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:09.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.689+0000 7f2bb1812640 1 --2- 172.21.15.161:0/4095760945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac06c8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009d90 tx=0x7f2ba402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97617a4823c2d948 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:09.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.689+0000 7f2ba3fff640 1 -- 172.21.15.161:0/4095760945 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba402cc60 con 0x7f2bac0b3650 2023-11-24T08:00:09.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.689+0000 7f2ba3fff640 1 -- 172.21.15.161:0/4095760945 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba402cdc0 con 0x7f2bac0b3650 2023-11-24T08:00:09.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.689+0000 7f2ba3fff640 1 -- 172.21.15.161:0/4095760945 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4034660 con 0x7f2bac0b3650 2023-11-24T08:00:09.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 -- 172.21.15.161:0/4095760945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 msgr2=0x7f2bac06c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 --2- 172.21.15.161:0/4095760945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac06c8c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009d90 tx=0x7f2ba402beb0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 -- 172.21.15.161:0/4095760945 shutdown_connections 2023-11-24T08:00:09.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 --2- 172.21.15.161:0/4095760945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac06c8c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 --2- 172.21.15.161:0/4095760945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac162430 0x7f2bac0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 -- 172.21.15.161:0/4095760945 >> 172.21.15.161:0/4095760945 conn(0x7f2bac06a800 msgr2=0x7f2bac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:09.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 -- 172.21.15.161:0/4095760945 shutdown_connections 2023-11-24T08:00:09.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.690+0000 7f2bb2013640 1 -- 172.21.15.161:0/4095760945 wait complete. 2023-11-24T08:00:09.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.692+0000 7f2bb2013640 1 Processor -- start 2023-11-24T08:00:09.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.692+0000 7f2bb2013640 1 -- start start 2023-11-24T08:00:09.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb2013640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb2013640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bac162430 0x7f2bac158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb2013640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac14a260 0x7f2bac1653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb2013640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1f8d70 con 0x7f2bac0b3650 2023-11-24T08:00:09.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb2013640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1f9050 con 0x7f2bac162430 2023-11-24T08:00:09.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb2013640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1f9330 con 0x7f2bac14a260 2023-11-24T08:00:09.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb1011640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb1011640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:35668/0 (socket says 172.21.15.161:35668) 2023-11-24T08:00:09.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb1011640 1 -- 172.21.15.161:0/314561125 learned_addr learned my addr 172.21.15.161:0/314561125 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:09.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.693+0000 7f2bb0810640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bac162430 0x7f2bac158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1812640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac14a260 0x7f2bac1653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1011640 1 -- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac14a260 msgr2=0x7f2bac1653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1011640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac14a260 0x7f2bac1653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1011640 1 -- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bac162430 msgr2=0x7f2bac158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1011640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bac162430 0x7f2bac158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1011640 1 -- 172.21.15.161:0/314561125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009a70 con 0x7f2bac0b3650 2023-11-24T08:00:09.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb0810640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bac162430 0x7f2bac158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:09.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb1011640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac149bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800e730 tx=0x7f2ba800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:09.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8004230 con 0x7f2bac0b3650 2023-11-24T08:00:09.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8004390 con 0x7f2bac0b3650 2023-11-24T08:00:09.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba800c8f0 con 0x7f2bac0b3650 2023-11-24T08:00:09.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.694+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac1f9610 con 0x7f2bac0b3650 2023-11-24T08:00:09.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.695+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac165900 con 0x7f2bac0b3650 2023-11-24T08:00:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.696+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac165b20 con 0x7f2bac0b3650 2023-11-24T08:00:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.696+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f2ba800ca50 con 0x7f2bac0b3650 2023-11-24T08:00:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.697+0000 7f2ba1ffb640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b9006adb0 0x7f2b9006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.697+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2ba8088150 con 0x7f2bac0b3650 2023-11-24T08:00:09.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.698+0000 7f2bb0810640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b9006adb0 0x7f2b9006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:09.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.698+0000 7f2bb0810640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b9006adb0 0x7f2b9006d270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c007fd0 tx=0x7f2b9c007dc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:09.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.703+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ba80542b0 con 0x7f2bac0b3650 2023-11-24T08:00:09.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.890+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bac067450 con 0x7f2bac0b3650 2023-11-24T08:00:09.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.891+0000 7f2ba1ffb640 1 -- 172.21.15.161:0/314561125 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2ba8020090 con 0x7f2bac0b3650 2023-11-24T08:00:09.895 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:09.895 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":10,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:09.403272+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:09.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.893+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b9006adb0 msgr2=0x7f2b9006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.893+0000 7f2bb2013640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b9006adb0 0x7f2b9006d270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c007fd0 tx=0x7f2b9c007dc0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.893+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 msgr2=0x7f2bac149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:09.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.893+0000 7f2bb2013640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac149bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800e730 tx=0x7f2ba800ebf0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 shutdown_connections 2023-11-24T08:00:09.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b9006adb0 0x7f2b9006d270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bac14a260 0x7f2bac1653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bac162430 0x7f2bac158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 --2- 172.21.15.161:0/314561125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bac0b3650 0x7f2bac149bb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 >> 172.21.15.161:0/314561125 conn(0x7f2bac06a800 msgr2=0x7f2bac0711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 shutdown_connections 2023-11-24T08:00:09.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:09.894+0000 7f2bb2013640 1 -- 172.21.15.161:0/314561125 wait complete. 2023-11-24T08:00:09.914 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T08:00:09.915 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T08:00:10.144 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-11-24T08:00:10.142+0000 7f5315213500 -1 Falling back to public interface 2023-11-24T08:00:10.149 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-11-24T08:00:10.147+0000 7f87faf74500 -1 Falling back to public interface 2023-11-24T08:00:10.160 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-24T08:00:10.159+0000 7fe43b212500 -1 Falling back to public interface 2023-11-24T08:00:10.164 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-24T08:00:10.162+0000 7fb56d710500 -1 Falling back to public interface 2023-11-24T08:00:10.165 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-24T08:00:10.163+0000 7f1f89503500 -1 Falling back to public interface 2023-11-24T08:00:10.165 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-24T08:00:10.164+0000 7f386bea9500 -1 Falling back to public interface 2023-11-24T08:00:10.168 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-24T08:00:10.167+0000 7fb56c6b7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-11-24T08:00:10.172 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-24T08:00:10.169+0000 7fe439b22640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6819/0: (98) Address already in use 2023-11-24T08:00:10.180 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-11-24T08:00:10.174+0000 7f40d3f9b500 -1 Falling back to public interface 2023-11-24T08:00:10.200 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-11-24T08:00:10.196+0000 7f907f016500 -1 Falling back to public interface 2023-11-24T08:00:10.720 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:10.883 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.881+0000 7f9cdb056640 1 Processor -- start 2023-11-24T08:00:10.884 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.882+0000 7f9cdb056640 1 -- start start 2023-11-24T08:00:10.887 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.883+0000 7f9cdb056640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9cd4160c80 0x7f9cd40cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.887 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.883+0000 7f9cdb056640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40ce860 con 0x7f9cd40d2030 2023-11-24T08:00:10.887 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.883+0000 7f9cdb056640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40ceb40 con 0x7f9cd40ce3a0 2023-11-24T08:00:10.888 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.883+0000 7f9cdb056640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd40b3230 con 0x7f9cd4160c80 2023-11-24T08:00:10.888 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.883+0000 7f9cd95f3640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9cd40d2030 0x7f9cd40b3650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:43754/0 (socket says 172.21.15.161:43754) 2023-11-24T08:00:10.888 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.883+0000 7f9cd95f3640 1 -- 172.21.15.161:0/1655050367 learned_addr learned my addr 172.21.15.161:0/1655050367 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:10.888 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/1655050367 >> v2:172.21.15.175:3300/0 conn(0x7f9cd4160c80 0x7f9cd40cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.889 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899573019 0 0) 0x7f9cd40ce860 con 0x7f9cd40d2030 2023-11-24T08:00:10.889 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc4003520 con 0x7f9cd40d2030 2023-11-24T08:00:10.889 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 53681366 0 0) 0x7f9cc4003520 con 0x7f9cd40d2030 2023-11-24T08:00:10.889 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 >> v2:172.21.15.175:3300/0 conn(0x7f9cd4160c80 msgr2=0x7f9cd40cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:10.890 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 --2- 172.21.15.161:0/1655050367 >> v2:172.21.15.175:3300/0 conn(0x7f9cd4160c80 0x7f9cd40cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.890 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 >> v1:172.21.15.175:6789/0 conn(0x7f9cd40ce3a0 legacy=0x7f9cd40d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:10.890 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd40cee20 con 0x7f9cd40d2030 2023-11-24T08:00:10.890 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f9ccc0019f0 con 0x7f9cd40d2030 2023-11-24T08:00:10.890 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/1655050367 >> v2:172.21.15.175:3300/0 conn(0x7f9cd4160c80 0x7f9cd40cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:10.891 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 >> v1:172.21.15.161:6789/0 conn(0x7f9cd40d2030 legacy=0x7f9cd40b3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:10.891 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4003970 0x7f9cc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.891 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc40047c0 0x7f9cc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.891 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4005180 0x7f9cc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.891 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40b3230 con 0x7f9cc4003970 2023-11-24T08:00:10.892 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc400c020 con 0x7f9cc40047c0 2023-11-24T08:00:10.892 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.884+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc400c1e0 con 0x7f9cc4005180 2023-11-24T08:00:10.892 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4003970 0x7f9cc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.892 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd3fff640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc40047c0 0x7f9cc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.892 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd8df2640 1 -- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4005180 msgr2=0x7f9cc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:10.892 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4005180 0x7f9cc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.893 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd8df2640 1 -- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc40047c0 msgr2=0x7f9cc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:10.893 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc40047c0 0x7f9cc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.893 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd8df2640 1 -- 172.21.15.161:0/1655050367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4003520 con 0x7f9cc4003970 2023-11-24T08:00:10.893 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.885+0000 7f9cd95f3640 1 -- 172.21.15.161:0/1655050367 reap_dead start 2023-11-24T08:00:10.897 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.886+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4003970 0x7f9cc4003d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009c90 tx=0x7f9cc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5508d9d69c091953 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:10.897 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.886+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc802c8f0 con 0x7f9cc4003970 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.886+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc802ca50 con 0x7f9cc4003970 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.886+0000 7f9cd37fe640 1 -- 172.21.15.161:0/1655050367 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc802ce40 con 0x7f9cc4003970 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 -- 172.21.15.161:0/1655050367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4003970 msgr2=0x7f9cc4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4003970 0x7f9cc4003d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009c90 tx=0x7f9cc40057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 -- 172.21.15.161:0/1655050367 shutdown_connections 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 --2- 172.21.15.161:0/1655050367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cc4003970 0x7f9cc4003d90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 -- 172.21.15.161:0/1655050367 >> 172.21.15.161:0/1655050367 conn(0x7f9cd408aff0 msgr2=0x7f9cd409c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 -- 172.21.15.161:0/1655050367 shutdown_connections 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.887+0000 7f9cdb056640 1 -- 172.21.15.161:0/1655050367 wait complete. 2023-11-24T08:00:10.898 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.889+0000 7f9cdb056640 1 Processor -- start 2023-11-24T08:00:10.899 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.889+0000 7f9cdb056640 1 -- start start 2023-11-24T08:00:10.899 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cdb056640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4003970 0x7f9cd40ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.901 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cdb056640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 0x7f9cd40b7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.901 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cdb056640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd40b84a0 0x7f9cd40b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cdb056640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd41f3190 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cdb056640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40b6710 con 0x7f9cd40b84a0 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cdb056640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40cace0 con 0x7f9cc4003970 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cd3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 0x7f9cd40b7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cd3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 0x7f9cd40b7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59652/0 (socket says 172.21.15.161:59652) 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.890+0000 7f9cd3fff640 1 -- 172.21.15.161:0/536848944 learned_addr learned my addr 172.21.15.161:0/536848944 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:10.902 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4003970 0x7f9cd40ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.903 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd95f3640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd40b84a0 0x7f9cd40b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.903 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd3fff640 1 -- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4003970 msgr2=0x7f9cd40ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:10.903 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd3fff640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4003970 0x7f9cd40ccee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.903 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd3fff640 1 -- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd40b84a0 msgr2=0x7f9cd40b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:10.903 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd3fff640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd40b84a0 0x7f9cd40b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:10.903 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd3fff640 1 -- 172.21.15.161:0/536848944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd40b5e70 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.904 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd95f3640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd40b84a0 0x7f9cd40b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:10.904 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd3fff640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 0x7f9cd40b7f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000e410 tx=0x7f9cc000e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:10.904 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00052e0 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.904 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc0005440 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.904 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd40b6150 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.905 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0003810 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.905 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.891+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd40caf40 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.905 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.893+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd40cb100 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.905 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.894+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f9cc0003970 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.905 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.894+0000 7f9cd17fa640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9cb806ade0 0x7f9cb806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:10.905 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.895+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9cc0087ce0 con 0x7f9cd40b7ae0 2023-11-24T08:00:10.906 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.895+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9cb806ade0 0x7f9cb806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:10.906 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.896+0000 7f9cd8df2640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9cb806ade0 0x7f9cb806d2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8036000 tx=0x7f9cc8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:10.906 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:10.900+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9cc0053e60 con 0x7f9cd40b7ae0 2023-11-24T08:00:11.086 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.084+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cd40675d0 con 0x7f9cd40b7ae0 2023-11-24T08:00:11.087 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.085+0000 7f9cd17fa640 1 -- 172.21.15.161:0/536848944 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9cc0019020 con 0x7f9cd40b7ae0 2023-11-24T08:00:11.087 INFO:teuthology.misc.health.smithi161.stdout: 2023-11-24T08:00:11.088 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":10,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:09.403272+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:11.090 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9cb806ade0 msgr2=0x7f9cb806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:11.090 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9cb806ade0 0x7f9cb806d2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8036000 tx=0x7f9cc8030000 comp rx=0 tx=0).stop 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 msgr2=0x7f9cd40b7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 0x7f9cd40b7f60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000e410 tx=0x7f9cc000e8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 shutdown_connections 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9cb806ade0 0x7f9cb806d2a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd40b84a0 0x7f9cd40b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9cd40b7ae0 0x7f9cd40b7f60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 --2- 172.21.15.161:0/536848944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc4003970 0x7f9cd40ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:11.091 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 >> 172.21.15.161:0/536848944 conn(0x7f9cd408aff0 msgr2=0x7f9cd40b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:11.092 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 shutdown_connections 2023-11-24T08:00:11.092 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:11.088+0000 7f9cdb056640 1 -- 172.21.15.161:0/536848944 wait complete. 2023-11-24T08:00:11.104 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T08:00:13.672 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-11-24T08:00:13.670+0000 7f87faf74500 -1 osd.1 0 log_to_monitors true 2023-11-24T08:00:13.710 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-11-24T08:00:13.708+0000 7f5315213500 -1 osd.0 0 log_to_monitors true 2023-11-24T08:00:13.720 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-24T08:00:13.719+0000 7fe43b212500 -1 osd.4 0 log_to_monitors true 2023-11-24T08:00:13.759 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-24T08:00:13.758+0000 7f1f89503500 -1 osd.6 0 log_to_monitors true 2023-11-24T08:00:13.943 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-24T08:00:13.941+0000 7fb56d710500 -1 osd.7 0 log_to_monitors true 2023-11-24T08:00:13.986 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-11-24T08:00:13.984+0000 7f40d3f9b500 -1 osd.2 0 log_to_monitors true 2023-11-24T08:00:14.008 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-11-24T08:00:14.006+0000 7f907f016500 -1 osd.3 0 log_to_monitors true 2023-11-24T08:00:14.008 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-24T08:00:14.007+0000 7f386bea9500 -1 osd.5 0 log_to_monitors true 2023-11-24T08:00:16.147 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-24T08:00:16.146+0000 7fe4362e6640 -1 osd.4 0 waiting for initial osdmap 2023-11-24T08:00:16.176 INFO:tasks.ceph.osd.4.smithi175.stderr:2023-11-24T08:00:16.174+0000 7fe42e91f640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:16.524 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-11-24T08:00:16.522+0000 7f5311ae3640 -1 osd.0 0 waiting for initial osdmap 2023-11-24T08:00:16.540 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-11-24T08:00:16.538+0000 7f87f66df640 -1 osd.1 0 waiting for initial osdmap 2023-11-24T08:00:16.544 INFO:tasks.ceph.osd.0.smithi161.stderr:2023-11-24T08:00:16.542+0000 7f53088e4640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:16.559 INFO:tasks.ceph.osd.1.smithi161.stderr:2023-11-24T08:00:16.558+0000 7f87eed18640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:17.273 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-11-24T08:00:17.271+0000 7f40cf708640 -1 osd.2 0 waiting for initial osdmap 2023-11-24T08:00:17.283 INFO:tasks.ceph.osd.2.smithi161.stderr:2023-11-24T08:00:17.280+0000 7f40c7d41640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:17.347 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-11-24T08:00:17.345+0000 7f907b8fb640 -1 osd.3 0 waiting for initial osdmap 2023-11-24T08:00:17.358 INFO:tasks.ceph.osd.3.smithi161.stderr:2023-11-24T08:00:17.356+0000 7f90726fc640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:17.640 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-24T08:00:17.637+0000 7f1f84c6e640 -1 osd.6 0 waiting for initial osdmap 2023-11-24T08:00:17.652 INFO:tasks.ceph.osd.6.smithi175.stderr:2023-11-24T08:00:17.651+0000 7f1f7d2a7640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:17.671 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-24T08:00:17.667+0000 7fb568e7b640 -1 osd.7 0 waiting for initial osdmap 2023-11-24T08:00:17.677 INFO:tasks.ceph.osd.7.smithi175.stderr:2023-11-24T08:00:17.676+0000 7fb5614b4640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:17.681 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-24T08:00:17.680+0000 7f3867614640 -1 osd.5 0 waiting for initial osdmap 2023-11-24T08:00:17.701 INFO:tasks.ceph.osd.5.smithi175.stderr:2023-11-24T08:00:17.700+0000 7f385fc4d640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T08:00:17.911 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:18.094 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.092+0000 7f33cac15640 1 Processor -- start 2023-11-24T08:00:18.094 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.092+0000 7f33cac15640 1 -- start start 2023-11-24T08:00:18.100 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.093+0000 7f33cac15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f33c4070a90 0x7f33c406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.100 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.093+0000 7f33cac15640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c4071040 con 0x7f33c4072160 2023-11-24T08:00:18.100 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.093+0000 7f33cac15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c4071320 con 0x7f33c406c1e0 2023-11-24T08:00:18.100 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.093+0000 7f33cac15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c406cbb0 con 0x7f33c4070a90 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c89b1640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f33c4072160 0x7f33c40b3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:43764/0 (socket says 172.21.15.161:43764) 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c89b1640 1 -- 172.21.15.161:0/2637885188 learned_addr learned my addr 172.21.15.161:0/2637885188 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115939620 0 0) 0x7f33c4071040 con 0x7f33c4072160 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b0003520 con 0x7f33c4072160 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c91b2640 1 --2- 172.21.15.161:0/2637885188 >> v2:172.21.15.175:3300/0 conn(0x7f33c4070a90 0x7f33c406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735111434 0 0) 0x7f33b0003520 con 0x7f33c4072160 2023-11-24T08:00:18.101 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 >> v2:172.21.15.175:3300/0 conn(0x7f33c4070a90 msgr2=0x7f33c406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 --2- 172.21.15.161:0/2637885188 >> v2:172.21.15.175:3300/0 conn(0x7f33c4070a90 0x7f33c406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 >> v1:172.21.15.175:6789/0 conn(0x7f33c406c1e0 legacy=0x7f33c4070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40b33e0 con 0x7f33c4072160 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f33ac001670 con 0x7f33c4072160 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.094+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 >> v1:172.21.15.161:6789/0 conn(0x7f33c4072160 legacy=0x7f33c40b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c37fe640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00039c0 0x7f33b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.102 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c37fe640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00047c0 0x7f33b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c37fe640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00051d0 0x7f33b000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c406cbb0 con 0x7f33b00039c0 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b000c100 con 0x7f33b00051d0 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b000c2c0 con 0x7f33b00047c0 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00039c0 0x7f33b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c3fff640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00047c0 0x7f33b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.103 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c89b1640 1 -- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00047c0 msgr2=0x7f33b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:18.104 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c91b2640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00051d0 0x7f33b000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.104 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00047c0 0x7f33b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.104 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c89b1640 1 -- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00051d0 msgr2=0x7f33b000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:18.104 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00051d0 0x7f33b000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.104 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c89b1640 1 -- 172.21.15.161:0/2637885188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0003520 con 0x7f33b00039c0 2023-11-24T08:00:18.104 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c3fff640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00047c0 0x7f33b0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c91b2640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33b00051d0 0x7f33b000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.095+0000 7f33c91b2640 1 -- 172.21.15.161:0/2637885188 reap_dead start 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.096+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00039c0 0x7f33b0003dc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c160 tx=0x7f33b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cc64e278b671a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.096+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac005ad0 con 0x7f33b00039c0 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.096+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac005c30 con 0x7f33b00039c0 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33c37fe640 1 -- 172.21.15.161:0/2637885188 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac02c7e0 con 0x7f33b00039c0 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 -- 172.21.15.161:0/2637885188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00039c0 msgr2=0x7f33b0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.105 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00039c0 0x7f33b0003dc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c160 tx=0x7f33b00057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.106 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 -- 172.21.15.161:0/2637885188 shutdown_connections 2023-11-24T08:00:18.106 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 --2- 172.21.15.161:0/2637885188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00039c0 0x7f33b0003dc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.106 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 -- 172.21.15.161:0/2637885188 >> 172.21.15.161:0/2637885188 conn(0x7f33c406dd50 msgr2=0x7f33c406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:18.106 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 -- 172.21.15.161:0/2637885188 shutdown_connections 2023-11-24T08:00:18.106 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.097+0000 7f33cac15640 1 -- 172.21.15.161:0/2637885188 wait complete. 2023-11-24T08:00:18.110 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.099+0000 7f33cac15640 1 Processor -- start 2023-11-24T08:00:18.110 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.099+0000 7f33cac15640 1 -- start start 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33cac15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00039c0 0x7f33c413a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33cac15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33c413bfa0 0x7f33c4144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33cac15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 0x7f33c41423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33cac15640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4145400 con 0x7f33c4144f50 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33cac15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c415e000 con 0x7f33c413bfa0 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33cac15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c413b220 con 0x7f33b00039c0 2023-11-24T08:00:18.111 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33c91b2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 0x7f33c41423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33c91b2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 0x7f33c41423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59712/0 (socket says 172.21.15.161:59712) 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33c91b2640 1 -- 172.21.15.161:0/2368692820 learned_addr learned my addr 172.21.15.161:0/2368692820 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.100+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00039c0 0x7f33c413a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c91b2640 1 -- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00039c0 msgr2=0x7f33c413a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c91b2640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00039c0 0x7f33c413a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c91b2640 1 -- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33c413bfa0 msgr2=0x7f33c4144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.112 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c91b2640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33c413bfa0 0x7f33c4144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c91b2640 1 -- 172.21.15.161:0/2368692820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c413b4c0 con 0x7f33c4144f50 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00039c0 0x7f33c413a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c91b2640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 0x7f33c41423a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33c40aeb50 tx=0x7f33bc009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc007cc0 con 0x7f33c4144f50 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc007e20 con 0x7f33c4144f50 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc014640 con 0x7f33c4144f50 2023-11-24T08:00:18.113 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c413b7a0 con 0x7f33c4144f50 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.101+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c4142f80 con 0x7f33c4144f50 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.102+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c413bcc0 con 0x7f33c4144f50 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.103+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f33bc01d3b0 con 0x7f33c4144f50 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.104+0000 7f33c17fa640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f33a406adb0 0x7f33a406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.105+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7f33bc088830 con 0x7f33c4144f50 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.105+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f33a406adb0 0x7f33a406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.114 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.106+0000 7f33c89b1640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f33a406adb0 0x7f33a406d270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33ac034000 tx=0x7f33ac009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:18.115 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.110+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f33c413bcc0 con 0x7f33c4144f50 2023-11-24T08:00:18.304 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.302+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33c413bcc0 con 0x7f33c4144f50 2023-11-24T08:00:18.305 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.304+0000 7f33c17fa640 1 -- 172.21.15.161:0/2368692820 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11001 (secure 0 0 0) 0x7f33c413bcc0 con 0x7f33c4144f50 2023-11-24T08:00:18.306 INFO:teuthology.misc.health.smithi161.stdout: 2023-11-24T08:00:18.306 INFO:teuthology.misc.health.smithi161.stdout:{"epoch":15,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:18.269126+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:18.308 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f33a406adb0 msgr2=0x7f33a406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.308 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f33a406adb0 0x7f33a406d270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33ac034000 tx=0x7f33ac009030 comp rx=0 tx=0).stop 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 msgr2=0x7f33c41423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 0x7f33c41423a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f33c40aeb50 tx=0x7f33bc009d30 comp rx=0 tx=0).stop 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 shutdown_connections 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f33a406adb0 0x7f33a406d270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33c4144f50 0x7f33c41423a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33c413bfa0 0x7f33c4144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 --2- 172.21.15.161:0/2368692820 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33b00039c0 0x7f33c413a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 >> 172.21.15.161:0/2368692820 conn(0x7f33c406dd50 msgr2=0x7f33c40b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 shutdown_connections 2023-11-24T08:00:18.309 INFO:teuthology.misc.health.smithi161.stderr:2023-11-24T08:00:18.306+0000 7f33cac15640 1 -- 172.21.15.161:0/2368692820 wait complete. 2023-11-24T08:00:18.323 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T08:00:18.323 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T08:00:18.323 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:00:18.323 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:00:18.328 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:00:18.328 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:00:18.328 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:00:18.333 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:00:18.334 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:00:18.334 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:00:18.342 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:00:18.343 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:00:18.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:00:18.353 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:00:18.353 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T08:00:18.354 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:18.486 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2023-11-24T08:00:18.486 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-11-24T08:00:18.500 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-24T08:00:18.508 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-24T08:00:18.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.538+0000 7ff2d6ba9640 1 Processor -- start 2023-11-24T08:00:18.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.539+0000 7ff2d6ba9640 1 -- start start 2023-11-24T08:00:18.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d6ba9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d00ae5a0 0x7ff2d015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d6ba9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00b3ae0 0x7ff2d006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d6ba9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d0070c40 con 0x7ff2d006d120 2023-11-24T08:00:18.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d6ba9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d0071450 con 0x7ff2d00ae5a0 2023-11-24T08:00:18.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d6ba9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d006c470 con 0x7ff2d00b3ae0 2023-11-24T08:00:18.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00b3ae0 0x7ff2d006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d4945640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d00ae5a0 0x7ff2d015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d5146640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff2d006d120 0x7ff2d00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:33418/0 (socket says 172.21.15.161:33418) 2023-11-24T08:00:18.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.540+0000 7ff2d5146640 1 -- 172.21.15.161:0/3882007440 learned_addr learned my addr 172.21.15.161:0/3882007440 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:18.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.541+0000 7ff2cffff640 1 -- 172.21.15.161:0/3882007440 >> v2:172.21.15.175:3300/0 conn(0x7ff2d00ae5a0 msgr2=0x7ff2d015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:18.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.541+0000 7ff2cffff640 1 --2- 172.21.15.161:0/3882007440 >> v2:172.21.15.175:3300/0 conn(0x7ff2d00ae5a0 0x7ff2d015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.541+0000 7ff2cffff640 1 -- 172.21.15.161:0/3882007440 >> v1:172.21.15.175:6789/0 conn(0x7ff2d006d120 legacy=0x7ff2d00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.541+0000 7ff2cffff640 1 -- 172.21.15.161:0/3882007440 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d006c750 con 0x7ff2d00b3ae0 2023-11-24T08:00:18.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.542+0000 7ff2cffff640 1 --2- 172.21.15.161:0/3882007440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00b3ae0 0x7ff2d006cbe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0097a0 tx=0x7ff2bc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6cd638c915243a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:18.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.542+0000 7ff2cf7fe640 1 -- 172.21.15.161:0/3882007440 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc02d040 con 0x7ff2d00b3ae0 2023-11-24T08:00:18.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.542+0000 7ff2cf7fe640 1 -- 172.21.15.161:0/3882007440 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc031810 con 0x7ff2d00b3ae0 2023-11-24T08:00:18.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.542+0000 7ff2cf7fe640 1 -- 172.21.15.161:0/3882007440 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc031ba0 con 0x7ff2d00b3ae0 2023-11-24T08:00:18.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/3882007440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00b3ae0 msgr2=0x7ff2d006cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/3882007440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00b3ae0 0x7ff2d006cbe0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0097a0 tx=0x7ff2bc02b8b0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/3882007440 shutdown_connections 2023-11-24T08:00:18.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/3882007440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00b3ae0 0x7ff2d006cbe0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/3882007440 >> v2:172.21.15.175:3300/0 conn(0x7ff2d00ae5a0 0x7ff2d015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/3882007440 >> 172.21.15.161:0/3882007440 conn(0x7ff2d006a800 msgr2=0x7ff2d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:18.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/3882007440 shutdown_connections 2023-11-24T08:00:18.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.543+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/3882007440 wait complete. 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.545+0000 7ff2d6ba9640 1 Processor -- start 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.545+0000 7ff2d6ba9640 1 -- start start 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d6ba9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 0x7ff2d00aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d6ba9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00ae5a0 0x7ff2d00b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d6ba9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00b3ae0 0x7ff2d01f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d6ba9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f3dd0 con 0x7ff2d00b3ae0 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d6ba9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f3f50 con 0x7ff2d006d120 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d6ba9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f3af0 con 0x7ff2d00ae5a0 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 0x7ff2d00aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 0x7ff2d00aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:44188/0 (socket says 172.21.15.161:44188) 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 -- 172.21.15.161:0/2572471002 learned_addr learned my addr 172.21.15.161:0/2572471002 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2cffff640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00ae5a0 0x7ff2d00b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 -- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00ae5a0 msgr2=0x7ff2d00b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00ae5a0 0x7ff2d00b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 -- 172.21.15.161:0/2572471002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00b3ae0 msgr2=0x7ff2d01f2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00b3ae0 0x7ff2d01f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2d4945640 1 -- 172.21.15.161:0/2572471002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc009400 con 0x7ff2d006d120 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.546+0000 7ff2cffff640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00ae5a0 0x7ff2d00b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.547+0000 7ff2d4945640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 0x7ff2d00aff70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400efc0 tx=0x7ff2c400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.547+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4014480 con 0x7ff2d006d120 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.547+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c400f040 con 0x7ff2d006d120 2023-11-24T08:00:18.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.547+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4014800 con 0x7ff2d006d120 2023-11-24T08:00:18.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.547+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d0147a30 con 0x7ff2d006d120 2023-11-24T08:00:18.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.547+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d0147ff0 con 0x7ff2d006d120 2023-11-24T08:00:18.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.549+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d0147890 con 0x7ff2d006d120 2023-11-24T08:00:18.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.549+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff2c4014960 con 0x7ff2d006d120 2023-11-24T08:00:18.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.551+0000 7ff2cd7fa640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff2b406adb0 0x7ff2b406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:18.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.551+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7ff2c4089bb0 con 0x7ff2d006d120 2023-11-24T08:00:18.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.551+0000 7ff2cffff640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff2b406adb0 0x7ff2b406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:18.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.552+0000 7ff2cffff640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff2b406adb0 0x7ff2b406d270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc036000 tx=0x7ff2bc03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:18.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.556+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2d0147890 con 0x7ff2d006d120 2023-11-24T08:00:18.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.770+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2d0147890 con 0x7ff2d006d120 2023-11-24T08:00:18.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.772+0000 7ff2cd7fa640 1 -- 172.21.15.161:0/2572471002 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11001 (secure 0 0 0) 0x7ff2d0147890 con 0x7ff2d006d120 2023-11-24T08:00:18.775 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:18.775 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":15,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:18.269126+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff2b406adb0 msgr2=0x7ff2b406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff2b406adb0 0x7ff2b406d270 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc036000 tx=0x7ff2bc03c040 comp rx=0 tx=0).stop 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 msgr2=0x7ff2d00aff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 0x7ff2d00aff70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400efc0 tx=0x7ff2c400c490 comp rx=0 tx=0).stop 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 shutdown_connections 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff2b406adb0 0x7ff2b406d270 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.775+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2d00b3ae0 0x7ff2d01f2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.776+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d00ae5a0 0x7ff2d00b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.776+0000 7ff2d6ba9640 1 --2- 172.21.15.161:0/2572471002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d006d120 0x7ff2d00aff70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:18.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.776+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 >> 172.21.15.161:0/2572471002 conn(0x7ff2d006a800 msgr2=0x7ff2d00b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:18.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.776+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 shutdown_connections 2023-11-24T08:00:18.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:18.776+0000 7ff2d6ba9640 1 -- 172.21.15.161:0/2572471002 wait complete. 2023-11-24T08:00:18.798 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-11-24T08:00:18.798 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:00:19.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.008+0000 7fb1e277c640 1 Processor -- start 2023-11-24T08:00:19.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.008+0000 7fb1e277c640 1 -- start start 2023-11-24T08:00:19.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1e277c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 0x7fb1dc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1e277c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc070c40 con 0x7fb1dc0b3ae0 2023-11-24T08:00:19.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1e277c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc06c470 con 0x7fb1dc0cf290 2023-11-24T08:00:19.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1e277c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc071450 con 0x7fb1dc0ae5a0 2023-11-24T08:00:19.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1db7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb1dc0b3ae0 0x7fb1dc06cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:43772/0 (socket says 172.21.15.161:43772) 2023-11-24T08:00:19.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1db7fe640 1 -- 172.21.15.161:0/465542575 learned_addr learned my addr 172.21.15.161:0/465542575 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1dbfff640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 0x7fb1dc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574093868 0 0) 0x7fb1dc070c40 con 0x7fb1dc0b3ae0 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.010+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c8003520 con 0x7fb1dc0b3ae0 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3593605467 0 0) 0x7fb1c8003520 con 0x7fb1dc0b3ae0 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 msgr2=0x7fb1dc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 0x7fb1dc15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 >> v1:172.21.15.175:6789/0 conn(0x7fb1dc0cf290 legacy=0x7fb1dc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc06c750 con 0x7fb1dc0b3ae0 2023-11-24T08:00:19.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fb1c4001670 con 0x7fb1dc0b3ae0 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 >> v1:172.21.15.161:6789/0 conn(0x7fb1dc0b3ae0 legacy=0x7fb1dc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 0x7fb1c80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1c8003f20 0x7fb1c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc071450 con 0x7fb1c8004d00 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c800baf0 con 0x7fb1c8003f20 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c800bcb0 con 0x7fb1dc0ae5a0 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1e0d19640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1db7fe640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1c8003f20 0x7fb1c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.011+0000 7fb1dbfff640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 0x7fb1c80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.012+0000 7fb1e0d19640 1 -- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 msgr2=0x7fb1c80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:19.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.012+0000 7fb1e0d19640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc0ae5a0 0x7fb1c80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.012+0000 7fb1e0d19640 1 -- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1c8003f20 msgr2=0x7fb1c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.012+0000 7fb1e0d19640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1c8003f20 0x7fb1c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.012+0000 7fb1e0d19640 1 -- 172.21.15.161:0/465542575 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8003520 con 0x7fb1c8004d00 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1e0d19640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1c8005180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc001750 tx=0x7fb1c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491333bbf30779e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0052d0 con 0x7fb1c8004d00 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc02e050 con 0x7fb1c8004d00 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1daffd640 1 -- 172.21.15.161:0/465542575 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc003830 con 0x7fb1c8004d00 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1e277c640 1 -- 172.21.15.161:0/465542575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 msgr2=0x7fb1c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1e277c640 1 --2- 172.21.15.161:0/465542575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1c8005180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc001750 tx=0x7fb1c80057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.013+0000 7fb1e0d19640 1 -- 172.21.15.161:0/465542575 reap_dead start 2023-11-24T08:00:19.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.014+0000 7fb1e277c640 1 -- 172.21.15.161:0/465542575 shutdown_connections 2023-11-24T08:00:19.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.014+0000 7fb1e277c640 1 -- 172.21.15.161:0/465542575 >> 172.21.15.161:0/465542575 conn(0x7fb1dc06a800 msgr2=0x7fb1dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:19.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.014+0000 7fb1e277c640 1 -- 172.21.15.161:0/465542575 shutdown_connections 2023-11-24T08:00:19.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.014+0000 7fb1e277c640 1 -- 172.21.15.161:0/465542575 wait complete. 2023-11-24T08:00:19.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.015+0000 7fb1e277c640 1 Processor -- start 2023-11-24T08:00:19.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.015+0000 7fb1e277c640 1 -- start start 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.016+0000 7fb1e277c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1dc15c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.016+0000 7fb1e277c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc1f3090 0x7fb1dc1583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.016+0000 7fb1e277c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc1588f0 0x7fb1dc14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.016+0000 7fb1e277c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0cc6c0 con 0x7fb1c8004d00 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.016+0000 7fb1e277c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0cba40 con 0x7fb1dc1f3090 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.016+0000 7fb1e277c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0cbd20 con 0x7fb1dc1588f0 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1dc15c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1dc15c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59762/0 (socket says 172.21.15.161:59762) 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 -- 172.21.15.161:0/1192951301 learned_addr learned my addr 172.21.15.161:0/1192951301 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 -- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc1588f0 msgr2=0x7fb1dc14c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc1588f0 0x7fb1dc14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 -- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc1f3090 msgr2=0x7fb1dc1583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc1f3090 0x7fb1dc1583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 -- 172.21.15.161:0/1192951301 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0cc000 con 0x7fb1c8004d00 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1dbfff640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1dc15c5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4007f30 tx=0x7fb1d4011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.017+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d400e030 con 0x7fb1c8004d00 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.018+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d4016470 con 0x7fb1c8004d00 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.018+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc0cc2e0 con 0x7fb1c8004d00 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.018+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4016820 con 0x7fb1c8004d00 2023-11-24T08:00:19.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.018+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc15cae0 con 0x7fb1c8004d00 2023-11-24T08:00:19.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.019+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc0675d0 con 0x7fb1c8004d00 2023-11-24T08:00:19.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.020+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fb1d4016980 con 0x7fb1c8004d00 2023-11-24T08:00:19.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.021+0000 7fb1d8ff9640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1bc06adb0 0x7fb1bc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:19.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.021+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb1d400f070 con 0x7fb1c8004d00 2023-11-24T08:00:19.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.021+0000 7fb1db7fe640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1bc06adb0 0x7fb1bc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:19.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.022+0000 7fb1db7fe640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1bc06adb0 0x7fb1bc06d270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4001eb0 tx=0x7fb1c4000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:19.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.026+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb1d4055650 con 0x7fb1c8004d00 2023-11-24T08:00:19.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.253+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1dc0b1ee0 con 0x7fb1c8004d00 2023-11-24T08:00:19.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.254+0000 7fb1d8ff9640 1 -- 172.21.15.161:0/1192951301 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fb1d4058c70 con 0x7fb1c8004d00 2023-11-24T08:00:19.256 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:19.256 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T08:00:19.257 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 2 2023-11-24T08:00:19.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1bc06adb0 msgr2=0x7fb1bc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1bc06adb0 0x7fb1bc06d270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4001eb0 tx=0x7fb1c4000ed0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 msgr2=0x7fb1dc15c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:19.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1dc15c5a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb1d4007f30 tx=0x7fb1d4011660 comp rx=0 tx=0).stop 2023-11-24T08:00:19.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 shutdown_connections 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1bc06adb0 0x7fb1bc06d270 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb1dc1588f0 0x7fb1dc14c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1dc1f3090 0x7fb1dc1583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 --2- 172.21.15.161:0/1192951301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb1c8004d00 0x7fb1dc15c5a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 >> 172.21.15.161:0/1192951301 conn(0x7fb1dc06a800 msgr2=0x7fb1dc15a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 shutdown_connections 2023-11-24T08:00:19.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:19.257+0000 7fb1e277c640 1 -- 172.21.15.161:0/1192951301 wait complete. 2023-11-24T08:00:21.279 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:00:21.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.488+0000 7fe53efce640 1 Processor -- start 2023-11-24T08:00:21.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.488+0000 7fe53efce640 1 -- start start 2023-11-24T08:00:21.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.489+0000 7fe53efce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe538161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.489+0000 7fe53efce640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5380cf1b0 con 0x7fe5380ced50 2023-11-24T08:00:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.489+0000 7fe53efce640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5381618a0 con 0x7fe5380ce8f0 2023-11-24T08:00:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.489+0000 7fe53efce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380d0a00 con 0x7fe538160f80 2023-11-24T08:00:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe53d56b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe5380ced50 0x7fe5380d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51152/0 (socket says 172.21.15.161:51152) 2023-11-24T08:00:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe53d56b640 1 -- 172.21.15.161:0/1744994289 learned_addr learned my addr 172.21.15.161:0/1744994289 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe53cd6a640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe538161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719576759 0 0) 0x7fe5380cf1b0 con 0x7fe5380ced50 2023-11-24T08:00:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe528003520 con 0x7fe5380ced50 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3946436563 0 0) 0x7fe528003520 con 0x7fe5380ced50 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 msgr2=0x7fe538161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe538161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 >> v1:172.21.15.175:6789/0 conn(0x7fe5380ce8f0 legacy=0x7fe5380cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380d0de0 con 0x7fe5380ced50 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.490+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fe5300019f0 con 0x7fe5380ced50 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 >> v1:172.21.15.161:6789/0 conn(0x7fe5380ced50 legacy=0x7fe5380d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5280039a0 0x7fe528003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe5280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528004d00 0x7fe528005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380d0a00 con 0x7fe528004d00 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52800ba30 con 0x7fe5280039a0 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52800bbf0 con 0x7fe538160f80 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53d56b640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528004d00 0x7fe528005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe537fff640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe5280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53d56b640 1 -- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 msgr2=0x7fe5280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53d56b640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe5280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53cd6a640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5280039a0 0x7fe528003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53d56b640 1 -- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5280039a0 msgr2=0x7fe528003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53d56b640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5280039a0 0x7fe528003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe53d56b640 1 -- 172.21.15.161:0/1744994289 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe528003520 con 0x7fe528004d00 2023-11-24T08:00:21.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.491+0000 7fe537fff640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe538160f80 0x7fe5280047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:21.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.492+0000 7fe53d56b640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528004d00 0x7fe528005180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe53000a800 tx=0x7fe5280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930faad606f54640 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:21.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5300072d0 con 0x7fe528004d00 2023-11-24T08:00:21.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53002f070 con 0x7fe528004d00 2023-11-24T08:00:21.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe5377fe640 1 -- 172.21.15.161:0/1744994289 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe530007690 con 0x7fe528004d00 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53efce640 1 -- 172.21.15.161:0/1744994289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528004d00 msgr2=0x7fe528005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53efce640 1 --2- 172.21.15.161:0/1744994289 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe528004d00 0x7fe528005180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe53000a800 tx=0x7fe5280057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53d56b640 1 -- 172.21.15.161:0/1744994289 reap_dead start 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53efce640 1 -- 172.21.15.161:0/1744994289 shutdown_connections 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53efce640 1 -- 172.21.15.161:0/1744994289 >> 172.21.15.161:0/1744994289 conn(0x7fe53809c550 msgr2=0x7fe5380d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53efce640 1 -- 172.21.15.161:0/1744994289 shutdown_connections 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.493+0000 7fe53efce640 1 -- 172.21.15.161:0/1744994289 wait complete. 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.495+0000 7fe53efce640 1 Processor -- start 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.495+0000 7fe53efce640 1 -- start start 2023-11-24T08:00:21.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe53efce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe528004d00 0x7fe53815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe53efce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 0x7fe5380cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe53efce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5380c8890 0x7fe5380b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe53efce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53815be90 con 0x7fe53815c0a0 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe53efce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380cacf0 con 0x7fe528004d00 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe53efce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5380caf40 con 0x7fe5380c8890 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe537fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 0x7fe5380cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe537fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 0x7fe5380cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33554/0 (socket says 172.21.15.161:33554) 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.496+0000 7fe537fff640 1 -- 172.21.15.161:0/3562748116 learned_addr learned my addr 172.21.15.161:0/3562748116 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe53d56b640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5380c8890 0x7fe5380b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe53cd6a640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe528004d00 0x7fe53815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe537fff640 1 -- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5380c8890 msgr2=0x7fe5380b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe537fff640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5380c8890 0x7fe5380b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe537fff640 1 -- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe528004d00 msgr2=0x7fe53815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe537fff640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe528004d00 0x7fe53815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe537fff640 1 -- 172.21.15.161:0/3562748116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380cb220 con 0x7fe53815c0a0 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe537fff640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 0x7fe5380cbd00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d7a0 tx=0x7fe52400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.497+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524017070 con 0x7fe53815c0a0 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.498+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524005070 con 0x7fe53815c0a0 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.498+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5380cb500 con 0x7fe53815c0a0 2023-11-24T08:00:21.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.498+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524005420 con 0x7fe53815c0a0 2023-11-24T08:00:21.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.498+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5380cc240 con 0x7fe53815c0a0 2023-11-24T08:00:21.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.499+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5380675d0 con 0x7fe53815c0a0 2023-11-24T08:00:21.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.500+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe524007030 con 0x7fe53815c0a0 2023-11-24T08:00:21.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.501+0000 7fe5357fa640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe51c06adb0 0x7fe51c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.502+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe524088a10 con 0x7fe53815c0a0 2023-11-24T08:00:21.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.506+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe524053f80 con 0x7fe53815c0a0 2023-11-24T08:00:21.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.512+0000 7fe53cd6a640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe51c06adb0 0x7fe51c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.513+0000 7fe53cd6a640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe51c06adb0 0x7fe51c06d270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5380c8120 tx=0x7fe52c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:21.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.747+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5380d3920 con 0x7fe53815c0a0 2023-11-24T08:00:21.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.748+0000 7fe5357fa640 1 -- 172.21.15.161:0/3562748116 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7fe5240575a0 con 0x7fe53815c0a0 2023-11-24T08:00:21.750 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:21.751 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T08:00:21.751 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 3 2023-11-24T08:00:21.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe51c06adb0 msgr2=0x7fe51c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe51c06adb0 0x7fe51c06d270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe5380c8120 tx=0x7fe52c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 msgr2=0x7fe5380cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 0x7fe5380cbd00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe52400d7a0 tx=0x7fe52400dc60 comp rx=0 tx=0).stop 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 shutdown_connections 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe51c06adb0 0x7fe51c06d270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5380c8890 0x7fe5380b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe53815c0a0 0x7fe5380cbd00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 --2- 172.21.15.161:0/3562748116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe528004d00 0x7fe53815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.750+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 >> 172.21.15.161:0/3562748116 conn(0x7fe53809c550 msgr2=0x7fe5380b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:21.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.751+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 shutdown_connections 2023-11-24T08:00:21.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.751+0000 7fe53efce640 1 -- 172.21.15.161:0/3562748116 wait complete. 2023-11-24T08:00:21.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:21.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.971+0000 7f899cdf5640 1 Processor -- start 2023-11-24T08:00:21.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.971+0000 7f899cdf5640 1 -- start start 2023-11-24T08:00:21.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.973+0000 7f899cdf5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89980b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.973+0000 7f899cdf5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899806cea0 con 0x7f899806c6b0 2023-11-24T08:00:21.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.973+0000 7f899cdf5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899806cbc0 con 0x7f89980cd240 2023-11-24T08:00:21.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.973+0000 7f899cdf5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899806f350 con 0x7f899809a170 2023-11-24T08:00:21.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8996d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f899806c6b0 0x7f89980cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51162/0 (socket says 172.21.15.161:51162) 2023-11-24T08:00:21.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8996d9d640 1 -- 172.21.15.161:0/3239276148 learned_addr learned my addr 172.21.15.161:0/3239276148 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:21.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f898dd9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89980b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228519424 0 0) 0x7f899806cea0 con 0x7f899806c6b0 2023-11-24T08:00:21.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8984003520 con 0x7f899806c6b0 2023-11-24T08:00:21.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 516716936 0 0) 0x7f8984003520 con 0x7f899806c6b0 2023-11-24T08:00:21.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 msgr2=0x7f89980b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:21.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89980b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 >> v1:172.21.15.175:6789/0 conn(0x7f89980cd240 legacy=0x7f8998099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899806f630 con 0x7f899806c6b0 2023-11-24T08:00:21.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f89900019f0 con 0x7f899806c6b0 2023-11-24T08:00:21.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.974+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 >> v1:172.21.15.161:6789/0 conn(0x7f899806c6b0 legacy=0x7f89980cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f8995d9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89840039a0 0x7f8984003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f8995d9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f8995d9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8984004d00 0x7f8984005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899806f350 con 0x7f89840039a0 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898400ba30 con 0x7f8984004d00 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898400bbf0 con 0x7f899809a170 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f899659c640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89840039a0 0x7f8984003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f898dd9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f899659c640 1 -- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 msgr2=0x7f89840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:21.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f899659c640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f899659c640 1 -- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8984004d00 msgr2=0x7f8984005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:21.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f899659c640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8984004d00 0x7f8984005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f899659c640 1 -- 172.21.15.161:0/3239276148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984003520 con 0x7f89840039a0 2023-11-24T08:00:21.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.975+0000 7f898dd9b640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f899809a170 0x7f89840047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:21.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.976+0000 7f899659c640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89840039a0 0x7f8984003dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8988001720 tx=0x7f89840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9329cd9a6e4de0a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:21.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880052d0 con 0x7f89840039a0 2023-11-24T08:00:21.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898802e050 con 0x7f89840039a0 2023-11-24T08:00:21.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f8995d9b640 1 -- 172.21.15.161:0/3239276148 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880035f0 con 0x7f89840039a0 2023-11-24T08:00:21.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f899cdf5640 1 -- 172.21.15.161:0/3239276148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89840039a0 msgr2=0x7f8984003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f899cdf5640 1 --2- 172.21.15.161:0/3239276148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89840039a0 0x7f8984003dc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8988001720 tx=0x7f89840057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f8996d9d640 1 -- 172.21.15.161:0/3239276148 reap_dead start 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f899cdf5640 1 -- 172.21.15.161:0/3239276148 shutdown_connections 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.977+0000 7f899cdf5640 1 -- 172.21.15.161:0/3239276148 >> 172.21.15.161:0/3239276148 conn(0x7f89980b2d00 msgr2=0x7f89980b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.978+0000 7f899cdf5640 1 -- 172.21.15.161:0/3239276148 shutdown_connections 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.978+0000 7f899cdf5640 1 -- 172.21.15.161:0/3239276148 wait complete. 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.980+0000 7f899cdf5640 1 Processor -- start 2023-11-24T08:00:21.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.980+0000 7f899cdf5640 1 -- start start 2023-11-24T08:00:21.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f899cdf5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89840039a0 0x7f89980c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f899cdf5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 0x7f89981f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f899cdf5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815a7d0 0x7f89980b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f899cdf5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980c4d00 con 0x7f89980c6dc0 2023-11-24T08:00:21.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f899cdf5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89980c90c0 con 0x7f899815a7d0 2023-11-24T08:00:21.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f899cdf5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89980c79d0 con 0x7f89840039a0 2023-11-24T08:00:21.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f898dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 0x7f89981f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f898dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 0x7f89981f6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33584/0 (socket says 172.21.15.161:33584) 2023-11-24T08:00:21.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.982+0000 7f898dd9b640 1 -- 172.21.15.161:0/2574809019 learned_addr learned my addr 172.21.15.161:0/2574809019 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:21.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f899659c640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89840039a0 0x7f89980c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f8996d9d640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815a7d0 0x7f89980b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898dd9b640 1 -- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89840039a0 msgr2=0x7f89980c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898dd9b640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89840039a0 0x7f89980c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898dd9b640 1 -- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815a7d0 msgr2=0x7f89980b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:21.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898dd9b640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815a7d0 0x7f89980b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:21.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898dd9b640 1 -- 172.21.15.161:0/2574809019 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89981f7320 con 0x7f89980c6dc0 2023-11-24T08:00:21.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898dd9b640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 0x7f89981f6de0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89800108b0 tx=0x7f8980010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:21.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000eb60 con 0x7f89980c6dc0 2023-11-24T08:00:21.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898000ecc0 con 0x7f89980c6dc0 2023-11-24T08:00:21.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89980c7280 con 0x7f89980c6dc0 2023-11-24T08:00:21.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.983+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898001c400 con 0x7f89980c6dc0 2023-11-24T08:00:21.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.984+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89980c51c0 con 0x7f89980c6dc0 2023-11-24T08:00:21.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.985+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89980675d0 con 0x7f89980c6dc0 2023-11-24T08:00:21.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.986+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f898001c560 con 0x7f89980c6dc0 2023-11-24T08:00:21.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.987+0000 7f898f7fe640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f897806ae30 0x7f897806d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:21.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.987+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89800895d0 con 0x7f89980c6dc0 2023-11-24T08:00:21.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.988+0000 7f899659c640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f897806ae30 0x7f897806d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:21.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.989+0000 7f899659c640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f897806ae30 0x7f897806d2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8988033000 tx=0x7f8988009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:21.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:21.992+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8980054c40 con 0x7f89980c6dc0 2023-11-24T08:00:22.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.201+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89980b31b0 con 0x7f89980c6dc0 2023-11-24T08:00:22.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.202+0000 7f898f7fe640 1 -- 172.21.15.161:0/2574809019 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f8980058260 con 0x7f89980c6dc0 2023-11-24T08:00:22.204 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:22.204 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":18,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:21.507974+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:22.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.204+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f897806ae30 msgr2=0x7f897806d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.204+0000 7f899cdf5640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f897806ae30 0x7f897806d2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8988033000 tx=0x7f8988009030 comp rx=0 tx=0).stop 2023-11-24T08:00:22.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.204+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 msgr2=0x7f89981f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.204+0000 7f899cdf5640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 0x7f89981f6de0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89800108b0 tx=0x7f8980010d70 comp rx=0 tx=0).stop 2023-11-24T08:00:22.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 shutdown_connections 2023-11-24T08:00:22.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f897806ae30 0x7f897806d2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f899815a7d0 0x7f89980b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89980c6dc0 0x7f89981f6de0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 --2- 172.21.15.161:0/2574809019 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89840039a0 0x7f89980c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 >> 172.21.15.161:0/2574809019 conn(0x7f89980b2d00 msgr2=0x7f89980aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:22.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 shutdown_connections 2023-11-24T08:00:22.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.205+0000 7f899cdf5640 1 -- 172.21.15.161:0/2574809019 wait complete. 2023-11-24T08:00:22.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:00:22.227 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:00:22.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.436+0000 7f9310f90640 1 Processor -- start 2023-11-24T08:00:22.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.436+0000 7f9310f90640 1 -- start start 2023-11-24T08:00:22.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.437+0000 7f9310f90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9310f90640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f930c15e3b0 0x7f930c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9310f90640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c0cfc30 con 0x7f930c0cf7d0 2023-11-24T08:00:22.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9310f90640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c0b1ee0 con 0x7f930c15e3b0 2023-11-24T08:00:22.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9310f90640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0b2780 con 0x7f930c143ae0 2023-11-24T08:00:22.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9303fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f930c0cf7d0 0x7f930c15dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51164/0 (socket says 172.21.15.161:51164) 2023-11-24T08:00:22.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9303fff640 1 -- 172.21.15.161:0/1213293583 learned_addr learned my addr 172.21.15.161:0/1213293583 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:22.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f930ad9d640 1 --2- 172.21.15.161:0/1213293583 >> v2:172.21.15.161:3300/0 conn(0x7f930c15e3b0 0x7f930c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f930a59c640 1 --2- 172.21.15.161:0/1213293583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9309d9b640 1 -- 172.21.15.161:0/1213293583 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3673217654 0 0) 0x7f930c0cfc30 con 0x7f930c0cf7d0 2023-11-24T08:00:22.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.438+0000 7f9309d9b640 1 -- 172.21.15.161:0/1213293583 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f8003520 con 0x7f930c0cf7d0 2023-11-24T08:00:22.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.439+0000 7f930ad9d640 1 -- 172.21.15.161:0/1213293583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 msgr2=0x7f930c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:22.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.439+0000 7f930ad9d640 1 --2- 172.21.15.161:0/1213293583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.439+0000 7f930ad9d640 1 -- 172.21.15.161:0/1213293583 >> v1:172.21.15.161:6789/0 conn(0x7f930c0cf7d0 legacy=0x7f930c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.439+0000 7f930ad9d640 1 -- 172.21.15.161:0/1213293583 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c15e990 con 0x7f930c15e3b0 2023-11-24T08:00:22.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.440+0000 7f930ad9d640 1 --2- 172.21.15.161:0/1213293583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c0702c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9304009d90 tx=0x7f930402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fa027ff58df835 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:22.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.440+0000 7f9309d9b640 1 -- 172.21.15.161:0/1213293583 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930402cc60 con 0x7f930c15e3b0 2023-11-24T08:00:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.440+0000 7f9309d9b640 1 -- 172.21.15.161:0/1213293583 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930402cdc0 con 0x7f930c15e3b0 2023-11-24T08:00:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.440+0000 7f9309d9b640 1 -- 172.21.15.161:0/1213293583 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304034660 con 0x7f930c15e3b0 2023-11-24T08:00:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.440+0000 7f9310f90640 1 -- 172.21.15.161:0/1213293583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 msgr2=0x7f930c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.440+0000 7f9310f90640 1 --2- 172.21.15.161:0/1213293583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c0702c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9304009d90 tx=0x7f930402beb0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.441+0000 7f9310f90640 1 -- 172.21.15.161:0/1213293583 shutdown_connections 2023-11-24T08:00:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.441+0000 7f9310f90640 1 --2- 172.21.15.161:0/1213293583 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c0702c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.441+0000 7f9310f90640 1 --2- 172.21.15.161:0/1213293583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.441+0000 7f9310f90640 1 -- 172.21.15.161:0/1213293583 >> 172.21.15.161:0/1213293583 conn(0x7f930c06a800 msgr2=0x7f930c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.441+0000 7f9310f90640 1 -- 172.21.15.161:0/1213293583 shutdown_connections 2023-11-24T08:00:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.441+0000 7f9310f90640 1 -- 172.21.15.161:0/1213293583 wait complete. 2023-11-24T08:00:22.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.442+0000 7f9310f90640 1 Processor -- start 2023-11-24T08:00:22.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.443+0000 7f9310f90640 1 -- start start 2023-11-24T08:00:22.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.443+0000 7f9310f90640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930c0cf7d0 0x7f930c140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9310f90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9310f90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9310f90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0acf20 con 0x7f930c15e3b0 2023-11-24T08:00:22.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9310f90640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0cd790 con 0x7f930c0cf7d0 2023-11-24T08:00:22.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9310f90640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0cda30 con 0x7f930c143ae0 2023-11-24T08:00:22.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33610/0 (socket says 172.21.15.161:33610) 2023-11-24T08:00:22.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 -- 172.21.15.161:0/308868431 learned_addr learned my addr 172.21.15.161:0/308868431 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:22.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9303fff640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930a59c640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930c0cf7d0 0x7f930c140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 -- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 msgr2=0x7f930c0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 -- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930c0cf7d0 msgr2=0x7f930c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930c0cf7d0 0x7f930c140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f930ad9d640 1 -- 172.21.15.161:0/308868431 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9304009a70 con 0x7f930c15e3b0 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.444+0000 7f9303fff640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.445+0000 7f930ad9d640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c159870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9304009eb0 tx=0x7f9304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.445+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930403e610 con 0x7f930c15e3b0 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.445+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930403e770 con 0x7f930c15e3b0 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.445+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c0cdd10 con 0x7f930c15e3b0 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.445+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930403eb60 con 0x7f930c15e3b0 2023-11-24T08:00:22.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.445+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c0acbb0 con 0x7f930c15e3b0 2023-11-24T08:00:22.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.446+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c0ad0d0 con 0x7f930c15e3b0 2023-11-24T08:00:22.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.447+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f930403b050 con 0x7f930c15e3b0 2023-11-24T08:00:22.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.448+0000 7f9302ffd640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f92ec06adb0 0x7f92ec06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.448+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93040ab3b0 con 0x7f930c15e3b0 2023-11-24T08:00:22.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.449+0000 7f930a59c640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f92ec06adb0 0x7f92ec06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.450+0000 7f930a59c640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f92ec06adb0 0x7f92ec06d270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009ad0 tx=0x7f92fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:22.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.453+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f930c0ad0d0 con 0x7f930c15e3b0 2023-11-24T08:00:22.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.645+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f930c0675d0 con 0x7f930c15e3b0 2023-11-24T08:00:22.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.646+0000 7f9302ffd640 1 -- 172.21.15.161:0/308868431 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9304076890 con 0x7f930c15e3b0 2023-11-24T08:00:22.648 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:00:22.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f92ec06adb0 msgr2=0x7f92ec06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f92ec06adb0 0x7f92ec06d270 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009ad0 tx=0x7f92fc008040 comp rx=0 tx=0).stop 2023-11-24T08:00:22.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 msgr2=0x7f930c159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c159870 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9304009eb0 tx=0x7f9304004a40 comp rx=0 tx=0).stop 2023-11-24T08:00:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 shutdown_connections 2023-11-24T08:00:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f92ec06adb0 0x7f92ec06d270 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f930c15e3b0 0x7f930c159870 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f930c143ae0 0x7f930c0cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 --2- 172.21.15.161:0/308868431 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f930c0cf7d0 0x7f930c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 >> 172.21.15.161:0/308868431 conn(0x7f930c06a800 msgr2=0x7f930c15afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:22.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 shutdown_connections 2023-11-24T08:00:22.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.649+0000 7f9310f90640 1 -- 172.21.15.161:0/308868431 wait complete. 2023-11-24T08:00:22.670 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:00:22.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.873+0000 7efd81831640 1 Processor -- start 2023-11-24T08:00:22.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.873+0000 7efd81831640 1 -- start start 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.875+0000 7efd81831640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd7c13e360 0x7efd7c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.875+0000 7efd81831640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c15c5f0 con 0x7efd7c15f9c0 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.875+0000 7efd81831640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7c06c470 con 0x7efd7c13df80 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd81831640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7c06c750 con 0x7efd7c13e360 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd727fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd7c13e360 0x7efd7c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd7b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efd7c15f9c0 0x7efd7c0cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51170/0 (socket says 172.21.15.161:51170) 2023-11-24T08:00:22.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd7b7fe640 1 -- 172.21.15.161:0/234963746 learned_addr learned my addr 172.21.15.161:0/234963746 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:22.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd727fc640 1 -- 172.21.15.161:0/234963746 >> v1:172.21.15.175:6789/0 conn(0x7efd7c13df80 legacy=0x7efd7c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd727fc640 1 -- 172.21.15.161:0/234963746 >> v1:172.21.15.161:6789/0 conn(0x7efd7c15f9c0 legacy=0x7efd7c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd727fc640 1 -- 172.21.15.161:0/234963746 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7c06ca30 con 0x7efd7c13e360 2023-11-24T08:00:22.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.876+0000 7efd7a7fc640 1 -- 172.21.15.161:0/234963746 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102242124 0 0) 0x7efd7c15c5f0 con 0x7efd7c15f9c0 2023-11-24T08:00:22.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.877+0000 7efd727fc640 1 --2- 172.21.15.161:0/234963746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c0cf290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d90 tx=0x7efd6402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de417c10416dc2bd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:22.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd7a7fc640 1 -- 172.21.15.161:0/234963746 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6402cd00 con 0x7efd7c13e360 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd7a7fc640 1 -- 172.21.15.161:0/234963746 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6402ce60 con 0x7efd7c13e360 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd7a7fc640 1 -- 172.21.15.161:0/234963746 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64034660 con 0x7efd7c13e360 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 -- 172.21.15.161:0/234963746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 msgr2=0x7efd7c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 --2- 172.21.15.161:0/234963746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c0cf290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd64009d90 tx=0x7efd6402bf50 comp rx=0 tx=0).stop 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 -- 172.21.15.161:0/234963746 shutdown_connections 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 --2- 172.21.15.161:0/234963746 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c0cf290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 -- 172.21.15.161:0/234963746 >> 172.21.15.161:0/234963746 conn(0x7efd7c06a800 msgr2=0x7efd7c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 -- 172.21.15.161:0/234963746 shutdown_connections 2023-11-24T08:00:22.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.878+0000 7efd81831640 1 -- 172.21.15.161:0/234963746 wait complete. 2023-11-24T08:00:22.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.880+0000 7efd81831640 1 Processor -- start 2023-11-24T08:00:22.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.880+0000 7efd81831640 1 -- start start 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd81831640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c13df80 0x7efd7c0b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd81831640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c14fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd81831640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c15f9c0 0x7efd7c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd81831640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c150800 con 0x7efd7c13e360 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd81831640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c151ac0 con 0x7efd7c13df80 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd81831640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7c1517e0 con 0x7efd7c15f9c0 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd727fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c14fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd727fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c14fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33624/0 (socket says 172.21.15.161:33624) 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd727fc640 1 -- 172.21.15.161:0/1280465855 learned_addr learned my addr 172.21.15.161:0/1280465855 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.881+0000 7efd7b7fe640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c15f9c0 0x7efd7c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd7affd640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c13df80 0x7efd7c0b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd727fc640 1 -- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c15f9c0 msgr2=0x7efd7c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd727fc640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c15f9c0 0x7efd7c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd727fc640 1 -- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c13df80 msgr2=0x7efd7c0b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd727fc640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c13df80 0x7efd7c0b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd727fc640 1 -- 172.21.15.161:0/1280465855 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64009a70 con 0x7efd7c13e360 2023-11-24T08:00:22.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd727fc640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c14fd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd64037040 tx=0x7efd64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:22.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6403d600 con 0x7efd7c13e360 2023-11-24T08:00:22.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6403d780 con 0x7efd7c13e360 2023-11-24T08:00:22.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7c151e70 con 0x7efd7c13e360 2023-11-24T08:00:22.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6403db30 con 0x7efd7c13e360 2023-11-24T08:00:22.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.882+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7c152430 con 0x7efd7c13e360 2023-11-24T08:00:22.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.883+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd7c067000 con 0x7efd7c13e360 2023-11-24T08:00:22.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.884+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7efd6403b040 con 0x7efd7c13e360 2023-11-24T08:00:22.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.886+0000 7efd78ff9640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd5c06adb0 0x7efd5c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:22.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.886+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd640ab250 con 0x7efd7c13e360 2023-11-24T08:00:22.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.886+0000 7efd7affd640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd5c06adb0 0x7efd5c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:22.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.887+0000 7efd7affd640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd5c06adb0 0x7efd5c06d270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd6c000f60 tx=0x7efd6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:22.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:22.890+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd64076720 con 0x7efd7c13e360 2023-11-24T08:00:23.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.086+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efd7c152620 con 0x7efd7c13e360 2023-11-24T08:00:23.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.087+0000 7efd78ff9640 1 -- 172.21.15.161:0/1280465855 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7efd6404d060 con 0x7efd7c13e360 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:00:23.089 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:00:23.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.089+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd5c06adb0 msgr2=0x7efd5c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.089+0000 7efd81831640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd5c06adb0 0x7efd5c06d270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efd6c000f60 tx=0x7efd6c009040 comp rx=0 tx=0).stop 2023-11-24T08:00:23.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.089+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 msgr2=0x7efd7c14fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.089+0000 7efd81831640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c14fd80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efd64037040 tx=0x7efd64004a40 comp rx=0 tx=0).stop 2023-11-24T08:00:23.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 shutdown_connections 2023-11-24T08:00:23.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd5c06adb0 0x7efd5c06d270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd7c15f9c0 0x7efd7c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd7c13e360 0x7efd7c14fd80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 --2- 172.21.15.161:0/1280465855 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd7c13df80 0x7efd7c0b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 >> 172.21.15.161:0/1280465855 conn(0x7efd7c06a800 msgr2=0x7efd7c15a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:23.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 shutdown_connections 2023-11-24T08:00:23.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.090+0000 7efd81831640 1 -- 172.21.15.161:0/1280465855 wait complete. 2023-11-24T08:00:23.111 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:00:23.111 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:00:23.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.321+0000 7eff5a690640 1 Processor -- start 2023-11-24T08:00:23.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.321+0000 7eff5a690640 1 -- start start 2023-11-24T08:00:23.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff5a690640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5406c6b0 0x7eff540b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:23.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff5a690640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5406cea0 con 0x7eff5409a170 2023-11-24T08:00:23.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff5a690640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5406cbc0 con 0x7eff540cd240 2023-11-24T08:00:23.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff5a690640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5406f350 con 0x7eff5406c6b0 2023-11-24T08:00:23.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff58c2d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5406c6b0 0x7eff540b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff53fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7eff540cd240 0x7eff54099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:47136/0 (socket says 172.21.15.161:47136) 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff53fff640 1 -- 172.21.15.161:0/1798616539 learned_addr learned my addr 172.21.15.161:0/1798616539 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.323+0000 7eff4b7fe640 1 --1- 172.21.15.161:0/1798616539 >> v1:172.21.15.161:6789/0 conn(0x7eff5409a170 0x7eff540cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51186/0 (socket says 172.21.15.161:51186) 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.324+0000 7eff537fe640 1 -- 172.21.15.161:0/1798616539 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265639096 0 0) 0x7eff5406cbc0 con 0x7eff540cd240 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.324+0000 7eff58c2d640 1 -- 172.21.15.161:0/1798616539 >> v1:172.21.15.175:6789/0 conn(0x7eff540cd240 legacy=0x7eff54099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.324+0000 7eff58c2d640 1 -- 172.21.15.161:0/1798616539 >> v1:172.21.15.161:6789/0 conn(0x7eff5409a170 legacy=0x7eff540cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.324+0000 7eff58c2d640 1 -- 172.21.15.161:0/1798616539 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5406f630 con 0x7eff5406c6b0 2023-11-24T08:00:23.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.325+0000 7eff58c2d640 1 --2- 172.21.15.161:0/1798616539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5406c6b0 0x7eff540b3820 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009dc0 tx=0x7eff4c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7187321fffbc99f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.326+0000 7eff537fe640 1 -- 172.21.15.161:0/1798616539 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c02ccd0 con 0x7eff5406c6b0 2023-11-24T08:00:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.326+0000 7eff537fe640 1 -- 172.21.15.161:0/1798616539 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c02ce30 con 0x7eff5406c6b0 2023-11-24T08:00:23.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.326+0000 7eff537fe640 1 -- 172.21.15.161:0/1798616539 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c034660 con 0x7eff5406c6b0 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 -- 172.21.15.161:0/1798616539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5406c6b0 msgr2=0x7eff540b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 --2- 172.21.15.161:0/1798616539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5406c6b0 0x7eff540b3820 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7eff4c009dc0 tx=0x7eff4c02bf20 comp rx=0 tx=0).stop 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 -- 172.21.15.161:0/1798616539 shutdown_connections 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 --2- 172.21.15.161:0/1798616539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff5406c6b0 0x7eff540b3820 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 -- 172.21.15.161:0/1798616539 >> 172.21.15.161:0/1798616539 conn(0x7eff540b2d00 msgr2=0x7eff540b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 -- 172.21.15.161:0/1798616539 shutdown_connections 2023-11-24T08:00:23.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.327+0000 7eff5a690640 1 -- 172.21.15.161:0/1798616539 wait complete. 2023-11-24T08:00:23.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.328+0000 7eff5a690640 1 Processor -- start 2023-11-24T08:00:23.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.329+0000 7eff5a690640 1 -- start start 2023-11-24T08:00:23.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.329+0000 7eff5a690640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 0x7eff540b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:23.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.329+0000 7eff5a690640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5409a170 0x7eff5415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:23.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff5a690640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff540cd240 0x7eff540c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:23.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff5a690640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540c82e0 con 0x7eff5406c6b0 2023-11-24T08:00:23.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff5a690640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540c8530 con 0x7eff5409a170 2023-11-24T08:00:23.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff5a690640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540c8810 con 0x7eff540cd240 2023-11-24T08:00:23.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff53fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 0x7eff540b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:23.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff53fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 0x7eff540b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33632/0 (socket says 172.21.15.161:33632) 2023-11-24T08:00:23.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff53fff640 1 -- 172.21.15.161:0/2741888957 learned_addr learned my addr 172.21.15.161:0/2741888957 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:23.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff58c2d640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff540cd240 0x7eff540c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:23.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.330+0000 7eff4b7fe640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5409a170 0x7eff5415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:23.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.331+0000 7eff53fff640 1 -- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff540cd240 msgr2=0x7eff540c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.331+0000 7eff53fff640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff540cd240 0x7eff540c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.331+0000 7eff53fff640 1 -- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5409a170 msgr2=0x7eff5415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:23.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.331+0000 7eff53fff640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5409a170 0x7eff5415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:23.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.331+0000 7eff53fff640 1 -- 172.21.15.161:0/2741888957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009a70 con 0x7eff5406c6b0 2023-11-24T08:00:23.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.331+0000 7eff53fff640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 0x7eff540b41d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff4400c4a0 tx=0x7eff4400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.423+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440074e0 con 0x7eff5406c6b0 2023-11-24T08:00:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.423+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff44007640 con 0x7eff5406c6b0 2023-11-24T08:00:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.423+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff44004a00 con 0x7eff5406c6b0 2023-11-24T08:00:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.423+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff540c8af0 con 0x7eff5406c6b0 2023-11-24T08:00:23.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.423+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540c5cc0 con 0x7eff5406c6b0 2023-11-24T08:00:23.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.425+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff540675d0 con 0x7eff5406c6b0 2023-11-24T08:00:23.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.429+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7eff4401b360 con 0x7eff5406c6b0 2023-11-24T08:00:23.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.431+0000 7eff517fa640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7eff3406ae00 0x7eff3406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:23.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.431+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff44088a90 con 0x7eff5406c6b0 2023-11-24T08:00:23.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.431+0000 7eff4b7fe640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7eff3406ae00 0x7eff3406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:23.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.433+0000 7eff4b7fe640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7eff3406ae00 0x7eff3406d2c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff5406c270 tx=0x7eff3c000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:23.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.434+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff44054190 con 0x7eff5406c6b0 2023-11-24T08:00:23.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.442+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff44054560 con 0x7eff5406c6b0 2023-11-24T08:00:23.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:23.640+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7eff54099e70 con 0x7eff5406c6b0 2023-11-24T08:00:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.438+0000 7eff517fa640 1 -- 172.21.15.161:0/2741888957 <== mon.0 v2:172.21.15.161:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7eff44018020 con 0x7eff5406c6b0 2023-11-24T08:00:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2023-11-24T08:00:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7eff3406ae00 msgr2=0x7eff3406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7eff3406ae00 0x7eff3406d2c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff5406c270 tx=0x7eff3c000ed0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 msgr2=0x7eff540b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 0x7eff540b41d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7eff4400c4a0 tx=0x7eff4400c960 comp rx=0 tx=0).stop 2023-11-24T08:00:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 shutdown_connections 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7eff3406ae00 0x7eff3406d2c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff540cd240 0x7eff540c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff5409a170 0x7eff5415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 --2- 172.21.15.161:0/2741888957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff5406c6b0 0x7eff540b41d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 >> 172.21.15.161:0/2741888957 conn(0x7eff540b2d00 msgr2=0x7eff540733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 shutdown_connections 2023-11-24T08:00:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.442+0000 7eff5a690640 1 -- 172.21.15.161:0/2741888957 wait complete. 2023-11-24T08:00:24.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:00:24.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.673+0000 7f9f68b33640 1 Processor -- start 2023-11-24T08:00:24.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.673+0000 7f9f68b33640 1 -- start start 2023-11-24T08:00:24.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.675+0000 7f9f68b33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 0x7f9f640cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.675+0000 7f9f68b33640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f640b35a0 con 0x7f9f64159a90 2023-11-24T08:00:24.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.675+0000 7f9f68b33640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f640b2990 con 0x7f9f640b3a30 2023-11-24T08:00:24.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.675+0000 7f9f68b33640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6406cba0 con 0x7f9f64071400 2023-11-24T08:00:24.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.675+0000 7f9f6259c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9f64159a90 0x7f9f6406c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51198/0 (socket says 172.21.15.161:51198) 2023-11-24T08:00:24.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.675+0000 7f9f6259c640 1 -- 172.21.15.161:0/1117050480 learned_addr learned my addr 172.21.15.161:0/1117050480 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:24.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809182943 0 0) 0x7f9f640b35a0 con 0x7f9f64159a90 2023-11-24T08:00:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c003520 con 0x7f9f64159a90 2023-11-24T08:00:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 0x7f9f640cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2060616930 0 0) 0x7f9f4c003520 con 0x7f9f64159a90 2023-11-24T08:00:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 msgr2=0x7f9f640cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 0x7f9f640cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 >> v1:172.21.15.175:6789/0 conn(0x7f9f640b3a30 legacy=0x7f9f64070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f640b2c70 con 0x7f9f64159a90 2023-11-24T08:00:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f9f54001670 con 0x7f9f64159a90 2023-11-24T08:00:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 >> v1:172.21.15.161:6789/0 conn(0x7f9f64159a90 legacy=0x7f9f6406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 0x7f9f4c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c003fd0 0x7f9f4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004d00 0x7f9f4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6406cba0 con 0x7f9f4c004d00 2023-11-24T08:00:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.676+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c00bb40 con 0x7f9f4c003fd0 2023-11-24T08:00:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c00df10 con 0x7f9f64071400 2023-11-24T08:00:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004d00 0x7f9f4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f6259c640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 0x7f9f4c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f61d9b640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c003fd0 0x7f9f4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f62d9d640 1 -- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 msgr2=0x7f9f4c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f64071400 0x7f9f4c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f62d9d640 1 -- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c003fd0 msgr2=0x7f9f4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c003fd0 0x7f9f4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f62d9d640 1 -- 172.21.15.161:0/1117050480 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c003520 con 0x7f9f4c004d00 2023-11-24T08:00:24.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.677+0000 7f9f61d9b640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c003fd0 0x7f9f4c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:24.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.678+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004d00 0x7f9f4c005180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c007360 tx=0x7f9f4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40da63188012b48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:24.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.678+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c02ccd0 con 0x7f9f4c004d00 2023-11-24T08:00:24.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.678+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c02ce30 con 0x7f9f4c004d00 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.678+0000 7f9f6159a640 1 -- 172.21.15.161:0/1117050480 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c034660 con 0x7f9f4c004d00 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f68b33640 1 -- 172.21.15.161:0/1117050480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004d00 msgr2=0x7f9f4c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f68b33640 1 --2- 172.21.15.161:0/1117050480 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f4c004d00 0x7f9f4c005180 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c007360 tx=0x7f9f4c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f62d9d640 1 -- 172.21.15.161:0/1117050480 reap_dead start 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f68b33640 1 -- 172.21.15.161:0/1117050480 shutdown_connections 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f68b33640 1 -- 172.21.15.161:0/1117050480 >> 172.21.15.161:0/1117050480 conn(0x7f9f640b0be0 msgr2=0x7f9f640b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:24.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f68b33640 1 -- 172.21.15.161:0/1117050480 shutdown_connections 2023-11-24T08:00:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.679+0000 7f9f68b33640 1 -- 172.21.15.161:0/1117050480 wait complete. 2023-11-24T08:00:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.681+0000 7f9f68b33640 1 Processor -- start 2023-11-24T08:00:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.681+0000 7f9f68b33640 1 -- start start 2023-11-24T08:00:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f68b33640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c004d00 0x7f9f6414d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f68b33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 0x7f9f641546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f68b33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f641e1f70 0x7f9f641e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f68b33640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641e3920 con 0x7f9f64154230 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f68b33640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64154bf0 con 0x7f9f4c004d00 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f68b33640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641e2da0 con 0x7f9f641e1f70 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 0x7f9f641546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 0x7f9f641546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33654/0 (socket says 172.21.15.161:33654) 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 -- 172.21.15.161:0/3188223921 learned_addr learned my addr 172.21.15.161:0/3188223921 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:24.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f641e1f70 0x7f9f641e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f6259c640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c004d00 0x7f9f6414d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 -- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f641e1f70 msgr2=0x7f9f641e23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f641e1f70 0x7f9f641e23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 -- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c004d00 msgr2=0x7f9f6414d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c004d00 0x7f9f6414d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:24.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f61d9b640 1 -- 172.21.15.161:0/3188223921 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f641e3080 con 0x7f9f64154230 2023-11-24T08:00:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.683+0000 7f9f62d9d640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f641e1f70 0x7f9f641e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.684+0000 7f9f61d9b640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 0x7f9f641546b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800d770 tx=0x7f9f5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.684+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f58005270 con 0x7f9f64154230 2023-11-24T08:00:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.684+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f580053d0 con 0x7f9f64154230 2023-11-24T08:00:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.684+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5800b8f0 con 0x7f9f64154230 2023-11-24T08:00:24.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.684+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f641e3360 con 0x7f9f64154230 2023-11-24T08:00:24.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.684+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6414d790 con 0x7f9f64154230 2023-11-24T08:00:24.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.685+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6414d950 con 0x7f9f64154230 2023-11-24T08:00:24.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.686+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f5800ba50 con 0x7f9f64154230 2023-11-24T08:00:24.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.687+0000 7f9f52ffd640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f4406ae40 0x7f9f4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:24.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.687+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9f58089400 con 0x7f9f64154230 2023-11-24T08:00:24.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.688+0000 7f9f6259c640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f4406ae40 0x7f9f4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:24.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.689+0000 7f9f6259c640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f4406ae40 0x7f9f4406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000f60 tx=0x7f9f54000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:24.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.693+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f6414d950 con 0x7f9f64154230 2023-11-24T08:00:24.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:24.889+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f6414d950 con 0x7f9f64154230 2023-11-24T08:00:25.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.445+0000 7f9f52ffd640 1 -- 172.21.15.161:0/3188223921 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f6414d950 con 0x7f9f64154230 2023-11-24T08:00:25.447 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2023-11-24T08:00:25.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f4406ae40 msgr2=0x7f9f4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f4406ae40 0x7f9f4406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9f54000f60 tx=0x7f9f54000ed0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 msgr2=0x7f9f641546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 0x7f9f641546b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f5800d770 tx=0x7f9f5800dc30 comp rx=0 tx=0).stop 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 shutdown_connections 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f4406ae40 0x7f9f4406d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f641e1f70 0x7f9f641e23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f64154230 0x7f9f641546b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 --2- 172.21.15.161:0/3188223921 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f4c004d00 0x7f9f6414d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 >> 172.21.15.161:0/3188223921 conn(0x7f9f640b0be0 msgr2=0x7f9f6414e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 shutdown_connections 2023-11-24T08:00:25.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.449+0000 7f9f68b33640 1 -- 172.21.15.161:0/3188223921 wait complete. 2023-11-24T08:00:25.486 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:00:25.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.671+0000 7f427dcc9640 1 Processor -- start 2023-11-24T08:00:25.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.672+0000 7f427dcc9640 1 -- start start 2023-11-24T08:00:25.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.673+0000 7f427dcc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42780715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.673+0000 7f427dcc9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427815b700 con 0x7f42781547a0 2023-11-24T08:00:25.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.673+0000 7f427dcc9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4278071ae0 con 0x7f427806bb00 2023-11-24T08:00:25.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.673+0000 7f427dcc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427815e7b0 con 0x7f427815b290 2023-11-24T08:00:25.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.673+0000 7f42777fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f42781547a0 0x7f427806b3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51208/0 (socket says 172.21.15.161:51208) 2023-11-24T08:00:25.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.673+0000 7f42777fe640 1 -- 172.21.15.161:0/818003906 learned_addr learned my addr 172.21.15.161:0/818003906 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4277fff640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42780715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593735639 0 0) 0x7f427815b700 con 0x7f42781547a0 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4264003520 con 0x7f42781547a0 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034774736 0 0) 0x7f4264003520 con 0x7f42781547a0 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 msgr2=0x7f42780715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42780715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 >> v1:172.21.15.175:6789/0 conn(0x7f427806bb00 legacy=0x7f42780b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278071d40 con 0x7f42781547a0 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f4268001670 con 0x7f42781547a0 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 >> v1:172.21.15.161:6789/0 conn(0x7f42781547a0 legacy=0x7f427806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4264003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4264004d00 0x7f4264005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427815e7b0 con 0x7f42640039a0 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426400bb60 con 0x7f4264004d00 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.674+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426400df30 con 0x7f427815b290 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f42777fe640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4264003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f426ffff640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f4277fff640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4264004d00 0x7f4264005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f42777fe640 1 -- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 msgr2=0x7f42640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f42777fe640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f42777fe640 1 -- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4264004d00 msgr2=0x7f4264005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f42777fe640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4264004d00 0x7f4264005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f42777fe640 1 -- 172.21.15.161:0/818003906 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264003520 con 0x7f42640039a0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.675+0000 7f426ffff640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f427815b290 0x7f42640047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.676+0000 7f42777fe640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4264003dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f426800c190 tx=0x7f42640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20b586dd587cb7bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.676+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268005ad0 con 0x7f42640039a0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.676+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4268005c30 con 0x7f42640039a0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.676+0000 7f4276ffd640 1 -- 172.21.15.161:0/818003906 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426802c8a0 con 0x7f42640039a0 2023-11-24T08:00:25.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f427dcc9640 1 -- 172.21.15.161:0/818003906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 msgr2=0x7f4264003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f427dcc9640 1 --2- 172.21.15.161:0/818003906 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4264003dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f426800c190 tx=0x7f42640057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f4277fff640 1 -- 172.21.15.161:0/818003906 reap_dead start 2023-11-24T08:00:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f427dcc9640 1 -- 172.21.15.161:0/818003906 shutdown_connections 2023-11-24T08:00:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f427dcc9640 1 -- 172.21.15.161:0/818003906 >> 172.21.15.161:0/818003906 conn(0x7f4278070a80 msgr2=0x7f4278070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f427dcc9640 1 -- 172.21.15.161:0/818003906 shutdown_connections 2023-11-24T08:00:25.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.677+0000 7f427dcc9640 1 -- 172.21.15.161:0/818003906 wait complete. 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.679+0000 7f427dcc9640 1 Processor -- start 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.679+0000 7f427dcc9640 1 -- start start 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f427dcc9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4278154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f427dcc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42781552d0 0x7f42780c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f427dcc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42780c9f10 0x7f427814e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f427dcc9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427814d130 con 0x7f42640039a0 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f427dcc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427814d380 con 0x7f42781552d0 2023-11-24T08:00:25.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f427dcc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427814d660 con 0x7f42780c9f10 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f42777fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4278154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f42777fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4278154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33674/0 (socket says 172.21.15.161:33674) 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.680+0000 7f42777fe640 1 -- 172.21.15.161:0/3518151885 learned_addr learned my addr 172.21.15.161:0/3518151885 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f426ffff640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42781552d0 0x7f42780c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f4277fff640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42780c9f10 0x7f427814e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f42777fe640 1 -- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42780c9f10 msgr2=0x7f427814e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f42777fe640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42780c9f10 0x7f427814e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f42777fe640 1 -- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42781552d0 msgr2=0x7f42780c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f42777fe640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42781552d0 0x7f42780c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f42777fe640 1 -- 172.21.15.161:0/3518151885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427814d940 con 0x7f42640039a0 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f42777fe640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4278154d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f426802c440 tx=0x7f427815e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:25.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4268039030 con 0x7f42640039a0 2023-11-24T08:00:25.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426802ccb0 con 0x7f42640039a0 2023-11-24T08:00:25.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426803c040 con 0x7f42640039a0 2023-11-24T08:00:25.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427814dc20 con 0x7f42640039a0 2023-11-24T08:00:25.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.681+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780b3500 con 0x7f42640039a0 2023-11-24T08:00:25.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.683+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42780675d0 con 0x7f42640039a0 2023-11-24T08:00:25.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.684+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4268032070 con 0x7f42640039a0 2023-11-24T08:00:25.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.684+0000 7f4274ff9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f425806ae40 0x7f425806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:25.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.685+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f42680aaa10 con 0x7f42640039a0 2023-11-24T08:00:25.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.685+0000 7f426ffff640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f425806ae40 0x7f425806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:25.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.686+0000 7f426ffff640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f425806ae40 0x7f425806d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f427814edf0 tx=0x7f4260009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:25.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.690+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4268075b10 con 0x7f42640039a0 2023-11-24T08:00:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:25.918+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4278159b70 con 0x7f42640039a0 2023-11-24T08:00:26.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.752+0000 7f4274ff9640 1 -- 172.21.15.161:0/3518151885 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4268079130 con 0x7f42640039a0 2023-11-24T08:00:26.758 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T08:00:26.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.762+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f425806ae40 msgr2=0x7f425806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.762+0000 7f427dcc9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f425806ae40 0x7f425806d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f427814edf0 tx=0x7f4260009040 comp rx=0 tx=0).stop 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.762+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 msgr2=0x7f4278154d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.762+0000 7f427dcc9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4278154d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f426802c440 tx=0x7f427815e6b0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.763+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 shutdown_connections 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.763+0000 7f427dcc9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f425806ae40 0x7f425806d300 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f427814edf0 tx=0x7f4260009040 comp rx=0 tx=0).stop 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.763+0000 7f427dcc9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42780c9f10 0x7f427814e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.763+0000 7f427dcc9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42781552d0 0x7f42780c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.763+0000 7f427dcc9640 1 --2- 172.21.15.161:0/3518151885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42640039a0 0x7f4278154d90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.763+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 >> 172.21.15.161:0/3518151885 conn(0x7f4278070a80 msgr2=0x7f4278159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:26.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.765+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 shutdown_connections 2023-11-24T08:00:26.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.765+0000 7f427dcc9640 1 -- 172.21.15.161:0/3518151885 wait complete. 2023-11-24T08:00:26.797 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:26.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.976+0000 7fc2b759e640 1 Processor -- start 2023-11-24T08:00:26.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.977+0000 7fc2b759e640 1 -- start start 2023-11-24T08:00:26.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.978+0000 7fc2b759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 0x7fc2b806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.978+0000 7fc2b759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8070e50 con 0x7fc2b8143c40 2023-11-24T08:00:26.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.978+0000 7fc2b759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8144020 con 0x7fc2b80cc500 2023-11-24T08:00:26.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.978+0000 7fc2b759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80723c0 con 0x7fc2b80cc990 2023-11-24T08:00:26.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.978+0000 7fc2b659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc2b8143c40 0x7fc2b8071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51216/0 (socket says 172.21.15.161:51216) 2023-11-24T08:00:26.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.978+0000 7fc2b659c640 1 -- 172.21.15.161:0/850682203 learned_addr learned my addr 172.21.15.161:0/850682203 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:26.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b6d9d640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 0x7fc2b806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3395300017 0 0) 0x7fc2b8070e50 con 0x7fc2b8143c40 2023-11-24T08:00:26.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2a4003520 con 0x7fc2b8143c40 2023-11-24T08:00:26.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1204022090 0 0) 0x7fc2a4003520 con 0x7fc2b8143c40 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 msgr2=0x7fc2b806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 0x7fc2b806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 >> v1:172.21.15.175:6789/0 conn(0x7fc2b80cc500 legacy=0x7fc2b806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8071e00 con 0x7fc2b8143c40 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc2a8001690 con 0x7fc2b8143c40 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 >> v1:172.21.15.161:6789/0 conn(0x7fc2b8143c40 legacy=0x7fc2b8071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2a40039a0 0x7fc2a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a40047c0 0x7fc2a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 0x7fc2a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b80723c0 con 0x7fc2a40039a0 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a4005510 con 0x7fc2a40047c0 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.979+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a400bec0 con 0x7fc2b80cc990 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2b659c640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2a40039a0 0x7fc2a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2add9b640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a40047c0 0x7fc2a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2b659c640 1 -- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 msgr2=0x7fc2a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2b659c640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b80cc990 0x7fc2a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2b659c640 1 -- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a40047c0 msgr2=0x7fc2a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2b659c640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a40047c0 0x7fc2a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2b659c640 1 -- 172.21.15.161:0/850682203 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a4003520 con 0x7fc2a40039a0 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.980+0000 7fc2add9b640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2a40047c0 0x7fc2a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.981+0000 7fc2b659c640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2a40039a0 0x7fc2a4003dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80cbd00 tx=0x7fc2a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484022f1b46cff04 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.981+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8005ad0 con 0x7fc2a40039a0 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.981+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a8005c30 con 0x7fc2a40039a0 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.981+0000 7fc2b5d9b640 1 -- 172.21.15.161:0/850682203 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a802c8a0 con 0x7fc2a40039a0 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b759e640 1 -- 172.21.15.161:0/850682203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2a40039a0 msgr2=0x7fc2a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b759e640 1 --2- 172.21.15.161:0/850682203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2a40039a0 0x7fc2a4003dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2b80cbd00 tx=0x7fc2a40057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b6d9d640 1 -- 172.21.15.161:0/850682203 reap_dead start 2023-11-24T08:00:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b759e640 1 -- 172.21.15.161:0/850682203 shutdown_connections 2023-11-24T08:00:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b759e640 1 -- 172.21.15.161:0/850682203 >> 172.21.15.161:0/850682203 conn(0x7fc2b806a800 msgr2=0x7fc2b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b759e640 1 -- 172.21.15.161:0/850682203 shutdown_connections 2023-11-24T08:00:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.982+0000 7fc2b759e640 1 -- 172.21.15.161:0/850682203 wait complete. 2023-11-24T08:00:26.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.984+0000 7fc2b759e640 1 Processor -- start 2023-11-24T08:00:26.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.984+0000 7fc2b759e640 1 -- start start 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2a40039a0 0x7fc2b814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80adec0 0x7fc2b8150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 0x7fc2b813e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b814ed80 con 0x7fc2b80ac370 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b813af30 con 0x7fc2b80adec0 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b814fb80 con 0x7fc2a40039a0 2023-11-24T08:00:26.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 0x7fc2b813e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 0x7fc2b813e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33694/0 (socket says 172.21.15.161:33694) 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 -- 172.21.15.161:0/3231793568 learned_addr learned my addr 172.21.15.161:0/3231793568 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2add9b640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80adec0 0x7fc2b8150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b659c640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2a40039a0 0x7fc2b814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 -- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2a40039a0 msgr2=0x7fc2b814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2a40039a0 0x7fc2b814e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 -- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80adec0 msgr2=0x7fc2b8150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80adec0 0x7fc2b8150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.985+0000 7fc2b6d9d640 1 -- 172.21.15.161:0/3231793568 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b814ef70 con 0x7fc2b80ac370 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.986+0000 7fc2b6d9d640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 0x7fc2b813e240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0007cc0 tx=0x7fc2b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.986+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0018070 con 0x7fc2b80ac370 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.986+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b000ebc0 con 0x7fc2b80ac370 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.986+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b814f250 con 0x7fc2b80ac370 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.986+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0003990 con 0x7fc2b80ac370 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.986+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b814f810 con 0x7fc2b80ac370 2023-11-24T08:00:26.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.987+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b814f9d0 con 0x7fc2b80ac370 2023-11-24T08:00:26.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.988+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2b0014420 con 0x7fc2b80ac370 2023-11-24T08:00:26.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.989+0000 7fc2af7fe640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc29806ae70 0x7fc29806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:26.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.989+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2b0089530 con 0x7fc2b80ac370 2023-11-24T08:00:26.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.990+0000 7fc2b659c640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc29806ae70 0x7fc29806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:26.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.990+0000 7fc2b659c640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc29806ae70 0x7fc29806d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8034000 tx=0x7fc2a8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:26.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:26.993+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2b00544b0 con 0x7fc2b80ac370 2023-11-24T08:00:27.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.184+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2b813c230 con 0x7fc2b80ac370 2023-11-24T08:00:27.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.187+0000 7fc2af7fe640 1 -- 172.21.15.161:0/3231793568 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fc2b00097a0 con 0x7fc2b80ac370 2023-11-24T08:00:27.190 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:27.190 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":21,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:25.920560+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:27.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc29806ae70 msgr2=0x7fc29806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc29806ae70 0x7fc29806d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8034000 tx=0x7fc2a8009030 comp rx=0 tx=0).stop 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 msgr2=0x7fc2b813e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 0x7fc2b813e240 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0007cc0 tx=0x7fc2b000e4b0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 shutdown_connections 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc29806ae70 0x7fc29806d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2b80ac370 0x7fc2b813e240 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b80adec0 0x7fc2b8150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 --2- 172.21.15.161:0/3231793568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2a40039a0 0x7fc2b814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 >> 172.21.15.161:0/3231793568 conn(0x7fc2b806a800 msgr2=0x7fc2b80af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:27.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.190+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 shutdown_connections 2023-11-24T08:00:27.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.191+0000 7fc2b759e640 1 -- 172.21.15.161:0/3231793568 wait complete. 2023-11-24T08:00:27.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:27.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.403+0000 7ff238133640 1 Processor -- start 2023-11-24T08:00:27.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.403+0000 7ff238133640 1 -- start start 2023-11-24T08:00:27.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.404+0000 7ff238133640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23015d610 0x7ff2300ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.404+0000 7ff238133640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2300d1ef0 0x7ff2300b3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.404+0000 7ff238133640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2300b3400 con 0x7ff2300ced60 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff238133640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2300d1390 con 0x7ff2300d1ef0 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff238133640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b27f0 con 0x7ff23015d610 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2366d0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff2300d1ef0 0x7ff2300b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2356ce640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff2300ced60 0x7ff2300d17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51224/0 (socket says 172.21.15.161:51224) 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2356ce640 1 -- 172.21.15.161:0/615004258 learned_addr learned my addr 172.21.15.161:0/615004258 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff235ecf640 1 --2- 172.21.15.161:0/615004258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23015d610 0x7ff2300ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff234ecd640 1 -- 172.21.15.161:0/615004258 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536667104 0 0) 0x7ff2300b3400 con 0x7ff2300ced60 2023-11-24T08:00:27.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff234ecd640 1 -- 172.21.15.161:0/615004258 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff21c003520 con 0x7ff2300ced60 2023-11-24T08:00:27.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2366d0640 1 -- 172.21.15.161:0/615004258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23015d610 msgr2=0x7ff2300ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:27.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2366d0640 1 --2- 172.21.15.161:0/615004258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23015d610 0x7ff2300ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2366d0640 1 -- 172.21.15.161:0/615004258 >> v1:172.21.15.161:6789/0 conn(0x7ff2300ced60 legacy=0x7ff2300d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.405+0000 7ff2366d0640 1 -- 172.21.15.161:0/615004258 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2300b2ad0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.407+0000 7ff2366d0640 1 --2- 172.21.15.161:0/615004258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff2300b3890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff228009d90 tx=0x7ff22802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2164ee75cd33b404 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:27.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.407+0000 7ff234ecd640 1 -- 172.21.15.161:0/615004258 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22802cc50 con 0x7ff2300d1ef0 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.407+0000 7ff234ecd640 1 -- 172.21.15.161:0/615004258 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22802cdb0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.407+0000 7ff234ecd640 1 -- 172.21.15.161:0/615004258 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228034660 con 0x7ff2300d1ef0 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 -- 172.21.15.161:0/615004258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 msgr2=0x7ff2300b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 --2- 172.21.15.161:0/615004258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff2300b3890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff228009d90 tx=0x7ff22802bea0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 -- 172.21.15.161:0/615004258 shutdown_connections 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 --2- 172.21.15.161:0/615004258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff2300b3890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 --2- 172.21.15.161:0/615004258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23015d610 0x7ff2300ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 -- 172.21.15.161:0/615004258 >> 172.21.15.161:0/615004258 conn(0x7ff23009c540 msgr2=0x7ff2300d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:27.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 -- 172.21.15.161:0/615004258 shutdown_connections 2023-11-24T08:00:27.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.408+0000 7ff238133640 1 -- 172.21.15.161:0/615004258 wait complete. 2023-11-24T08:00:27.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.410+0000 7ff238133640 1 Processor -- start 2023-11-24T08:00:27.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.410+0000 7ff238133640 1 -- start start 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.411+0000 7ff238133640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300ced60 0x7ff230151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff238133640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff23015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff238133640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23015d610 0x7ff23015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff238133640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff230151bc0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff238133640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b6050 con 0x7ff23015d610 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff238133640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300b6330 con 0x7ff2300ced60 2023-11-24T08:00:27.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff23015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff23015afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33704/0 (socket says 172.21.15.161:33704) 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 -- 172.21.15.161:0/2637475187 learned_addr learned my addr 172.21.15.161:0/2637475187 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 -- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300ced60 msgr2=0x7ff230151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2366d0640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23015d610 0x7ff23015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300ced60 0x7ff230151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 -- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23015d610 msgr2=0x7ff23015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23015d610 0x7ff23015b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 -- 172.21.15.161:0/2637475187 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff228009a70 con 0x7ff2300d1ef0 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.412+0000 7ff2356ce640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff23015afc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c500 tx=0x7ff22000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.413+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220005ce0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.413+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff220005e40 con 0x7ff2300d1ef0 2023-11-24T08:00:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.413+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220007330 con 0x7ff2300d1ef0 2023-11-24T08:00:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.413+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2300b6610 con 0x7ff2300d1ef0 2023-11-24T08:00:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.413+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2300b6bd0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.414+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2300b6dc0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.415+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff220007550 con 0x7ff2300d1ef0 2023-11-24T08:00:27.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.416+0000 7ff2267fc640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff21406ae40 0x7ff21406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.416+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff220088cc0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.416+0000 7ff235ecf640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff21406ae40 0x7ff21406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.417+0000 7ff235ecf640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff21406ae40 0x7ff21406d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006fd0 tx=0x7ff22c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:27.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.420+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff22008f080 con 0x7ff2300d1ef0 2023-11-24T08:00:27.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.608+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2300675d0 con 0x7ff2300d1ef0 2023-11-24T08:00:27.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.611+0000 7ff2267fc640 1 -- 172.21.15.161:0/2637475187 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16542 (secure 0 0 0) 0x7ff220017020 con 0x7ff2300d1ef0 2023-11-24T08:00:27.614 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:27.615 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":21,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:25.920560+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:27.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff21406ae40 msgr2=0x7ff21406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff21406ae40 0x7ff21406d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff22c006fd0 tx=0x7ff22c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 msgr2=0x7ff23015afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff23015afc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff22000c500 tx=0x7ff22000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 shutdown_connections 2023-11-24T08:00:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff21406ae40 0x7ff21406d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff23015d610 0x7ff23015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff2300d1ef0 0x7ff23015afc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 --2- 172.21.15.161:0/2637475187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2300ced60 0x7ff230151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 >> 172.21.15.161:0/2637475187 conn(0x7ff23009c540 msgr2=0x7ff2300b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:27.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 shutdown_connections 2023-11-24T08:00:27.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.614+0000 7ff238133640 1 -- 172.21.15.161:0/2637475187 wait complete. 2023-11-24T08:00:27.635 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:00:27.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.843+0000 7fbaf3251640 1 Processor -- start 2023-11-24T08:00:27.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.843+0000 7fbaf3251640 1 -- start start 2023-11-24T08:00:27.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaf3251640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaec06a3e0 0x7fbaec0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaf3251640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 0x7fbaec06f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaf3251640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaec071de0 con 0x7fbaec0d0b60 2023-11-24T08:00:27.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaf3251640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec0af270 con 0x7fbaec06a3e0 2023-11-24T08:00:27.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaf3251640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec072030 con 0x7fbaec0aede0 2023-11-24T08:00:27.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaebfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbaec0d0b60 0x7fbaec06a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51238/0 (socket says 172.21.15.161:51238) 2023-11-24T08:00:27.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.845+0000 7fbaebfff640 1 -- 172.21.15.161:0/796562768 learned_addr learned my addr 172.21.15.161:0/796562768 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:27.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaf17ee640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 0x7fbaec06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaf0fed640 1 --2- 172.21.15.161:0/796562768 >> v2:172.21.15.175:3300/0 conn(0x7fbaec06a3e0 0x7fbaec0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707710371 0 0) 0x7fbaec071de0 con 0x7fbaec0d0b60 2023-11-24T08:00:27.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbadc003520 con 0x7fbaec0d0b60 2023-11-24T08:00:27.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 628393172 0 0) 0x7fbadc003520 con 0x7fbaec0d0b60 2023-11-24T08:00:27.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 msgr2=0x7fbaec06f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:27.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 0x7fbaec06f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 >> v2:172.21.15.175:3300/0 conn(0x7fbaec06a3e0 msgr2=0x7fbaec0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:27.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 --2- 172.21.15.161:0/796562768 >> v2:172.21.15.175:3300/0 conn(0x7fbaec06a3e0 0x7fbaec0ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec072310 con 0x7fbaec0d0b60 2023-11-24T08:00:27.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fbad8001670 con 0x7fbaec0d0b60 2023-11-24T08:00:27.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 >> v1:172.21.15.161:6789/0 conn(0x7fbaec0d0b60 legacy=0x7fbaec06a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 0x7fbadc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003f40 0x7fbadc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbadc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0af270 con 0x7fbadc004d00 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec072030 con 0x7fbadc003f40 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.846+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbadc00b980 con 0x7fbaec0aede0 2023-11-24T08:00:27.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaf17ee640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbadc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaebfff640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003f40 0x7fbadc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaf17ee640 1 -- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 msgr2=0x7fbadc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaf17ee640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec0aede0 0x7fbadc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaf17ee640 1 -- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003f40 msgr2=0x7fbadc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaf17ee640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003f40 0x7fbadc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.847+0000 7fbaf17ee640 1 -- 172.21.15.161:0/796562768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc003520 con 0x7fbadc004d00 2023-11-24T08:00:27.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.848+0000 7fbaf17ee640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbadc005180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbae400e170 tx=0x7fbadc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1a53d70287067e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.848+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae402cc20 con 0x7fbadc004d00 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.848+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae400f040 con 0x7fbadc004d00 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.848+0000 7fbaeb7fe640 1 -- 172.21.15.161:0/796562768 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4034440 con 0x7fbadc004d00 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf3251640 1 -- 172.21.15.161:0/796562768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 msgr2=0x7fbadc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf3251640 1 --2- 172.21.15.161:0/796562768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbadc005180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbae400e170 tx=0x7fbadc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf17ee640 1 -- 172.21.15.161:0/796562768 reap_dead start 2023-11-24T08:00:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf3251640 1 -- 172.21.15.161:0/796562768 shutdown_connections 2023-11-24T08:00:27.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf3251640 1 -- 172.21.15.161:0/796562768 >> 172.21.15.161:0/796562768 conn(0x7fbaec0cfef0 msgr2=0x7fbaec0d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:27.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf3251640 1 -- 172.21.15.161:0/796562768 shutdown_connections 2023-11-24T08:00:27.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.849+0000 7fbaf3251640 1 -- 172.21.15.161:0/796562768 wait complete. 2023-11-24T08:00:27.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.851+0000 7fbaf3251640 1 Processor -- start 2023-11-24T08:00:27.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.851+0000 7fbaf3251640 1 -- start start 2023-11-24T08:00:27.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf3251640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbaec14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf3251640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec15ff90 0x7fbaec14ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf3251640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec151030 0x7fbaec1514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf3251640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec14fb70 con 0x7fbadc004d00 2023-11-24T08:00:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf3251640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec15fb00 con 0x7fbaec15ff90 2023-11-24T08:00:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf3251640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec14e030 con 0x7fbaec151030 2023-11-24T08:00:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbaec14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbaec14daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33714/0 (socket says 172.21.15.161:33714) 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 -- 172.21.15.161:0/970655865 learned_addr learned my addr 172.21.15.161:0/970655865 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 -- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec151030 msgr2=0x7fbaec1514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec151030 0x7fbaec1514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 -- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec15ff90 msgr2=0x7fbaec14ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec15ff90 0x7fbaec14ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.852+0000 7fbaf0fed640 1 -- 172.21.15.161:0/970655865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec14f5b0 con 0x7fbadc004d00 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.853+0000 7fbaf0fed640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbaec14daf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e7f0 tx=0x7fbae000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.853+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000c8c0 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.853+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae000ca20 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.853+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae000cdd0 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.853+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaec14f890 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.853+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec1519f0 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.854+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec15f5c0 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.855+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbae0013470 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.856+0000 7fbae97fa640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbad006ae70 0x7fbad006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.856+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbae00896b0 con 0x7fbadc004d00 2023-11-24T08:00:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.856+0000 7fbaebfff640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbad006ae70 0x7fbad006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:27.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.857+0000 7fbaebfff640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbad006ae70 0x7fbad006d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbaec1554d0 tx=0x7fbad8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:27.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:27.860+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbae00546c0 con 0x7fbadc004d00 2023-11-24T08:00:28.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.086+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbaec0675d0 con 0x7fbadc004d00 2023-11-24T08:00:28.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.769+0000 7fbae97fa640 1 -- 172.21.15.161:0/970655865 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbae0057ce0 con 0x7fbadc004d00 2023-11-24T08:00:28.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbad006ae70 msgr2=0x7fbad006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:28.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbad006ae70 0x7fbad006d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbaec1554d0 tx=0x7fbad8009040 comp rx=0 tx=0).stop 2023-11-24T08:00:28.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 msgr2=0x7fbaec14daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:28.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbaec14daf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbae000e7f0 tx=0x7fbae000ecb0 comp rx=0 tx=0).stop 2023-11-24T08:00:28.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 shutdown_connections 2023-11-24T08:00:28.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbad006ae70 0x7fbad006d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:28.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaec151030 0x7fbaec1514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:28.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaec15ff90 0x7fbaec14ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:28.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 --2- 172.21.15.161:0/970655865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbadc004d00 0x7fbaec14daf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:28.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 >> 172.21.15.161:0/970655865 conn(0x7fbaec0cfef0 msgr2=0x7fbaec0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:28.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 shutdown_connections 2023-11-24T08:00:28.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:28.773+0000 7fbaf3251640 1 -- 172.21.15.161:0/970655865 wait complete. 2023-11-24T08:00:28.794 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:00:28.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:00:29.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.004+0000 7f7e23651640 1 Processor -- start 2023-11-24T08:00:29.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.004+0000 7f7e23651640 1 -- start start 2023-11-24T08:00:29.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.005+0000 7f7e23651640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7e1c0cf9a0 0x7f7e1c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:29.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.005+0000 7f7e23651640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e1c15e1e0 0x7f7e1c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:29.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e23651640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1c0b1ee0 con 0x7f7e1c143ae0 2023-11-24T08:00:29.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e23651640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c0b2780 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e23651640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e1c15e990 con 0x7f7e1c0cf9a0 2023-11-24T08:00:29.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e1c15e1e0 0x7f7e1c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:29.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e1c15e1e0 0x7f7e1c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33722/0 (socket says 172.21.15.161:33722) 2023-11-24T08:00:29.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 -- 172.21.15.161:0/151782450 learned_addr learned my addr 172.21.15.161:0/151782450 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:29.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e20bec640 1 --2- 172.21.15.161:0/151782450 >> v2:172.21.15.175:3300/0 conn(0x7f7e1c0cf9a0 0x7f7e1c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:29.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 -- 172.21.15.161:0/151782450 >> v2:172.21.15.175:3300/0 conn(0x7f7e1c0cf9a0 msgr2=0x7f7e1c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:29.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 --2- 172.21.15.161:0/151782450 >> v2:172.21.15.175:3300/0 conn(0x7f7e1c0cf9a0 0x7f7e1c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 -- 172.21.15.161:0/151782450 >> v1:172.21.15.175:6789/0 conn(0x7f7e1c143ae0 legacy=0x7f7e1c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:29.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.006+0000 7f7e21bee640 1 -- 172.21.15.161:0/151782450 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c0b2130 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.007+0000 7f7e21bee640 1 --2- 172.21.15.161:0/151782450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c0702c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cb830 tx=0x7f7e1402e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca34111397cd4a09 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:29.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e13fff640 1 -- 172.21.15.161:0/151782450 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1402ea90 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e13fff640 1 -- 172.21.15.161:0/151782450 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1402ebf0 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e13fff640 1 -- 172.21.15.161:0/151782450 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14009600 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e23651640 1 -- 172.21.15.161:0/151782450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 msgr2=0x7f7e1c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:29.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e23651640 1 --2- 172.21.15.161:0/151782450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c0702c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cb830 tx=0x7f7e1402e0f0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e23651640 1 -- 172.21.15.161:0/151782450 shutdown_connections 2023-11-24T08:00:29.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e23651640 1 --2- 172.21.15.161:0/151782450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c0702c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e23651640 1 --2- 172.21.15.161:0/151782450 >> v2:172.21.15.175:3300/0 conn(0x7f7e1c0cf9a0 0x7f7e1c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.008+0000 7f7e23651640 1 -- 172.21.15.161:0/151782450 >> 172.21.15.161:0/151782450 conn(0x7f7e1c06a800 msgr2=0x7f7e1c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:29.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.009+0000 7f7e23651640 1 -- 172.21.15.161:0/151782450 shutdown_connections 2023-11-24T08:00:29.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.009+0000 7f7e23651640 1 -- 172.21.15.161:0/151782450 wait complete. 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.011+0000 7f7e23651640 1 Processor -- start 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.011+0000 7f7e23651640 1 -- start start 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e23651640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e1c0cf9a0 0x7f7e1c0c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e23651640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e1c143ae0 0x7f7e1c15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e23651640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c137010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e23651640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c3e50 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e23651640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c4130 con 0x7f7e1c143ae0 2023-11-24T08:00:29.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e23651640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1c0c4410 con 0x7f7e1c0cf9a0 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e21bee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c137010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e21bee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c137010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33738/0 (socket says 172.21.15.161:33738) 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.012+0000 7f7e21bee640 1 -- 172.21.15.161:0/2652901706 learned_addr learned my addr 172.21.15.161:0/2652901706 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e213ed640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e1c0cf9a0 0x7f7e1c0c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e20bec640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e1c143ae0 0x7f7e1c15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e21bee640 1 -- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e1c0cf9a0 msgr2=0x7f7e1c0c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e21bee640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e1c0cf9a0 0x7f7e1c0c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e21bee640 1 -- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e1c143ae0 msgr2=0x7f7e1c15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e21bee640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e1c143ae0 0x7f7e1c15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e21bee640 1 -- 172.21.15.161:0/2652901706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1400bd40 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.013+0000 7f7e21bee640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c137010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e14038040 tx=0x7f7e14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.014+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1402ea90 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.014+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e14036820 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.014+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14036bd0 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.014+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1c0c46f0 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.014+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1c0c5430 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.015+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1c0c4c10 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.016+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e14036d30 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.017+0000 7f7e11ffb640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e0006ae40 0x7f7e0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:29.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.018+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e140aca50 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.018+0000 7f7e213ed640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e0006ae40 0x7f7e0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:29.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.019+0000 7f7e213ed640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e0006ae40 0x7f7e0006d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e18004ea0 tx=0x7f7e18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:29.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.022+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e1c0c4c10 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.253+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7e1c0c4c10 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.518 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-11-24T08:00:29.517+0000 7f514119c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:00:29.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.772+0000 7f7e11ffb640 1 -- 172.21.15.161:0/2652901706 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e1c0c4c10 con 0x7f7e1c15e1e0 2023-11-24T08:00:29.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e0006ae40 msgr2=0x7f7e0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:29.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e0006ae40 0x7f7e0006d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e18004ea0 tx=0x7f7e18009040 comp rx=0 tx=0).stop 2023-11-24T08:00:29.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 msgr2=0x7f7e1c137010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:29.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c137010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7e14038040 tx=0x7f7e14004a40 comp rx=0 tx=0).stop 2023-11-24T08:00:29.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 shutdown_connections 2023-11-24T08:00:29.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e0006ae40 0x7f7e0006d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e1c15e1e0 0x7f7e1c137010 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e1c143ae0 0x7f7e1c15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 --2- 172.21.15.161:0/2652901706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e1c0cf9a0 0x7f7e1c0c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:29.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 >> 172.21.15.161:0/2652901706 conn(0x7f7e1c06a800 msgr2=0x7f7e1c0ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:29.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 shutdown_connections 2023-11-24T08:00:29.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:29.776+0000 7f7e23651640 1 -- 172.21.15.161:0/2652901706 wait complete. 2023-11-24T08:00:29.800 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:00:29.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:00:30.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.012+0000 7fa267ab4640 1 Processor -- start 2023-11-24T08:00:30.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.012+0000 7fa267ab4640 1 -- start start 2023-11-24T08:00:30.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa267ab4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa26013df80 0x7fa26015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa267ab4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa26013e360 0x7fa2600cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa267ab4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26015f9c0 0x7fa2600cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa267ab4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006c470 con 0x7fa26013e360 2023-11-24T08:00:30.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa267ab4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006c750 con 0x7fa26013df80 2023-11-24T08:00:30.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa267ab4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26006ca30 con 0x7fa26015f9c0 2023-11-24T08:00:30.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa26504f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa26013e360 0x7fa2600cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa26504f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa26013e360 0x7fa2600cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33744/0 (socket says 172.21.15.161:33744) 2023-11-24T08:00:30.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.014+0000 7fa26504f640 1 -- 172.21.15.161:0/1370709111 learned_addr learned my addr 172.21.15.161:0/1370709111 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:30.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa265850640 1 --2- 172.21.15.161:0/1370709111 >> v2:172.21.15.175:3300/0 conn(0x7fa26013df80 0x7fa26015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa26504f640 1 -- 172.21.15.161:0/1370709111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26015f9c0 msgr2=0x7fa2600cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:30.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa266051640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26015f9c0 0x7fa2600cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa26504f640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26015f9c0 0x7fa2600cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa26504f640 1 -- 172.21.15.161:0/1370709111 >> v2:172.21.15.175:3300/0 conn(0x7fa26013df80 msgr2=0x7fa26015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa26504f640 1 --2- 172.21.15.161:0/1370709111 >> v2:172.21.15.175:3300/0 conn(0x7fa26013df80 0x7fa26015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa26504f640 1 -- 172.21.15.161:0/1370709111 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26006cd10 con 0x7fa26013e360 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa265850640 1 --2- 172.21.15.161:0/1370709111 >> v2:172.21.15.175:3300/0 conn(0x7fa26013df80 0x7fa26015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.015+0000 7fa266051640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26015f9c0 0x7fa2600cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.016+0000 7fa26504f640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa2600cf290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa260072770 tx=0x7fa25002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea3c5174935c637 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.016+0000 7fa26484e640 1 -- 172.21.15.161:0/1370709111 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250031880 con 0x7fa26013e360 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.016+0000 7fa26484e640 1 -- 172.21.15.161:0/1370709111 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2500319e0 con 0x7fa26013e360 2023-11-24T08:00:30.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.016+0000 7fa26484e640 1 -- 172.21.15.161:0/1370709111 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250031d70 con 0x7fa26013e360 2023-11-24T08:00:30.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 -- 172.21.15.161:0/1370709111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 msgr2=0x7fa2600cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa2600cf290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa260072770 tx=0x7fa25002b920 comp rx=0 tx=0).stop 2023-11-24T08:00:30.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 -- 172.21.15.161:0/1370709111 shutdown_connections 2023-11-24T08:00:30.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26015f9c0 0x7fa2600cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 --2- 172.21.15.161:0/1370709111 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa2600cf290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 --2- 172.21.15.161:0/1370709111 >> v2:172.21.15.175:3300/0 conn(0x7fa26013df80 0x7fa26015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 -- 172.21.15.161:0/1370709111 >> 172.21.15.161:0/1370709111 conn(0x7fa26006a800 msgr2=0x7fa26006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:30.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 -- 172.21.15.161:0/1370709111 shutdown_connections 2023-11-24T08:00:30.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.017+0000 7fa267ab4640 1 -- 172.21.15.161:0/1370709111 wait complete. 2023-11-24T08:00:30.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.019+0000 7fa267ab4640 1 Processor -- start 2023-11-24T08:00:30.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.019+0000 7fa267ab4640 1 -- start start 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa267ab4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26013df80 0x7fa260135b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa267ab4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa26015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa267ab4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa26015f9c0 0x7fa26015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa267ab4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601385e0 con 0x7fa26013e360 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa267ab4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260139160 con 0x7fa26015f9c0 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa267ab4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa260138830 con 0x7fa26013df80 2023-11-24T08:00:30.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa26504f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa26015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa26504f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa26015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33752/0 (socket says 172.21.15.161:33752) 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.020+0000 7fa26504f640 1 -- 172.21.15.161:0/2402481733 learned_addr learned my addr 172.21.15.161:0/2402481733 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa266051640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa26015f9c0 0x7fa26015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa265850640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26013df80 0x7fa260135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa26504f640 1 -- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26013df80 msgr2=0x7fa260135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa26504f640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26013df80 0x7fa260135b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa26504f640 1 -- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa26015f9c0 msgr2=0x7fa26015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa26504f640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa26015f9c0 0x7fa26015cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa26504f640 1 -- 172.21.15.161:0/2402481733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500094d0 con 0x7fa26013e360 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa26504f640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa26015c850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa2500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250031870 con 0x7fa26013e360 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2500443f0 con 0x7fa26013e360 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2500447a0 con 0x7fa26013e360 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.021+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260138b10 con 0x7fa26013e360 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.022+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260154670 con 0x7fa26013e360 2023-11-24T08:00:30.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.023+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa260154860 con 0x7fa26013e360 2023-11-24T08:00:30.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.024+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa250044900 con 0x7fa26013e360 2023-11-24T08:00:30.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.025+0000 7fa2567fc640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa24406ae40 0x7fa24406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.025+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2500abee0 con 0x7fa26013e360 2023-11-24T08:00:30.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.025+0000 7fa265850640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa24406ae40 0x7fa24406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.026+0000 7fa265850640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa24406ae40 0x7fa24406d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00a950 tx=0x7fa25c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.030+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2500770a0 con 0x7fa26013e360 2023-11-24T08:00:30.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.260+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2600675d0 con 0x7fa26013e360 2023-11-24T08:00:30.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.261+0000 7fa2567fc640 1 -- 172.21.15.161:0/2402481733 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fa250035020 con 0x7fa26013e360 2023-11-24T08:00:30.263 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:30.263 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:00:30.263 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:00:30.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa24406ae40 msgr2=0x7fa24406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa24406ae40 0x7fa24406d300 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa25c00a950 tx=0x7fa25c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:30.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 msgr2=0x7fa26015c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa26015c850 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa250000c00 tx=0x7fa2500046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 shutdown_connections 2023-11-24T08:00:30.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa24406ae40 0x7fa24406d300 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa26015f9c0 0x7fa26015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa26013e360 0x7fa26015c850 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 --2- 172.21.15.161:0/2402481733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa26013df80 0x7fa260135b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 >> 172.21.15.161:0/2402481733 conn(0x7fa26006a800 msgr2=0x7fa26006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 shutdown_connections 2023-11-24T08:00:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.263+0000 7fa267ab4640 1 -- 172.21.15.161:0/2402481733 wait complete. 2023-11-24T08:00:30.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:30.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.494+0000 7fa66af7d640 1 Processor -- start 2023-11-24T08:00:30.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.495+0000 7fa66af7d640 1 -- start start 2023-11-24T08:00:30.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.496+0000 7fa66af7d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6640ce8f0 0x7fa6640ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.496+0000 7fa66af7d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6640b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.496+0000 7fa66af7d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6640d0de0 con 0x7fa664160f80 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.496+0000 7fa66af7d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640d10c0 con 0x7fa6640ce8f0 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.496+0000 7fa66af7d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640d13a0 con 0x7fa6640b2a00 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.496+0000 7fa663fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6640ce8f0 0x7fa6640ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa663fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6640ce8f0 0x7fa6640ced30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33758/0 (socket says 172.21.15.161:33758) 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa663fff640 1 -- 172.21.15.161:0/2857716694 learned_addr learned my addr 172.21.15.161:0/2857716694 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:30.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa66951a640 1 --2- 172.21.15.161:0/2857716694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6640b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa663fff640 1 -- 172.21.15.161:0/2857716694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 msgr2=0x7fa6640b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:30.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa663fff640 1 --2- 172.21.15.161:0/2857716694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6640b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa663fff640 1 -- 172.21.15.161:0/2857716694 >> v1:172.21.15.175:6789/0 conn(0x7fa664160f80 legacy=0x7fa664161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.497+0000 7fa663fff640 1 -- 172.21.15.161:0/2857716694 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640d1680 con 0x7fa6640ce8f0 2023-11-24T08:00:30.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.498+0000 7fa663fff640 1 --2- 172.21.15.161:0/2857716694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6640ce8f0 0x7fa6640ced30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa650009870 tx=0x7fa65002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485dab6259c80127 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.498+0000 7fa6637fe640 1 -- 172.21.15.161:0/2857716694 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650030840 con 0x7fa6640ce8f0 2023-11-24T08:00:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.498+0000 7fa6637fe640 1 -- 172.21.15.161:0/2857716694 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6500309a0 con 0x7fa6640ce8f0 2023-11-24T08:00:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.498+0000 7fa6637fe640 1 -- 172.21.15.161:0/2857716694 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650030d30 con 0x7fa6640ce8f0 2023-11-24T08:00:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 -- 172.21.15.161:0/2857716694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6640ce8f0 msgr2=0x7fa6640ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2857716694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6640ce8f0 0x7fa6640ced30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa650009870 tx=0x7fa65002b980 comp rx=0 tx=0).stop 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 -- 172.21.15.161:0/2857716694 shutdown_connections 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2857716694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6640b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2857716694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6640ce8f0 0x7fa6640ced30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 -- 172.21.15.161:0/2857716694 >> 172.21.15.161:0/2857716694 conn(0x7fa66409c550 msgr2=0x7fa6640d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 -- 172.21.15.161:0/2857716694 shutdown_connections 2023-11-24T08:00:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.499+0000 7fa66af7d640 1 -- 172.21.15.161:0/2857716694 wait complete. 2023-11-24T08:00:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.501+0000 7fa66af7d640 1 Processor -- start 2023-11-24T08:00:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.501+0000 7fa66af7d640 1 -- start start 2023-11-24T08:00:30.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66af7d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6641f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66af7d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6640ce8f0 0x7fa66415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66af7d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 0x7fa6640cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66af7d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664160060 con 0x7fa664160f80 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66af7d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66415f3e0 con 0x7fa6640ce8f0 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66af7d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66415f6c0 con 0x7fa6640b2a00 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66951a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 0x7fa6640cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66951a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 0x7fa6640cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33766/0 (socket says 172.21.15.161:33766) 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.502+0000 7fa66951a640 1 -- 172.21.15.161:0/2100057212 learned_addr learned my addr 172.21.15.161:0/2100057212 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa668d19640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6641f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa663fff640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6640ce8f0 0x7fa66415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66951a640 1 -- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 msgr2=0x7fa6641f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66951a640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6641f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66951a640 1 -- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6640ce8f0 msgr2=0x7fa66415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66951a640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6640ce8f0 0x7fa66415ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66951a640 1 -- 172.21.15.161:0/2100057212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500094d0 con 0x7fa664160f80 2023-11-24T08:00:30.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa668d19640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6641f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:30.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66951a640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 0x7fa6640cbe70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa65c007e40 tx=0x7fa65c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c014620 con 0x7fa664160f80 2023-11-24T08:00:30.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00ee90 con 0x7fa664160f80 2023-11-24T08:00:30.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66415f9a0 con 0x7fa664160f80 2023-11-24T08:00:30.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.503+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0149e0 con 0x7fa664160f80 2023-11-24T08:00:30.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.504+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6641f2bd0 con 0x7fa664160f80 2023-11-24T08:00:30.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.505+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6641601a0 con 0x7fa664160f80 2023-11-24T08:00:30.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.505+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa65c014b40 con 0x7fa664160f80 2023-11-24T08:00:30.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.507+0000 7fa6617fa640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa64806ae40 0x7fa64806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.507+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa65c08a070 con 0x7fa664160f80 2023-11-24T08:00:30.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.507+0000 7fa668d19640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa64806ae40 0x7fa64806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.508+0000 7fa668d19640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa64806ae40 0x7fa64806d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa664067f30 tx=0x7fa658009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.511+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa65c0bce90 con 0x7fa664160f80 2023-11-24T08:00:30.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.704+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6640675d0 con 0x7fa664160f80 2023-11-24T08:00:30.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.707+0000 7fa6617fa640 1 -- 172.21.15.161:0/2100057212 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fa65c055080 con 0x7fa664160f80 2023-11-24T08:00:30.710 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:30.710 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:30.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa64806ae40 msgr2=0x7fa64806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa64806ae40 0x7fa64806d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa664067f30 tx=0x7fa658009040 comp rx=0 tx=0).stop 2023-11-24T08:00:30.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 msgr2=0x7fa6640cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 0x7fa6640cbe70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa65c007e40 tx=0x7fa65c00e4b0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 shutdown_connections 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa64806ae40 0x7fa64806d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa664160f80 0x7fa6640cbe70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6640ce8f0 0x7fa66415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 --2- 172.21.15.161:0/2100057212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6640b2a00 0x7fa6641f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 >> 172.21.15.161:0/2100057212 conn(0x7fa66409c550 msgr2=0x7fa664161360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 shutdown_connections 2023-11-24T08:00:30.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.710+0000 7fa66af7d640 1 -- 172.21.15.161:0/2100057212 wait complete. 2023-11-24T08:00:30.731 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:00:30.732 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:00:30.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.939+0000 7f010b59e640 1 Processor -- start 2023-11-24T08:00:30.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.939+0000 7f010b59e640 1 -- start start 2023-11-24T08:00:30.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.941+0000 7f010b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 0x7f010c0d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.941+0000 7f010b59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c0d0a10 con 0x7f010c0d0100 2023-11-24T08:00:30.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.941+0000 7f010b59e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c0cf080 con 0x7f010c160920 2023-11-24T08:00:30.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.941+0000 7f010b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0c6be0 con 0x7f010c0b3f30 2023-11-24T08:00:30.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.941+0000 7f0109d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f010c0d0100 0x7f010c0d0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39920/0 (socket says 172.21.15.161:39920) 2023-11-24T08:00:30.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.941+0000 7f0109d9b640 1 -- 172.21.15.161:0/3439827136 learned_addr learned my addr 172.21.15.161:0/3439827136 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:30.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010ad9d640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 0x7f010c0d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595069930 0 0) 0x7f010c0d0a10 con 0x7f010c0d0100 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f4003520 con 0x7f010c0d0100 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2535126990 0 0) 0x7f00f4003520 con 0x7f010c0d0100 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 msgr2=0x7f010c0d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 0x7f010c0d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 >> v1:172.21.15.175:6789/0 conn(0x7f010c160920 legacy=0x7f010c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0ce7e0 con 0x7f010c0d0100 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0100001670 con 0x7f010c0d0100 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 >> v1:172.21.15.161:6789/0 conn(0x7f010c0d0100 legacy=0x7f010c0d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00f40039a0 0x7f00f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 0x7f00f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f00f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0c6be0 con 0x7f00f4004d00 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f400ba60 con 0x7f00f40039a0 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.942+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f400bc20 con 0x7f010c0b3f30 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010ad9d640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f00f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f0109d9b640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 0x7f00f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010a59c640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00f40039a0 0x7f00f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010ad9d640 1 -- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 msgr2=0x7f00f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010ad9d640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c0b3f30 0x7f00f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010ad9d640 1 -- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00f40039a0 msgr2=0x7f00f4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010ad9d640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00f40039a0 0x7f00f4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010ad9d640 1 -- 172.21.15.161:0/3439827136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f4003520 con 0x7f00f4004d00 2023-11-24T08:00:30.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.943+0000 7f010a59c640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00f40039a0 0x7f00f4003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:30.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.944+0000 7f010ad9d640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f00f4005180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0104009a90 tx=0x7f00f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33713647cdbd42a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.944+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010402c680 con 0x7f00f4004d00 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.944+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010402c7e0 con 0x7f00f4004d00 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.944+0000 7f010959a640 1 -- 172.21.15.161:0/3439827136 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010402cb70 con 0x7f00f4004d00 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010b59e640 1 -- 172.21.15.161:0/3439827136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 msgr2=0x7f00f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010b59e640 1 --2- 172.21.15.161:0/3439827136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f00f4005180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0104009a90 tx=0x7f00f40057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010ad9d640 1 -- 172.21.15.161:0/3439827136 reap_dead start 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010b59e640 1 -- 172.21.15.161:0/3439827136 shutdown_connections 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010b59e640 1 -- 172.21.15.161:0/3439827136 >> 172.21.15.161:0/3439827136 conn(0x7f010c0d3090 msgr2=0x7f010c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010b59e640 1 -- 172.21.15.161:0/3439827136 shutdown_connections 2023-11-24T08:00:30.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.945+0000 7f010b59e640 1 -- 172.21.15.161:0/3439827136 wait complete. 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.947+0000 7f010b59e640 1 Processor -- start 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.947+0000 7f010b59e640 1 -- start start 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.948+0000 7f010b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f010c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.948+0000 7f010b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c158960 0x7f010c0b8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.948+0000 7f010b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1553e0 0x7f010c155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.948+0000 7f010b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0ccfe0 con 0x7f00f4004d00 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.948+0000 7f010b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c155da0 con 0x7f010c1553e0 2023-11-24T08:00:30.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.948+0000 7f010b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c158de0 con 0x7f010c158960 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f010c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f010c0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56456/0 (socket says 172.21.15.161:56456) 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 -- 172.21.15.161:0/2369235232 learned_addr learned my addr 172.21.15.161:0/2369235232 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 -- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c158960 msgr2=0x7f010c0b8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c158960 0x7f010c0b8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 -- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1553e0 msgr2=0x7f010c155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1553e0 0x7f010c155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 -- 172.21.15.161:0/2369235232 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0b6800 con 0x7f00f4004d00 2023-11-24T08:00:30.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f010a59c640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f010c0cca00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00db10 tx=0x7f00fc0020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc003da0 con 0x7f00f4004d00 2023-11-24T08:00:30.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.949+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc006b50 con 0x7f00f4004d00 2023-11-24T08:00:30.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.950+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c0b6ae0 con 0x7f00f4004d00 2023-11-24T08:00:30.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.950+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00b740 con 0x7f00f4004d00 2023-11-24T08:00:30.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.950+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c0b70a0 con 0x7f00f4004d00 2023-11-24T08:00:30.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.951+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c0b7260 con 0x7f00f4004d00 2023-11-24T08:00:30.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.952+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00fc00b8a0 con 0x7f00f4004d00 2023-11-24T08:00:30.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.953+0000 7f00faffd640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f00ec06ae40 0x7f00ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:30.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.953+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00fc088b90 con 0x7f00f4004d00 2023-11-24T08:00:30.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.954+0000 7f0109d9b640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f00ec06ae40 0x7f00ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:30.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.955+0000 7f0109d9b640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f00ec06ae40 0x7f00ec06d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0100001050 tx=0x7f0100000f60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:30.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:30.958+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00fc053c50 con 0x7f00f4004d00 2023-11-24T08:00:31.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.144+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f010c160d00 con 0x7f00ec06ae40 2023-11-24T08:00:31.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.169+0000 7f00faffd640 1 -- 172.21.15.161:0/2369235232 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264429 (secure 0 0 0) 0x7f0100001c90 con 0x7f00ec06ae40 2023-11-24T08:00:31.177 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:31.179 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:00:31.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f00ec06ae40 msgr2=0x7f00ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f00ec06ae40 0x7f00ec06d300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0100001050 tx=0x7f0100000f60 comp rx=0 tx=0).stop 2023-11-24T08:00:31.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 msgr2=0x7f010c0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f010c0cca00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00db10 tx=0x7f00fc0020c0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 shutdown_connections 2023-11-24T08:00:31.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f00ec06ae40 0x7f00ec06d300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f010c1553e0 0x7f010c155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f010c158960 0x7f010c0b8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 --2- 172.21.15.161:0/2369235232 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00f4004d00 0x7f010c0cca00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 >> 172.21.15.161:0/2369235232 conn(0x7f010c0d3090 msgr2=0x7f010c06aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:31.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 shutdown_connections 2023-11-24T08:00:31.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.175+0000 7f010b59e640 1 -- 172.21.15.161:0/2369235232 wait complete. 2023-11-24T08:00:31.197 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-24T08:00:30.526927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2924544,"data_stored":1757783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002079"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174603+0000","last_change":"2023-11-24T08:00:26.768948+0000","last_active":"2023-11-24T08:00:28.174603+0000","last_peered":"2023-11-24T08:00:28.174603+0000","last_clean":"2023-11-24T08:00:28.174603+0000","last_became_active":"2023-11-24T08:00:26.768601+0000","last_became_peered":"2023-11-24T08:00:26.768601+0000","last_unstale":"2023-11-24T08:00:28.174603+0000","last_undegraded":"2023-11-24T08:00:28.174603+0000","last_fullsized":"2023-11-24T08:00:28.174603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.770381+0000","last_change":"2023-11-24T08:00:26.766088+0000","last_active":"2023-11-24T08:00:26.770381+0000","last_peered":"2023-11-24T08:00:26.770381+0000","last_clean":"2023-11-24T08:00:26.770381+0000","last_became_active":"2023-11-24T08:00:26.765786+0000","last_became_peered":"2023-11-24T08:00:26.765786+0000","last_unstale":"2023-11-24T08:00:26.770381+0000","last_undegraded":"2023-11-24T08:00:26.770381+0000","last_fullsized":"2023-11-24T08:00:26.770381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:23.219831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.769322+0000","last_change":"2023-11-24T08:00:26.762423+0000","last_active":"2023-11-24T08:00:26.769322+0000","last_peered":"2023-11-24T08:00:26.769322+0000","last_clean":"2023-11-24T08:00:26.769322+0000","last_became_active":"2023-11-24T08:00:26.760624+0000","last_became_peered":"2023-11-24T08:00:26.760624+0000","last_unstale":"2023-11-24T08:00:26.769322+0000","last_undegraded":"2023-11-24T08:00:26.769322+0000","last_fullsized":"2023-11-24T08:00:26.769322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:31.782236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768385+0000","last_change":"2023-11-24T08:00:26.777163+0000","last_active":"2023-11-24T08:00:27.768385+0000","last_peered":"2023-11-24T08:00:27.768385+0000","last_clean":"2023-11-24T08:00:27.768385+0000","last_became_active":"2023-11-24T08:00:26.776740+0000","last_became_peered":"2023-11-24T08:00:26.776740+0000","last_unstale":"2023-11-24T08:00:27.768385+0000","last_undegraded":"2023-11-24T08:00:27.768385+0000","last_fullsized":"2023-11-24T08:00:27.768385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173729+0000","last_change":"2023-11-24T08:00:26.763129+0000","last_active":"2023-11-24T08:00:28.173729+0000","last_peered":"2023-11-24T08:00:28.173729+0000","last_clean":"2023-11-24T08:00:28.173729+0000","last_became_active":"2023-11-24T08:00:26.762767+0000","last_became_peered":"2023-11-24T08:00:26.762767+0000","last_unstale":"2023-11-24T08:00:28.173729+0000","last_undegraded":"2023-11-24T08:00:28.173729+0000","last_fullsized":"2023-11-24T08:00:28.173729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768358+0000","last_change":"2023-11-24T08:00:26.772489+0000","last_active":"2023-11-24T08:00:27.768358+0000","last_peered":"2023-11-24T08:00:27.768358+0000","last_clean":"2023-11-24T08:00:27.768358+0000","last_became_active":"2023-11-24T08:00:26.769412+0000","last_became_peered":"2023-11-24T08:00:26.769412+0000","last_unstale":"2023-11-24T08:00:27.768358+0000","last_undegraded":"2023-11-24T08:00:27.768358+0000","last_fullsized":"2023-11-24T08:00:27.768358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172502+0000","last_change":"2023-11-24T08:00:26.771569+0000","last_active":"2023-11-24T08:00:28.172502+0000","last_peered":"2023-11-24T08:00:28.172502+0000","last_clean":"2023-11-24T08:00:28.172502+0000","last_became_active":"2023-11-24T08:00:26.771170+0000","last_became_peered":"2023-11-24T08:00:26.771170+0000","last_unstale":"2023-11-24T08:00:28.172502+0000","last_undegraded":"2023-11-24T08:00:28.172502+0000","last_fullsized":"2023-11-24T08:00:28.172502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172266+0000","last_change":"2023-11-24T08:00:26.770049+0000","last_active":"2023-11-24T08:00:28.172266+0000","last_peered":"2023-11-24T08:00:28.172266+0000","last_clean":"2023-11-24T08:00:28.172266+0000","last_became_active":"2023-11-24T08:00:26.769256+0000","last_became_peered":"2023-11-24T08:00:26.769256+0000","last_unstale":"2023-11-24T08:00:28.172266+0000","last_undegraded":"2023-11-24T08:00:28.172266+0000","last_fullsized":"2023-11-24T08:00:28.172266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174837+0000","last_change":"2023-11-24T08:00:26.782744+0000","last_active":"2023-11-24T08:00:28.174837+0000","last_peered":"2023-11-24T08:00:28.174837+0000","last_clean":"2023-11-24T08:00:28.174837+0000","last_became_active":"2023-11-24T08:00:26.780825+0000","last_became_peered":"2023-11-24T08:00:26.780825+0000","last_unstale":"2023-11-24T08:00:28.174837+0000","last_undegraded":"2023-11-24T08:00:28.174837+0000","last_fullsized":"2023-11-24T08:00:28.174837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:26.750802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768128+0000","last_change":"2023-11-24T08:00:26.771369+0000","last_active":"2023-11-24T08:00:27.768128+0000","last_peered":"2023-11-24T08:00:27.768128+0000","last_clean":"2023-11-24T08:00:27.768128+0000","last_became_active":"2023-11-24T08:00:26.769019+0000","last_became_peered":"2023-11-24T08:00:26.769019+0000","last_unstale":"2023-11-24T08:00:27.768128+0000","last_undegraded":"2023-11-24T08:00:27.768128+0000","last_fullsized":"2023-11-24T08:00:27.768128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768021+0000","last_change":"2023-11-24T08:00:26.768671+0000","last_active":"2023-11-24T08:00:27.768021+0000","last_peered":"2023-11-24T08:00:27.768021+0000","last_clean":"2023-11-24T08:00:27.768021+0000","last_became_active":"2023-11-24T08:00:26.768353+0000","last_became_peered":"2023-11-24T08:00:26.768353+0000","last_unstale":"2023-11-24T08:00:27.768021+0000","last_undegraded":"2023-11-24T08:00:27.768021+0000","last_fullsized":"2023-11-24T08:00:27.768021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.761527+0000","last_change":"2023-11-24T08:00:26.749810+0000","last_active":"2023-11-24T08:00:26.761527+0000","last_peered":"2023-11-24T08:00:26.761527+0000","last_clean":"2023-11-24T08:00:26.761527+0000","last_became_active":"2023-11-24T08:00:26.749245+0000","last_became_peered":"2023-11-24T08:00:26.749245+0000","last_unstale":"2023-11-24T08:00:26.761527+0000","last_undegraded":"2023-11-24T08:00:26.761527+0000","last_fullsized":"2023-11-24T08:00:26.761527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:42.055903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174534+0000","last_change":"2023-11-24T08:00:26.765178+0000","last_active":"2023-11-24T08:00:28.174534+0000","last_peered":"2023-11-24T08:00:28.174534+0000","last_clean":"2023-11-24T08:00:28.174534+0000","last_became_active":"2023-11-24T08:00:26.764424+0000","last_became_peered":"2023-11-24T08:00:26.764424+0000","last_unstale":"2023-11-24T08:00:28.174534+0000","last_undegraded":"2023-11-24T08:00:28.174534+0000","last_fullsized":"2023-11-24T08:00:28.174534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.770803+0000","last_change":"2023-11-24T08:00:26.764196+0000","last_active":"2023-11-24T08:00:26.770803+0000","last_peered":"2023-11-24T08:00:26.770803+0000","last_clean":"2023-11-24T08:00:26.770803+0000","last_became_active":"2023-11-24T08:00:26.763658+0000","last_became_peered":"2023-11-24T08:00:26.763658+0000","last_unstale":"2023-11-24T08:00:26.770803+0000","last_undegraded":"2023-11-24T08:00:26.770803+0000","last_fullsized":"2023-11-24T08:00:26.770803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:23.219831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.766097+0000","last_change":"2023-11-24T08:00:26.756725+0000","last_active":"2023-11-24T08:00:26.766097+0000","last_peered":"2023-11-24T08:00:26.766097+0000","last_clean":"2023-11-24T08:00:26.766097+0000","last_became_active":"2023-11-24T08:00:26.755826+0000","last_became_peered":"2023-11-24T08:00:26.755826+0000","last_unstale":"2023-11-24T08:00:26.766097+0000","last_undegraded":"2023-11-24T08:00:26.766097+0000","last_fullsized":"2023-11-24T08:00:26.766097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:50.279093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767981+0000","last_change":"2023-11-24T08:00:26.765661+0000","last_active":"2023-11-24T08:00:27.767981+0000","last_peered":"2023-11-24T08:00:27.767981+0000","last_clean":"2023-11-24T08:00:27.767981+0000","last_became_active":"2023-11-24T08:00:26.765342+0000","last_became_peered":"2023-11-24T08:00:26.765342+0000","last_unstale":"2023-11-24T08:00:27.767981+0000","last_undegraded":"2023-11-24T08:00:27.767981+0000","last_fullsized":"2023-11-24T08:00:27.767981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769287+0000","last_change":"2023-11-24T08:00:26.775973+0000","last_active":"2023-11-24T08:00:27.769287+0000","last_peered":"2023-11-24T08:00:27.769287+0000","last_clean":"2023-11-24T08:00:27.769287+0000","last_became_active":"2023-11-24T08:00:26.775605+0000","last_became_peered":"2023-11-24T08:00:26.775605+0000","last_unstale":"2023-11-24T08:00:27.769287+0000","last_undegraded":"2023-11-24T08:00:27.769287+0000","last_fullsized":"2023-11-24T08:00:27.769287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171624+0000","last_change":"2023-11-24T08:00:26.759204+0000","last_active":"2023-11-24T08:00:28.171624+0000","last_peered":"2023-11-24T08:00:28.171624+0000","last_clean":"2023-11-24T08:00:28.171624+0000","last_became_active":"2023-11-24T08:00:26.758953+0000","last_became_peered":"2023-11-24T08:00:26.758953+0000","last_unstale":"2023-11-24T08:00:28.171624+0000","last_undegraded":"2023-11-24T08:00:28.171624+0000","last_fullsized":"2023-11-24T08:00:28.171624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:13.212470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174627+0000","last_change":"2023-11-24T08:00:26.763759+0000","last_active":"2023-11-24T08:00:28.174627+0000","last_peered":"2023-11-24T08:00:28.174627+0000","last_clean":"2023-11-24T08:00:28.174627+0000","last_became_active":"2023-11-24T08:00:26.763404+0000","last_became_peered":"2023-11-24T08:00:26.763404+0000","last_unstale":"2023-11-24T08:00:28.174627+0000","last_undegraded":"2023-11-24T08:00:28.174627+0000","last_fullsized":"2023-11-24T08:00:28.174627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767389+0000","last_change":"2023-11-24T08:00:26.755257+0000","last_active":"2023-11-24T08:00:27.767389+0000","last_peered":"2023-11-24T08:00:27.767389+0000","last_clean":"2023-11-24T08:00:27.767389+0000","last_became_active":"2023-11-24T08:00:26.754494+0000","last_became_peered":"2023-11-24T08:00:26.754494+0000","last_unstale":"2023-11-24T08:00:27.767389+0000","last_undegraded":"2023-11-24T08:00:27.767389+0000","last_fullsized":"2023-11-24T08:00:27.767389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.773107+0000","last_change":"2023-11-24T08:00:26.768879+0000","last_active":"2023-11-24T08:00:26.773107+0000","last_peered":"2023-11-24T08:00:26.773107+0000","last_clean":"2023-11-24T08:00:26.773107+0000","last_became_active":"2023-11-24T08:00:26.768610+0000","last_became_peered":"2023-11-24T08:00:26.768610+0000","last_unstale":"2023-11-24T08:00:26.773107+0000","last_undegraded":"2023-11-24T08:00:26.773107+0000","last_fullsized":"2023-11-24T08:00:26.773107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:07:22.755097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768724+0000","last_change":"2023-11-24T08:00:26.772226+0000","last_active":"2023-11-24T08:00:27.768724+0000","last_peered":"2023-11-24T08:00:27.768724+0000","last_clean":"2023-11-24T08:00:27.768724+0000","last_became_active":"2023-11-24T08:00:26.769115+0000","last_became_peered":"2023-11-24T08:00:26.769115+0000","last_unstale":"2023-11-24T08:00:27.768724+0000","last_undegraded":"2023-11-24T08:00:27.768724+0000","last_fullsized":"2023-11-24T08:00:27.768724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173030+0000","last_change":"2023-11-24T08:00:26.763479+0000","last_active":"2023-11-24T08:00:28.173030+0000","last_peered":"2023-11-24T08:00:28.173030+0000","last_clean":"2023-11-24T08:00:28.173030+0000","last_became_active":"2023-11-24T08:00:26.763174+0000","last_became_peered":"2023-11-24T08:00:26.763174+0000","last_unstale":"2023-11-24T08:00:28.173030+0000","last_undegraded":"2023-11-24T08:00:28.173030+0000","last_fullsized":"2023-11-24T08:00:28.173030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768104+0000","last_change":"2023-11-24T08:00:26.765894+0000","last_active":"2023-11-24T08:00:27.768104+0000","last_peered":"2023-11-24T08:00:27.768104+0000","last_clean":"2023-11-24T08:00:27.768104+0000","last_became_active":"2023-11-24T08:00:26.764976+0000","last_became_peered":"2023-11-24T08:00:26.764976+0000","last_unstale":"2023-11-24T08:00:27.768104+0000","last_undegraded":"2023-11-24T08:00:27.768104+0000","last_fullsized":"2023-11-24T08:00:27.768104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175290+0000","last_change":"2023-11-24T08:00:26.768006+0000","last_active":"2023-11-24T08:00:28.175290+0000","last_peered":"2023-11-24T08:00:28.175290+0000","last_clean":"2023-11-24T08:00:28.175290+0000","last_became_active":"2023-11-24T08:00:26.767556+0000","last_became_peered":"2023-11-24T08:00:26.767556+0000","last_unstale":"2023-11-24T08:00:28.175290+0000","last_undegraded":"2023-11-24T08:00:28.175290+0000","last_fullsized":"2023-11-24T08:00:28.175290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768993+0000","last_change":"2023-11-24T08:00:26.758837+0000","last_active":"2023-11-24T08:00:27.768993+0000","last_peered":"2023-11-24T08:00:27.768993+0000","last_clean":"2023-11-24T08:00:27.768993+0000","last_became_active":"2023-11-24T08:00:26.758557+0000","last_became_peered":"2023-11-24T08:00:26.758557+0000","last_unstale":"2023-11-24T08:00:27.768993+0000","last_undegraded":"2023-11-24T08:00:27.768993+0000","last_fullsized":"2023-11-24T08:00:27.768993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.768116+0000","last_change":"2023-11-24T08:00:26.759241+0000","last_active":"2023-11-24T08:00:26.768116+0000","last_peered":"2023-11-24T08:00:26.768116+0000","last_clean":"2023-11-24T08:00:26.768116+0000","last_became_active":"2023-11-24T08:00:26.758911+0000","last_became_peered":"2023-11-24T08:00:26.758911+0000","last_unstale":"2023-11-24T08:00:26.768116+0000","last_undegraded":"2023-11-24T08:00:26.768116+0000","last_fullsized":"2023-11-24T08:00:26.768116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:07:22.755097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174708+0000","last_change":"2023-11-24T08:00:26.765218+0000","last_active":"2023-11-24T08:00:28.174708+0000","last_peered":"2023-11-24T08:00:28.174708+0000","last_clean":"2023-11-24T08:00:28.174708+0000","last_became_active":"2023-11-24T08:00:26.763830+0000","last_became_peered":"2023-11-24T08:00:26.763830+0000","last_unstale":"2023-11-24T08:00:28.174708+0000","last_undegraded":"2023-11-24T08:00:28.174708+0000","last_fullsized":"2023-11-24T08:00:28.174708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.772878+0000","last_change":"2023-11-24T08:00:26.765008+0000","last_active":"2023-11-24T08:00:26.772878+0000","last_peered":"2023-11-24T08:00:26.772878+0000","last_clean":"2023-11-24T08:00:26.772878+0000","last_became_active":"2023-11-24T08:00:26.764497+0000","last_became_peered":"2023-11-24T08:00:26.764497+0000","last_unstale":"2023-11-24T08:00:26.772878+0000","last_undegraded":"2023-11-24T08:00:26.772878+0000","last_fullsized":"2023-11-24T08:00:26.772878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:15:38.288322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768747+0000","last_change":"2023-11-24T08:00:26.772754+0000","last_active":"2023-11-24T08:00:27.768747+0000","last_peered":"2023-11-24T08:00:27.768747+0000","last_clean":"2023-11-24T08:00:27.768747+0000","last_became_active":"2023-11-24T08:00:26.768109+0000","last_became_peered":"2023-11-24T08:00:26.768109+0000","last_unstale":"2023-11-24T08:00:27.768747+0000","last_undegraded":"2023-11-24T08:00:27.768747+0000","last_fullsized":"2023-11-24T08:00:27.768747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170980+0000","last_change":"2023-11-24T08:00:26.768358+0000","last_active":"2023-11-24T08:00:28.170980+0000","last_peered":"2023-11-24T08:00:28.170980+0000","last_clean":"2023-11-24T08:00:28.170980+0000","last_became_active":"2023-11-24T08:00:26.768127+0000","last_became_peered":"2023-11-24T08:00:26.768127+0000","last_unstale":"2023-11-24T08:00:28.170980+0000","last_undegraded":"2023-11-24T08:00:28.170980+0000","last_fullsized":"2023-11-24T08:00:28.170980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:19.015329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767410+0000","last_change":"2023-11-24T08:00:26.759713+0000","last_active":"2023-11-24T08:00:27.767410+0000","last_peered":"2023-11-24T08:00:27.767410+0000","last_clean":"2023-11-24T08:00:27.767410+0000","last_became_active":"2023-11-24T08:00:26.759342+0000","last_became_peered":"2023-11-24T08:00:26.759342+0000","last_unstale":"2023-11-24T08:00:27.767410+0000","last_undegraded":"2023-11-24T08:00:27.767410+0000","last_fullsized":"2023-11-24T08:00:27.767410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.761910+0000","last_change":"2023-11-24T08:00:26.756578+0000","last_active":"2023-11-24T08:00:26.761910+0000","last_peered":"2023-11-24T08:00:26.761910+0000","last_clean":"2023-11-24T08:00:26.761910+0000","last_became_active":"2023-11-24T08:00:26.756310+0000","last_became_peered":"2023-11-24T08:00:26.756310+0000","last_unstale":"2023-11-24T08:00:26.761910+0000","last_undegraded":"2023-11-24T08:00:26.761910+0000","last_fullsized":"2023-11-24T08:00:26.761910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:29.174934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174796+0000","last_change":"2023-11-24T08:00:25.487322+0000","last_active":"2023-11-24T08:00:28.174796+0000","last_peered":"2023-11-24T08:00:28.174796+0000","last_clean":"2023-11-24T08:00:28.174796+0000","last_became_active":"2023-11-24T08:00:25.486807+0000","last_became_peered":"2023-11-24T08:00:25.486807+0000","last_unstale":"2023-11-24T08:00:28.174796+0000","last_undegraded":"2023-11-24T08:00:28.174796+0000","last_fullsized":"2023-11-24T08:00:28.174796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.771291+0000","last_change":"2023-11-24T08:00:26.763826+0000","last_active":"2023-11-24T08:00:26.771291+0000","last_peered":"2023-11-24T08:00:26.771291+0000","last_clean":"2023-11-24T08:00:26.771291+0000","last_became_active":"2023-11-24T08:00:26.761268+0000","last_became_peered":"2023-11-24T08:00:26.761268+0000","last_unstale":"2023-11-24T08:00:26.771291+0000","last_undegraded":"2023-11-24T08:00:26.771291+0000","last_fullsized":"2023-11-24T08:00:26.771291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:42.055903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767502+0000","last_change":"2023-11-24T08:00:25.484440+0000","last_active":"2023-11-24T08:00:27.767502+0000","last_peered":"2023-11-24T08:00:27.767502+0000","last_clean":"2023-11-24T08:00:27.767502+0000","last_became_active":"2023-11-24T08:00:25.484176+0000","last_became_peered":"2023-11-24T08:00:25.484176+0000","last_unstale":"2023-11-24T08:00:27.767502+0000","last_undegraded":"2023-11-24T08:00:27.767502+0000","last_fullsized":"2023-11-24T08:00:27.767502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173120+0000","last_change":"2023-11-24T08:00:25.477583+0000","last_active":"2023-11-24T08:00:28.173120+0000","last_peered":"2023-11-24T08:00:28.173120+0000","last_clean":"2023-11-24T08:00:28.173120+0000","last_became_active":"2023-11-24T08:00:25.477315+0000","last_became_peered":"2023-11-24T08:00:25.477315+0000","last_unstale":"2023-11-24T08:00:28.173120+0000","last_undegraded":"2023-11-24T08:00:28.173120+0000","last_fullsized":"2023-11-24T08:00:28.173120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172762+0000","last_change":"2023-11-24T08:00:26.768787+0000","last_active":"2023-11-24T08:00:28.172762+0000","last_peered":"2023-11-24T08:00:28.172762+0000","last_clean":"2023-11-24T08:00:28.172762+0000","last_became_active":"2023-11-24T08:00:26.766444+0000","last_became_peered":"2023-11-24T08:00:26.766444+0000","last_unstale":"2023-11-24T08:00:28.172762+0000","last_undegraded":"2023-11-24T08:00:28.172762+0000","last_fullsized":"2023-11-24T08:00:28.172762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768123+0000","last_change":"2023-11-24T08:00:25.492070+0000","last_active":"2023-11-24T08:00:27.768123+0000","last_peered":"2023-11-24T08:00:27.768123+0000","last_clean":"2023-11-24T08:00:27.768123+0000","last_became_active":"2023-11-24T08:00:25.489186+0000","last_became_peered":"2023-11-24T08:00:25.489186+0000","last_unstale":"2023-11-24T08:00:27.768123+0000","last_undegraded":"2023-11-24T08:00:27.768123+0000","last_fullsized":"2023-11-24T08:00:27.768123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.768204+0000","last_change":"2023-11-24T08:00:26.759451+0000","last_active":"2023-11-24T08:00:26.768204+0000","last_peered":"2023-11-24T08:00:26.768204+0000","last_clean":"2023-11-24T08:00:26.768204+0000","last_became_active":"2023-11-24T08:00:26.758996+0000","last_became_peered":"2023-11-24T08:00:26.758996+0000","last_unstale":"2023-11-24T08:00:26.768204+0000","last_undegraded":"2023-11-24T08:00:26.768204+0000","last_fullsized":"2023-11-24T08:00:26.768204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:34:33.895684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768950+0000","last_change":"2023-11-24T08:00:25.493105+0000","last_active":"2023-11-24T08:00:27.768950+0000","last_peered":"2023-11-24T08:00:27.768950+0000","last_clean":"2023-11-24T08:00:27.768950+0000","last_became_active":"2023-11-24T08:00:25.492800+0000","last_became_peered":"2023-11-24T08:00:25.492800+0000","last_unstale":"2023-11-24T08:00:27.768950+0000","last_undegraded":"2023-11-24T08:00:27.768950+0000","last_fullsized":"2023-11-24T08:00:27.768950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768631+0000","last_change":"2023-11-24T08:00:26.777968+0000","last_active":"2023-11-24T08:00:27.768631+0000","last_peered":"2023-11-24T08:00:27.768631+0000","last_clean":"2023-11-24T08:00:27.768631+0000","last_became_active":"2023-11-24T08:00:26.774815+0000","last_became_peered":"2023-11-24T08:00:26.774815+0000","last_unstale":"2023-11-24T08:00:27.768631+0000","last_undegraded":"2023-11-24T08:00:27.768631+0000","last_fullsized":"2023-11-24T08:00:27.768631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768646+0000","last_change":"2023-11-24T08:00:25.491014+0000","last_active":"2023-11-24T08:00:27.768646+0000","last_peered":"2023-11-24T08:00:27.768646+0000","last_clean":"2023-11-24T08:00:27.768646+0000","last_became_active":"2023-11-24T08:00:25.490752+0000","last_became_peered":"2023-11-24T08:00:25.490752+0000","last_unstale":"2023-11-24T08:00:27.768646+0000","last_undegraded":"2023-11-24T08:00:27.768646+0000","last_fullsized":"2023-11-24T08:00:27.768646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.781780+0000","last_change":"2023-11-24T08:00:26.777398+0000","last_active":"2023-11-24T08:00:26.781780+0000","last_peered":"2023-11-24T08:00:26.781780+0000","last_clean":"2023-11-24T08:00:26.781780+0000","last_became_active":"2023-11-24T08:00:26.777180+0000","last_became_peered":"2023-11-24T08:00:26.777180+0000","last_unstale":"2023-11-24T08:00:26.781780+0000","last_undegraded":"2023-11-24T08:00:26.781780+0000","last_fullsized":"2023-11-24T08:00:26.781780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:47.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.791615+0000","last_change":"2023-11-24T08:00:25.493583+0000","last_active":"2023-11-24T08:00:26.791615+0000","last_peered":"2023-11-24T08:00:26.791615+0000","last_clean":"2023-11-24T08:00:26.791615+0000","last_became_active":"2023-11-24T08:00:25.493049+0000","last_became_peered":"2023-11-24T08:00:25.493049+0000","last_unstale":"2023-11-24T08:00:26.791615+0000","last_undegraded":"2023-11-24T08:00:26.791615+0000","last_fullsized":"2023-11-24T08:00:26.791615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:04.556704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.773376+0000","last_change":"2023-11-24T08:00:26.771496+0000","last_active":"2023-11-24T08:00:26.773376+0000","last_peered":"2023-11-24T08:00:26.773376+0000","last_clean":"2023-11-24T08:00:26.773376+0000","last_became_active":"2023-11-24T08:00:26.768866+0000","last_became_peered":"2023-11-24T08:00:26.768866+0000","last_unstale":"2023-11-24T08:00:26.773376+0000","last_undegraded":"2023-11-24T08:00:26.773376+0000","last_fullsized":"2023-11-24T08:00:26.773376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:10.821210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767521+0000","last_change":"2023-11-24T08:00:25.470991+0000","last_active":"2023-11-24T08:00:27.767521+0000","last_peered":"2023-11-24T08:00:27.767521+0000","last_clean":"2023-11-24T08:00:27.767521+0000","last_became_active":"2023-11-24T08:00:25.467281+0000","last_became_peered":"2023-11-24T08:00:25.467281+0000","last_unstale":"2023-11-24T08:00:27.767521+0000","last_undegraded":"2023-11-24T08:00:27.767521+0000","last_fullsized":"2023-11-24T08:00:27.767521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173928+0000","last_change":"2023-11-24T08:00:26.761810+0000","last_active":"2023-11-24T08:00:28.173928+0000","last_peered":"2023-11-24T08:00:28.173928+0000","last_clean":"2023-11-24T08:00:28.173928+0000","last_became_active":"2023-11-24T08:00:26.761443+0000","last_became_peered":"2023-11-24T08:00:26.761443+0000","last_unstale":"2023-11-24T08:00:28.173928+0000","last_undegraded":"2023-11-24T08:00:28.173928+0000","last_fullsized":"2023-11-24T08:00:28.173928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.794579+0000","last_change":"2023-11-24T08:00:25.476805+0000","last_active":"2023-11-24T08:00:26.794579+0000","last_peered":"2023-11-24T08:00:26.794579+0000","last_clean":"2023-11-24T08:00:26.794579+0000","last_became_active":"2023-11-24T08:00:25.476150+0000","last_became_peered":"2023-11-24T08:00:25.476150+0000","last_unstale":"2023-11-24T08:00:26.794579+0000","last_undegraded":"2023-11-24T08:00:26.794579+0000","last_fullsized":"2023-11-24T08:00:26.794579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.776031+0000","last_change":"2023-11-24T08:00:26.770849+0000","last_active":"2023-11-24T08:00:26.776031+0000","last_peered":"2023-11-24T08:00:26.776031+0000","last_clean":"2023-11-24T08:00:26.776031+0000","last_became_active":"2023-11-24T08:00:26.769532+0000","last_became_peered":"2023-11-24T08:00:26.769532+0000","last_unstale":"2023-11-24T08:00:26.776031+0000","last_undegraded":"2023-11-24T08:00:26.776031+0000","last_fullsized":"2023-11-24T08:00:26.776031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:48.837595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768910+0000","last_change":"2023-11-24T08:00:25.489658+0000","last_active":"2023-11-24T08:00:27.768910+0000","last_peered":"2023-11-24T08:00:27.768910+0000","last_clean":"2023-11-24T08:00:27.768910+0000","last_became_active":"2023-11-24T08:00:25.489387+0000","last_became_peered":"2023-11-24T08:00:25.489387+0000","last_unstale":"2023-11-24T08:00:27.768910+0000","last_undegraded":"2023-11-24T08:00:27.768910+0000","last_fullsized":"2023-11-24T08:00:27.768910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:12.207873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174020+0000","last_change":"2023-11-24T08:00:26.773222+0000","last_active":"2023-11-24T08:00:28.174020+0000","last_peered":"2023-11-24T08:00:28.174020+0000","last_clean":"2023-11-24T08:00:28.174020+0000","last_became_active":"2023-11-24T08:00:26.772961+0000","last_became_peered":"2023-11-24T08:00:26.772961+0000","last_unstale":"2023-11-24T08:00:28.174020+0000","last_undegraded":"2023-11-24T08:00:28.174020+0000","last_fullsized":"2023-11-24T08:00:28.174020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767377+0000","last_change":"2023-11-24T08:00:25.480070+0000","last_active":"2023-11-24T08:00:27.767377+0000","last_peered":"2023-11-24T08:00:27.767377+0000","last_clean":"2023-11-24T08:00:27.767377+0000","last_became_active":"2023-11-24T08:00:25.479345+0000","last_became_peered":"2023-11-24T08:00:25.479345+0000","last_unstale":"2023-11-24T08:00:27.767377+0000","last_undegraded":"2023-11-24T08:00:27.767377+0000","last_fullsized":"2023-11-24T08:00:27.767377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767763+0000","last_change":"2023-11-24T08:00:26.760511+0000","last_active":"2023-11-24T08:00:27.767763+0000","last_peered":"2023-11-24T08:00:27.767763+0000","last_clean":"2023-11-24T08:00:27.767763+0000","last_became_active":"2023-11-24T08:00:26.760206+0000","last_became_peered":"2023-11-24T08:00:26.760206+0000","last_unstale":"2023-11-24T08:00:27.767763+0000","last_undegraded":"2023-11-24T08:00:27.767763+0000","last_fullsized":"2023-11-24T08:00:27.767763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170764+0000","last_change":"2023-11-24T08:00:25.477302+0000","last_active":"2023-11-24T08:00:28.170764+0000","last_peered":"2023-11-24T08:00:28.170764+0000","last_clean":"2023-11-24T08:00:28.170764+0000","last_became_active":"2023-11-24T08:00:25.477026+0000","last_became_peered":"2023-11-24T08:00:25.477026+0000","last_unstale":"2023-11-24T08:00:28.170764+0000","last_undegraded":"2023-11-24T08:00:28.170764+0000","last_fullsized":"2023-11-24T08:00:28.170764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:47.411014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173040+0000","last_change":"2023-11-24T08:00:26.771081+0000","last_active":"2023-11-24T08:00:28.173040+0000","last_peered":"2023-11-24T08:00:28.173040+0000","last_clean":"2023-11-24T08:00:28.173040+0000","last_became_active":"2023-11-24T08:00:26.767738+0000","last_became_peered":"2023-11-24T08:00:26.767738+0000","last_unstale":"2023-11-24T08:00:28.173040+0000","last_undegraded":"2023-11-24T08:00:28.173040+0000","last_fullsized":"2023-11-24T08:00:28.173040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.786295+0000","last_change":"2023-11-24T08:00:25.473084+0000","last_active":"2023-11-24T08:00:26.786295+0000","last_peered":"2023-11-24T08:00:26.786295+0000","last_clean":"2023-11-24T08:00:26.786295+0000","last_became_active":"2023-11-24T08:00:25.472511+0000","last_became_peered":"2023-11-24T08:00:25.472511+0000","last_unstale":"2023-11-24T08:00:26.786295+0000","last_undegraded":"2023-11-24T08:00:26.786295+0000","last_fullsized":"2023-11-24T08:00:26.786295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:30.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174602+0000","last_change":"2023-11-24T08:00:26.770832+0000","last_active":"2023-11-24T08:00:28.174602+0000","last_peered":"2023-11-24T08:00:28.174602+0000","last_clean":"2023-11-24T08:00:28.174602+0000","last_became_active":"2023-11-24T08:00:26.770425+0000","last_became_peered":"2023-11-24T08:00:26.770425+0000","last_unstale":"2023-11-24T08:00:28.174602+0000","last_undegraded":"2023-11-24T08:00:28.174602+0000","last_fullsized":"2023-11-24T08:00:28.174602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171853+0000","last_change":"2023-11-24T08:00:25.479082+0000","last_active":"2023-11-24T08:00:28.171853+0000","last_peered":"2023-11-24T08:00:28.171853+0000","last_clean":"2023-11-24T08:00:28.171853+0000","last_became_active":"2023-11-24T08:00:25.478759+0000","last_became_peered":"2023-11-24T08:00:25.478759+0000","last_unstale":"2023-11-24T08:00:28.171853+0000","last_undegraded":"2023-11-24T08:00:28.171853+0000","last_fullsized":"2023-11-24T08:00:28.171853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175030+0000","last_change":"2023-11-24T08:00:26.766352+0000","last_active":"2023-11-24T08:00:28.175030+0000","last_peered":"2023-11-24T08:00:28.175030+0000","last_clean":"2023-11-24T08:00:28.175030+0000","last_became_active":"2023-11-24T08:00:26.765178+0000","last_became_peered":"2023-11-24T08:00:26.765178+0000","last_unstale":"2023-11-24T08:00:28.175030+0000","last_undegraded":"2023-11-24T08:00:28.175030+0000","last_fullsized":"2023-11-24T08:00:28.175030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:31.302140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.791506+0000","last_change":"2023-11-24T08:00:25.480774+0000","last_active":"2023-11-24T08:00:26.791506+0000","last_peered":"2023-11-24T08:00:26.791506+0000","last_clean":"2023-11-24T08:00:26.791506+0000","last_became_active":"2023-11-24T08:00:25.480505+0000","last_became_peered":"2023-11-24T08:00:25.480505+0000","last_unstale":"2023-11-24T08:00:26.791506+0000","last_undegraded":"2023-11-24T08:00:26.791506+0000","last_fullsized":"2023-11-24T08:00:26.791506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:47.832998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768605+0000","last_change":"2023-11-24T08:00:26.777032+0000","last_active":"2023-11-24T08:00:27.768605+0000","last_peered":"2023-11-24T08:00:27.768605+0000","last_clean":"2023-11-24T08:00:27.768605+0000","last_became_active":"2023-11-24T08:00:26.776390+0000","last_became_peered":"2023-11-24T08:00:26.776390+0000","last_unstale":"2023-11-24T08:00:27.768605+0000","last_undegraded":"2023-11-24T08:00:27.768605+0000","last_fullsized":"2023-11-24T08:00:27.768605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171558+0000","last_change":"2023-11-24T08:00:25.482325+0000","last_active":"2023-11-24T08:00:28.171558+0000","last_peered":"2023-11-24T08:00:28.171558+0000","last_clean":"2023-11-24T08:00:28.171558+0000","last_became_active":"2023-11-24T08:00:25.481949+0000","last_became_peered":"2023-11-24T08:00:25.481949+0000","last_unstale":"2023-11-24T08:00:28.171558+0000","last_undegraded":"2023-11-24T08:00:28.171558+0000","last_fullsized":"2023-11-24T08:00:28.171558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174954+0000","last_change":"2023-11-24T08:00:26.768210+0000","last_active":"2023-11-24T08:00:28.174954+0000","last_peered":"2023-11-24T08:00:28.174954+0000","last_clean":"2023-11-24T08:00:28.174954+0000","last_became_active":"2023-11-24T08:00:26.767945+0000","last_became_peered":"2023-11-24T08:00:26.767945+0000","last_unstale":"2023-11-24T08:00:28.174954+0000","last_undegraded":"2023-11-24T08:00:28.174954+0000","last_fullsized":"2023-11-24T08:00:28.174954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:14.495500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.745147+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:00:26.745147+0000","last_peered":"2023-11-24T08:00:26.745147+0000","last_clean":"2023-11-24T08:00:26.745147+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:00:26.745147+0000","last_undegraded":"2023-11-24T08:00:26.745147+0000","last_fullsized":"2023-11-24T08:00:26.745147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768099+0000","last_change":"2023-11-24T08:00:25.482920+0000","last_active":"2023-11-24T08:00:27.768099+0000","last_peered":"2023-11-24T08:00:27.768099+0000","last_clean":"2023-11-24T08:00:27.768099+0000","last_became_active":"2023-11-24T08:00:25.482550+0000","last_became_peered":"2023-11-24T08:00:25.482550+0000","last_unstale":"2023-11-24T08:00:27.768099+0000","last_undegraded":"2023-11-24T08:00:27.768099+0000","last_fullsized":"2023-11-24T08:00:27.768099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174979+0000","last_change":"2023-11-24T08:00:26.771428+0000","last_active":"2023-11-24T08:00:28.174979+0000","last_peered":"2023-11-24T08:00:28.174979+0000","last_clean":"2023-11-24T08:00:28.174979+0000","last_became_active":"2023-11-24T08:00:26.771067+0000","last_became_peered":"2023-11-24T08:00:26.771067+0000","last_unstale":"2023-11-24T08:00:28.174979+0000","last_undegraded":"2023-11-24T08:00:28.174979+0000","last_fullsized":"2023-11-24T08:00:28.174979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172499+0000","last_change":"2023-11-24T08:00:25.494571+0000","last_active":"2023-11-24T08:00:28.172499+0000","last_peered":"2023-11-24T08:00:28.172499+0000","last_clean":"2023-11-24T08:00:28.172499+0000","last_became_active":"2023-11-24T08:00:25.493557+0000","last_became_peered":"2023-11-24T08:00:25.493557+0000","last_unstale":"2023-11-24T08:00:28.172499+0000","last_undegraded":"2023-11-24T08:00:28.172499+0000","last_fullsized":"2023-11-24T08:00:28.172499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.771152+0000","last_change":"2023-11-24T08:00:26.762814+0000","last_active":"2023-11-24T08:00:26.771152+0000","last_peered":"2023-11-24T08:00:26.771152+0000","last_clean":"2023-11-24T08:00:26.771152+0000","last_became_active":"2023-11-24T08:00:26.761448+0000","last_became_peered":"2023-11-24T08:00:26.761448+0000","last_unstale":"2023-11-24T08:00:26.771152+0000","last_undegraded":"2023-11-24T08:00:26.771152+0000","last_fullsized":"2023-11-24T08:00:26.771152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:10.821210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170966+0000","last_change":"2023-11-24T08:00:25.478945+0000","last_active":"2023-11-24T08:00:28.170966+0000","last_peered":"2023-11-24T08:00:28.170966+0000","last_clean":"2023-11-24T08:00:28.170966+0000","last_became_active":"2023-11-24T08:00:25.478645+0000","last_became_peered":"2023-11-24T08:00:25.478645+0000","last_unstale":"2023-11-24T08:00:28.170966+0000","last_undegraded":"2023-11-24T08:00:28.170966+0000","last_fullsized":"2023-11-24T08:00:28.170966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:26:36.241356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.766174+0000","last_change":"2023-11-24T08:00:26.756524+0000","last_active":"2023-11-24T08:00:26.766174+0000","last_peered":"2023-11-24T08:00:26.766174+0000","last_clean":"2023-11-24T08:00:26.766174+0000","last_became_active":"2023-11-24T08:00:26.754522+0000","last_became_peered":"2023-11-24T08:00:26.754522+0000","last_unstale":"2023-11-24T08:00:26.766174+0000","last_undegraded":"2023-11-24T08:00:26.766174+0000","last_fullsized":"2023-11-24T08:00:26.766174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:21.367690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768991+0000","last_change":"2023-11-24T08:00:25.489726+0000","last_active":"2023-11-24T08:00:27.768991+0000","last_peered":"2023-11-24T08:00:27.768991+0000","last_clean":"2023-11-24T08:00:27.768991+0000","last_became_active":"2023-11-24T08:00:25.489421+0000","last_became_peered":"2023-11-24T08:00:25.489421+0000","last_unstale":"2023-11-24T08:00:27.768991+0000","last_undegraded":"2023-11-24T08:00:27.768991+0000","last_fullsized":"2023-11-24T08:00:27.768991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.770903+0000","last_change":"2023-11-24T08:00:26.766472+0000","last_active":"2023-11-24T08:00:26.770903+0000","last_peered":"2023-11-24T08:00:26.770903+0000","last_clean":"2023-11-24T08:00:26.770903+0000","last_became_active":"2023-11-24T08:00:26.765996+0000","last_became_peered":"2023-11-24T08:00:26.765996+0000","last_unstale":"2023-11-24T08:00:26.770903+0000","last_undegraded":"2023-11-24T08:00:26.770903+0000","last_fullsized":"2023-11-24T08:00:26.770903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:47.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.732096+0000","last_change":"2023-11-24T08:00:25.481042+0000","last_active":"2023-11-24T08:00:26.732096+0000","last_peered":"2023-11-24T08:00:26.732096+0000","last_clean":"2023-11-24T08:00:26.732096+0000","last_became_active":"2023-11-24T08:00:25.480733+0000","last_became_peered":"2023-11-24T08:00:25.480733+0000","last_unstale":"2023-11-24T08:00:26.732096+0000","last_undegraded":"2023-11-24T08:00:26.732096+0000","last_fullsized":"2023-11-24T08:00:26.732096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:41.051307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769401+0000","last_change":"2023-11-24T08:00:26.775027+0000","last_active":"2023-11-24T08:00:27.769401+0000","last_peered":"2023-11-24T08:00:27.769401+0000","last_clean":"2023-11-24T08:00:27.769401+0000","last_became_active":"2023-11-24T08:00:26.774593+0000","last_became_peered":"2023-11-24T08:00:26.774593+0000","last_unstale":"2023-11-24T08:00:27.769401+0000","last_undegraded":"2023-11-24T08:00:27.769401+0000","last_fullsized":"2023-11-24T08:00:27.769401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174850+0000","last_change":"2023-11-24T08:00:25.494481+0000","last_active":"2023-11-24T08:00:28.174850+0000","last_peered":"2023-11-24T08:00:28.174850+0000","last_clean":"2023-11-24T08:00:28.174850+0000","last_became_active":"2023-11-24T08:00:25.494253+0000","last_became_peered":"2023-11-24T08:00:25.494253+0000","last_unstale":"2023-11-24T08:00:28.174850+0000","last_undegraded":"2023-11-24T08:00:28.174850+0000","last_fullsized":"2023-11-24T08:00:28.174850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.768841+0000","last_change":"2023-11-24T08:00:26.757666+0000","last_active":"2023-11-24T08:00:26.768841+0000","last_peered":"2023-11-24T08:00:26.768841+0000","last_clean":"2023-11-24T08:00:26.768841+0000","last_became_active":"2023-11-24T08:00:26.757401+0000","last_became_peered":"2023-11-24T08:00:26.757401+0000","last_unstale":"2023-11-24T08:00:26.768841+0000","last_undegraded":"2023-11-24T08:00:26.768841+0000","last_fullsized":"2023-11-24T08:00:26.768841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:15:38.288322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.733923+0000","last_change":"2023-11-24T08:00:25.483011+0000","last_active":"2023-11-24T08:00:26.733923+0000","last_peered":"2023-11-24T08:00:26.733923+0000","last_clean":"2023-11-24T08:00:26.733923+0000","last_became_active":"2023-11-24T08:00:25.481668+0000","last_became_peered":"2023-11-24T08:00:25.481668+0000","last_unstale":"2023-11-24T08:00:26.733923+0000","last_undegraded":"2023-11-24T08:00:26.733923+0000","last_fullsized":"2023-11-24T08:00:26.733923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174672+0000","last_change":"2023-11-24T08:00:26.760962+0000","last_active":"2023-11-24T08:00:28.174672+0000","last_peered":"2023-11-24T08:00:28.174672+0000","last_clean":"2023-11-24T08:00:28.174672+0000","last_became_active":"2023-11-24T08:00:26.760541+0000","last_became_peered":"2023-11-24T08:00:26.760541+0000","last_unstale":"2023-11-24T08:00:28.174672+0000","last_undegraded":"2023-11-24T08:00:28.174672+0000","last_fullsized":"2023-11-24T08:00:28.174672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769002+0000","last_change":"2023-11-24T08:00:25.491430+0000","last_active":"2023-11-24T08:00:27.769002+0000","last_peered":"2023-11-24T08:00:27.769002+0000","last_clean":"2023-11-24T08:00:27.769002+0000","last_became_active":"2023-11-24T08:00:25.490656+0000","last_became_peered":"2023-11-24T08:00:25.490656+0000","last_unstale":"2023-11-24T08:00:27.769002+0000","last_undegraded":"2023-11-24T08:00:27.769002+0000","last_fullsized":"2023-11-24T08:00:27.769002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.769453+0000","last_change":"2023-11-24T08:00:26.762592+0000","last_active":"2023-11-24T08:00:26.769453+0000","last_peered":"2023-11-24T08:00:26.769453+0000","last_clean":"2023-11-24T08:00:26.769453+0000","last_became_active":"2023-11-24T08:00:26.759772+0000","last_became_peered":"2023-11-24T08:00:26.759772+0000","last_unstale":"2023-11-24T08:00:26.769453+0000","last_undegraded":"2023-11-24T08:00:26.769453+0000","last_fullsized":"2023-11-24T08:00:26.769453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:29.174934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172271+0000","last_change":"2023-11-24T08:00:25.494768+0000","last_active":"2023-11-24T08:00:28.172271+0000","last_peered":"2023-11-24T08:00:28.172271+0000","last_clean":"2023-11-24T08:00:28.172271+0000","last_became_active":"2023-11-24T08:00:25.494268+0000","last_became_peered":"2023-11-24T08:00:25.494268+0000","last_unstale":"2023-11-24T08:00:28.172271+0000","last_undegraded":"2023-11-24T08:00:28.172271+0000","last_fullsized":"2023-11-24T08:00:28.172271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.769625+0000","last_change":"2023-11-24T08:00:26.761236+0000","last_active":"2023-11-24T08:00:26.769625+0000","last_peered":"2023-11-24T08:00:26.769625+0000","last_clean":"2023-11-24T08:00:26.769625+0000","last_became_active":"2023-11-24T08:00:26.755777+0000","last_became_peered":"2023-11-24T08:00:26.755777+0000","last_unstale":"2023-11-24T08:00:26.769625+0000","last_undegraded":"2023-11-24T08:00:26.769625+0000","last_fullsized":"2023-11-24T08:00:26.769625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:41.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.737896+0000","last_change":"2023-11-24T08:00:25.483781+0000","last_active":"2023-11-24T08:00:26.737896+0000","last_peered":"2023-11-24T08:00:26.737896+0000","last_clean":"2023-11-24T08:00:26.737896+0000","last_became_active":"2023-11-24T08:00:25.483449+0000","last_became_peered":"2023-11-24T08:00:25.483449+0000","last_unstale":"2023-11-24T08:00:26.737896+0000","last_undegraded":"2023-11-24T08:00:26.737896+0000","last_fullsized":"2023-11-24T08:00:26.737896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:42.351833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172763+0000","last_change":"2023-11-24T08:00:26.770074+0000","last_active":"2023-11-24T08:00:28.172763+0000","last_peered":"2023-11-24T08:00:28.172763+0000","last_clean":"2023-11-24T08:00:28.172763+0000","last_became_active":"2023-11-24T08:00:26.767285+0000","last_became_peered":"2023-11-24T08:00:26.767285+0000","last_unstale":"2023-11-24T08:00:28.172763+0000","last_undegraded":"2023-11-24T08:00:28.172763+0000","last_fullsized":"2023-11-24T08:00:28.172763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.732029+0000","last_change":"2023-11-24T08:00:25.483961+0000","last_active":"2023-11-24T08:00:26.732029+0000","last_peered":"2023-11-24T08:00:26.732029+0000","last_clean":"2023-11-24T08:00:26.732029+0000","last_became_active":"2023-11-24T08:00:25.481836+0000","last_became_peered":"2023-11-24T08:00:25.481836+0000","last_unstale":"2023-11-24T08:00:26.732029+0000","last_undegraded":"2023-11-24T08:00:26.732029+0000","last_fullsized":"2023-11-24T08:00:26.732029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:09.816614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175247+0000","last_change":"2023-11-24T08:00:26.769858+0000","last_active":"2023-11-24T08:00:28.175247+0000","last_peered":"2023-11-24T08:00:28.175247+0000","last_clean":"2023-11-24T08:00:28.175247+0000","last_became_active":"2023-11-24T08:00:26.766200+0000","last_became_peered":"2023-11-24T08:00:26.766200+0000","last_unstale":"2023-11-24T08:00:28.175247+0000","last_undegraded":"2023-11-24T08:00:28.175247+0000","last_fullsized":"2023-11-24T08:00:28.175247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174355+0000","last_change":"2023-11-24T08:00:25.495132+0000","last_active":"2023-11-24T08:00:28.174355+0000","last_peered":"2023-11-24T08:00:28.174355+0000","last_clean":"2023-11-24T08:00:28.174355+0000","last_became_active":"2023-11-24T08:00:25.494764+0000","last_became_peered":"2023-11-24T08:00:25.494764+0000","last_unstale":"2023-11-24T08:00:28.174355+0000","last_undegraded":"2023-11-24T08:00:28.174355+0000","last_fullsized":"2023-11-24T08:00:28.174355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767414+0000","last_change":"2023-11-24T08:00:26.749850+0000","last_active":"2023-11-24T08:00:27.767414+0000","last_peered":"2023-11-24T08:00:27.767414+0000","last_clean":"2023-11-24T08:00:27.767414+0000","last_became_active":"2023-11-24T08:00:26.749536+0000","last_became_peered":"2023-11-24T08:00:26.749536+0000","last_unstale":"2023-11-24T08:00:27.767414+0000","last_undegraded":"2023-11-24T08:00:27.767414+0000","last_fullsized":"2023-11-24T08:00:27.767414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769202+0000","last_change":"2023-11-24T08:00:26.779787+0000","last_active":"2023-11-24T08:00:27.769202+0000","last_peered":"2023-11-24T08:00:27.769202+0000","last_clean":"2023-11-24T08:00:27.769202+0000","last_became_active":"2023-11-24T08:00:26.779470+0000","last_became_peered":"2023-11-24T08:00:26.779470+0000","last_unstale":"2023-11-24T08:00:27.769202+0000","last_undegraded":"2023-11-24T08:00:27.769202+0000","last_fullsized":"2023-11-24T08:00:27.769202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173834+0000","last_change":"2023-11-24T08:00:25.497773+0000","last_active":"2023-11-24T08:00:28.173834+0000","last_peered":"2023-11-24T08:00:28.173834+0000","last_clean":"2023-11-24T08:00:28.173834+0000","last_became_active":"2023-11-24T08:00:25.497355+0000","last_became_peered":"2023-11-24T08:00:25.497355+0000","last_unstale":"2023-11-24T08:00:28.173834+0000","last_undegraded":"2023-11-24T08:00:28.173834+0000","last_fullsized":"2023-11-24T08:00:28.173834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769447+0000","last_change":"2023-11-24T08:00:26.779853+0000","last_active":"2023-11-24T08:00:27.769447+0000","last_peered":"2023-11-24T08:00:27.769447+0000","last_clean":"2023-11-24T08:00:27.769447+0000","last_became_active":"2023-11-24T08:00:26.779449+0000","last_became_peered":"2023-11-24T08:00:26.779449+0000","last_unstale":"2023-11-24T08:00:27.769447+0000","last_undegraded":"2023-11-24T08:00:27.769447+0000","last_fullsized":"2023-11-24T08:00:27.769447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174399+0000","last_change":"2023-11-24T08:00:25.493174+0000","last_active":"2023-11-24T08:00:28.174399+0000","last_peered":"2023-11-24T08:00:28.174399+0000","last_clean":"2023-11-24T08:00:28.174399+0000","last_became_active":"2023-11-24T08:00:25.492565+0000","last_became_peered":"2023-11-24T08:00:25.492565+0000","last_unstale":"2023-11-24T08:00:28.174399+0000","last_undegraded":"2023-11-24T08:00:28.174399+0000","last_fullsized":"2023-11-24T08:00:28.174399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:16.328173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.785695+0000","last_change":"2023-11-24T08:00:26.779709+0000","last_active":"2023-11-24T08:00:26.785695+0000","last_peered":"2023-11-24T08:00:26.785695+0000","last_clean":"2023-11-24T08:00:26.785695+0000","last_became_active":"2023-11-24T08:00:26.779501+0000","last_became_peered":"2023-11-24T08:00:26.779501+0000","last_unstale":"2023-11-24T08:00:26.785695+0000","last_undegraded":"2023-11-24T08:00:26.785695+0000","last_fullsized":"2023-11-24T08:00:26.785695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:05.561300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174361+0000","last_change":"2023-11-24T08:00:25.475566+0000","last_active":"2023-11-24T08:00:28.174361+0000","last_peered":"2023-11-24T08:00:28.174361+0000","last_clean":"2023-11-24T08:00:28.174361+0000","last_became_active":"2023-11-24T08:00:25.475286+0000","last_became_peered":"2023-11-24T08:00:25.475286+0000","last_unstale":"2023-11-24T08:00:28.174361+0000","last_undegraded":"2023-11-24T08:00:28.174361+0000","last_fullsized":"2023-11-24T08:00:28.174361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:25.827802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174531+0000","last_change":"2023-11-24T08:00:26.759142+0000","last_active":"2023-11-24T08:00:28.174531+0000","last_peered":"2023-11-24T08:00:28.174531+0000","last_clean":"2023-11-24T08:00:28.174531+0000","last_became_active":"2023-11-24T08:00:26.758874+0000","last_became_peered":"2023-11-24T08:00:26.758874+0000","last_unstale":"2023-11-24T08:00:28.174531+0000","last_undegraded":"2023-11-24T08:00:28.174531+0000","last_fullsized":"2023-11-24T08:00:28.174531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.794833+0000","last_change":"2023-11-24T08:00:25.490543+0000","last_active":"2023-11-24T08:00:26.794833+0000","last_peered":"2023-11-24T08:00:26.794833+0000","last_clean":"2023-11-24T08:00:26.794833+0000","last_became_active":"2023-11-24T08:00:25.490222+0000","last_became_peered":"2023-11-24T08:00:25.490222+0000","last_unstale":"2023-11-24T08:00:26.794833+0000","last_undegraded":"2023-11-24T08:00:26.794833+0000","last_fullsized":"2023-11-24T08:00:26.794833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:34:32.891088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":661830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":77270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.944}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.861}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.97}]}]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":71006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1680000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1760000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":654473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0790000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1030000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:00:31.202 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:00:31.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.459+0000 7f390bcbb640 1 Processor -- start 2023-11-24T08:00:31.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.459+0000 7f390bcbb640 1 -- start start 2023-11-24T08:00:31.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.460+0000 7f390bcbb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3904143ae0 0x7f39040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.460+0000 7f390bcbb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.460+0000 7f390bcbb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39040cfc30 con 0x7f39040cf7d0 2023-11-24T08:00:31.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.460+0000 7f390bcbb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040b1ee0 con 0x7f3904143ae0 2023-11-24T08:00:31.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.460+0000 7f390bcbb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040b2780 con 0x7f390415e3b0 2023-11-24T08:00:31.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909a57640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3904143ae0 0x7f39040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909256640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f39040cf7d0 0x7f390415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39922/0 (socket says 172.21.15.161:39922) 2023-11-24T08:00:31.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909256640 1 -- 172.21.15.161:0/637520255 learned_addr learned my addr 172.21.15.161:0/637520255 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:31.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f390a258640 1 --2- 172.21.15.161:0/637520255 >> v2:172.21.15.175:3300/0 conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909a57640 1 -- 172.21.15.161:0/637520255 >> v2:172.21.15.175:3300/0 conn(0x7f390415e3b0 msgr2=0x7f39040702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:31.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909a57640 1 --2- 172.21.15.161:0/637520255 >> v2:172.21.15.175:3300/0 conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909a57640 1 -- 172.21.15.161:0/637520255 >> v1:172.21.15.161:6789/0 conn(0x7f39040cf7d0 legacy=0x7f390415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3908a55640 1 -- 172.21.15.161:0/637520255 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740575165 0 0) 0x7f39040cfc30 con 0x7f39040cf7d0 2023-11-24T08:00:31.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.461+0000 7f3909a57640 1 -- 172.21.15.161:0/637520255 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390415e990 con 0x7f3904143ae0 2023-11-24T08:00:31.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.462+0000 7f3909a57640 1 --2- 172.21.15.161:0/637520255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3904143ae0 0x7f39040cf290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f390406e4f0 tx=0x7f390002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb5631af4272d88 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f3908a55640 1 -- 172.21.15.161:0/637520255 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900031830 con 0x7f3904143ae0 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f3908a55640 1 -- 172.21.15.161:0/637520255 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900031990 con 0x7f3904143ae0 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f3908a55640 1 -- 172.21.15.161:0/637520255 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900031d20 con 0x7f3904143ae0 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 -- 172.21.15.161:0/637520255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3904143ae0 msgr2=0x7f39040cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 --2- 172.21.15.161:0/637520255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3904143ae0 0x7f39040cf290 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f390406e4f0 tx=0x7f390002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 -- 172.21.15.161:0/637520255 shutdown_connections 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 --2- 172.21.15.161:0/637520255 >> v2:172.21.15.175:3300/0 conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 --2- 172.21.15.161:0/637520255 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3904143ae0 0x7f39040cf290 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 -- 172.21.15.161:0/637520255 >> 172.21.15.161:0/637520255 conn(0x7f390406a800 msgr2=0x7f390406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 -- 172.21.15.161:0/637520255 shutdown_connections 2023-11-24T08:00:31.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.463+0000 7f390bcbb640 1 -- 172.21.15.161:0/637520255 wait complete. 2023-11-24T08:00:31.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.465+0000 7f390bcbb640 1 Processor -- start 2023-11-24T08:00:31.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.465+0000 7f390bcbb640 1 -- start start 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f390bcbb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 0x7f3904141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f390bcbb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3904143ae0 0x7f39040ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f390bcbb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f390bcbb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904141dc0 con 0x7f39040cf7d0 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f390bcbb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39040c3e50 con 0x7f3904143ae0 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f390bcbb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040ccbd0 con 0x7f390415e3b0 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f3909a57640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 0x7f3904141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f3909a57640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 0x7f3904141880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56468/0 (socket says 172.21.15.161:56468) 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.466+0000 7f3909a57640 1 -- 172.21.15.161:0/4263006707 learned_addr learned my addr 172.21.15.161:0/4263006707 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f390a258640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909a57640 1 -- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390415e3b0 msgr2=0x7f39040702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909a57640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909a57640 1 -- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3904143ae0 msgr2=0x7f39040ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909256640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3904143ae0 0x7f39040ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909a57640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3904143ae0 0x7f39040ce160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909a57640 1 -- 172.21.15.161:0/4263006707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900009400 con 0x7f39040cf7d0 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f3909a57640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 0x7f3904141880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3900009890 tx=0x7f39000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:31.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390003ba70 con 0x7f39040cf7d0 2023-11-24T08:00:31.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390003bbf0 con 0x7f39040cf7d0 2023-11-24T08:00:31.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900045400 con 0x7f39040cf7d0 2023-11-24T08:00:31.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.467+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39040cceb0 con 0x7f39040cf7d0 2023-11-24T08:00:31.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.468+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39040cd470 con 0x7f39040cf7d0 2023-11-24T08:00:31.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.469+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39040cbf50 con 0x7f39040cf7d0 2023-11-24T08:00:31.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.470+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f390004e440 con 0x7f39040cf7d0 2023-11-24T08:00:31.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.472+0000 7f38fa7fc640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f38e806ae40 0x7f38e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.472+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39000ab9e0 con 0x7f39040cf7d0 2023-11-24T08:00:31.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.472+0000 7f3909256640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f38e806ae40 0x7f38e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.473+0000 7f3909256640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f38e806ae40 0x7f38e806d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39040cdda0 tx=0x7f38f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:31.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.478+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39000769f0 con 0x7f39040cf7d0 2023-11-24T08:00:31.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.668+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39040cd600 con 0x7f38e806ae40 2023-11-24T08:00:31.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.688+0000 7f38fa7fc640 1 -- 172.21.15.161:0/4263006707 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264429 (secure 0 0 0) 0x7f39040cd600 con 0x7f38e806ae40 2023-11-24T08:00:31.694 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:31.695 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:00:31.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f38e806ae40 msgr2=0x7f38e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f38e806ae40 0x7f38e806d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39040cdda0 tx=0x7f38f4009040 comp rx=0 tx=0).stop 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 msgr2=0x7f3904141880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 0x7f3904141880 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3900009890 tx=0x7f39000046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 shutdown_connections 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f38e806ae40 0x7f38e806d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f390415e3b0 0x7f39040702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3904143ae0 0x7f39040ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 --2- 172.21.15.161:0/4263006707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f39040cf7d0 0x7f3904141880 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 >> 172.21.15.161:0/4263006707 conn(0x7f390406a800 msgr2=0x7f390415b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:31.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 shutdown_connections 2023-11-24T08:00:31.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.694+0000 7f390bcbb640 1 -- 172.21.15.161:0/4263006707 wait complete. 2023-11-24T08:00:31.716 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-11-24T08:00:30.526927+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219048,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2924544,"data_stored":1757783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002079"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174603+0000","last_change":"2023-11-24T08:00:26.768948+0000","last_active":"2023-11-24T08:00:28.174603+0000","last_peered":"2023-11-24T08:00:28.174603+0000","last_clean":"2023-11-24T08:00:28.174603+0000","last_became_active":"2023-11-24T08:00:26.768601+0000","last_became_peered":"2023-11-24T08:00:26.768601+0000","last_unstale":"2023-11-24T08:00:28.174603+0000","last_undegraded":"2023-11-24T08:00:28.174603+0000","last_fullsized":"2023-11-24T08:00:28.174603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.770381+0000","last_change":"2023-11-24T08:00:26.766088+0000","last_active":"2023-11-24T08:00:26.770381+0000","last_peered":"2023-11-24T08:00:26.770381+0000","last_clean":"2023-11-24T08:00:26.770381+0000","last_became_active":"2023-11-24T08:00:26.765786+0000","last_became_peered":"2023-11-24T08:00:26.765786+0000","last_unstale":"2023-11-24T08:00:26.770381+0000","last_undegraded":"2023-11-24T08:00:26.770381+0000","last_fullsized":"2023-11-24T08:00:26.770381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:23.219831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.769322+0000","last_change":"2023-11-24T08:00:26.762423+0000","last_active":"2023-11-24T08:00:26.769322+0000","last_peered":"2023-11-24T08:00:26.769322+0000","last_clean":"2023-11-24T08:00:26.769322+0000","last_became_active":"2023-11-24T08:00:26.760624+0000","last_became_peered":"2023-11-24T08:00:26.760624+0000","last_unstale":"2023-11-24T08:00:26.769322+0000","last_undegraded":"2023-11-24T08:00:26.769322+0000","last_fullsized":"2023-11-24T08:00:26.769322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:31.782236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768385+0000","last_change":"2023-11-24T08:00:26.777163+0000","last_active":"2023-11-24T08:00:27.768385+0000","last_peered":"2023-11-24T08:00:27.768385+0000","last_clean":"2023-11-24T08:00:27.768385+0000","last_became_active":"2023-11-24T08:00:26.776740+0000","last_became_peered":"2023-11-24T08:00:26.776740+0000","last_unstale":"2023-11-24T08:00:27.768385+0000","last_undegraded":"2023-11-24T08:00:27.768385+0000","last_fullsized":"2023-11-24T08:00:27.768385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173729+0000","last_change":"2023-11-24T08:00:26.763129+0000","last_active":"2023-11-24T08:00:28.173729+0000","last_peered":"2023-11-24T08:00:28.173729+0000","last_clean":"2023-11-24T08:00:28.173729+0000","last_became_active":"2023-11-24T08:00:26.762767+0000","last_became_peered":"2023-11-24T08:00:26.762767+0000","last_unstale":"2023-11-24T08:00:28.173729+0000","last_undegraded":"2023-11-24T08:00:28.173729+0000","last_fullsized":"2023-11-24T08:00:28.173729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768358+0000","last_change":"2023-11-24T08:00:26.772489+0000","last_active":"2023-11-24T08:00:27.768358+0000","last_peered":"2023-11-24T08:00:27.768358+0000","last_clean":"2023-11-24T08:00:27.768358+0000","last_became_active":"2023-11-24T08:00:26.769412+0000","last_became_peered":"2023-11-24T08:00:26.769412+0000","last_unstale":"2023-11-24T08:00:27.768358+0000","last_undegraded":"2023-11-24T08:00:27.768358+0000","last_fullsized":"2023-11-24T08:00:27.768358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172502+0000","last_change":"2023-11-24T08:00:26.771569+0000","last_active":"2023-11-24T08:00:28.172502+0000","last_peered":"2023-11-24T08:00:28.172502+0000","last_clean":"2023-11-24T08:00:28.172502+0000","last_became_active":"2023-11-24T08:00:26.771170+0000","last_became_peered":"2023-11-24T08:00:26.771170+0000","last_unstale":"2023-11-24T08:00:28.172502+0000","last_undegraded":"2023-11-24T08:00:28.172502+0000","last_fullsized":"2023-11-24T08:00:28.172502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172266+0000","last_change":"2023-11-24T08:00:26.770049+0000","last_active":"2023-11-24T08:00:28.172266+0000","last_peered":"2023-11-24T08:00:28.172266+0000","last_clean":"2023-11-24T08:00:28.172266+0000","last_became_active":"2023-11-24T08:00:26.769256+0000","last_became_peered":"2023-11-24T08:00:26.769256+0000","last_unstale":"2023-11-24T08:00:28.172266+0000","last_undegraded":"2023-11-24T08:00:28.172266+0000","last_fullsized":"2023-11-24T08:00:28.172266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174837+0000","last_change":"2023-11-24T08:00:26.782744+0000","last_active":"2023-11-24T08:00:28.174837+0000","last_peered":"2023-11-24T08:00:28.174837+0000","last_clean":"2023-11-24T08:00:28.174837+0000","last_became_active":"2023-11-24T08:00:26.780825+0000","last_became_peered":"2023-11-24T08:00:26.780825+0000","last_unstale":"2023-11-24T08:00:28.174837+0000","last_undegraded":"2023-11-24T08:00:28.174837+0000","last_fullsized":"2023-11-24T08:00:28.174837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:26.750802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768128+0000","last_change":"2023-11-24T08:00:26.771369+0000","last_active":"2023-11-24T08:00:27.768128+0000","last_peered":"2023-11-24T08:00:27.768128+0000","last_clean":"2023-11-24T08:00:27.768128+0000","last_became_active":"2023-11-24T08:00:26.769019+0000","last_became_peered":"2023-11-24T08:00:26.769019+0000","last_unstale":"2023-11-24T08:00:27.768128+0000","last_undegraded":"2023-11-24T08:00:27.768128+0000","last_fullsized":"2023-11-24T08:00:27.768128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768021+0000","last_change":"2023-11-24T08:00:26.768671+0000","last_active":"2023-11-24T08:00:27.768021+0000","last_peered":"2023-11-24T08:00:27.768021+0000","last_clean":"2023-11-24T08:00:27.768021+0000","last_became_active":"2023-11-24T08:00:26.768353+0000","last_became_peered":"2023-11-24T08:00:26.768353+0000","last_unstale":"2023-11-24T08:00:27.768021+0000","last_undegraded":"2023-11-24T08:00:27.768021+0000","last_fullsized":"2023-11-24T08:00:27.768021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.761527+0000","last_change":"2023-11-24T08:00:26.749810+0000","last_active":"2023-11-24T08:00:26.761527+0000","last_peered":"2023-11-24T08:00:26.761527+0000","last_clean":"2023-11-24T08:00:26.761527+0000","last_became_active":"2023-11-24T08:00:26.749245+0000","last_became_peered":"2023-11-24T08:00:26.749245+0000","last_unstale":"2023-11-24T08:00:26.761527+0000","last_undegraded":"2023-11-24T08:00:26.761527+0000","last_fullsized":"2023-11-24T08:00:26.761527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:42.055903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174534+0000","last_change":"2023-11-24T08:00:26.765178+0000","last_active":"2023-11-24T08:00:28.174534+0000","last_peered":"2023-11-24T08:00:28.174534+0000","last_clean":"2023-11-24T08:00:28.174534+0000","last_became_active":"2023-11-24T08:00:26.764424+0000","last_became_peered":"2023-11-24T08:00:26.764424+0000","last_unstale":"2023-11-24T08:00:28.174534+0000","last_undegraded":"2023-11-24T08:00:28.174534+0000","last_fullsized":"2023-11-24T08:00:28.174534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.770803+0000","last_change":"2023-11-24T08:00:26.764196+0000","last_active":"2023-11-24T08:00:26.770803+0000","last_peered":"2023-11-24T08:00:26.770803+0000","last_clean":"2023-11-24T08:00:26.770803+0000","last_became_active":"2023-11-24T08:00:26.763658+0000","last_became_peered":"2023-11-24T08:00:26.763658+0000","last_unstale":"2023-11-24T08:00:26.770803+0000","last_undegraded":"2023-11-24T08:00:26.770803+0000","last_fullsized":"2023-11-24T08:00:26.770803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:23.219831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.766097+0000","last_change":"2023-11-24T08:00:26.756725+0000","last_active":"2023-11-24T08:00:26.766097+0000","last_peered":"2023-11-24T08:00:26.766097+0000","last_clean":"2023-11-24T08:00:26.766097+0000","last_became_active":"2023-11-24T08:00:26.755826+0000","last_became_peered":"2023-11-24T08:00:26.755826+0000","last_unstale":"2023-11-24T08:00:26.766097+0000","last_undegraded":"2023-11-24T08:00:26.766097+0000","last_fullsized":"2023-11-24T08:00:26.766097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:50.279093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767981+0000","last_change":"2023-11-24T08:00:26.765661+0000","last_active":"2023-11-24T08:00:27.767981+0000","last_peered":"2023-11-24T08:00:27.767981+0000","last_clean":"2023-11-24T08:00:27.767981+0000","last_became_active":"2023-11-24T08:00:26.765342+0000","last_became_peered":"2023-11-24T08:00:26.765342+0000","last_unstale":"2023-11-24T08:00:27.767981+0000","last_undegraded":"2023-11-24T08:00:27.767981+0000","last_fullsized":"2023-11-24T08:00:27.767981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769287+0000","last_change":"2023-11-24T08:00:26.775973+0000","last_active":"2023-11-24T08:00:27.769287+0000","last_peered":"2023-11-24T08:00:27.769287+0000","last_clean":"2023-11-24T08:00:27.769287+0000","last_became_active":"2023-11-24T08:00:26.775605+0000","last_became_peered":"2023-11-24T08:00:26.775605+0000","last_unstale":"2023-11-24T08:00:27.769287+0000","last_undegraded":"2023-11-24T08:00:27.769287+0000","last_fullsized":"2023-11-24T08:00:27.769287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171624+0000","last_change":"2023-11-24T08:00:26.759204+0000","last_active":"2023-11-24T08:00:28.171624+0000","last_peered":"2023-11-24T08:00:28.171624+0000","last_clean":"2023-11-24T08:00:28.171624+0000","last_became_active":"2023-11-24T08:00:26.758953+0000","last_became_peered":"2023-11-24T08:00:26.758953+0000","last_unstale":"2023-11-24T08:00:28.171624+0000","last_undegraded":"2023-11-24T08:00:28.171624+0000","last_fullsized":"2023-11-24T08:00:28.171624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:13.212470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174627+0000","last_change":"2023-11-24T08:00:26.763759+0000","last_active":"2023-11-24T08:00:28.174627+0000","last_peered":"2023-11-24T08:00:28.174627+0000","last_clean":"2023-11-24T08:00:28.174627+0000","last_became_active":"2023-11-24T08:00:26.763404+0000","last_became_peered":"2023-11-24T08:00:26.763404+0000","last_unstale":"2023-11-24T08:00:28.174627+0000","last_undegraded":"2023-11-24T08:00:28.174627+0000","last_fullsized":"2023-11-24T08:00:28.174627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767389+0000","last_change":"2023-11-24T08:00:26.755257+0000","last_active":"2023-11-24T08:00:27.767389+0000","last_peered":"2023-11-24T08:00:27.767389+0000","last_clean":"2023-11-24T08:00:27.767389+0000","last_became_active":"2023-11-24T08:00:26.754494+0000","last_became_peered":"2023-11-24T08:00:26.754494+0000","last_unstale":"2023-11-24T08:00:27.767389+0000","last_undegraded":"2023-11-24T08:00:27.767389+0000","last_fullsized":"2023-11-24T08:00:27.767389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.773107+0000","last_change":"2023-11-24T08:00:26.768879+0000","last_active":"2023-11-24T08:00:26.773107+0000","last_peered":"2023-11-24T08:00:26.773107+0000","last_clean":"2023-11-24T08:00:26.773107+0000","last_became_active":"2023-11-24T08:00:26.768610+0000","last_became_peered":"2023-11-24T08:00:26.768610+0000","last_unstale":"2023-11-24T08:00:26.773107+0000","last_undegraded":"2023-11-24T08:00:26.773107+0000","last_fullsized":"2023-11-24T08:00:26.773107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:07:22.755097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768724+0000","last_change":"2023-11-24T08:00:26.772226+0000","last_active":"2023-11-24T08:00:27.768724+0000","last_peered":"2023-11-24T08:00:27.768724+0000","last_clean":"2023-11-24T08:00:27.768724+0000","last_became_active":"2023-11-24T08:00:26.769115+0000","last_became_peered":"2023-11-24T08:00:26.769115+0000","last_unstale":"2023-11-24T08:00:27.768724+0000","last_undegraded":"2023-11-24T08:00:27.768724+0000","last_fullsized":"2023-11-24T08:00:27.768724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173030+0000","last_change":"2023-11-24T08:00:26.763479+0000","last_active":"2023-11-24T08:00:28.173030+0000","last_peered":"2023-11-24T08:00:28.173030+0000","last_clean":"2023-11-24T08:00:28.173030+0000","last_became_active":"2023-11-24T08:00:26.763174+0000","last_became_peered":"2023-11-24T08:00:26.763174+0000","last_unstale":"2023-11-24T08:00:28.173030+0000","last_undegraded":"2023-11-24T08:00:28.173030+0000","last_fullsized":"2023-11-24T08:00:28.173030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768104+0000","last_change":"2023-11-24T08:00:26.765894+0000","last_active":"2023-11-24T08:00:27.768104+0000","last_peered":"2023-11-24T08:00:27.768104+0000","last_clean":"2023-11-24T08:00:27.768104+0000","last_became_active":"2023-11-24T08:00:26.764976+0000","last_became_peered":"2023-11-24T08:00:26.764976+0000","last_unstale":"2023-11-24T08:00:27.768104+0000","last_undegraded":"2023-11-24T08:00:27.768104+0000","last_fullsized":"2023-11-24T08:00:27.768104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175290+0000","last_change":"2023-11-24T08:00:26.768006+0000","last_active":"2023-11-24T08:00:28.175290+0000","last_peered":"2023-11-24T08:00:28.175290+0000","last_clean":"2023-11-24T08:00:28.175290+0000","last_became_active":"2023-11-24T08:00:26.767556+0000","last_became_peered":"2023-11-24T08:00:26.767556+0000","last_unstale":"2023-11-24T08:00:28.175290+0000","last_undegraded":"2023-11-24T08:00:28.175290+0000","last_fullsized":"2023-11-24T08:00:28.175290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768993+0000","last_change":"2023-11-24T08:00:26.758837+0000","last_active":"2023-11-24T08:00:27.768993+0000","last_peered":"2023-11-24T08:00:27.768993+0000","last_clean":"2023-11-24T08:00:27.768993+0000","last_became_active":"2023-11-24T08:00:26.758557+0000","last_became_peered":"2023-11-24T08:00:26.758557+0000","last_unstale":"2023-11-24T08:00:27.768993+0000","last_undegraded":"2023-11-24T08:00:27.768993+0000","last_fullsized":"2023-11-24T08:00:27.768993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.768116+0000","last_change":"2023-11-24T08:00:26.759241+0000","last_active":"2023-11-24T08:00:26.768116+0000","last_peered":"2023-11-24T08:00:26.768116+0000","last_clean":"2023-11-24T08:00:26.768116+0000","last_became_active":"2023-11-24T08:00:26.758911+0000","last_became_peered":"2023-11-24T08:00:26.758911+0000","last_unstale":"2023-11-24T08:00:26.768116+0000","last_undegraded":"2023-11-24T08:00:26.768116+0000","last_fullsized":"2023-11-24T08:00:26.768116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:07:22.755097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174708+0000","last_change":"2023-11-24T08:00:26.765218+0000","last_active":"2023-11-24T08:00:28.174708+0000","last_peered":"2023-11-24T08:00:28.174708+0000","last_clean":"2023-11-24T08:00:28.174708+0000","last_became_active":"2023-11-24T08:00:26.763830+0000","last_became_peered":"2023-11-24T08:00:26.763830+0000","last_unstale":"2023-11-24T08:00:28.174708+0000","last_undegraded":"2023-11-24T08:00:28.174708+0000","last_fullsized":"2023-11-24T08:00:28.174708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.772878+0000","last_change":"2023-11-24T08:00:26.765008+0000","last_active":"2023-11-24T08:00:26.772878+0000","last_peered":"2023-11-24T08:00:26.772878+0000","last_clean":"2023-11-24T08:00:26.772878+0000","last_became_active":"2023-11-24T08:00:26.764497+0000","last_became_peered":"2023-11-24T08:00:26.764497+0000","last_unstale":"2023-11-24T08:00:26.772878+0000","last_undegraded":"2023-11-24T08:00:26.772878+0000","last_fullsized":"2023-11-24T08:00:26.772878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:15:38.288322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768747+0000","last_change":"2023-11-24T08:00:26.772754+0000","last_active":"2023-11-24T08:00:27.768747+0000","last_peered":"2023-11-24T08:00:27.768747+0000","last_clean":"2023-11-24T08:00:27.768747+0000","last_became_active":"2023-11-24T08:00:26.768109+0000","last_became_peered":"2023-11-24T08:00:26.768109+0000","last_unstale":"2023-11-24T08:00:27.768747+0000","last_undegraded":"2023-11-24T08:00:27.768747+0000","last_fullsized":"2023-11-24T08:00:27.768747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170980+0000","last_change":"2023-11-24T08:00:26.768358+0000","last_active":"2023-11-24T08:00:28.170980+0000","last_peered":"2023-11-24T08:00:28.170980+0000","last_clean":"2023-11-24T08:00:28.170980+0000","last_became_active":"2023-11-24T08:00:26.768127+0000","last_became_peered":"2023-11-24T08:00:26.768127+0000","last_unstale":"2023-11-24T08:00:28.170980+0000","last_undegraded":"2023-11-24T08:00:28.170980+0000","last_fullsized":"2023-11-24T08:00:28.170980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:19.015329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767410+0000","last_change":"2023-11-24T08:00:26.759713+0000","last_active":"2023-11-24T08:00:27.767410+0000","last_peered":"2023-11-24T08:00:27.767410+0000","last_clean":"2023-11-24T08:00:27.767410+0000","last_became_active":"2023-11-24T08:00:26.759342+0000","last_became_peered":"2023-11-24T08:00:26.759342+0000","last_unstale":"2023-11-24T08:00:27.767410+0000","last_undegraded":"2023-11-24T08:00:27.767410+0000","last_fullsized":"2023-11-24T08:00:27.767410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.761910+0000","last_change":"2023-11-24T08:00:26.756578+0000","last_active":"2023-11-24T08:00:26.761910+0000","last_peered":"2023-11-24T08:00:26.761910+0000","last_clean":"2023-11-24T08:00:26.761910+0000","last_became_active":"2023-11-24T08:00:26.756310+0000","last_became_peered":"2023-11-24T08:00:26.756310+0000","last_unstale":"2023-11-24T08:00:26.761910+0000","last_undegraded":"2023-11-24T08:00:26.761910+0000","last_fullsized":"2023-11-24T08:00:26.761910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:29.174934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174796+0000","last_change":"2023-11-24T08:00:25.487322+0000","last_active":"2023-11-24T08:00:28.174796+0000","last_peered":"2023-11-24T08:00:28.174796+0000","last_clean":"2023-11-24T08:00:28.174796+0000","last_became_active":"2023-11-24T08:00:25.486807+0000","last_became_peered":"2023-11-24T08:00:25.486807+0000","last_unstale":"2023-11-24T08:00:28.174796+0000","last_undegraded":"2023-11-24T08:00:28.174796+0000","last_fullsized":"2023-11-24T08:00:28.174796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.771291+0000","last_change":"2023-11-24T08:00:26.763826+0000","last_active":"2023-11-24T08:00:26.771291+0000","last_peered":"2023-11-24T08:00:26.771291+0000","last_clean":"2023-11-24T08:00:26.771291+0000","last_became_active":"2023-11-24T08:00:26.761268+0000","last_became_peered":"2023-11-24T08:00:26.761268+0000","last_unstale":"2023-11-24T08:00:26.771291+0000","last_undegraded":"2023-11-24T08:00:26.771291+0000","last_fullsized":"2023-11-24T08:00:26.771291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:42.055903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767502+0000","last_change":"2023-11-24T08:00:25.484440+0000","last_active":"2023-11-24T08:00:27.767502+0000","last_peered":"2023-11-24T08:00:27.767502+0000","last_clean":"2023-11-24T08:00:27.767502+0000","last_became_active":"2023-11-24T08:00:25.484176+0000","last_became_peered":"2023-11-24T08:00:25.484176+0000","last_unstale":"2023-11-24T08:00:27.767502+0000","last_undegraded":"2023-11-24T08:00:27.767502+0000","last_fullsized":"2023-11-24T08:00:27.767502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173120+0000","last_change":"2023-11-24T08:00:25.477583+0000","last_active":"2023-11-24T08:00:28.173120+0000","last_peered":"2023-11-24T08:00:28.173120+0000","last_clean":"2023-11-24T08:00:28.173120+0000","last_became_active":"2023-11-24T08:00:25.477315+0000","last_became_peered":"2023-11-24T08:00:25.477315+0000","last_unstale":"2023-11-24T08:00:28.173120+0000","last_undegraded":"2023-11-24T08:00:28.173120+0000","last_fullsized":"2023-11-24T08:00:28.173120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172762+0000","last_change":"2023-11-24T08:00:26.768787+0000","last_active":"2023-11-24T08:00:28.172762+0000","last_peered":"2023-11-24T08:00:28.172762+0000","last_clean":"2023-11-24T08:00:28.172762+0000","last_became_active":"2023-11-24T08:00:26.766444+0000","last_became_peered":"2023-11-24T08:00:26.766444+0000","last_unstale":"2023-11-24T08:00:28.172762+0000","last_undegraded":"2023-11-24T08:00:28.172762+0000","last_fullsized":"2023-11-24T08:00:28.172762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768123+0000","last_change":"2023-11-24T08:00:25.492070+0000","last_active":"2023-11-24T08:00:27.768123+0000","last_peered":"2023-11-24T08:00:27.768123+0000","last_clean":"2023-11-24T08:00:27.768123+0000","last_became_active":"2023-11-24T08:00:25.489186+0000","last_became_peered":"2023-11-24T08:00:25.489186+0000","last_unstale":"2023-11-24T08:00:27.768123+0000","last_undegraded":"2023-11-24T08:00:27.768123+0000","last_fullsized":"2023-11-24T08:00:27.768123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.768204+0000","last_change":"2023-11-24T08:00:26.759451+0000","last_active":"2023-11-24T08:00:26.768204+0000","last_peered":"2023-11-24T08:00:26.768204+0000","last_clean":"2023-11-24T08:00:26.768204+0000","last_became_active":"2023-11-24T08:00:26.758996+0000","last_became_peered":"2023-11-24T08:00:26.758996+0000","last_unstale":"2023-11-24T08:00:26.768204+0000","last_undegraded":"2023-11-24T08:00:26.768204+0000","last_fullsized":"2023-11-24T08:00:26.768204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:34:33.895684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768950+0000","last_change":"2023-11-24T08:00:25.493105+0000","last_active":"2023-11-24T08:00:27.768950+0000","last_peered":"2023-11-24T08:00:27.768950+0000","last_clean":"2023-11-24T08:00:27.768950+0000","last_became_active":"2023-11-24T08:00:25.492800+0000","last_became_peered":"2023-11-24T08:00:25.492800+0000","last_unstale":"2023-11-24T08:00:27.768950+0000","last_undegraded":"2023-11-24T08:00:27.768950+0000","last_fullsized":"2023-11-24T08:00:27.768950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768631+0000","last_change":"2023-11-24T08:00:26.777968+0000","last_active":"2023-11-24T08:00:27.768631+0000","last_peered":"2023-11-24T08:00:27.768631+0000","last_clean":"2023-11-24T08:00:27.768631+0000","last_became_active":"2023-11-24T08:00:26.774815+0000","last_became_peered":"2023-11-24T08:00:26.774815+0000","last_unstale":"2023-11-24T08:00:27.768631+0000","last_undegraded":"2023-11-24T08:00:27.768631+0000","last_fullsized":"2023-11-24T08:00:27.768631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768646+0000","last_change":"2023-11-24T08:00:25.491014+0000","last_active":"2023-11-24T08:00:27.768646+0000","last_peered":"2023-11-24T08:00:27.768646+0000","last_clean":"2023-11-24T08:00:27.768646+0000","last_became_active":"2023-11-24T08:00:25.490752+0000","last_became_peered":"2023-11-24T08:00:25.490752+0000","last_unstale":"2023-11-24T08:00:27.768646+0000","last_undegraded":"2023-11-24T08:00:27.768646+0000","last_fullsized":"2023-11-24T08:00:27.768646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.781780+0000","last_change":"2023-11-24T08:00:26.777398+0000","last_active":"2023-11-24T08:00:26.781780+0000","last_peered":"2023-11-24T08:00:26.781780+0000","last_clean":"2023-11-24T08:00:26.781780+0000","last_became_active":"2023-11-24T08:00:26.777180+0000","last_became_peered":"2023-11-24T08:00:26.777180+0000","last_unstale":"2023-11-24T08:00:26.781780+0000","last_undegraded":"2023-11-24T08:00:26.781780+0000","last_fullsized":"2023-11-24T08:00:26.781780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:47.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.791615+0000","last_change":"2023-11-24T08:00:25.493583+0000","last_active":"2023-11-24T08:00:26.791615+0000","last_peered":"2023-11-24T08:00:26.791615+0000","last_clean":"2023-11-24T08:00:26.791615+0000","last_became_active":"2023-11-24T08:00:25.493049+0000","last_became_peered":"2023-11-24T08:00:25.493049+0000","last_unstale":"2023-11-24T08:00:26.791615+0000","last_undegraded":"2023-11-24T08:00:26.791615+0000","last_fullsized":"2023-11-24T08:00:26.791615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:04.556704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.773376+0000","last_change":"2023-11-24T08:00:26.771496+0000","last_active":"2023-11-24T08:00:26.773376+0000","last_peered":"2023-11-24T08:00:26.773376+0000","last_clean":"2023-11-24T08:00:26.773376+0000","last_became_active":"2023-11-24T08:00:26.768866+0000","last_became_peered":"2023-11-24T08:00:26.768866+0000","last_unstale":"2023-11-24T08:00:26.773376+0000","last_undegraded":"2023-11-24T08:00:26.773376+0000","last_fullsized":"2023-11-24T08:00:26.773376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:10.821210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767521+0000","last_change":"2023-11-24T08:00:25.470991+0000","last_active":"2023-11-24T08:00:27.767521+0000","last_peered":"2023-11-24T08:00:27.767521+0000","last_clean":"2023-11-24T08:00:27.767521+0000","last_became_active":"2023-11-24T08:00:25.467281+0000","last_became_peered":"2023-11-24T08:00:25.467281+0000","last_unstale":"2023-11-24T08:00:27.767521+0000","last_undegraded":"2023-11-24T08:00:27.767521+0000","last_fullsized":"2023-11-24T08:00:27.767521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173928+0000","last_change":"2023-11-24T08:00:26.761810+0000","last_active":"2023-11-24T08:00:28.173928+0000","last_peered":"2023-11-24T08:00:28.173928+0000","last_clean":"2023-11-24T08:00:28.173928+0000","last_became_active":"2023-11-24T08:00:26.761443+0000","last_became_peered":"2023-11-24T08:00:26.761443+0000","last_unstale":"2023-11-24T08:00:28.173928+0000","last_undegraded":"2023-11-24T08:00:28.173928+0000","last_fullsized":"2023-11-24T08:00:28.173928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.794579+0000","last_change":"2023-11-24T08:00:25.476805+0000","last_active":"2023-11-24T08:00:26.794579+0000","last_peered":"2023-11-24T08:00:26.794579+0000","last_clean":"2023-11-24T08:00:26.794579+0000","last_became_active":"2023-11-24T08:00:25.476150+0000","last_became_peered":"2023-11-24T08:00:25.476150+0000","last_unstale":"2023-11-24T08:00:26.794579+0000","last_undegraded":"2023-11-24T08:00:26.794579+0000","last_fullsized":"2023-11-24T08:00:26.794579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.776031+0000","last_change":"2023-11-24T08:00:26.770849+0000","last_active":"2023-11-24T08:00:26.776031+0000","last_peered":"2023-11-24T08:00:26.776031+0000","last_clean":"2023-11-24T08:00:26.776031+0000","last_became_active":"2023-11-24T08:00:26.769532+0000","last_became_peered":"2023-11-24T08:00:26.769532+0000","last_unstale":"2023-11-24T08:00:26.776031+0000","last_undegraded":"2023-11-24T08:00:26.776031+0000","last_fullsized":"2023-11-24T08:00:26.776031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:48.837595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768910+0000","last_change":"2023-11-24T08:00:25.489658+0000","last_active":"2023-11-24T08:00:27.768910+0000","last_peered":"2023-11-24T08:00:27.768910+0000","last_clean":"2023-11-24T08:00:27.768910+0000","last_became_active":"2023-11-24T08:00:25.489387+0000","last_became_peered":"2023-11-24T08:00:25.489387+0000","last_unstale":"2023-11-24T08:00:27.768910+0000","last_undegraded":"2023-11-24T08:00:27.768910+0000","last_fullsized":"2023-11-24T08:00:27.768910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:12.207873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174020+0000","last_change":"2023-11-24T08:00:26.773222+0000","last_active":"2023-11-24T08:00:28.174020+0000","last_peered":"2023-11-24T08:00:28.174020+0000","last_clean":"2023-11-24T08:00:28.174020+0000","last_became_active":"2023-11-24T08:00:26.772961+0000","last_became_peered":"2023-11-24T08:00:26.772961+0000","last_unstale":"2023-11-24T08:00:28.174020+0000","last_undegraded":"2023-11-24T08:00:28.174020+0000","last_fullsized":"2023-11-24T08:00:28.174020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767377+0000","last_change":"2023-11-24T08:00:25.480070+0000","last_active":"2023-11-24T08:00:27.767377+0000","last_peered":"2023-11-24T08:00:27.767377+0000","last_clean":"2023-11-24T08:00:27.767377+0000","last_became_active":"2023-11-24T08:00:25.479345+0000","last_became_peered":"2023-11-24T08:00:25.479345+0000","last_unstale":"2023-11-24T08:00:27.767377+0000","last_undegraded":"2023-11-24T08:00:27.767377+0000","last_fullsized":"2023-11-24T08:00:27.767377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767763+0000","last_change":"2023-11-24T08:00:26.760511+0000","last_active":"2023-11-24T08:00:27.767763+0000","last_peered":"2023-11-24T08:00:27.767763+0000","last_clean":"2023-11-24T08:00:27.767763+0000","last_became_active":"2023-11-24T08:00:26.760206+0000","last_became_peered":"2023-11-24T08:00:26.760206+0000","last_unstale":"2023-11-24T08:00:27.767763+0000","last_undegraded":"2023-11-24T08:00:27.767763+0000","last_fullsized":"2023-11-24T08:00:27.767763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170764+0000","last_change":"2023-11-24T08:00:25.477302+0000","last_active":"2023-11-24T08:00:28.170764+0000","last_peered":"2023-11-24T08:00:28.170764+0000","last_clean":"2023-11-24T08:00:28.170764+0000","last_became_active":"2023-11-24T08:00:25.477026+0000","last_became_peered":"2023-11-24T08:00:25.477026+0000","last_unstale":"2023-11-24T08:00:28.170764+0000","last_undegraded":"2023-11-24T08:00:28.170764+0000","last_fullsized":"2023-11-24T08:00:28.170764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:47.411014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173040+0000","last_change":"2023-11-24T08:00:26.771081+0000","last_active":"2023-11-24T08:00:28.173040+0000","last_peered":"2023-11-24T08:00:28.173040+0000","last_clean":"2023-11-24T08:00:28.173040+0000","last_became_active":"2023-11-24T08:00:26.767738+0000","last_became_peered":"2023-11-24T08:00:26.767738+0000","last_unstale":"2023-11-24T08:00:28.173040+0000","last_undegraded":"2023-11-24T08:00:28.173040+0000","last_fullsized":"2023-11-24T08:00:28.173040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.786295+0000","last_change":"2023-11-24T08:00:25.473084+0000","last_active":"2023-11-24T08:00:26.786295+0000","last_peered":"2023-11-24T08:00:26.786295+0000","last_clean":"2023-11-24T08:00:26.786295+0000","last_became_active":"2023-11-24T08:00:25.472511+0000","last_became_peered":"2023-11-24T08:00:25.472511+0000","last_unstale":"2023-11-24T08:00:26.786295+0000","last_undegraded":"2023-11-24T08:00:26.786295+0000","last_fullsized":"2023-11-24T08:00:26.786295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:30.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174602+0000","last_change":"2023-11-24T08:00:26.770832+0000","last_active":"2023-11-24T08:00:28.174602+0000","last_peered":"2023-11-24T08:00:28.174602+0000","last_clean":"2023-11-24T08:00:28.174602+0000","last_became_active":"2023-11-24T08:00:26.770425+0000","last_became_peered":"2023-11-24T08:00:26.770425+0000","last_unstale":"2023-11-24T08:00:28.174602+0000","last_undegraded":"2023-11-24T08:00:28.174602+0000","last_fullsized":"2023-11-24T08:00:28.174602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171853+0000","last_change":"2023-11-24T08:00:25.479082+0000","last_active":"2023-11-24T08:00:28.171853+0000","last_peered":"2023-11-24T08:00:28.171853+0000","last_clean":"2023-11-24T08:00:28.171853+0000","last_became_active":"2023-11-24T08:00:25.478759+0000","last_became_peered":"2023-11-24T08:00:25.478759+0000","last_unstale":"2023-11-24T08:00:28.171853+0000","last_undegraded":"2023-11-24T08:00:28.171853+0000","last_fullsized":"2023-11-24T08:00:28.171853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175030+0000","last_change":"2023-11-24T08:00:26.766352+0000","last_active":"2023-11-24T08:00:28.175030+0000","last_peered":"2023-11-24T08:00:28.175030+0000","last_clean":"2023-11-24T08:00:28.175030+0000","last_became_active":"2023-11-24T08:00:26.765178+0000","last_became_peered":"2023-11-24T08:00:26.765178+0000","last_unstale":"2023-11-24T08:00:28.175030+0000","last_undegraded":"2023-11-24T08:00:28.175030+0000","last_fullsized":"2023-11-24T08:00:28.175030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:31.302140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.791506+0000","last_change":"2023-11-24T08:00:25.480774+0000","last_active":"2023-11-24T08:00:26.791506+0000","last_peered":"2023-11-24T08:00:26.791506+0000","last_clean":"2023-11-24T08:00:26.791506+0000","last_became_active":"2023-11-24T08:00:25.480505+0000","last_became_peered":"2023-11-24T08:00:25.480505+0000","last_unstale":"2023-11-24T08:00:26.791506+0000","last_undegraded":"2023-11-24T08:00:26.791506+0000","last_fullsized":"2023-11-24T08:00:26.791506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:47.832998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768605+0000","last_change":"2023-11-24T08:00:26.777032+0000","last_active":"2023-11-24T08:00:27.768605+0000","last_peered":"2023-11-24T08:00:27.768605+0000","last_clean":"2023-11-24T08:00:27.768605+0000","last_became_active":"2023-11-24T08:00:26.776390+0000","last_became_peered":"2023-11-24T08:00:26.776390+0000","last_unstale":"2023-11-24T08:00:27.768605+0000","last_undegraded":"2023-11-24T08:00:27.768605+0000","last_fullsized":"2023-11-24T08:00:27.768605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171558+0000","last_change":"2023-11-24T08:00:25.482325+0000","last_active":"2023-11-24T08:00:28.171558+0000","last_peered":"2023-11-24T08:00:28.171558+0000","last_clean":"2023-11-24T08:00:28.171558+0000","last_became_active":"2023-11-24T08:00:25.481949+0000","last_became_peered":"2023-11-24T08:00:25.481949+0000","last_unstale":"2023-11-24T08:00:28.171558+0000","last_undegraded":"2023-11-24T08:00:28.171558+0000","last_fullsized":"2023-11-24T08:00:28.171558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174954+0000","last_change":"2023-11-24T08:00:26.768210+0000","last_active":"2023-11-24T08:00:28.174954+0000","last_peered":"2023-11-24T08:00:28.174954+0000","last_clean":"2023-11-24T08:00:28.174954+0000","last_became_active":"2023-11-24T08:00:26.767945+0000","last_became_peered":"2023-11-24T08:00:26.767945+0000","last_unstale":"2023-11-24T08:00:28.174954+0000","last_undegraded":"2023-11-24T08:00:28.174954+0000","last_fullsized":"2023-11-24T08:00:28.174954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:14.495500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.745147+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:00:26.745147+0000","last_peered":"2023-11-24T08:00:26.745147+0000","last_clean":"2023-11-24T08:00:26.745147+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:00:26.745147+0000","last_undegraded":"2023-11-24T08:00:26.745147+0000","last_fullsized":"2023-11-24T08:00:26.745147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768099+0000","last_change":"2023-11-24T08:00:25.482920+0000","last_active":"2023-11-24T08:00:27.768099+0000","last_peered":"2023-11-24T08:00:27.768099+0000","last_clean":"2023-11-24T08:00:27.768099+0000","last_became_active":"2023-11-24T08:00:25.482550+0000","last_became_peered":"2023-11-24T08:00:25.482550+0000","last_unstale":"2023-11-24T08:00:27.768099+0000","last_undegraded":"2023-11-24T08:00:27.768099+0000","last_fullsized":"2023-11-24T08:00:27.768099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174979+0000","last_change":"2023-11-24T08:00:26.771428+0000","last_active":"2023-11-24T08:00:28.174979+0000","last_peered":"2023-11-24T08:00:28.174979+0000","last_clean":"2023-11-24T08:00:28.174979+0000","last_became_active":"2023-11-24T08:00:26.771067+0000","last_became_peered":"2023-11-24T08:00:26.771067+0000","last_unstale":"2023-11-24T08:00:28.174979+0000","last_undegraded":"2023-11-24T08:00:28.174979+0000","last_fullsized":"2023-11-24T08:00:28.174979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172499+0000","last_change":"2023-11-24T08:00:25.494571+0000","last_active":"2023-11-24T08:00:28.172499+0000","last_peered":"2023-11-24T08:00:28.172499+0000","last_clean":"2023-11-24T08:00:28.172499+0000","last_became_active":"2023-11-24T08:00:25.493557+0000","last_became_peered":"2023-11-24T08:00:25.493557+0000","last_unstale":"2023-11-24T08:00:28.172499+0000","last_undegraded":"2023-11-24T08:00:28.172499+0000","last_fullsized":"2023-11-24T08:00:28.172499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.771152+0000","last_change":"2023-11-24T08:00:26.762814+0000","last_active":"2023-11-24T08:00:26.771152+0000","last_peered":"2023-11-24T08:00:26.771152+0000","last_clean":"2023-11-24T08:00:26.771152+0000","last_became_active":"2023-11-24T08:00:26.761448+0000","last_became_peered":"2023-11-24T08:00:26.761448+0000","last_unstale":"2023-11-24T08:00:26.771152+0000","last_undegraded":"2023-11-24T08:00:26.771152+0000","last_fullsized":"2023-11-24T08:00:26.771152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:10.821210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170966+0000","last_change":"2023-11-24T08:00:25.478945+0000","last_active":"2023-11-24T08:00:28.170966+0000","last_peered":"2023-11-24T08:00:28.170966+0000","last_clean":"2023-11-24T08:00:28.170966+0000","last_became_active":"2023-11-24T08:00:25.478645+0000","last_became_peered":"2023-11-24T08:00:25.478645+0000","last_unstale":"2023-11-24T08:00:28.170966+0000","last_undegraded":"2023-11-24T08:00:28.170966+0000","last_fullsized":"2023-11-24T08:00:28.170966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:26:36.241356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.766174+0000","last_change":"2023-11-24T08:00:26.756524+0000","last_active":"2023-11-24T08:00:26.766174+0000","last_peered":"2023-11-24T08:00:26.766174+0000","last_clean":"2023-11-24T08:00:26.766174+0000","last_became_active":"2023-11-24T08:00:26.754522+0000","last_became_peered":"2023-11-24T08:00:26.754522+0000","last_unstale":"2023-11-24T08:00:26.766174+0000","last_undegraded":"2023-11-24T08:00:26.766174+0000","last_fullsized":"2023-11-24T08:00:26.766174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:21.367690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768991+0000","last_change":"2023-11-24T08:00:25.489726+0000","last_active":"2023-11-24T08:00:27.768991+0000","last_peered":"2023-11-24T08:00:27.768991+0000","last_clean":"2023-11-24T08:00:27.768991+0000","last_became_active":"2023-11-24T08:00:25.489421+0000","last_became_peered":"2023-11-24T08:00:25.489421+0000","last_unstale":"2023-11-24T08:00:27.768991+0000","last_undegraded":"2023-11-24T08:00:27.768991+0000","last_fullsized":"2023-11-24T08:00:27.768991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.770903+0000","last_change":"2023-11-24T08:00:26.766472+0000","last_active":"2023-11-24T08:00:26.770903+0000","last_peered":"2023-11-24T08:00:26.770903+0000","last_clean":"2023-11-24T08:00:26.770903+0000","last_became_active":"2023-11-24T08:00:26.765996+0000","last_became_peered":"2023-11-24T08:00:26.765996+0000","last_unstale":"2023-11-24T08:00:26.770903+0000","last_undegraded":"2023-11-24T08:00:26.770903+0000","last_fullsized":"2023-11-24T08:00:26.770903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:42:47.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.732096+0000","last_change":"2023-11-24T08:00:25.481042+0000","last_active":"2023-11-24T08:00:26.732096+0000","last_peered":"2023-11-24T08:00:26.732096+0000","last_clean":"2023-11-24T08:00:26.732096+0000","last_became_active":"2023-11-24T08:00:25.480733+0000","last_became_peered":"2023-11-24T08:00:25.480733+0000","last_unstale":"2023-11-24T08:00:26.732096+0000","last_undegraded":"2023-11-24T08:00:26.732096+0000","last_fullsized":"2023-11-24T08:00:26.732096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:41.051307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769401+0000","last_change":"2023-11-24T08:00:26.775027+0000","last_active":"2023-11-24T08:00:27.769401+0000","last_peered":"2023-11-24T08:00:27.769401+0000","last_clean":"2023-11-24T08:00:27.769401+0000","last_became_active":"2023-11-24T08:00:26.774593+0000","last_became_peered":"2023-11-24T08:00:26.774593+0000","last_unstale":"2023-11-24T08:00:27.769401+0000","last_undegraded":"2023-11-24T08:00:27.769401+0000","last_fullsized":"2023-11-24T08:00:27.769401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174850+0000","last_change":"2023-11-24T08:00:25.494481+0000","last_active":"2023-11-24T08:00:28.174850+0000","last_peered":"2023-11-24T08:00:28.174850+0000","last_clean":"2023-11-24T08:00:28.174850+0000","last_became_active":"2023-11-24T08:00:25.494253+0000","last_became_peered":"2023-11-24T08:00:25.494253+0000","last_unstale":"2023-11-24T08:00:28.174850+0000","last_undegraded":"2023-11-24T08:00:28.174850+0000","last_fullsized":"2023-11-24T08:00:28.174850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.768841+0000","last_change":"2023-11-24T08:00:26.757666+0000","last_active":"2023-11-24T08:00:26.768841+0000","last_peered":"2023-11-24T08:00:26.768841+0000","last_clean":"2023-11-24T08:00:26.768841+0000","last_became_active":"2023-11-24T08:00:26.757401+0000","last_became_peered":"2023-11-24T08:00:26.757401+0000","last_unstale":"2023-11-24T08:00:26.768841+0000","last_undegraded":"2023-11-24T08:00:26.768841+0000","last_fullsized":"2023-11-24T08:00:26.768841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:15:38.288322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.733923+0000","last_change":"2023-11-24T08:00:25.483011+0000","last_active":"2023-11-24T08:00:26.733923+0000","last_peered":"2023-11-24T08:00:26.733923+0000","last_clean":"2023-11-24T08:00:26.733923+0000","last_became_active":"2023-11-24T08:00:25.481668+0000","last_became_peered":"2023-11-24T08:00:25.481668+0000","last_unstale":"2023-11-24T08:00:26.733923+0000","last_undegraded":"2023-11-24T08:00:26.733923+0000","last_fullsized":"2023-11-24T08:00:26.733923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174672+0000","last_change":"2023-11-24T08:00:26.760962+0000","last_active":"2023-11-24T08:00:28.174672+0000","last_peered":"2023-11-24T08:00:28.174672+0000","last_clean":"2023-11-24T08:00:28.174672+0000","last_became_active":"2023-11-24T08:00:26.760541+0000","last_became_peered":"2023-11-24T08:00:26.760541+0000","last_unstale":"2023-11-24T08:00:28.174672+0000","last_undegraded":"2023-11-24T08:00:28.174672+0000","last_fullsized":"2023-11-24T08:00:28.174672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769002+0000","last_change":"2023-11-24T08:00:25.491430+0000","last_active":"2023-11-24T08:00:27.769002+0000","last_peered":"2023-11-24T08:00:27.769002+0000","last_clean":"2023-11-24T08:00:27.769002+0000","last_became_active":"2023-11-24T08:00:25.490656+0000","last_became_peered":"2023-11-24T08:00:25.490656+0000","last_unstale":"2023-11-24T08:00:27.769002+0000","last_undegraded":"2023-11-24T08:00:27.769002+0000","last_fullsized":"2023-11-24T08:00:27.769002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.769453+0000","last_change":"2023-11-24T08:00:26.762592+0000","last_active":"2023-11-24T08:00:26.769453+0000","last_peered":"2023-11-24T08:00:26.769453+0000","last_clean":"2023-11-24T08:00:26.769453+0000","last_became_active":"2023-11-24T08:00:26.759772+0000","last_became_peered":"2023-11-24T08:00:26.759772+0000","last_unstale":"2023-11-24T08:00:26.769453+0000","last_undegraded":"2023-11-24T08:00:26.769453+0000","last_fullsized":"2023-11-24T08:00:26.769453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:29.174934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172271+0000","last_change":"2023-11-24T08:00:25.494768+0000","last_active":"2023-11-24T08:00:28.172271+0000","last_peered":"2023-11-24T08:00:28.172271+0000","last_clean":"2023-11-24T08:00:28.172271+0000","last_became_active":"2023-11-24T08:00:25.494268+0000","last_became_peered":"2023-11-24T08:00:25.494268+0000","last_unstale":"2023-11-24T08:00:28.172271+0000","last_undegraded":"2023-11-24T08:00:28.172271+0000","last_fullsized":"2023-11-24T08:00:28.172271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.769625+0000","last_change":"2023-11-24T08:00:26.761236+0000","last_active":"2023-11-24T08:00:26.769625+0000","last_peered":"2023-11-24T08:00:26.769625+0000","last_clean":"2023-11-24T08:00:26.769625+0000","last_became_active":"2023-11-24T08:00:26.755777+0000","last_became_peered":"2023-11-24T08:00:26.755777+0000","last_unstale":"2023-11-24T08:00:26.769625+0000","last_undegraded":"2023-11-24T08:00:26.769625+0000","last_fullsized":"2023-11-24T08:00:26.769625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:41.031540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.737896+0000","last_change":"2023-11-24T08:00:25.483781+0000","last_active":"2023-11-24T08:00:26.737896+0000","last_peered":"2023-11-24T08:00:26.737896+0000","last_clean":"2023-11-24T08:00:26.737896+0000","last_became_active":"2023-11-24T08:00:25.483449+0000","last_became_peered":"2023-11-24T08:00:25.483449+0000","last_unstale":"2023-11-24T08:00:26.737896+0000","last_undegraded":"2023-11-24T08:00:26.737896+0000","last_fullsized":"2023-11-24T08:00:26.737896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:42.351833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172763+0000","last_change":"2023-11-24T08:00:26.770074+0000","last_active":"2023-11-24T08:00:28.172763+0000","last_peered":"2023-11-24T08:00:28.172763+0000","last_clean":"2023-11-24T08:00:28.172763+0000","last_became_active":"2023-11-24T08:00:26.767285+0000","last_became_peered":"2023-11-24T08:00:26.767285+0000","last_unstale":"2023-11-24T08:00:28.172763+0000","last_undegraded":"2023-11-24T08:00:28.172763+0000","last_fullsized":"2023-11-24T08:00:28.172763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.732029+0000","last_change":"2023-11-24T08:00:25.483961+0000","last_active":"2023-11-24T08:00:26.732029+0000","last_peered":"2023-11-24T08:00:26.732029+0000","last_clean":"2023-11-24T08:00:26.732029+0000","last_became_active":"2023-11-24T08:00:25.481836+0000","last_became_peered":"2023-11-24T08:00:25.481836+0000","last_unstale":"2023-11-24T08:00:26.732029+0000","last_undegraded":"2023-11-24T08:00:26.732029+0000","last_fullsized":"2023-11-24T08:00:26.732029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:09.816614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175247+0000","last_change":"2023-11-24T08:00:26.769858+0000","last_active":"2023-11-24T08:00:28.175247+0000","last_peered":"2023-11-24T08:00:28.175247+0000","last_clean":"2023-11-24T08:00:28.175247+0000","last_became_active":"2023-11-24T08:00:26.766200+0000","last_became_peered":"2023-11-24T08:00:26.766200+0000","last_unstale":"2023-11-24T08:00:28.175247+0000","last_undegraded":"2023-11-24T08:00:28.175247+0000","last_fullsized":"2023-11-24T08:00:28.175247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174355+0000","last_change":"2023-11-24T08:00:25.495132+0000","last_active":"2023-11-24T08:00:28.174355+0000","last_peered":"2023-11-24T08:00:28.174355+0000","last_clean":"2023-11-24T08:00:28.174355+0000","last_became_active":"2023-11-24T08:00:25.494764+0000","last_became_peered":"2023-11-24T08:00:25.494764+0000","last_unstale":"2023-11-24T08:00:28.174355+0000","last_undegraded":"2023-11-24T08:00:28.174355+0000","last_fullsized":"2023-11-24T08:00:28.174355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767414+0000","last_change":"2023-11-24T08:00:26.749850+0000","last_active":"2023-11-24T08:00:27.767414+0000","last_peered":"2023-11-24T08:00:27.767414+0000","last_clean":"2023-11-24T08:00:27.767414+0000","last_became_active":"2023-11-24T08:00:26.749536+0000","last_became_peered":"2023-11-24T08:00:26.749536+0000","last_unstale":"2023-11-24T08:00:27.767414+0000","last_undegraded":"2023-11-24T08:00:27.767414+0000","last_fullsized":"2023-11-24T08:00:27.767414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769202+0000","last_change":"2023-11-24T08:00:26.779787+0000","last_active":"2023-11-24T08:00:27.769202+0000","last_peered":"2023-11-24T08:00:27.769202+0000","last_clean":"2023-11-24T08:00:27.769202+0000","last_became_active":"2023-11-24T08:00:26.779470+0000","last_became_peered":"2023-11-24T08:00:26.779470+0000","last_unstale":"2023-11-24T08:00:27.769202+0000","last_undegraded":"2023-11-24T08:00:27.769202+0000","last_fullsized":"2023-11-24T08:00:27.769202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173834+0000","last_change":"2023-11-24T08:00:25.497773+0000","last_active":"2023-11-24T08:00:28.173834+0000","last_peered":"2023-11-24T08:00:28.173834+0000","last_clean":"2023-11-24T08:00:28.173834+0000","last_became_active":"2023-11-24T08:00:25.497355+0000","last_became_peered":"2023-11-24T08:00:25.497355+0000","last_unstale":"2023-11-24T08:00:28.173834+0000","last_undegraded":"2023-11-24T08:00:28.173834+0000","last_fullsized":"2023-11-24T08:00:28.173834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769447+0000","last_change":"2023-11-24T08:00:26.779853+0000","last_active":"2023-11-24T08:00:27.769447+0000","last_peered":"2023-11-24T08:00:27.769447+0000","last_clean":"2023-11-24T08:00:27.769447+0000","last_became_active":"2023-11-24T08:00:26.779449+0000","last_became_peered":"2023-11-24T08:00:26.779449+0000","last_unstale":"2023-11-24T08:00:27.769447+0000","last_undegraded":"2023-11-24T08:00:27.769447+0000","last_fullsized":"2023-11-24T08:00:27.769447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174399+0000","last_change":"2023-11-24T08:00:25.493174+0000","last_active":"2023-11-24T08:00:28.174399+0000","last_peered":"2023-11-24T08:00:28.174399+0000","last_clean":"2023-11-24T08:00:28.174399+0000","last_became_active":"2023-11-24T08:00:25.492565+0000","last_became_peered":"2023-11-24T08:00:25.492565+0000","last_unstale":"2023-11-24T08:00:28.174399+0000","last_undegraded":"2023-11-24T08:00:28.174399+0000","last_fullsized":"2023-11-24T08:00:28.174399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:16.328173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.785695+0000","last_change":"2023-11-24T08:00:26.779709+0000","last_active":"2023-11-24T08:00:26.785695+0000","last_peered":"2023-11-24T08:00:26.785695+0000","last_clean":"2023-11-24T08:00:26.785695+0000","last_became_active":"2023-11-24T08:00:26.779501+0000","last_became_peered":"2023-11-24T08:00:26.779501+0000","last_unstale":"2023-11-24T08:00:26.785695+0000","last_undegraded":"2023-11-24T08:00:26.785695+0000","last_fullsized":"2023-11-24T08:00:26.785695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:05.561300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174361+0000","last_change":"2023-11-24T08:00:25.475566+0000","last_active":"2023-11-24T08:00:28.174361+0000","last_peered":"2023-11-24T08:00:28.174361+0000","last_clean":"2023-11-24T08:00:28.174361+0000","last_became_active":"2023-11-24T08:00:25.475286+0000","last_became_peered":"2023-11-24T08:00:25.475286+0000","last_unstale":"2023-11-24T08:00:28.174361+0000","last_undegraded":"2023-11-24T08:00:28.174361+0000","last_fullsized":"2023-11-24T08:00:28.174361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:25.827802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174531+0000","last_change":"2023-11-24T08:00:26.759142+0000","last_active":"2023-11-24T08:00:28.174531+0000","last_peered":"2023-11-24T08:00:28.174531+0000","last_clean":"2023-11-24T08:00:28.174531+0000","last_became_active":"2023-11-24T08:00:26.758874+0000","last_became_peered":"2023-11-24T08:00:26.758874+0000","last_unstale":"2023-11-24T08:00:28.174531+0000","last_undegraded":"2023-11-24T08:00:28.174531+0000","last_fullsized":"2023-11-24T08:00:28.174531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.794833+0000","last_change":"2023-11-24T08:00:25.490543+0000","last_active":"2023-11-24T08:00:26.794833+0000","last_peered":"2023-11-24T08:00:26.794833+0000","last_clean":"2023-11-24T08:00:26.794833+0000","last_became_active":"2023-11-24T08:00:25.490222+0000","last_became_peered":"2023-11-24T08:00:25.490222+0000","last_unstale":"2023-11-24T08:00:26.794833+0000","last_undegraded":"2023-11-24T08:00:26.794833+0000","last_fullsized":"2023-11-24T08:00:26.794833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:34:32.891088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":661830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5029999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8939999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509443,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":77270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.667}]}]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":72492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2430000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.944}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.861}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.97}]}]},{"osd":2,"up_from":15,"seq":64424509443,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":70880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5760000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":71006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.264}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1680000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5880000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.819}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.911}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1760000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1150000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":654473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.073}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0790000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9990000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1030000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:00:31.721 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:00:31.721 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T08:00:31.721 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T08:00:31.722 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T08:00:31.722 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T08:00:31.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.970+0000 7fd6afb8e640 1 Processor -- start 2023-11-24T08:00:31.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.971+0000 7fd6afb8e640 1 -- start start 2023-11-24T08:00:31.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.972+0000 7fd6afb8e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6a813e360 0x7fd6a80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.972+0000 7fd6afb8e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd6a815f9c0 0x7fd6a80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.972+0000 7fd6afb8e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a815c5f0 con 0x7fd6a813df80 2023-11-24T08:00:31.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.972+0000 7fd6afb8e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a806c470 con 0x7fd6a813e360 2023-11-24T08:00:31.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.972+0000 7fd6afb8e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a806c750 con 0x7fd6a815f9c0 2023-11-24T08:00:31.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad129640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6a813e360 0x7fd6a80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad92a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd6a813df80 0x7fd6a815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39934/0 (socket says 172.21.15.161:39934) 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad92a640 1 -- 172.21.15.161:0/4251651878 learned_addr learned my addr 172.21.15.161:0/4251651878 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ae12b640 1 --2- 172.21.15.161:0/4251651878 >> v2:172.21.15.175:3300/0 conn(0x7fd6a815f9c0 0x7fd6a80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad129640 1 -- 172.21.15.161:0/4251651878 >> v2:172.21.15.175:3300/0 conn(0x7fd6a815f9c0 msgr2=0x7fd6a80cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad129640 1 --2- 172.21.15.161:0/4251651878 >> v2:172.21.15.175:3300/0 conn(0x7fd6a815f9c0 0x7fd6a80cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad129640 1 -- 172.21.15.161:0/4251651878 >> v1:172.21.15.161:6789/0 conn(0x7fd6a813df80 legacy=0x7fd6a815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ad129640 1 -- 172.21.15.161:0/4251651878 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a806ca30 con 0x7fd6a813e360 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ae12b640 1 --2- 172.21.15.161:0/4251651878 >> v2:172.21.15.175:3300/0 conn(0x7fd6a815f9c0 0x7fd6a80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:31.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.973+0000 7fd6ac928640 1 -- 172.21.15.161:0/4251651878 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236623097 0 0) 0x7fd6a815c5f0 con 0x7fd6a813df80 2023-11-24T08:00:31.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.974+0000 7fd6ad129640 1 --2- 172.21.15.161:0/4251651878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813e360 0x7fd6a80cf290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80ccae0 tx=0x7fd69802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab2dad15db037f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:31.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.974+0000 7fd6ac928640 1 -- 172.21.15.161:0/4251651878 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698031830 con 0x7fd6a813e360 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.974+0000 7fd6ac928640 1 -- 172.21.15.161:0/4251651878 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd698031990 con 0x7fd6a813e360 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.974+0000 7fd6ac928640 1 -- 172.21.15.161:0/4251651878 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698031d20 con 0x7fd6a813e360 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 -- 172.21.15.161:0/4251651878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813e360 msgr2=0x7fd6a80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/4251651878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813e360 0x7fd6a80cf290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd6a80ccae0 tx=0x7fd69802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 -- 172.21.15.161:0/4251651878 shutdown_connections 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/4251651878 >> v2:172.21.15.175:3300/0 conn(0x7fd6a815f9c0 0x7fd6a80cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/4251651878 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813e360 0x7fd6a80cf290 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 -- 172.21.15.161:0/4251651878 >> 172.21.15.161:0/4251651878 conn(0x7fd6a806a800 msgr2=0x7fd6a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 -- 172.21.15.161:0/4251651878 shutdown_connections 2023-11-24T08:00:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.975+0000 7fd6afb8e640 1 -- 172.21.15.161:0/4251651878 wait complete. 2023-11-24T08:00:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.977+0000 7fd6afb8e640 1 Processor -- start 2023-11-24T08:00:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.977+0000 7fd6afb8e640 1 -- start start 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6afb8e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 0x7fd6a81358e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6afb8e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a813e360 0x7fd6a8159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6afb8e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a815f9c0 0x7fd6a8159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6afb8e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a814e960 con 0x7fd6a813df80 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6afb8e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a814ec40 con 0x7fd6a815f9c0 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6afb8e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a814ef20 con 0x7fd6a813e360 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6ad92a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 0x7fd6a81358e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6ad92a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 0x7fd6a81358e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56490/0 (socket says 172.21.15.161:56490) 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.978+0000 7fd6ad92a640 1 -- 172.21.15.161:0/2394201204 learned_addr learned my addr 172.21.15.161:0/2394201204 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad129640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a813e360 0x7fd6a8159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ae12b640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a815f9c0 0x7fd6a8159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad92a640 1 -- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a813e360 msgr2=0x7fd6a8159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad92a640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a813e360 0x7fd6a8159a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad92a640 1 -- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a815f9c0 msgr2=0x7fd6a8159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad92a640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a815f9c0 0x7fd6a8159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad92a640 1 -- 172.21.15.161:0/2394201204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009400 con 0x7fd6a813df80 2023-11-24T08:00:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6ad92a640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 0x7fd6a81358e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400c400 tx=0x7fd6a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4005ce0 con 0x7fd6a813df80 2023-11-24T08:00:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a4005e40 con 0x7fd6a813df80 2023-11-24T08:00:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4007310 con 0x7fd6a813df80 2023-11-24T08:00:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a814f200 con 0x7fd6a813df80 2023-11-24T08:00:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.979+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a814f7c0 con 0x7fd6a813df80 2023-11-24T08:00:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.981+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a814f9e0 con 0x7fd6a813df80 2023-11-24T08:00:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.981+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6a4007530 con 0x7fd6a813df80 2023-11-24T08:00:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.982+0000 7fd69e7fc640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd68c06ae40 0x7fd68c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.982+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a4088c30 con 0x7fd6a813df80 2023-11-24T08:00:31.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.983+0000 7fd6ad129640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd68c06ae40 0x7fd68c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:31.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.984+0000 7fd6ad129640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd68c06ae40 0x7fd68c06d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd698036000 tx=0x7fd698008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:31.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:31.987+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6a4053ce0 con 0x7fd6a813df80 2023-11-24T08:00:32.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.219+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fd6a80675d0 con 0x7fd6a813df80 2023-11-24T08:00:32.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.228+0000 7fd69e7fc640 1 -- 172.21.15.161:0/2394201204 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171039 (secure 0 0 0) 0x7fd6a4017090 con 0x7fd6a813df80 2023-11-24T08:00:32.232 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:32.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd68c06ae40 msgr2=0x7fd68c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd68c06ae40 0x7fd68c06d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd698036000 tx=0x7fd698008030 comp rx=0 tx=0).stop 2023-11-24T08:00:32.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 msgr2=0x7fd6a81358e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 0x7fd6a81358e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400c400 tx=0x7fd6a400c8c0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 shutdown_connections 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd68c06ae40 0x7fd68c06d300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6a815f9c0 0x7fd6a8159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd6a813e360 0x7fd6a8159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 --2- 172.21.15.161:0/2394201204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6a813df80 0x7fd6a81358e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 >> 172.21.15.161:0/2394201204 conn(0x7fd6a806a800 msgr2=0x7fd6a815d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 shutdown_connections 2023-11-24T08:00:32.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.232+0000 7fd6afb8e640 1 -- 172.21.15.161:0/2394201204 wait complete. 2023-11-24T08:00:32.251 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":3392875734},{"type":"v1","addr":"172.21.15.175:6801","nonce":3392875734}]},"active_addr":"172.21.15.175:6801/3392875734","active_change":"2023-11-24T08:00:04.504317+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":3181400666}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":2363052597}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":1299685020}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.175:0","nonce":2465853939}]}]} 2023-11-24T08:00:32.254 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T08:00:32.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T08:00:32.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.443+0000 7f9348fa9640 1 Processor -- start 2023-11-24T08:00:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.443+0000 7f9348fa9640 1 -- start start 2023-11-24T08:00:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.444+0000 7f9348fa9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9344143ae0 0x7f93440cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.444+0000 7f9348fa9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f93440702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.444+0000 7f9348fa9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440cfc30 con 0x7f93440cf7d0 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.444+0000 7f9348fa9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93440b1ee0 con 0x7f9344143ae0 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.444+0000 7f9348fa9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440b2780 con 0x7f934415e3b0 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.445+0000 7f9339d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f93440cf7d0 0x7f934415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39936/0 (socket says 172.21.15.161:39936) 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.445+0000 7f9339d9b640 1 -- 172.21.15.161:0/2654349269 learned_addr learned my addr 172.21.15.161:0/2654349269 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.445+0000 7f934259c640 1 --2- 172.21.15.161:0/2654349269 >> v2:172.21.15.175:3300/0 conn(0x7f9344143ae0 0x7f93440cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.445+0000 7f9342d9d640 1 --2- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f93440702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.445+0000 7f9341d9b640 1 -- 172.21.15.161:0/2654349269 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553938040 0 0) 0x7f93440cfc30 con 0x7f93440cf7d0 2023-11-24T08:00:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.445+0000 7f9341d9b640 1 -- 172.21.15.161:0/2654349269 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9330003520 con 0x7f93440cf7d0 2023-11-24T08:00:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.446+0000 7f934259c640 1 -- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 msgr2=0x7f93440702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.446+0000 7f934259c640 1 --2- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f93440702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.446+0000 7f9341d9b640 1 -- 172.21.15.161:0/2654349269 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 450571253 0 0) 0x7f9330003520 con 0x7f93440cf7d0 2023-11-24T08:00:32.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.446+0000 7f934259c640 1 -- 172.21.15.161:0/2654349269 >> v1:172.21.15.161:6789/0 conn(0x7f93440cf7d0 legacy=0x7f934415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.446+0000 7f934259c640 1 -- 172.21.15.161:0/2654349269 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934415e990 con 0x7f9344143ae0 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.447+0000 7f934259c640 1 --2- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 0x7f93440cf290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93340097a0 tx=0x7f933402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9046db2df6dad6d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.447+0000 7f9341d9b640 1 -- 172.21.15.161:0/2654349269 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c001670 con 0x7f9344143ae0 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.447+0000 7f9341d9b640 1 -- 172.21.15.161:0/2654349269 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933402e050 con 0x7f9344143ae0 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.447+0000 7f9341d9b640 1 -- 172.21.15.161:0/2654349269 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334030730 con 0x7f9344143ae0 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 -- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 msgr2=0x7f93440cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 --2- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 0x7f93440cf290 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f93340097a0 tx=0x7f933402b790 comp rx=0 tx=0).stop 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 -- 172.21.15.161:0/2654349269 shutdown_connections 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 --2- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f93440702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 --2- 172.21.15.161:0/2654349269 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 0x7f93440cf290 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 -- 172.21.15.161:0/2654349269 >> 172.21.15.161:0/2654349269 conn(0x7f934406a800 msgr2=0x7f934406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 -- 172.21.15.161:0/2654349269 shutdown_connections 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.448+0000 7f9348fa9640 1 -- 172.21.15.161:0/2654349269 wait complete. 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.450+0000 7f9348fa9640 1 Processor -- start 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.450+0000 7f9348fa9640 1 -- start start 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f9348fa9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 0x7f9344140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f9348fa9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 0x7f9344159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f9348fa9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f9344159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f9348fa9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93440af980 con 0x7f93440cf7d0 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f9348fa9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93440aed70 con 0x7f9344143ae0 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f9348fa9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440af050 con 0x7f934415e3b0 2023-11-24T08:00:32.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 0x7f9344140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 0x7f9344140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56492/0 (socket says 172.21.15.161:56492) 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 -- 172.21.15.161:0/615932871 learned_addr learned my addr 172.21.15.161:0/615932871 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 -- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 msgr2=0x7f9344159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f9344159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 -- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 msgr2=0x7f9344159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 0x7f9344159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.451+0000 7f934259c640 1 -- 172.21.15.161:0/615932871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9334009400 con 0x7f93440cf7d0 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.452+0000 7f934259c640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 0x7f9344140520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9334000c00 tx=0x7f93340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.452+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933403b810 con 0x7f93440cf7d0 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.452+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933403b970 con 0x7f93440cf7d0 2023-11-24T08:00:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.452+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93440af330 con 0x7f93440cf7d0 2023-11-24T08:00:32.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.452+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933403bd20 con 0x7f93440cf7d0 2023-11-24T08:00:32.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.452+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93440aea20 con 0x7f93440cf7d0 2023-11-24T08:00:32.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.453+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93440675d0 con 0x7f93440cf7d0 2023-11-24T08:00:32.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.454+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9334039040 con 0x7f93440cf7d0 2023-11-24T08:00:32.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.455+0000 7f933b7fe640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f932406ae70 0x7f932406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.455+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93340aade0 con 0x7f93440cf7d0 2023-11-24T08:00:32.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.455+0000 7f9339d9b640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f932406ae70 0x7f932406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.456+0000 7f9339d9b640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f932406ae70 0x7f932406d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f932c001eb0 tx=0x7f932c001a00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:32.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.460+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9334075e80 con 0x7f93440cf7d0 2023-11-24T08:00:32.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.653+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f934415c120 con 0x7f93440cf7d0 2023-11-24T08:00:32.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.654+0000 7f933b7fe640 1 -- 172.21.15.161:0/615932871 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f9334037090 con 0x7f93440cf7d0 2023-11-24T08:00:32.657 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:32.657 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:32.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f932406ae70 msgr2=0x7f932406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f932406ae70 0x7f932406d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f932c001eb0 tx=0x7f932c001a00 comp rx=0 tx=0).stop 2023-11-24T08:00:32.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 msgr2=0x7f9344140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 0x7f9344140520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9334000c00 tx=0x7f93340046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 shutdown_connections 2023-11-24T08:00:32.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f932406ae70 0x7f932406d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f934415e3b0 0x7f9344159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9344143ae0 0x7f9344159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 --2- 172.21.15.161:0/615932871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93440cf7d0 0x7f9344140520 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 >> 172.21.15.161:0/615932871 conn(0x7f934406a800 msgr2=0x7f934415c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:32.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 shutdown_connections 2023-11-24T08:00:32.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.657+0000 7f9348fa9640 1 -- 172.21.15.161:0/615932871 wait complete. 2023-11-24T08:00:32.678 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T08:00:32.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:32.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.890+0000 7f3099d47640 1 Processor -- start 2023-11-24T08:00:32.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.890+0000 7f3099d47640 1 -- start start 2023-11-24T08:00:32.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3099d47640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f309406d760 0x7f3094070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3099d47640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3094071790 con 0x7f3094159590 2023-11-24T08:00:32.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3099d47640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3094071100 con 0x7f30940b3c20 2023-11-24T08:00:32.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3099d47640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3094070860 con 0x7f309406d760 2023-11-24T08:00:32.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3098d45640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3094159590 0x7f30940ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39950/0 (socket says 172.21.15.161:39950) 2023-11-24T08:00:32.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3098d45640 1 -- 172.21.15.161:0/1972710881 learned_addr learned my addr 172.21.15.161:0/1972710881 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:32.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f3099546640 1 --2- 172.21.15.161:0/1972710881 >> v2:172.21.15.161:3300/0 conn(0x7f309406d760 0x7f3094070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f30937fe640 1 -- 172.21.15.161:0/1972710881 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343181832 0 0) 0x7f3094071790 con 0x7f3094159590 2023-11-24T08:00:32.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.892+0000 7f30937fe640 1 -- 172.21.15.161:0/1972710881 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3084003520 con 0x7f3094159590 2023-11-24T08:00:32.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.893+0000 7f3099546640 1 -- 172.21.15.161:0/1972710881 >> v1:172.21.15.175:6789/0 conn(0x7f30940b3c20 legacy=0x7f309406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:32.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.893+0000 7f3099546640 1 -- 172.21.15.161:0/1972710881 >> v1:172.21.15.161:6789/0 conn(0x7f3094159590 legacy=0x7f30940ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.893+0000 7f3099546640 1 -- 172.21.15.161:0/1972710881 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3094070b40 con 0x7f309406d760 2023-11-24T08:00:32.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.894+0000 7f3099546640 1 --2- 172.21.15.161:0/1972710881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094070160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f308c009d90 tx=0x7f308c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece86596e72d67cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:32.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.894+0000 7f30937fe640 1 -- 172.21.15.161:0/1972710881 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c02cbd0 con 0x7f309406d760 2023-11-24T08:00:32.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.894+0000 7f30937fe640 1 -- 172.21.15.161:0/1972710881 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c02cd30 con 0x7f309406d760 2023-11-24T08:00:32.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.894+0000 7f30937fe640 1 -- 172.21.15.161:0/1972710881 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c02cea0 con 0x7f309406d760 2023-11-24T08:00:32.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.894+0000 7f3099d47640 1 -- 172.21.15.161:0/1972710881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 msgr2=0x7f3094070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.894+0000 7f3099d47640 1 --2- 172.21.15.161:0/1972710881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094070160 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f308c009d90 tx=0x7f308c02be20 comp rx=0 tx=0).stop 2023-11-24T08:00:32.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.895+0000 7f3099d47640 1 -- 172.21.15.161:0/1972710881 shutdown_connections 2023-11-24T08:00:32.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.895+0000 7f3099d47640 1 --2- 172.21.15.161:0/1972710881 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094070160 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.895+0000 7f3099d47640 1 -- 172.21.15.161:0/1972710881 >> 172.21.15.161:0/1972710881 conn(0x7f309406a800 msgr2=0x7f309406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:32.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.895+0000 7f3099d47640 1 -- 172.21.15.161:0/1972710881 shutdown_connections 2023-11-24T08:00:32.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.895+0000 7f3099d47640 1 -- 172.21.15.161:0/1972710881 wait complete. 2023-11-24T08:00:32.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.896+0000 7f3099d47640 1 Processor -- start 2023-11-24T08:00:32.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.897+0000 7f3099d47640 1 -- start start 2023-11-24T08:00:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.897+0000 7f3099d47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3099d47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30940b3c20 0x7f3094159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3099d47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3094159590 0x7f3094143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3099d47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309415c330 con 0x7f309406d760 2023-11-24T08:00:32.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3099d47640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309415c610 con 0x7f30940b3c20 2023-11-24T08:00:32.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3099d47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309415c8f0 con 0x7f3094159590 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094158480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56506/0 (socket says 172.21.15.161:56506) 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 -- 172.21.15.161:0/2174936356 learned_addr learned my addr 172.21.15.161:0/2174936356 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 -- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3094159590 msgr2=0x7f3094143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3099546640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3094159590 0x7f3094143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3093fff640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30940b3c20 0x7f3094159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3094159590 0x7f3094143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 -- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30940b3c20 msgr2=0x7f3094159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30940b3c20 0x7f3094159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:32.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.898+0000 7f3098d45640 1 -- 172.21.15.161:0/2174936356 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c009a70 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.899+0000 7f3098d45640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094158480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30880010e0 tx=0x7f308800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.899+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3088005ce0 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.899+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3088005e60 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.899+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30880072f0 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.899+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309415a280 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.899+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3094143c50 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.900+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3094067450 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.901+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3088007450 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.902+0000 7f30917fa640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f307806ae40 0x7f307806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.902+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3088088c70 con 0x7f309406d760 2023-11-24T08:00:32.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.903+0000 7f3093fff640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f307806ae40 0x7f307806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:32.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.904+0000 7f3093fff640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f307806ae40 0x7f307806d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30940cb4c0 tx=0x7f3080008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:32.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:32.907+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3088053c80 con 0x7f309406d760 2023-11-24T08:00:33.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.098+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f309415c470 con 0x7f309406d760 2023-11-24T08:00:33.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.101+0000 7f30917fa640 1 -- 172.21.15.161:0/2174936356 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f309415c470 con 0x7f309406d760 2023-11-24T08:00:33.103 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:33.103 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:33.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.103+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f307806ae40 msgr2=0x7f307806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.103+0000 7f3099d47640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f307806ae40 0x7f307806d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f30940cb4c0 tx=0x7f3080008040 comp rx=0 tx=0).stop 2023-11-24T08:00:33.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 msgr2=0x7f3094158480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094158480 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30880010e0 tx=0x7f308800c890 comp rx=0 tx=0).stop 2023-11-24T08:00:33.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 shutdown_connections 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f307806ae40 0x7f307806d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3094159590 0x7f3094143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30940b3c20 0x7f3094159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 --2- 172.21.15.161:0/2174936356 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f309406d760 0x7f3094158480 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 >> 172.21.15.161:0/2174936356 conn(0x7f309406a800 msgr2=0x7f30940b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 shutdown_connections 2023-11-24T08:00:33.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.104+0000 7f3099d47640 1 -- 172.21.15.161:0/2174936356 wait complete. 2023-11-24T08:00:33.125 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T08:00:33.125 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T08:00:33.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T08:00:33.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T08:00:33.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T08:00:33.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T08:00:33.128 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T08:00:33.128 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T08:00:33.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.413+0000 7f9f29497640 1 Processor -- start 2023-11-24T08:00:33.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.414+0000 7f9f29497640 1 -- start start 2023-11-24T08:00:33.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.416+0000 7f9f29497640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c0e12d0 0x7f9f1c03a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.417+0000 7f9f29497640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f1c00a420 0x7f9f1c055d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.417+0000 7f9f29497640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1c0558e0 con 0x7f9f1c00ab00 2023-11-24T08:00:33.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.417+0000 7f9f29497640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1c0e16b0 con 0x7f9f1c00a420 2023-11-24T08:00:33.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.418+0000 7f9f29497640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c03a670 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.418+0000 7f9f237fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f1c00a420 0x7f9f1c055d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.418+0000 7f9f237fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9f1c00a420 0x7f9f1c055d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56520/0 (socket says 172.21.15.161:56520) 2023-11-24T08:00:33.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.419+0000 7f9f237fe640 1 -- 172.21.15.161:0/2093236918 learned_addr learned my addr 172.21.15.161:0/2093236918 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.419+0000 7f9f237fe640 1 -- 172.21.15.161:0/2093236918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c0e12d0 msgr2=0x7f9f1c03a130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:00:33.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.419+0000 7f9f237fe640 1 --2- 172.21.15.161:0/2093236918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c0e12d0 0x7f9f1c03a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.420+0000 7f9f237fe640 1 -- 172.21.15.161:0/2093236918 >> v1:172.21.15.175:6789/0 conn(0x7f9f1c00ab00 legacy=0x7f9f1c009d10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:00:33.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.420+0000 7f9f237fe640 1 -- 172.21.15.161:0/2093236918 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1c054cd0 con 0x7f9f1c00a420 2023-11-24T08:00:33.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.422+0000 7f9f237fe640 1 --2- 172.21.15.161:0/2093236918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c00a420 0x7f9f1c055d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000b60 tx=0x7f9f240a5ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c4d97552300d86 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.423+0000 7f9f21ffb640 1 -- 172.21.15.161:0/2093236918 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240a6d10 con 0x7f9f1c00a420 2023-11-24T08:00:33.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.423+0000 7f9f21ffb640 1 -- 172.21.15.161:0/2093236918 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240a6e70 con 0x7f9f1c00a420 2023-11-24T08:00:33.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.423+0000 7f9f21ffb640 1 -- 172.21.15.161:0/2093236918 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240ae640 con 0x7f9f1c00a420 2023-11-24T08:00:33.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.424+0000 7f9f29497640 1 -- 172.21.15.161:0/2093236918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c00a420 msgr2=0x7f9f1c055d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.424+0000 7fd6851ec640 1 Processor -- start 2023-11-24T08:00:33.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.424+0000 7f9f29497640 1 --2- 172.21.15.161:0/2093236918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c00a420 0x7f9f1c055d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000b60 tx=0x7f9f240a5ea0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.424+0000 7fd6851ec640 1 -- start start 2023-11-24T08:00:33.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.425+0000 7f27399b3640 1 Processor -- start 2023-11-24T08:00:33.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.425+0000 7f9f29497640 1 -- 172.21.15.161:0/2093236918 shutdown_connections 2023-11-24T08:00:33.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.425+0000 7f9f29497640 1 --2- 172.21.15.161:0/2093236918 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c00a420 0x7f9f1c055d70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.425+0000 7f9f29497640 1 --2- 172.21.15.161:0/2093236918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c0e12d0 0x7f9f1c03a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.426+0000 7f9f29497640 1 -- 172.21.15.161:0/2093236918 >> 172.21.15.161:0/2093236918 conn(0x7f9f1c056c90 msgr2=0x7f9f1c0570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.425+0000 7f27399b3640 1 -- start start 2023-11-24T08:00:33.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.426+0000 7f9f29497640 1 -- 172.21.15.161:0/2093236918 shutdown_connections 2023-11-24T08:00:33.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.426+0000 7f9f29497640 1 -- 172.21.15.161:0/2093236918 wait complete. 2023-11-24T08:00:33.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.427+0000 7fd6851ec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd68014b0a0 0x7fd6800b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.427+0000 7fd6851ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6800b4260 0x7fd680070440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.427+0000 7fd6851ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800b3160 con 0x7fd680165d90 2023-11-24T08:00:33.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.427+0000 7fd6851ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800b25e0 con 0x7fd6800b4260 2023-11-24T08:00:33.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.427+0000 7fd6851ec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800b28c0 con 0x7fd68014b0a0 2023-11-24T08:00:33.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.428+0000 7fd67f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6800b4260 0x7fd680070440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.428+0000 7fd67f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd6800b4260 0x7fd680070440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56528/0 (socket says 172.21.15.161:56528) 2023-11-24T08:00:33.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.428+0000 7fd67f59e640 1 -- 172.21.15.161:0/500233827 learned_addr learned my addr 172.21.15.161:0/500233827 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.428+0000 7fd67ed9d640 1 --2- 172.21.15.161:0/500233827 >> v2:172.21.15.175:3300/0 conn(0x7fd68014b0a0 0x7fd6800b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.429+0000 7fd67ed9d640 1 -- 172.21.15.161:0/500233827 >> v2:172.21.15.161:3300/0 conn(0x7fd6800b4260 msgr2=0x7fd680070440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.429+0000 7fd67ed9d640 1 --2- 172.21.15.161:0/500233827 >> v2:172.21.15.161:3300/0 conn(0x7fd6800b4260 0x7fd680070440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.429+0000 7f9f29497640 1 Processor -- start 2023-11-24T08:00:33.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.430+0000 7f27399b3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f272c00aa70 0x7f272c0541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.430+0000 7f27399b3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c006870 con 0x7f272c04fa60 2023-11-24T08:00:33.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.429+0000 7fd67ed9d640 1 -- 172.21.15.161:0/500233827 >> v1:172.21.15.161:6789/0 conn(0x7fd680165d90 legacy=0x7fd6800b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.429+0000 7fd67ed9d640 1 -- 172.21.15.161:0/500233827 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800b2ba0 con 0x7fd68014b0a0 2023-11-24T08:00:33.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.430+0000 7f27399b3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c006ac0 con 0x7f272c0df3f0 2023-11-24T08:00:33.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.430+0000 7f27399b3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c007740 con 0x7f272c00aa70 2023-11-24T08:00:33.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.431+0000 7fd67ed9d640 1 --2- 172.21.15.161:0/500233827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68014b0a0 0x7fd6800b1d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6800b1a90 tx=0x7fd67802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a37b933ffe150562 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.429+0000 7f9f29497640 1 -- start start 2023-11-24T08:00:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.431+0000 7f9f29497640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c00a420 0x7f9f1c0dd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.431+0000 7f9f29497640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c00ab00 0x7f9f1c0ddbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.431+0000 7f9f29497640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c0e12d0 0x7f9f1c04cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.431+0000 7f27389b1640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f272c04fa60 0x7f272c04fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39964/0 (socket says 172.21.15.161:39964) 2023-11-24T08:00:33.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.431+0000 7f27389b1640 1 -- 172.21.15.161:0/222468876 learned_addr learned my addr 172.21.15.161:0/222468876 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:33.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7fd67dd9b640 1 -- 172.21.15.161:0/500233827 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678030710 con 0x7fd68014b0a0 2023-11-24T08:00:33.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7fd67dd9b640 1 -- 172.21.15.161:0/500233827 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67802e050 con 0x7fd68014b0a0 2023-11-24T08:00:33.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7fd67dd9b640 1 -- 172.21.15.161:0/500233827 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678030a90 con 0x7fd68014b0a0 2023-11-24T08:00:33.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f9f227fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c00ab00 0x7f9f1c0ddbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f9f227fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c00ab00 0x7f9f1c0ddbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:48698/0 (socket says 172.21.15.161:48698) 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001091559 0 0) 0x7f272c006870 con 0x7f272c04fa60 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2724003520 con 0x7f272c04fa60 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160935513 0 0) 0x7f272c006ac0 con 0x7f272c0df3f0 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f272c006870 con 0x7f272c0df3f0 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f27391b2640 1 --2- 172.21.15.161:0/222468876 >> v2:172.21.15.175:3300/0 conn(0x7f272c00aa70 0x7f272c0541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c0e12d0 0x7f9f1c04cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f9f237fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c0e12d0 0x7f9f1c04cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56544/0 (socket says 172.21.15.161:56544) 2023-11-24T08:00:33.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.432+0000 7f9f237fe640 1 -- 172.21.15.161:0/1168810515 learned_addr learned my addr 172.21.15.161:0/1168810515 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c04a6b0 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c04a950 con 0x7f9f1c00ab00 2023-11-24T08:00:33.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c04ac30 con 0x7f9f1c00a420 2023-11-24T08:00:33.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f22ffd640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c00a420 0x7f9f1c0dd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3795319266 0 0) 0x7f2724003520 con 0x7f272c04fa60 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 >> v2:172.21.15.175:3300/0 conn(0x7f272c00aa70 msgr2=0x7f272c0541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 --2- 172.21.15.161:0/222468876 >> v2:172.21.15.175:3300/0 conn(0x7f272c00aa70 0x7f272c0541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 >> v1:172.21.15.175:6789/0 conn(0x7f272c0df3f0 legacy=0x7f272c053ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c006da0 con 0x7f272c04fa60 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f273404f090 con 0x7f272c04fa60 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 >> v1:172.21.15.161:6789/0 conn(0x7f272c04fa60 legacy=0x7f272c04fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2724003b00 0x7f2724003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f27337fe640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27240047c0 0x7f2724004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.434+0000 7f27337fe640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2724005180 0x7f2724014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.434+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c007740 con 0x7f2724003b00 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.434+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240147e0 con 0x7f27240047c0 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.434+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240149a0 con 0x7f2724005180 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.434+0000 7f2733fff640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27240047c0 0x7f2724004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f237fe640 1 -- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c00a420 msgr2=0x7f9f1c0dd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f237fe640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f1c00a420 0x7f9f1c0dd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f237fe640 1 -- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c00ab00 msgr2=0x7f9f1c0ddbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f237fe640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f1c00ab00 0x7f9f1c0ddbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.433+0000 7f9f237fe640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2404f090 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f27391b2640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2724005180 0x7f2724014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f27389b1640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2724003b00 0x7f2724003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f2733fff640 1 -- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2724005180 msgr2=0x7f2724014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f2733fff640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2724005180 0x7f2724014190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f2733fff640 1 -- 172.21.15.161:0/222468876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2724003b00 msgr2=0x7f2724003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f2733fff640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2724003b00 0x7f2724003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7f2733fff640 1 -- 172.21.15.161:0/222468876 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c006da0 con 0x7f27240047c0 2023-11-24T08:00:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7fd6851ec640 1 -- 172.21.15.161:0/500233827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68014b0a0 msgr2=0x7fd6800b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.435+0000 7fd6851ec640 1 --2- 172.21.15.161:0/500233827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68014b0a0 0x7fd6800b1d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6800b1a90 tx=0x7fd67802b710 comp rx=0 tx=0).stop 2023-11-24T08:00:33.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.436+0000 7fd6851ec640 1 -- 172.21.15.161:0/500233827 shutdown_connections 2023-11-24T08:00:33.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.436+0000 7f27391b2640 1 -- 172.21.15.161:0/222468876 reap_dead start 2023-11-24T08:00:33.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.436+0000 7fd6851ec640 1 --2- 172.21.15.161:0/500233827 >> v2:172.21.15.161:3300/0 conn(0x7fd6800b4260 0x7fd680070440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.436+0000 7fd6851ec640 1 --2- 172.21.15.161:0/500233827 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd68014b0a0 0x7fd6800b1d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.436+0000 7fd6851ec640 1 -- 172.21.15.161:0/500233827 >> 172.21.15.161:0/500233827 conn(0x7fd68006c340 msgr2=0x7fd68006c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.436+0000 7fd6851ec640 1 -- 172.21.15.161:0/500233827 shutdown_connections 2023-11-24T08:00:33.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.437+0000 7f2733fff640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27240047c0 0x7f2724004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27280018d0 tx=0x7f27240057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50c878ae6fb58767 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.437+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27280052d0 con 0x7f27240047c0 2023-11-24T08:00:33.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.437+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728005430 con 0x7f27240047c0 2023-11-24T08:00:33.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.437+0000 7f27337fe640 1 -- 172.21.15.161:0/222468876 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728003810 con 0x7f27240047c0 2023-11-24T08:00:33.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.437+0000 7fd6851ec640 1 -- 172.21.15.161:0/500233827 wait complete. 2023-11-24T08:00:33.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.437+0000 7f9f237fe640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c0e12d0 0x7f9f1c04cbe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9f240681d0 tx=0x7f9f240687a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.438+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240b8670 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.438+0000 7f27399b3640 1 -- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27240047c0 msgr2=0x7f2724004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.438+0000 7f27399b3640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27240047c0 0x7f2724004c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27280018d0 tx=0x7f27240057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.438+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f240b87d0 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.438+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c04af10 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.438+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c0dd960 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.439+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240b8bc0 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.439+0000 7fd6851ec640 1 Processor -- start 2023-11-24T08:00:33.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.440+0000 7f27399b3640 1 -- 172.21.15.161:0/222468876 shutdown_connections 2023-11-24T08:00:33.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.440+0000 7f27399b3640 1 --2- 172.21.15.161:0/222468876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27240047c0 0x7f2724004c40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.440+0000 7f27399b3640 1 -- 172.21.15.161:0/222468876 >> 172.21.15.161:0/222468876 conn(0x7f272c009f80 msgr2=0x7f272c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.439+0000 7fd6851ec640 1 -- start start 2023-11-24T08:00:33.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.440+0000 7f27399b3640 1 -- 172.21.15.161:0/222468876 shutdown_connections 2023-11-24T08:00:33.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.440+0000 7f27399b3640 1 -- 172.21.15.161:0/222468876 wait complete. 2023-11-24T08:00:33.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.441+0000 7fd6851ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6800b4260 0x7fd6800a8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.441+0000 7fd6851ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68014b0a0 0x7fd680156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.441+0000 7fd6851ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd680165d90 0x7fd6801445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.442+0000 7fd6851ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f9ae0 con 0x7fd6800b4260 2023-11-24T08:00:33.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.442+0000 7fd6851ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f91f0 con 0x7fd680165d90 2023-11-24T08:00:33.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.442+0000 7fd6851ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f9490 con 0x7fd68014b0a0 2023-11-24T08:00:33.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.442+0000 7fd67ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6800b4260 0x7fd6800a8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.442+0000 7fd67f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd680165d90 0x7fd6801445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.443+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f04000fc0 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.443+0000 7f27399b3640 1 Processor -- start 2023-11-24T08:00:33.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.443+0000 7fd67e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68014b0a0 0x7fd680156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.443+0000 7fd67e59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68014b0a0 0x7fd680156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51354/0 (socket says 172.21.15.161:51354) 2023-11-24T08:00:33.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.443+0000 7fd67e59c640 1 -- 172.21.15.161:0/3198800557 learned_addr learned my addr 172.21.15.161:0/3198800557 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f240b5040 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.443+0000 7f27399b3640 1 -- start start 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67e59c640 1 -- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd680165d90 msgr2=0x7fd6801445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67e59c640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd680165d90 0x7fd6801445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67e59c640 1 -- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6800b4260 msgr2=0x7fd6800a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67e59c640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6800b4260 0x7fd6800a8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67e59c640 1 -- 172.21.15.161:0/3198800557 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009400 con 0x7fd68014b0a0 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67f59e640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd680165d90 0x7fd6801445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:33.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.444+0000 7fd67ed9d640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd6800b4260 0x7fd6800a8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27399b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27240047c0 0x7f272c0d9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27399b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f272c048580 0x7f272c0489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27399b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f272c035980 0x7f272c035e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27399b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0d9970 con 0x7f27240047c0 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27399b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c04cbb0 con 0x7f272c048580 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27399b3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c04ce70 con 0x7f272c035980 2023-11-24T08:00:33.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7fd67e59c640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68014b0a0 0x7fd680156bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c780 tx=0x7fd66800cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668005270 con 0x7fd68014b0a0 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6680053f0 con 0x7fd68014b0a0 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66800a880 con 0x7fd68014b0a0 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.445+0000 7f27389b1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27240047c0 0x7f272c0d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f27389b1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27240047c0 0x7f272c0d9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56560/0 (socket says 172.21.15.161:56560) 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f27389b1640 1 -- 172.21.15.161:0/418147197 learned_addr learned my addr 172.21.15.161:0/418147197 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f9f0b7fe640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f1006aec0 0x7f9f1006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7fd6851ec640 1 -- 172.21.15.161:0/3198800557 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801f9770 con 0x7fd68014b0a0 2023-11-24T08:00:33.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7fd6851ec640 1 -- 172.21.15.161:0/3198800557 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6800a9390 con 0x7fd68014b0a0 2023-11-24T08:00:33.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f241254d0 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f9f0b7fe640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f9f100730e0 0x7f9f10075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f10075bb0 con 0x7f9f100730e0 2023-11-24T08:00:33.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f24127be0 con 0x7f9f1c0e12d0 2023-11-24T08:00:33.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.446+0000 7f2733fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f272c048580 0x7f272c0489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f9f22ffd640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f1006aec0 0x7f9f1006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27391b2640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f272c035980 0x7f272c035e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27389b1640 1 -- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f272c035980 msgr2=0x7f272c035e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27389b1640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f272c035980 0x7f272c035e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27389b1640 1 -- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f272c048580 msgr2=0x7f272c0489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27389b1640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f272c048580 0x7f272c0489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27389b1640 1 -- 172.21.15.161:0/418147197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c04d150 con 0x7f27240047c0 2023-11-24T08:00:33.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f6512b5c640 1 Processor -- start 2023-11-24T08:00:33.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f001758a640 1 Processor -- start 2023-11-24T08:00:33.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f27391b2640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f272c035980 0x7f272c035e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:33.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.447+0000 7f2733fff640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f272c048580 0x7f272c0489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:33.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6800b22d0 con 0x7fd68014b0a0 2023-11-24T08:00:33.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f001758a640 1 -- start start 2023-11-24T08:00:33.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f9f227fc640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f9f100730e0 0x7f9f10075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f27389b1640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27240047c0 0x7f272c0d9430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f273402cf10 tx=0x7f273406b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7fae6f823640 1 Processor -- start 2023-11-24T08:00:33.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f6512b5c640 1 -- start start 2023-11-24T08:00:33.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340723d0 con 0x7f27240047c0 2023-11-24T08:00:33.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734072530 con 0x7f27240047c0 2023-11-24T08:00:33.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340728c0 con 0x7f27240047c0 2023-11-24T08:00:33.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.449+0000 7f9f227fc640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f9f100730e0 0x7f9f10075500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.449+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c04d430 con 0x7f27240047c0 2023-11-24T08:00:33.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.449+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c04d9f0 con 0x7f27240047c0 2023-11-24T08:00:33.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.449+0000 7f9f22ffd640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f1006aec0 0x7f9f1006d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f14006fd0 tx=0x7f9f14009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f272c007360 con 0x7f27240047c0 2023-11-24T08:00:33.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.448+0000 7fae6f823640 1 -- start start 2023-11-24T08:00:33.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7fae6f823640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae60006c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7fae6f823640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae600e7530 0x7fae60057b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7fae6f823640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae60057670 con 0x7fae60007190 2023-11-24T08:00:33.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7fae6f823640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae600570f0 con 0x7fae600e7530 2023-11-24T08:00:33.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7fae6f823640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600076f0 con 0x7fae600e31c0 2023-11-24T08:00:33.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.450+0000 7f6512b5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65040e3130 0x7f65040e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6512b5c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6504053c80 0x7f65040540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6512b5c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6504054630 con 0x7f650403c070 2023-11-24T08:00:33.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6512b5c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6504007b40 con 0x7f6504053c80 2023-11-24T08:00:33.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6512b5c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040587e0 con 0x7f65040e3130 2023-11-24T08:00:33.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7fae6d5bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae60006c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7fae6d5bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae60006c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51372/0 (socket says 172.21.15.161:51372) 2023-11-24T08:00:33.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7fae6d5bf640 1 -- 172.21.15.161:0/1366509871 learned_addr learned my addr 172.21.15.161:0/1366509871 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== osd.0 v2:172.21.15.161:6800/2118422527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9f10075bb0 con 0x7f9f100730e0 2023-11-24T08:00:33.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7fae6ddc0640 1 --2- 172.21.15.161:0/1366509871 >> v2:172.21.15.175:3300/0 conn(0x7fae600e7530 0x7fae60057b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6511359640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f650403c070 0x7f6504058020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:49778/0 (socket says 172.21.15.161:49778) 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6511b5a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65040e3130 0x7f65040e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.451+0000 7f6511359640 1 -- 172.21.15.161:0/299718122 learned_addr learned my addr 172.21.15.161:0/299718122 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f6511b5a640 1 -- 172.21.15.161:0/299718122 >> v2:172.21.15.161:3300/0 conn(0x7f6504053c80 msgr2=0x7f65040540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f6511b5a640 1 --2- 172.21.15.161:0/299718122 >> v2:172.21.15.161:3300/0 conn(0x7f6504053c80 0x7f65040540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f6511b5a640 1 -- 172.21.15.161:0/299718122 >> v1:172.21.15.175:6789/0 conn(0x7f650403c070 legacy=0x7f6504058020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f6511b5a640 1 -- 172.21.15.161:0/299718122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504058ac0 con 0x7f65040e3130 2023-11-24T08:00:33.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f001758a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00100ce8f0 0x7f00100ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f001758a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f00100b2a00 0x7f00100b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f001758a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00100d0de0 con 0x7f0010160f80 2023-11-24T08:00:33.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f001758a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00100d10c0 con 0x7f00100b2a00 2023-11-24T08:00:33.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f001758a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100d13a0 con 0x7f00100ce8f0 2023-11-24T08:00:33.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7fae6d5bf640 1 -- 172.21.15.161:0/1366509871 >> v2:172.21.15.175:3300/0 conn(0x7fae600e7530 msgr2=0x7fae60057b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7fae6d5bf640 1 --2- 172.21.15.161:0/1366509871 >> v2:172.21.15.175:3300/0 conn(0x7fae600e7530 0x7fae60057b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7fae6d5bf640 1 -- 172.21.15.161:0/1366509871 >> v1:172.21.15.161:6789/0 conn(0x7fae60007190 legacy=0x7fae600e6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7f0015326640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f0010160f80 0x7f0010161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:49780/0 (socket says 172.21.15.161:49780) 2023-11-24T08:00:33.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7f0015326640 1 -- 172.21.15.161:0/514384187 learned_addr learned my addr 172.21.15.161:0/514384187 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:33.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7fae6d5bf640 1 -- 172.21.15.161:0/1366509871 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae600079d0 con 0x7fae600e31c0 2023-11-24T08:00:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7f0014b25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00100ce8f0 0x7f00100ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f0015b27640 1 --2- 172.21.15.161:0/514384187 >> v2:172.21.15.175:3300/0 conn(0x7f00100b2a00 0x7f00100b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f0014b25640 1 -- 172.21.15.161:0/514384187 >> v2:172.21.15.175:3300/0 conn(0x7f00100b2a00 msgr2=0x7f00100b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2734072a20 con 0x7f27240047c0 2023-11-24T08:00:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.452+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd66800a9e0 con 0x7fd68014b0a0 2023-11-24T08:00:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7fd6777fe640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd66006af10 0x7fd66006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd668089360 con 0x7fd68014b0a0 2023-11-24T08:00:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fd6777fe640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fd660073130 0x7fd660075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 --> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd660075c00 con 0x7fd660073130 2023-11-24T08:00:33.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd668089710 con 0x7fd68014b0a0 2023-11-24T08:00:33.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f0014b25640 1 --2- 172.21.15.161:0/514384187 >> v2:172.21.15.175:3300/0 conn(0x7f00100b2a00 0x7f00100b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f0014b25640 1 -- 172.21.15.161:0/514384187 >> v1:172.21.15.175:6789/0 conn(0x7f0010160f80 legacy=0x7f0010161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f0014b25640 1 -- 172.21.15.161:0/514384187 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100d1680 con 0x7f00100ce8f0 2023-11-24T08:00:33.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fd67f59e640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fd660073130 0x7fd660075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f0015b27640 1 --2- 172.21.15.161:0/514384187 >> v2:172.21.15.175:3300/0 conn(0x7f00100b2a00 0x7f00100b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:33.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.453+0000 7f6511b5a640 1 --2- 172.21.15.161:0/299718122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65040e3130 0x7f65040e7750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f650c04fab0 tx=0x7f650c0a5cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ca8858c850ee5c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f6510b58640 1 -- 172.21.15.161:0/299718122 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c0a69e0 con 0x7f65040e3130 2023-11-24T08:00:33.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f6510b58640 1 -- 172.21.15.161:0/299718122 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650c0a6bc0 con 0x7f65040e3130 2023-11-24T08:00:33.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7f6510b58640 1 -- 172.21.15.161:0/299718122 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c0ae440 con 0x7f65040e3130 2023-11-24T08:00:33.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fae6ddc0640 1 --2- 172.21.15.161:0/1366509871 >> v2:172.21.15.175:3300/0 conn(0x7fae600e7530 0x7fae60057b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:33.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f27317fa640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f271806af40 0x7f271806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2734103ae0 con 0x7f27240047c0 2023-11-24T08:00:33.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7fae6d5bf640 1 --2- 172.21.15.161:0/1366509871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae60006c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fae64009870 tx=0x7fae6402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b9a6ea941484c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f27317fa640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7f2718073160 0x7f2718075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 --> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2718075c30 con 0x7f2718073160 2023-11-24T08:00:33.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27341082a0 con 0x7f27240047c0 2023-11-24T08:00:33.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.454+0000 7fd67ed9d640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd66006af10 0x7fd66006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f6512b5c640 1 -- 172.21.15.161:0/299718122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65040e3130 msgr2=0x7f65040e7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.455+0000 7f6512b5c640 1 --2- 172.21.15.161:0/299718122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65040e3130 0x7f65040e7750 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f650c04fab0 tx=0x7f650c0a5cb0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7fae5ffff640 1 -- 172.21.15.161:0/1366509871 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64031640 con 0x7fae600e31c0 2023-11-24T08:00:33.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7fae5ffff640 1 -- 172.21.15.161:0/1366509871 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae640317a0 con 0x7fae600e31c0 2023-11-24T08:00:33.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7fae5ffff640 1 -- 172.21.15.161:0/1366509871 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64031b70 con 0x7fae600e31c0 2023-11-24T08:00:33.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7fd67f59e640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fd660073130 0x7fd660075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f2733fff640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f271806af40 0x7f271806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f27391b2640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7f2718073160 0x7f2718075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7fd67ed9d640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd66006af10 0x7fd66006d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd678034000 tx=0x7fd678008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f6512b5c640 1 -- 172.21.15.161:0/299718122 shutdown_connections 2023-11-24T08:00:33.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f6512b5c640 1 --2- 172.21.15.161:0/299718122 >> v2:172.21.15.161:3300/0 conn(0x7f6504053c80 0x7f65040540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f6512b5c640 1 --2- 172.21.15.161:0/299718122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65040e3130 0x7f65040e7750 secure :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f650c04fab0 tx=0x7f650c0a5cb0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f6512b5c640 1 -- 172.21.15.161:0/299718122 >> 172.21.15.161:0/299718122 conn(0x7f6504058eb0 msgr2=0x7f6504059290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f0014b25640 1 --2- 172.21.15.161:0/514384187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00100ce8f0 0x7f00100ced30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f000c0097a0 tx=0x7f000c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a752e09fc6e9456d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.456+0000 7f99efdc9640 1 Processor -- start 2023-11-24T08:00:33.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7fae6f823640 1 -- 172.21.15.161:0/1366509871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 msgr2=0x7fae60006c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7fae6f823640 1 --2- 172.21.15.161:0/1366509871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae60006c50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fae64009870 tx=0x7fae6402b8f0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f6512b5c640 1 -- 172.21.15.161:0/299718122 shutdown_connections 2023-11-24T08:00:33.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f6512b5c640 1 -- 172.21.15.161:0/299718122 wait complete. 2023-11-24T08:00:33.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f99efdc9640 1 -- start start 2023-11-24T08:00:33.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== osd.2 v2:172.21.15.161:6816/4193711640 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd660075c00 con 0x7fd660073130 2023-11-24T08:00:33.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f27391b2640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7f2718073160 0x7f2718075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f0007fff640 1 -- 172.21.15.161:0/514384187 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c02e070 con 0x7f00100ce8f0 2023-11-24T08:00:33.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f0007fff640 1 -- 172.21.15.161:0/514384187 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c0315a0 con 0x7f00100ce8f0 2023-11-24T08:00:33.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.457+0000 7f0007fff640 1 -- 172.21.15.161:0/514384187 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c031930 con 0x7f00100ce8f0 2023-11-24T08:00:33.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7fae6f823640 1 -- 172.21.15.161:0/1366509871 shutdown_connections 2023-11-24T08:00:33.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7fae6f823640 1 --2- 172.21.15.161:0/1366509871 >> v2:172.21.15.175:3300/0 conn(0x7fae600e7530 0x7fae60057b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7fae6f823640 1 --2- 172.21.15.161:0/1366509871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae60006c50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7fae6f823640 1 -- 172.21.15.161:0/1366509871 >> 172.21.15.161:0/1366509871 conn(0x7fae6003aa30 msgr2=0x7fae6003ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7f001758a640 1 -- 172.21.15.161:0/514384187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00100ce8f0 msgr2=0x7f00100ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7f001758a640 1 --2- 172.21.15.161:0/514384187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00100ce8f0 0x7f00100ced30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f000c0097a0 tx=0x7f000c02b840 comp rx=0 tx=0).stop 2023-11-24T08:00:33.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7f2733fff640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f271806af40 0x7f271806d400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2728034000 tx=0x7f2728031000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f001758a640 1 -- 172.21.15.161:0/514384187 shutdown_connections 2023-11-24T08:00:33.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f001758a640 1 --2- 172.21.15.161:0/514384187 >> v2:172.21.15.175:3300/0 conn(0x7f00100b2a00 0x7f00100b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f001758a640 1 --2- 172.21.15.161:0/514384187 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00100ce8f0 0x7f00100ced30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f001758a640 1 -- 172.21.15.161:0/514384187 >> 172.21.15.161:0/514384187 conn(0x7f001009c550 msgr2=0x7f00100d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== osd.1 v2:172.21.15.161:6808/555346844 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2718075c30 con 0x7f2718073160 2023-11-24T08:00:33.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7fae6f823640 1 -- 172.21.15.161:0/1366509871 shutdown_connections 2023-11-24T08:00:33.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.458+0000 7fae6f823640 1 -- 172.21.15.161:0/1366509871 wait complete. 2023-11-24T08:00:33.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f99efdc9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99e80b4660 0x7f99e80b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.460+0000 7f6512b5c640 1 Processor -- start 2023-11-24T08:00:33.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f99efdc9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f99e80cfe40 0x7f99e80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f99efdc9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80ceb50 con 0x7f99e8165560 2023-11-24T08:00:33.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f99efdc9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80cf9b0 con 0x7f99e80cfe40 2023-11-24T08:00:33.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f99efdc9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e80d0830 con 0x7f99e80b4660 2023-11-24T08:00:33.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.460+0000 7f6512b5c640 1 -- start start 2023-11-24T08:00:33.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.461+0000 7fae6f823640 1 Processor -- start 2023-11-24T08:00:33.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.460+0000 7f99edb65640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99e80b4660 0x7f99e80b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.461+0000 7f99ee366640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f99e8165560 0x7f99e81659b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39988/0 (socket says 172.21.15.161:39988) 2023-11-24T08:00:33.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.461+0000 7fae6f823640 1 -- start start 2023-11-24T08:00:33.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.461+0000 7f99ee366640 1 -- 172.21.15.161:0/4007311386 learned_addr learned my addr 172.21.15.161:0/4007311386 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:33.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.461+0000 7f6512b5c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f650403c070 0x7f65040d5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6512b5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6504053c80 0x7f65040519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6512b5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6504051f20 0x7f650416db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6512b5c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040523b0 con 0x7f650403c070 2023-11-24T08:00:33.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6512b5c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65040d5950 con 0x7f6504051f20 2023-11-24T08:00:33.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6512b5c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650404e340 con 0x7f6504053c80 2023-11-24T08:00:33.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f001758a640 1 -- 172.21.15.161:0/514384187 shutdown_connections 2023-11-24T08:00:33.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.459+0000 7f001758a640 1 -- 172.21.15.161:0/514384187 wait complete. 2023-11-24T08:00:33.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6511359640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6504053c80 0x7f65040519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6511359640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6504053c80 0x7f65040519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51400/0 (socket says 172.21.15.161:51400) 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f6511359640 1 -- 172.21.15.161:0/1257237986 learned_addr learned my addr 172.21.15.161:0/1257237986 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f651235b640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6504051f20 0x7f650416db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7fae6f823640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae60007190 0x7fae6000c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7fae6f823640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae6000ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7fae6f823640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae600e7530 0x7fae600e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7fae6cdbe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae6000ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7fae6cdbe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae6000ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51402/0 (socket says 172.21.15.161:51402) 2023-11-24T08:00:33.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7f6511359640 1 -- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6504051f20 msgr2=0x7f650416db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7f6511359640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6504051f20 0x7f650416db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7f6511359640 1 -- 172.21.15.161:0/1257237986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f650403c070 msgr2=0x7f65040d5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6f823640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae600cea10 con 0x7fae60007190 2023-11-24T08:00:33.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6f823640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6017d0c0 con 0x7fae600e7530 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7f6511359640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f650403c070 0x7f65040d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7f6511359640 1 -- 172.21.15.161:0/1257237986 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c04edc0 con 0x7f6504053c80 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6f823640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae600e5f30 con 0x7fae600e31c0 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6cdbe640 1 -- 172.21.15.161:0/1822005975 learned_addr learned my addr 172.21.15.161:0/1822005975 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6cdbe640 1 -- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae600e7530 msgr2=0x7fae600e4a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6cdbe640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae600e7530 0x7fae600e4a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6cdbe640 1 -- 172.21.15.161:0/1822005975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae60007190 msgr2=0x7fae6000c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f001758a640 1 Processor -- start 2023-11-24T08:00:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6cdbe640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fae60007190 0x7fae6000c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7fae6cdbe640 1 -- 172.21.15.161:0/1822005975 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6804edc0 con 0x7fae600e31c0 2023-11-24T08:00:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.461+0000 7f99ed364640 1 --2- 172.21.15.161:0/4007311386 >> v2:172.21.15.161:3300/0 conn(0x7f99e80cfe40 0x7f99e80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.462+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920195560 0 0) 0x7f99e80ceb50 con 0x7f99e8165560 2023-11-24T08:00:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.463+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99d4003520 con 0x7f99e8165560 2023-11-24T08:00:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198587947 0 0) 0x7f99d4003520 con 0x7f99e8165560 2023-11-24T08:00:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 >> v2:172.21.15.175:3300/0 conn(0x7f99e80b4660 msgr2=0x7f99e80b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 --2- 172.21.15.161:0/4007311386 >> v2:172.21.15.175:3300/0 conn(0x7f99e80b4660 0x7f99e80b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 >> v2:172.21.15.161:3300/0 conn(0x7f99e80cfe40 msgr2=0x7f99e80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 --2- 172.21.15.161:0/4007311386 >> v2:172.21.15.161:3300/0 conn(0x7f99e80cfe40 0x7f99e80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80ceda0 con 0x7f99e8165560 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f99e0001670 con 0x7f99e8165560 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 >> v1:172.21.15.161:6789/0 conn(0x7f99e8165560 legacy=0x7f99e81659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d4003970 0x7f99d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40047c0 0x7f99d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d40052a0 0x7f99d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80cf9b0 con 0x7f99d40047c0 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80d0830 con 0x7f99d4003970 2023-11-24T08:00:33.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d400c1f0 con 0x7f99d40052a0 2023-11-24T08:00:33.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.464+0000 7f99edb65640 1 --2- 172.21.15.161:0/4007311386 >> v2:172.21.15.175:3300/0 conn(0x7f99e80b4660 0x7f99e80b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:33.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.465+0000 7f001758a640 1 -- start start 2023-11-24T08:00:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.465+0000 7fae6cdbe640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae6000ca60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c430 tx=0x7fae5800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58011790 con 0x7fae600e31c0 2023-11-24T08:00:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae580118f0 con 0x7fae600e31c0 2023-11-24T08:00:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae640094d0 con 0x7fae600e31c0 2023-11-24T08:00:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58011ce0 con 0x7fae600e31c0 2023-11-24T08:00:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae600e5c50 con 0x7fae600e31c0 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.465+0000 7f99ed364640 1 --2- 172.21.15.161:0/4007311386 >> v2:172.21.15.161:3300/0 conn(0x7f99e80cfe40 0x7f99e80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.465+0000 7f99ee366640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d40052a0 0x7f99d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7f99ed364640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40047c0 0x7f99d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7f99ee366640 1 -- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d4003970 msgr2=0x7f99d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7f99ee366640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d4003970 0x7f99d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7f99ee366640 1 -- 172.21.15.161:0/4007311386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40047c0 msgr2=0x7f99d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7f99ee366640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40047c0 0x7f99d4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.466+0000 7f99ee366640 1 -- 172.21.15.161:0/4007311386 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80ceda0 con 0x7f99d40052a0 2023-11-24T08:00:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.467+0000 7efc0ec15640 1 Processor -- start 2023-11-24T08:00:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.467+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae60008030 con 0x7fae600e31c0 2023-11-24T08:00:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.467+0000 7efc0ec15640 1 -- start start 2023-11-24T08:00:33.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f6511359640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6504053c80 0x7f65040519e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f650800c7b0 tx=0x7f650800cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f99ee366640 1 -- 172.21.15.161:0/4007311386 reap_dead start 2023-11-24T08:00:33.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f001758a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00100b2a00 0x7f0010157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080072d0 con 0x7f6504053c80 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6508007430 con 0x7f6504053c80 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080047e0 con 0x7f6504053c80 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650404d730 con 0x7f6504053c80 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7efc0ec15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc0815fa90 0x7efc080cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7efc0ec15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc080b4460 0x7efc080d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7efc0ec15640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc080b48a0 0x7efc080d1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7efc0ec15640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc081613e0 con 0x7efc080b48a0 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7efc0ec15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc08161630 con 0x7efc080b4460 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7efc0ec15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc08161910 con 0x7efc0815fa90 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.470+0000 7efc0c9b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc0815fa90 0x7efc080cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.470+0000 7efc0c9b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc0815fa90 0x7efc080cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51418/0 (socket says 172.21.15.161:51418) 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.470+0000 7efc0c9b1640 1 -- 172.21.15.161:0/2758423198 learned_addr learned my addr 172.21.15.161:0/2758423198 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.470+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/2758423198 >> v2:172.21.15.161:3300/0 conn(0x7efc080b48a0 0x7efc080d1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.469+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650404dcf0 con 0x7f6504053c80 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f001758a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100ce8f0 0x7f00100cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f001758a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0010160f80 0x7f00100c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f001758a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c7090 con 0x7f00100ce8f0 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f001758a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c7370 con 0x7f00100b2a00 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f001758a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100c7650 con 0x7f0010160f80 2023-11-24T08:00:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.470+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae5801c460 con 0x7fae600e31c0 2023-11-24T08:00:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.468+0000 7f99ee366640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d40052a0 0x7f99d400b980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c340 tx=0x7f99d40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9388b2ba98fb7c49 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7efc07fff640 1 --2- 172.21.15.161:0/2758423198 >> v2:172.21.15.175:3300/0 conn(0x7efc080b4460 0x7efc080d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e002cbc0 con 0x7f99d40052a0 2023-11-24T08:00:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e002cd40 con 0x7f99d40052a0 2023-11-24T08:00:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f99ecb63640 1 -- 172.21.15.161:0/4007311386 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e0005b10 con 0x7f99d40052a0 2023-11-24T08:00:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f0015326640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00100b2a00 0x7f0010157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f0015b27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0010160f80 0x7f00100c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7efc0d1b2640 1 -- 172.21.15.161:0/2758423198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc0815fa90 msgr2=0x7efc080cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/2758423198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc0815fa90 0x7efc080cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7efc0d1b2640 1 -- 172.21.15.161:0/2758423198 >> v2:172.21.15.175:3300/0 conn(0x7efc080b4460 msgr2=0x7efc080d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/2758423198 >> v2:172.21.15.175:3300/0 conn(0x7efc080b4460 0x7efc080d15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7efc0d1b2640 1 -- 172.21.15.161:0/2758423198 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08161bf0 con 0x7efc080b48a0 2023-11-24T08:00:33.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f0015b27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0010160f80 0x7f00100c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51422/0 (socket says 172.21.15.161:51422) 2023-11-24T08:00:33.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.471+0000 7f0015b27640 1 -- 172.21.15.161:0/3804676846 learned_addr learned my addr 172.21.15.161:0/3804676846 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.472+0000 7f99efdc9640 1 -- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d40052a0 msgr2=0x7f99d400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.472+0000 7f99efdc9640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d40052a0 0x7f99d400b980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f99e000c340 tx=0x7f99d40057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.472+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/2758423198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc080d1af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc0808b640 tx=0x7efc0002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0a1a381a58475d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.472+0000 7f0014b25640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100ce8f0 0x7f00100cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f99efdc9640 1 -- 172.21.15.161:0/4007311386 shutdown_connections 2023-11-24T08:00:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f99efdc9640 1 --2- 172.21.15.161:0/4007311386 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d40052a0 0x7f99d400b980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f99efdc9640 1 -- 172.21.15.161:0/4007311386 >> 172.21.15.161:0/4007311386 conn(0x7f99e809c560 msgr2=0x7f99e80d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7efc077fe640 1 -- 172.21.15.161:0/2758423198 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0002cc90 con 0x7efc080b48a0 2023-11-24T08:00:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7efc077fe640 1 -- 172.21.15.161:0/2758423198 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0002cdf0 con 0x7efc080b48a0 2023-11-24T08:00:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7efc077fe640 1 -- 172.21.15.161:0/2758423198 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00034660 con 0x7efc080b48a0 2023-11-24T08:00:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6508004940 con 0x7f6504053c80 2023-11-24T08:00:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f0015326640 1 -- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0010160f80 msgr2=0x7f00100c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f0015326640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0010160f80 0x7f00100c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6504006610 con 0x7f6504053c80 2023-11-24T08:00:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7fae5dffb640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fae4c06ae40 0x7fae4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae58089ff0 con 0x7fae600e31c0 2023-11-24T08:00:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7fae5dffb640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fae4c072fe0 0x7fae4c075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 --> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae4c075ab0 con 0x7fae4c072fe0 2023-11-24T08:00:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae5808a400 con 0x7fae600e31c0 2023-11-24T08:00:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7fae6d5bf640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fae4c06ae40 0x7fae4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f0015326640 1 -- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100ce8f0 msgr2=0x7f00100cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f0015326640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100ce8f0 0x7f00100cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.473+0000 7f0015326640 1 -- 172.21.15.161:0/3804676846 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c009400 con 0x7f00100b2a00 2023-11-24T08:00:33.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7f0014b25640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f00100ce8f0 0x7f00100cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:33.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.474+0000 7fae6ddc0640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fae4c072fe0 0x7fae4c075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f99efdc9640 1 -- 172.21.15.161:0/4007311386 shutdown_connections 2023-11-24T08:00:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f0015326640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00100b2a00 0x7f0010157e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f000000b410 tx=0x7f000000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f99efdc9640 1 -- 172.21.15.161:0/4007311386 wait complete. 2023-11-24T08:00:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 -- 172.21.15.161:0/2758423198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 msgr2=0x7efc080d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 --2- 172.21.15.161:0/2758423198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc080d1af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efc0808b640 tx=0x7efc0002bee0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 -- 172.21.15.161:0/2758423198 shutdown_connections 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 --2- 172.21.15.161:0/2758423198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc080d1af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 --2- 172.21.15.161:0/2758423198 >> v2:172.21.15.175:3300/0 conn(0x7efc080b4460 0x7efc080d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 --2- 172.21.15.161:0/2758423198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc0815fa90 0x7efc080cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f65027fc640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f64f006aec0 0x7f64f006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 -- 172.21.15.161:0/2758423198 >> 172.21.15.161:0/2758423198 conn(0x7efc0809c540 msgr2=0x7efc080d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6508088d90 con 0x7f6504053c80 2023-11-24T08:00:33.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7efc0ec15640 1 -- 172.21.15.161:0/2758423198 shutdown_connections 2023-11-24T08:00:33.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000011830 con 0x7f00100b2a00 2023-11-24T08:00:33.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00100c7930 con 0x7f00100b2a00 2023-11-24T08:00:33.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0000011990 con 0x7f00100b2a00 2023-11-24T08:00:33.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0010158350 con 0x7f00100b2a00 2023-11-24T08:00:33.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.475+0000 7f65027fc640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f64f00730e0 0x7f64f0075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.476+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 --> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64f0075bb0 con 0x7f64f00730e0 2023-11-24T08:00:33.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.476+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f650808b370 con 0x7f6504053c80 2023-11-24T08:00:33.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.476+0000 7efc0ec15640 1 -- 172.21.15.161:0/2758423198 wait complete. 2023-11-24T08:00:33.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.476+0000 7fae6d5bf640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fae4c06ae40 0x7fae4c06d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fae64036000 tx=0x7fae64030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.476+0000 7fae6ddc0640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fae4c072fe0 0x7fae4c075400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.477+0000 7f6511b5a640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f64f006aec0 0x7f64f006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.476+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000011d40 con 0x7f00100b2a00 2023-11-24T08:00:33.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.477+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efff0000fc0 con 0x7f00100b2a00 2023-11-24T08:00:33.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.478+0000 7f651235b640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f64f00730e0 0x7f64f0075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.477+0000 7f99efdc9640 1 Processor -- start 2023-11-24T08:00:33.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.479+0000 7efc0ec15640 1 Processor -- start 2023-11-24T08:00:33.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.479+0000 7f651235b640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f64f00730e0 0x7f64f0075500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.480+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== osd.5 v2:172.21.15.175:6812/1039296029 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fae4c075ab0 con 0x7fae4c072fe0 2023-11-24T08:00:33.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.479+0000 7efc0ec15640 1 -- start start 2023-11-24T08:00:33.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.480+0000 7f6511b5a640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f64f006aec0 0x7f64f006d380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6504058920 tx=0x7f650c0aa000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.480+0000 7efc0ec15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc080b4460 0x7efc080a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc0ec15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc08153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc0ec15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0815fa90 0x7efc0809dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc0ec15640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080c77c0 con 0x7efc080b48a0 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc0ec15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc080cb610 con 0x7efc0815fa90 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc0c9b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc080b4460 0x7efc080a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc07fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc08153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 --> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6801f95d0 con 0x7fd660073130 2023-11-24T08:00:33.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc07fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc08153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56618/0 (socket says 172.21.15.161:56618) 2023-11-24T08:00:33.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc0c9b1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc080b4460 0x7efc080a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51436/0 (socket says 172.21.15.161:51436) 2023-11-24T08:00:33.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7efc07fff640 1 -- 172.21.15.161:0/1592170161 learned_addr learned my addr 172.21.15.161:0/1592170161 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.480+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f000001a400 con 0x7f00100b2a00 2023-11-24T08:00:33.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.479+0000 7f99efdc9640 1 -- start start 2023-11-24T08:00:33.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0815fa90 0x7efc0809dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.481+0000 7f0005ffb640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efff406ae40 0x7efff406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc08153aa0 con 0x7efc080b4460 2023-11-24T08:00:33.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99efdc9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40052a0 0x7f99e80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99efdc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99e80c7580 0x7f99e81f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99efdc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e80cbdb0 0x7f99e80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99efdc9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80cb920 con 0x7f99d40052a0 2023-11-24T08:00:33.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99efdc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80c7a00 con 0x7f99e80cbdb0 2023-11-24T08:00:33.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99efdc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80caff0 con 0x7f99e80c7580 2023-11-24T08:00:33.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0000089c20 con 0x7f00100b2a00 2023-11-24T08:00:33.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7fd6777fe640 1 -- 172.21.15.161:0/3198800557 <== osd.2 v2:172.21.15.161:6816/4193711640 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6801f95d0 con 0x7fd660073130 2023-11-24T08:00:33.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== osd.4 v2:172.21.15.175:6802/972684895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f64f0075bb0 con 0x7f64f00730e0 2023-11-24T08:00:33.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99edb65640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40052a0 0x7f99e80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.482+0000 7f99ee366640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e80cbdb0 0x7f99e80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f0014b25640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efff406ae40 0x7efff406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f0005ffb640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7efff4073060 0x7efff4075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f99edb65640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40052a0 0x7f99e80c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56622/0 (socket says 172.21.15.161:56622) 2023-11-24T08:00:33.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fd660073130 msgr2=0x7fd660075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fd660073130 0x7fd660075550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 --> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efff4075b30 con 0x7efff4073060 2023-11-24T08:00:33.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd66006af10 msgr2=0x7fd66006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd66006af10 0x7fd66006d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd678034000 tx=0x7fd678008030 comp rx=0 tx=0).stop 2023-11-24T08:00:33.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68014b0a0 msgr2=0x7fd680156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 --2- 172.21.15.161:0/3198800557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd68014b0a0 0x7fd680156bc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c780 tx=0x7fd66800cc40 comp rx=0 tx=0).stop 2023-11-24T08:00:33.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f000003c070 con 0x7f00100b2a00 2023-11-24T08:00:33.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd67f59e640 1 -- 172.21.15.161:0/3198800557 reap_dead start 2023-11-24T08:00:33.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f99edb65640 1 -- 172.21.15.161:0/1856864719 learned_addr learned my addr 172.21.15.161:0/1856864719 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f99ed364640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99e80c7580 0x7f99e81f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 --> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f04002cb0 con 0x7f9f100730e0 2023-11-24T08:00:33.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 shutdown_connections 2023-11-24T08:00:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 >> 172.21.15.161:0/3198800557 conn(0x7fd68006c340 msgr2=0x7fd680070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7f0015b27640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7efff4073060 0x7efff4075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f99edb65640 1 -- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99e80c7580 msgr2=0x7f99e81f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7f99edb65640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99e80c7580 0x7f99e81f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7f99edb65640 1 -- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e80cbdb0 msgr2=0x7f99e80cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7f99edb65640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99e80cbdb0 0x7f99e80cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7f99edb65640 1 -- 172.21.15.161:0/1856864719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80cb2d0 con 0x7f99d40052a0 2023-11-24T08:00:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7efc0c9b1640 1 -- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0815fa90 msgr2=0x7efc0809dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7efc0c9b1640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc0815fa90 0x7efc0809dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7efc0c9b1640 1 -- 172.21.15.161:0/1592170161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 msgr2=0x7efc08153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7efc0c9b1640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc08153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7efc0c9b1640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc00009a70 con 0x7efc080b4460 2023-11-24T08:00:33.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.483+0000 7efc07fff640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc080b48a0 0x7efc08153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:33.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7efc0c9b1640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc080b4460 0x7efc080a0ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00d5d0 tx=0x7efbfc00da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7f9f0b7fe640 1 -- 172.21.15.161:0/1168810515 <== osd.0 v2:172.21.15.161:6800/2118422527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f04002cb0 con 0x7f9f100730e0 2023-11-24T08:00:33.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f9f100730e0 msgr2=0x7f9f10075500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f29497640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f9f100730e0 0x7f9f10075500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f0015b27640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7efff4073060 0x7efff4075480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.484+0000 7f99edb65640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40052a0 0x7f99e80c6c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c7c0 tx=0x7f99d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0007820 con 0x7f99d40052a0 2023-11-24T08:00:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc014620 con 0x7efc080b4460 2023-11-24T08:00:33.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbfc014780 con 0x7efc080b4460 2023-11-24T08:00:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d0007980 con 0x7f99d40052a0 2023-11-24T08:00:33.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0007d30 con 0x7f99d40052a0 2023-11-24T08:00:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f1006aec0 msgr2=0x7f9f1006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f29497640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9f1006aec0 0x7f9f1006d380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f14006fd0 tx=0x7f9f14009060 comp rx=0 tx=0).stop 2023-11-24T08:00:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c0e12d0 msgr2=0x7f9f1c04cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f29497640 1 --2- 172.21.15.161:0/1168810515 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9f1c0e12d0 0x7f9f1c04cbe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9f240681d0 tx=0x7f9f240687a0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc014b10 con 0x7efc080b4460 2023-11-24T08:00:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.485+0000 7f9f237fe640 1 -- 172.21.15.161:0/1168810515 reap_dead start 2023-11-24T08:00:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 shutdown_connections 2023-11-24T08:00:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 >> 172.21.15.161:0/1168810515 conn(0x7f9f1c056c90 msgr2=0x7f9f1c03ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc080c9790 con 0x7efc080b4460 2023-11-24T08:00:33.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc080c9a30 con 0x7efc080b4460 2023-11-24T08:00:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 shutdown_connections 2023-11-24T08:00:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7f9f29497640 1 -- 172.21.15.161:0/1168810515 wait complete. 2023-11-24T08:00:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7f0014b25640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efff406ae40 0x7efff406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f000c036000 tx=0x7f000c03d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.486+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== osd.3 v2:172.21.15.161:6824/3270873402 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efff4075b30 con 0x7efff4073060 2023-11-24T08:00:33.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.487+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 shutdown_connections 2023-11-24T08:00:33.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.487+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e80cb5b0 con 0x7f99d40052a0 2023-11-24T08:00:33.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.487+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e81f7260 con 0x7f99d40052a0 2023-11-24T08:00:33.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.487+0000 7fd6757fa640 1 -- 172.21.15.161:0/3198800557 wait complete. 2023-11-24T08:00:33.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.488+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc081621b0 con 0x7efc080b4460 2023-11-24T08:00:33.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.488+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99e80a0fa0 con 0x7f99d40052a0 2023-11-24T08:00:33.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.490+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f99d00113f0 con 0x7f99d40052a0 2023-11-24T08:00:33.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.491+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efbfc014c70 con 0x7efc080b4460 2023-11-24T08:00:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.492+0000 7f99e67fc640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99c806ae70 0x7f99c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.492+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99d00895c0 con 0x7f99d40052a0 2023-11-24T08:00:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.492+0000 7f99e67fc640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7f99c8073010 0x7f99c8075430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.492+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 --> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99c8075ae0 con 0x7f99c8073010 2023-11-24T08:00:33.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.492+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99d0007e90 con 0x7f99d40052a0 2023-11-24T08:00:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.493+0000 7f99ed364640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99c806ae70 0x7f99c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.493+0000 7f99ee366640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7f99c8073010 0x7f99c8075430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.493+0000 7efc057fa640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efbec06af40 0x7efbec06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.493+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efbfc089ac0 con 0x7efc080b4460 2023-11-24T08:00:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.494+0000 7efc057fa640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7efbec0730e0 0x7efbec075500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.494+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efbec075bb0 con 0x7efbec0730e0 2023-11-24T08:00:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.494+0000 7efc07fff640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efbec06af40 0x7efbec06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.494+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbfc004660 con 0x7efc080b4460 2023-11-24T08:00:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.495+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7efbec0730e0 0x7efbec075500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.495+0000 7f99ee366640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7f99c8073010 0x7f99c8075430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.495+0000 7f99ed364640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99c806ae70 0x7f99c806d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99e81606f0 tx=0x7f99d8008a50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.495+0000 7efc07fff640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efbec06af40 0x7efbec06d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc080b9260 tx=0x7efbf4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.496+0000 7efc0d1b2640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7efbec0730e0 0x7efbec075500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.498+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== osd.6 v2:172.21.15.175:6809/1496030978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f99c8075ae0 con 0x7f99c8073010 2023-11-24T08:00:33.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.498+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== osd.7 v2:172.21.15.175:6806/296022395 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efbec075bb0 con 0x7efbec0730e0 2023-11-24T08:00:33.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.509+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 --> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6504006b30 con 0x7f64f00730e0 2023-11-24T08:00:33.543 INFO:teuthology.orchestra.run.smithi161.stdout:60129542150 2023-11-24T08:00:33.544 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:00:33.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.511+0000 7f65027fc640 1 -- 172.21.15.161:0/1257237986 <== osd.4 v2:172.21.15.175:6802/972684895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f64fc009560 con 0x7f64f00730e0 2023-11-24T08:00:33.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.511+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f64f00730e0 msgr2=0x7f64f0075500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.511+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 --> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f272c036340 con 0x7f2718073160 2023-11-24T08:00:33.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.511+0000 7f6512b5c640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f64f00730e0 0x7f64f0075500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.512+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f64f006aec0 msgr2=0x7f64f006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.512+0000 7f6512b5c640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f64f006aec0 0x7f64f006d380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6504058920 tx=0x7f650c0aa000 comp rx=0 tx=0).stop 2023-11-24T08:00:33.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.512+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6504053c80 msgr2=0x7f65040519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.512+0000 7f6512b5c640 1 --2- 172.21.15.161:0/1257237986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6504053c80 0x7f65040519e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f650800c7b0 tx=0x7f650800cc70 comp rx=0 tx=0).stop 2023-11-24T08:00:33.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.512+0000 7f27317fa640 1 -- 172.21.15.161:0/418147197 <== osd.1 v2:172.21.15.161:6808/555346844 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f272c036340 con 0x7f2718073160 2023-11-24T08:00:33.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f651235b640 1 -- 172.21.15.161:0/1257237986 reap_dead start 2023-11-24T08:00:33.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7f2718073160 msgr2=0x7f2718075580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 shutdown_connections 2023-11-24T08:00:33.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7f2718073160 0x7f2718075580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 >> 172.21.15.161:0/1257237986 conn(0x7f6504058eb0 msgr2=0x7f65040e6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 shutdown_connections 2023-11-24T08:00:33.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f6512b5c640 1 -- 172.21.15.161:0/1257237986 wait complete. 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f271806af40 msgr2=0x7f271806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f271806af40 0x7f271806d400 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2728034000 tx=0x7f2728031000 comp rx=0 tx=0).stop 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27240047c0 msgr2=0x7f272c0d9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 --2- 172.21.15.161:0/418147197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27240047c0 0x7f272c0d9430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f273402cf10 tx=0x7f273406b820 comp rx=0 tx=0).stop 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27391b2640 1 -- 172.21.15.161:0/418147197 reap_dead start 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 shutdown_connections 2023-11-24T08:00:33.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.513+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 >> 172.21.15.161:0/418147197 conn(0x7f272c009f80 msgr2=0x7f272c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.514+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 --> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae600e7b90 con 0x7fae4c072fe0 2023-11-24T08:00:33.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.515+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 shutdown_connections 2023-11-24T08:00:33.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.515+0000 7f27399b3640 1 -- 172.21.15.161:0/418147197 wait complete. 2023-11-24T08:00:33.551 INFO:teuthology.orchestra.run.smithi161.stdout:64424509444 2023-11-24T08:00:33.552 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:00:33.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.515+0000 7fae5dffb640 1 -- 172.21.15.161:0/1822005975 <== osd.5 v2:172.21.15.175:6812/1039296029 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae68067b60 con 0x7fae4c072fe0 2023-11-24T08:00:33.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fae4c072fe0 msgr2=0x7fae4c075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 --> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efff0002cb0 con 0x7efff4073060 2023-11-24T08:00:33.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fae4c072fe0 0x7fae4c075400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fae4c06ae40 msgr2=0x7fae4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fae4c06ae40 0x7fae4c06d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fae64036000 tx=0x7fae64030000 comp rx=0 tx=0).stop 2023-11-24T08:00:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 msgr2=0x7fae6000ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 --2- 172.21.15.161:0/1822005975 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae600e31c0 0x7fae6000ca60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fae5800c430 tx=0x7fae5800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6ddc0640 1 -- 172.21.15.161:0/1822005975 reap_dead start 2023-11-24T08:00:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 shutdown_connections 2023-11-24T08:00:33.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.516+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 >> 172.21.15.161:0/1822005975 conn(0x7fae6003aa30 msgr2=0x7fae6003cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.517+0000 7f0005ffb640 1 -- 172.21.15.161:0/3804676846 <== osd.3 v2:172.21.15.161:6824/3270873402 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efff0002cb0 con 0x7efff4073060 2023-11-24T08:00:33.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.517+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 shutdown_connections 2023-11-24T08:00:33.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.517+0000 7fae6f823640 1 -- 172.21.15.161:0/1822005975 wait complete. 2023-11-24T08:00:33.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.518+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7efff4073060 msgr2=0x7efff4075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.518+0000 7f001758a640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7efff4073060 0x7efff4075480 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.518+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efff406ae40 msgr2=0x7efff406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.518+0000 7f001758a640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efff406ae40 0x7efff406d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f000c036000 tx=0x7f000c03d040 comp rx=0 tx=0).stop 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.518+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00100b2a00 msgr2=0x7f0010157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.518+0000 7f001758a640 1 --2- 172.21.15.161:0/3804676846 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f00100b2a00 0x7f0010157e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f000000b410 tx=0x7f000000b8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.519+0000 7f0015b27640 1 -- 172.21.15.161:0/3804676846 reap_dead start 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.519+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 shutdown_connections 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.519+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 >> 172.21.15.161:0/3804676846 conn(0x7f001009c550 msgr2=0x7f00100d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.520+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 shutdown_connections 2023-11-24T08:00:33.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.520+0000 7f001758a640 1 -- 172.21.15.161:0/3804676846 wait complete. 2023-11-24T08:00:33.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.528+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 --> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99e80cf640 con 0x7f99c8073010 2023-11-24T08:00:33.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.530+0000 7f99e67fc640 1 -- 172.21.15.161:0/1856864719 <== osd.6 v2:172.21.15.175:6809/1496030978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99e003c040 con 0x7f99c8073010 2023-11-24T08:00:33.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.530+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 --> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efc080675d0 con 0x7efbec0730e0 2023-11-24T08:00:33.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7f99c8073010 msgr2=0x7f99c8075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7f99c8073010 0x7f99c8075430 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99c806ae70 msgr2=0x7f99c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99c806ae70 0x7f99c806d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99e81606f0 tx=0x7f99d8008a50 comp rx=0 tx=0).stop 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40052a0 msgr2=0x7f99e80c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 --2- 172.21.15.161:0/1856864719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d40052a0 0x7f99e80c6c10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c7c0 tx=0x7f99d000cc80 comp rx=0 tx=0).stop 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99ee366640 1 -- 172.21.15.161:0/1856864719 reap_dead start 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 shutdown_connections 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 >> 172.21.15.161:0/1856864719 conn(0x7f99e809c560 msgr2=0x7f99e81648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 shutdown_connections 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.531+0000 7f99efdc9640 1 -- 172.21.15.161:0/1856864719 wait complete. 2023-11-24T08:00:33.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc057fa640 1 -- 172.21.15.161:0/1592170161 <== osd.7 v2:172.21.15.175:6806/296022395 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efc080675d0 con 0x7efbec0730e0 2023-11-24T08:00:33.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7efbec0730e0 msgr2=0x7efbec075500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0ec15640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7efbec0730e0 0x7efbec075500 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efbec06af40 msgr2=0x7efbec06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0ec15640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efbec06af40 0x7efbec06d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efc080b9260 tx=0x7efbf4008040 comp rx=0 tx=0).stop 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc080b4460 msgr2=0x7efc080a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0ec15640 1 --2- 172.21.15.161:0/1592170161 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc080b4460 0x7efc080a0ce0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00d5d0 tx=0x7efbfc00da90 comp rx=0 tx=0).stop 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.532+0000 7efc0d1b2640 1 -- 172.21.15.161:0/1592170161 reap_dead start 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.533+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 shutdown_connections 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.533+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 >> 172.21.15.161:0/1592170161 conn(0x7efc0809c540 msgr2=0x7efc080b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.533+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 shutdown_connections 2023-11-24T08:00:33.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.533+0000 7efc0ec15640 1 -- 172.21.15.161:0/1592170161 wait complete. 2023-11-24T08:00:33.563 INFO:teuthology.orchestra.run.smithi161.stdout:60129542149 2023-11-24T08:00:33.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:00:33.565 INFO:teuthology.orchestra.run.smithi161.stdout:60129542151 2023-11-24T08:00:33.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:00:33.566 INFO:teuthology.orchestra.run.smithi161.stdout:64424509446 2023-11-24T08:00:33.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:00:33.567 INFO:teuthology.orchestra.run.smithi161.stdout:64424509444 2023-11-24T08:00:33.567 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:00:33.568 INFO:teuthology.orchestra.run.smithi161.stdout:64424509445 2023-11-24T08:00:33.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:00:33.569 INFO:teuthology.orchestra.run.smithi161.stdout:64424509446 2023-11-24T08:00:33.569 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:00:33.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.894+0000 7f09761a5640 1 Processor -- start 2023-11-24T08:00:33.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.895+0000 7f09761a5640 1 -- start start 2023-11-24T08:00:33.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.896+0000 7f09761a5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f096804fa50 0x7f096804fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.896+0000 7f09761a5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f09680df3e0 0x7f0968038280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.896+0000 7f09761a5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0968006860 con 0x7f09680387c0 2023-11-24T08:00:33.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.896+0000 7f09761a5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0968007730 con 0x7f096804fa50 2023-11-24T08:00:33.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.896+0000 7f09761a5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0968050370 con 0x7f09680df3e0 2023-11-24T08:00:33.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.897+0000 7f09751a3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f096804fa50 0x7f096804fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.897+0000 7f09751a3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f096804fa50 0x7f096804fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56626/0 (socket says 172.21.15.161:56626) 2023-11-24T08:00:33.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.897+0000 7f09751a3640 1 -- 172.21.15.161:0/571324197 learned_addr learned my addr 172.21.15.161:0/571324197 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.898+0000 7f09749a2640 1 --2- 172.21.15.161:0/571324197 >> v2:172.21.15.175:3300/0 conn(0x7f09680df3e0 0x7f0968038280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.899+0000 7f09751a3640 1 -- 172.21.15.161:0/571324197 >> v2:172.21.15.175:3300/0 conn(0x7f09680df3e0 msgr2=0x7f0968038280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.899+0000 7f09751a3640 1 --2- 172.21.15.161:0/571324197 >> v2:172.21.15.175:3300/0 conn(0x7f09680df3e0 0x7f0968038280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.899+0000 7f09751a3640 1 -- 172.21.15.161:0/571324197 >> v1:172.21.15.161:6789/0 conn(0x7f09680387c0 legacy=0x7f0968038c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.899+0000 7f09751a3640 1 -- 172.21.15.161:0/571324197 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968006ab0 con 0x7f096804fa50 2023-11-24T08:00:33.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.900+0000 7f09751a3640 1 --2- 172.21.15.161:0/571324197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f096804fa50 0x7f096804fe30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0968007a20 tx=0x7f096c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e599e74a1fdb770a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.901+0000 7f0967fff640 1 -- 172.21.15.161:0/571324197 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c007ce0 con 0x7f096804fa50 2023-11-24T08:00:33.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.901+0000 7f0967fff640 1 -- 172.21.15.161:0/571324197 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c007e40 con 0x7f096804fa50 2023-11-24T08:00:33.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.901+0000 7f0967fff640 1 -- 172.21.15.161:0/571324197 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0092f0 con 0x7f096804fa50 2023-11-24T08:00:33.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.902+0000 7f09761a5640 1 -- 172.21.15.161:0/571324197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f096804fa50 msgr2=0x7f096804fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.902+0000 7f09761a5640 1 --2- 172.21.15.161:0/571324197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f096804fa50 0x7f096804fe30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0968007a20 tx=0x7f096c02b9b0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.903+0000 7f09761a5640 1 -- 172.21.15.161:0/571324197 shutdown_connections 2023-11-24T08:00:33.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.903+0000 7f09761a5640 1 --2- 172.21.15.161:0/571324197 >> v2:172.21.15.175:3300/0 conn(0x7f09680df3e0 0x7f0968038280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.903+0000 7f09761a5640 1 --2- 172.21.15.161:0/571324197 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f096804fa50 0x7f096804fe30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.903+0000 7f09761a5640 1 -- 172.21.15.161:0/571324197 >> 172.21.15.161:0/571324197 conn(0x7f0968009f70 msgr2=0x7f096800a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.904+0000 7f09761a5640 1 -- 172.21.15.161:0/571324197 shutdown_connections 2023-11-24T08:00:33.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.904+0000 7f09761a5640 1 -- 172.21.15.161:0/571324197 wait complete. 2023-11-24T08:00:33.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.908+0000 7f09761a5640 1 Processor -- start 2023-11-24T08:00:33.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.908+0000 7f09761a5640 1 -- start start 2023-11-24T08:00:33.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.909+0000 7f548f3b3640 1 Processor -- start 2023-11-24T08:00:33.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.909+0000 7f548f3b3640 1 -- start start 2023-11-24T08:00:33.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.910+0000 7f09761a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09680387c0 0x7f09680cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.910+0000 7f09761a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096804fa50 0x7f09680ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.910+0000 7f09761a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 0x7f096804a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.910+0000 7f09761a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680caee0 con 0x7f09680df3e0 2023-11-24T08:00:33.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.910+0000 7f09761a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680e0990 con 0x7f096804fa50 2023-11-24T08:00:33.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.910+0000 7f09761a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096804b310 con 0x7f09680387c0 2023-11-24T08:00:33.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.911+0000 7f09759a4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 0x7f096804a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.911+0000 7f09759a4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 0x7f096804a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56636/0 (socket says 172.21.15.161:56636) 2023-11-24T08:00:33.913 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.911+0000 7f09759a4640 1 -- 172.21.15.161:0/373612821 learned_addr learned my addr 172.21.15.161:0/373612821 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f548f3b3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5480039290 0x7f54800e9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f09751a3640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09680387c0 0x7f09680cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f09749a2640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096804fa50 0x7f09680ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f548f3b3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5480006860 con 0x7f548004fa50 2023-11-24T08:00:33.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f548f3b3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5480006ab0 con 0x7f54800df3e0 2023-11-24T08:00:33.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f548f3b3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5480007730 con 0x7f5480039290 2023-11-24T08:00:33.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f548dbb0640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f54800df3e0 0x7f5480053220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:49786/0 (socket says 172.21.15.161:49786) 2023-11-24T08:00:33.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.912+0000 7f548dbb0640 1 -- 172.21.15.161:0/722815124 learned_addr learned my addr 172.21.15.161:0/722815124 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f09759a4640 1 -- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09680387c0 msgr2=0x7f09680cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f09759a4640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09680387c0 0x7f09680cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f09759a4640 1 -- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096804fa50 msgr2=0x7f09680ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f09759a4640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096804fa50 0x7f09680ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f09759a4640 1 -- 172.21.15.161:0/373612821 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c009df0 con 0x7f09680df3e0 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f09751a3640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09680387c0 0x7f09680cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:33.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.913+0000 7f548ebb2640 1 --2- 172.21.15.161:0/722815124 >> v2:172.21.15.161:3300/0 conn(0x7f5480039290 0x7f54800e9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.914+0000 7f548d3af640 1 -- 172.21.15.161:0/722815124 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241531794 0 0) 0x7f5480006ab0 con 0x7f54800df3e0 2023-11-24T08:00:33.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.914+0000 7f09759a4640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 0x7f096804a5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f096000c3c0 tx=0x7f096000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.914+0000 7f548d3af640 1 -- 172.21.15.161:0/722815124 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5474003520 con 0x7f54800df3e0 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.914+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600052d0 con 0x7f09680df3e0 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960005430 con 0x7f09680df3e0 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960003830 con 0x7f09680df3e0 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09680e0c50 con 0x7f09680df3e0 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096804aae0 con 0x7f09680df3e0 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f548ebb2640 1 -- 172.21.15.161:0/722815124 >> v1:172.21.15.175:6789/0 conn(0x7f54800df3e0 legacy=0x7f5480053220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f548ebb2640 1 -- 172.21.15.161:0/722815124 >> v1:172.21.15.161:6789/0 conn(0x7f548004fa50 legacy=0x7f548004fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.915+0000 7f548ebb2640 1 -- 172.21.15.161:0/722815124 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480006d90 con 0x7f5480039290 2023-11-24T08:00:33.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.916+0000 7f0ea0c31640 1 Processor -- start 2023-11-24T08:00:33.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.917+0000 7f0ea0c31640 1 -- start start 2023-11-24T08:00:33.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.916+0000 7f3ce90c2640 1 Processor -- start 2023-11-24T08:00:33.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.917+0000 7f3ce90c2640 1 -- start start 2023-11-24T08:00:33.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.918+0000 7f548ebb2640 1 --2- 172.21.15.161:0/722815124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800e9d00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54780090e0 tx=0x7f547802ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf9da44b0ee3b8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.918+0000 7f548d3af640 1 -- 172.21.15.161:0/722815124 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478031850 con 0x7f5480039290 2023-11-24T08:00:33.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f548d3af640 1 -- 172.21.15.161:0/722815124 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54780319b0 con 0x7f5480039290 2023-11-24T08:00:33.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0960003990 con 0x7f09680df3e0 2023-11-24T08:00:33.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f3ce90c2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3ce40d1540 0x7f3ce40cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f3ce90c2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3ce40c6d80 0x7f3ce40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f3ce90c2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce40cdd40 con 0x7f3ce40d1e60 2023-11-24T08:00:33.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f548d3af640 1 -- 172.21.15.161:0/722815124 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478031850 con 0x7f5480039290 2023-11-24T08:00:33.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f3ce90c2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce40ce000 con 0x7f3ce40d1540 2023-11-24T08:00:33.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f3ce90c2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce40d0ab0 con 0x7f3ce40c6d80 2023-11-24T08:00:33.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.920+0000 7f3ce359e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3ce40d1e60 0x7f3ce40d2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40020/0 (socket says 172.21.15.161:40020) 2023-11-24T08:00:33.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.920+0000 7f3ce359e640 1 -- 172.21.15.161:0/2481596015 learned_addr learned my addr 172.21.15.161:0/2481596015 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:33.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.920+0000 7f3ce2d9d640 1 --2- 172.21.15.161:0/2481596015 >> v2:172.21.15.161:3300/0 conn(0x7f3ce40d1540 0x7f3ce40cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.920+0000 7f0965ffb640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f095406ae90 0x7f095406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.920+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09600889e0 con 0x7f09680df3e0 2023-11-24T08:00:33.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f3ce259c640 1 --2- 172.21.15.161:0/2481596015 >> v2:172.21.15.175:3300/0 conn(0x7f3ce40c6d80 0x7f3ce40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0ea0c31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 0x7f0e9c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0ea0c31640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0e9c06e380 0x7f0e9c0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0ea0c31640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c15d840 con 0x7f0e9c0b1ee0 2023-11-24T08:00:33.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0ea0c31640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c071490 con 0x7f0e9c06e380 2023-11-24T08:00:33.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0ea0c31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0b3790 con 0x7f0e9c15d460 2023-11-24T08:00:33.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0e9a59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 0x7f0e9c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0e9a59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 0x7f0e9c0ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51452/0 (socket says 172.21.15.161:51452) 2023-11-24T08:00:33.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.919+0000 7f0e9a59c640 1 -- 172.21.15.161:0/426268236 learned_addr learned my addr 172.21.15.161:0/426268236 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f0e9a59c640 1 -- 172.21.15.161:0/426268236 >> v2:172.21.15.161:3300/0 conn(0x7f0e9c06e380 msgr2=0x7f0e9c0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f0e9a59c640 1 --2- 172.21.15.161:0/426268236 >> v2:172.21.15.161:3300/0 conn(0x7f0e9c06e380 0x7f0e9c0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f0e9a59c640 1 -- 172.21.15.161:0/426268236 >> v1:172.21.15.161:6789/0 conn(0x7f0e9c0b1ee0 legacy=0x7f0e9c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f0e9a59c640 1 -- 172.21.15.161:0/426268236 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c072190 con 0x7f0e9c15d460 2023-11-24T08:00:33.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f548f3b3640 1 -- 172.21.15.161:0/722815124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 msgr2=0x7f54800e9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f0da3761640 1 Processor -- start 2023-11-24T08:00:33.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f548f3b3640 1 --2- 172.21.15.161:0/722815124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800e9d00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f54780090e0 tx=0x7f547802ca10 comp rx=0 tx=0).stop 2023-11-24T08:00:33.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f09751a3640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f095406ae90 0x7f095406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0950005250 con 0x7f09680df3e0 2023-11-24T08:00:33.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f548f3b3640 1 -- 172.21.15.161:0/722815124 shutdown_connections 2023-11-24T08:00:33.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f548f3b3640 1 --2- 172.21.15.161:0/722815124 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800e9d00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f548f3b3640 1 -- 172.21.15.161:0/722815124 >> 172.21.15.161:0/722815124 conn(0x7f5480009f70 msgr2=0x7f548000a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.922+0000 7f548f3b3640 1 -- 172.21.15.161:0/722815124 shutdown_connections 2023-11-24T08:00:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f3ce2d9d640 1 -- 172.21.15.161:0/2481596015 >> v2:172.21.15.175:3300/0 conn(0x7f3ce40c6d80 msgr2=0x7f3ce40d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f3ce2d9d640 1 --2- 172.21.15.161:0/2481596015 >> v2:172.21.15.175:3300/0 conn(0x7f3ce40c6d80 0x7f3ce40d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f3ce2d9d640 1 -- 172.21.15.161:0/2481596015 >> v1:172.21.15.161:6789/0 conn(0x7f3ce40d1e60 legacy=0x7f3ce40d2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.921+0000 7f3ce2d9d640 1 -- 172.21.15.161:0/2481596015 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40cff40 con 0x7f3ce40d1540 2023-11-24T08:00:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f3ce2d9d640 1 --2- 172.21.15.161:0/2481596015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40d1540 0x7f3ce40cfa00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4165510 tx=0x7f3cdc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43ae26bfae62167 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.922+0000 7f0da3761640 1 -- start start 2023-11-24T08:00:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.922+0000 7f548f3b3640 1 -- 172.21.15.161:0/722815124 wait complete. 2023-11-24T08:00:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f09751a3640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f095406ae90 0x7f095406d350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f096c035000 tx=0x7f096c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f0da3761640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d9c0d1c40 0x7f0d9c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f0da3761640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c0b3400 con 0x7f0d9c0d17e0 2023-11-24T08:00:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f0da3761640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d9c0b27f0 con 0x7f0d9c15d610 2023-11-24T08:00:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f0da3761640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d9c0d1390 con 0x7f0d9c0d1c40 2023-11-24T08:00:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.924+0000 7f0e9a59c640 1 --2- 172.21.15.161:0/426268236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 0x7f0e9c0ac8d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000ffd0 tx=0x7f0e90034a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7f692705a6bb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0da1cfe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d9c0d1c40 0x7f0d9c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0da1cfe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d9c0d1c40 0x7f0d9c0b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:48840/0 (socket says 172.21.15.161:48840) 2023-11-24T08:00:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0da1cfe640 1 -- 172.21.15.161:0/2791455325 learned_addr learned my addr 172.21.15.161:0/2791455325 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f548f3b3640 1 Processor -- start 2023-11-24T08:00:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0e9959a640 1 -- 172.21.15.161:0/426268236 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90038860 con 0x7f0e9c15d460 2023-11-24T08:00:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0e9959a640 1 -- 172.21.15.161:0/426268236 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e900389c0 con 0x7f0e9c15d460 2023-11-24T08:00:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0e9959a640 1 -- 172.21.15.161:0/426268236 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90038d50 con 0x7f0e9c15d460 2023-11-24T08:00:33.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f548f3b3640 1 -- start start 2023-11-24T08:00:33.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.925+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186189089 0 0) 0x7f0d9c0b27f0 con 0x7f0d9c15d610 2023-11-24T08:00:33.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d88003520 con 0x7f0d9c15d610 2023-11-24T08:00:33.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 -- 172.21.15.161:0/426268236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 msgr2=0x7f0e9c0ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/426268236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 0x7f0e9c0ac8d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0e9000ffd0 tx=0x7f0e90034a40 comp rx=0 tx=0).stop 2023-11-24T08:00:33.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 -- 172.21.15.161:0/426268236 shutdown_connections 2023-11-24T08:00:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f27475e5640 1 Processor -- start 2023-11-24T08:00:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830567133 0 0) 0x7f0d88003520 con 0x7f0d9c15d610 2023-11-24T08:00:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 >> v2:172.21.15.175:3300/0 conn(0x7f0d9c0d1c40 msgr2=0x7f0d9c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 --2- 172.21.15.161:0/2791455325 >> v2:172.21.15.175:3300/0 conn(0x7f0d9c0d1c40 0x7f0d9c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 >> v1:172.21.15.161:6789/0 conn(0x7f0d9c0d17e0 legacy=0x7f0d9c0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c0b2ad0 con 0x7f0d9c15d610 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f27475e5640 1 -- start start 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0d8c001670 con 0x7f0d9c15d610 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 >> v1:172.21.15.175:6789/0 conn(0x7f0d9c15d610 legacy=0x7f0d9c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d880039c0 0x7f0d88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d880047c0 0x7f0d88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c0d1390 con 0x7f0d88005180 2023-11-24T08:00:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8800c080 con 0x7f0d880039c0 2023-11-24T08:00:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8800c240 con 0x7f0d880047c0 2023-11-24T08:00:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/426268236 >> v2:172.21.15.161:3300/0 conn(0x7f0e9c06e380 0x7f0e9c0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/426268236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c15d460 0x7f0e9c0ac8d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 -- 172.21.15.161:0/426268236 >> 172.21.15.161:0/426268236 conn(0x7f0e9c0b0be0 msgr2=0x7f0e9c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 -- 172.21.15.161:0/426268236 shutdown_connections 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.926+0000 7f0ea0c31640 1 -- 172.21.15.161:0/426268236 wait complete. 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f548f3b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f548f3b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 0x7f548004bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f548f3b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54800df3e0 0x7f5480180480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f548f3b3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54800c44e0 con 0x7f5480039290 2023-11-24T08:00:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f548f3b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54800d7e80 con 0x7f54800df3e0 2023-11-24T08:00:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f548f3b3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54800dc970 con 0x7f548004fa50 2023-11-24T08:00:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.927+0000 7f0da1cfe640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f548dbb0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 0x7f548004bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f548ebb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54800df3e0 0x7f5480180480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f548e3b1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f548dbb0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 0x7f548004bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51468/0 (socket says 172.21.15.161:51468) 2023-11-24T08:00:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f548dbb0640 1 -- 172.21.15.161:0/2317109923 learned_addr learned my addr 172.21.15.161:0/2317109923 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f0da1cfe640 1 -- 172.21.15.161:0/2791455325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d880047c0 msgr2=0x7f0d88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f0da1cfe640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d880047c0 0x7f0d88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f0da1cfe640 1 -- 172.21.15.161:0/2791455325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d880039c0 msgr2=0x7f0d88003de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:00:33.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f0da1cfe640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d880039c0 0x7f0d88003de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f0da1cfe640 1 -- 172.21.15.161:0/2791455325 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d88003520 con 0x7f0d88005180 2023-11-24T08:00:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f27475e5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f274015d740 0x7f27400cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.928+0000 7f27475e5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f27400cff40 0x7f27400cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f27475e5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27400b0500 con 0x7f274015db20 2023-11-24T08:00:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f27475e5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400d03b0 con 0x7f274015d740 2023-11-24T08:00:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f27475e5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27400d1e90 con 0x7f27400cff40 2023-11-24T08:00:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f548e3b1640 1 -- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 msgr2=0x7f548004bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f2745381640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f274015d740 0x7f27400cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f2745381640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f274015d740 0x7f27400cfa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56676/0 (socket says 172.21.15.161:56676) 2023-11-24T08:00:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f2745381640 1 -- 172.21.15.161:0/2723267259 learned_addr learned my addr 172.21.15.161:0/2723267259 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f2745b82640 1 --2- 172.21.15.161:0/2723267259 >> v2:172.21.15.175:3300/0 conn(0x7f27400cff40 0x7f27400cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f3ce1d9b640 1 -- 172.21.15.161:0/2481596015 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc02cc90 con 0x7f3ce40d1540 2023-11-24T08:00:33.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f3ce1d9b640 1 -- 172.21.15.161:0/2481596015 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc02cdf0 con 0x7f3ce40d1540 2023-11-24T08:00:33.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f0ea0c31640 1 Processor -- start 2023-11-24T08:00:33.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f3ce1d9b640 1 -- 172.21.15.161:0/2481596015 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc034660 con 0x7f3ce40d1540 2023-11-24T08:00:33.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f2745381640 1 -- 172.21.15.161:0/2723267259 >> v2:172.21.15.175:3300/0 conn(0x7f27400cff40 msgr2=0x7f27400cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f2745381640 1 --2- 172.21.15.161:0/2723267259 >> v2:172.21.15.175:3300/0 conn(0x7f27400cff40 0x7f27400cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f2745381640 1 -- 172.21.15.161:0/2723267259 >> v1:172.21.15.175:6789/0 conn(0x7f274015db20 legacy=0x7f27400b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f2745381640 1 -- 172.21.15.161:0/2723267259 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400d2130 con 0x7f274015d740 2023-11-24T08:00:33.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f0ea0c31640 1 -- start start 2023-11-24T08:00:33.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f548e3b1640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 0x7f548004bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f548e3b1640 1 -- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54800df3e0 msgr2=0x7f5480180480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f548e3b1640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54800df3e0 0x7f5480180480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.929+0000 7f548e3b1640 1 -- 172.21.15.161:0/2317109923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009c90 con 0x7f5480039290 2023-11-24T08:00:33.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f548dbb0640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 0x7f548004bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:33.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f0da1cfe640 1 -- 172.21.15.161:0/2791455325 reap_dead start 2023-11-24T08:00:33.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f0da1cfe640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d8800b980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009c10 tx=0x7f0d880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc394068b485279d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94004020 con 0x7f0d88005180 2023-11-24T08:00:33.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.930+0000 7f0d93fff640 1 -- 172.21.15.161:0/2791455325 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94004180 con 0x7f0d88005180 2023-11-24T08:00:33.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.931+0000 7f548e3b1640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800c3fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5488067b00 tx=0x7f54880748f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.931+0000 7f0da3761640 1 -- 172.21.15.161:0/2791455325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 msgr2=0x7f0d8800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.931+0000 7f0da3761640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d8800b980 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009c10 tx=0x7f0d880057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.931+0000 7f0da3761640 1 -- 172.21.15.161:0/2791455325 shutdown_connections 2023-11-24T08:00:33.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.931+0000 7f0da3761640 1 --2- 172.21.15.161:0/2791455325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d8800b980 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0960053b20 con 0x7f09680df3e0 2023-11-24T08:00:33.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.931+0000 7f0da3761640 1 -- 172.21.15.161:0/2791455325 >> 172.21.15.161:0/2791455325 conn(0x7f0d9c09c540 msgr2=0x7f0d9c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f2745381640 1 --2- 172.21.15.161:0/2723267259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015d740 0x7f27400cfa00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27400cd7e0 tx=0x7f273c02b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b85423d857cdf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f0ea0c31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 0x7f0e9c152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548808e070 con 0x7f5480039290 2023-11-24T08:00:33.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f0ea0c31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c0b1ee0 0x7f0e9c13d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f2737fff640 1 -- 172.21.15.161:0/2723267259 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c030890 con 0x7f274015d740 2023-11-24T08:00:33.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488074a20 con 0x7f5480039290 2023-11-24T08:00:33.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548808e070 con 0x7f5480039290 2023-11-24T08:00:33.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2481596015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40d1540 msgr2=0x7f3ce40cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f2737fff640 1 -- 172.21.15.161:0/2723267259 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273c0309f0 con 0x7f274015d740 2023-11-24T08:00:33.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f2737fff640 1 -- 172.21.15.161:0/2723267259 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273c030d80 con 0x7f274015d740 2023-11-24T08:00:33.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2481596015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40d1540 0x7f3ce40cfa00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4165510 tx=0x7f3cdc02bee0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.932+0000 7f0ea0c31640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 0x7f0e9c13d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0e9a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 0x7f0e9c152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54800dcc50 con 0x7f5480039290 2023-11-24T08:00:33.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2481596015 shutdown_connections 2023-11-24T08:00:33.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2481596015 >> v2:172.21.15.175:3300/0 conn(0x7f3ce40c6d80 0x7f3ce40d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2481596015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40d1540 0x7f3ce40cfa00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2481596015 >> 172.21.15.161:0/2481596015 conn(0x7f3ce408cc50 msgr2=0x7f3ce409c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54800dd210 con 0x7f5480039290 2023-11-24T08:00:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0e9a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 0x7f0e9c152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:48888/0 (socket says 172.21.15.161:48888) 2023-11-24T08:00:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0e9ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 0x7f0e9c13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0e9ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 0x7f0e9c13d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56684/0 (socket says 172.21.15.161:56684) 2023-11-24T08:00:33.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f27475e5640 1 -- 172.21.15.161:0/2723267259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015d740 msgr2=0x7f27400cfa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f27475e5640 1 --2- 172.21.15.161:0/2723267259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015d740 0x7f27400cfa00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27400cd7e0 tx=0x7f273c02b9d0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0e9a59c640 1 -- 172.21.15.161:0/2680564768 learned_addr learned my addr 172.21.15.161:0/2680564768 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2481596015 shutdown_connections 2023-11-24T08:00:33.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0da3761640 1 -- 172.21.15.161:0/2791455325 shutdown_connections 2023-11-24T08:00:33.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0e99d9b640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c0b1ee0 0x7f0e9c13d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f0da3761640 1 -- 172.21.15.161:0/2791455325 wait complete. 2023-11-24T08:00:33.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f27475e5640 1 -- 172.21.15.161:0/2723267259 shutdown_connections 2023-11-24T08:00:33.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f27475e5640 1 --2- 172.21.15.161:0/2723267259 >> v2:172.21.15.175:3300/0 conn(0x7f27400cff40 0x7f27400cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f27475e5640 1 --2- 172.21.15.161:0/2723267259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015d740 0x7f27400cfa00 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f27400cd7e0 tx=0x7f273c02b9d0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.933+0000 7f27475e5640 1 -- 172.21.15.161:0/2723267259 >> 172.21.15.161:0/2723267259 conn(0x7f274009c550 msgr2=0x7f27400d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:33.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.934+0000 7f27475e5640 1 -- 172.21.15.161:0/2723267259 shutdown_connections 2023-11-24T08:00:33.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.934+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2481596015 wait complete. 2023-11-24T08:00:33.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.934+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548004f8c0 con 0x7f5480039290 2023-11-24T08:00:33.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.934+0000 7f27475e5640 1 -- 172.21.15.161:0/2723267259 wait complete. 2023-11-24T08:00:33.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7fe7a359e640 1 Processor -- start 2023-11-24T08:00:33.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7fe7a359e640 1 -- start start 2023-11-24T08:00:33.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f27475e5640 1 Processor -- start 2023-11-24T08:00:33.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c13de40 con 0x7f0e9c15d460 2023-11-24T08:00:33.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cb9f0 con 0x7f0e9c06e380 2023-11-24T08:00:33.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0cbcd0 con 0x7f0e9c0b1ee0 2023-11-24T08:00:33.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f3ce90c2640 1 Processor -- start 2023-11-24T08:00:33.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7ff00c60e640 1 Processor -- start 2023-11-24T08:00:33.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7f3ce90c2640 1 -- start start 2023-11-24T08:00:33.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7ff00c60e640 1 -- start start 2023-11-24T08:00:33.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7fe7a359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4160920 0x7fe7a40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7fe7a359e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7a40cf9f0 0x7fe7a40cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9a59c640 1 -- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c0b1ee0 msgr2=0x7f0e9c13d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9a59c640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c0b1ee0 0x7f0e9c13d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7fe7a359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7a4161010 0x7fe7a41614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7fe7a359e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40d03b0 con 0x7fe7a4161010 2023-11-24T08:00:33.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f27475e5640 1 -- start start 2023-11-24T08:00:33.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f27475e5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27400cff40 0x7f274014e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f27475e5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 0x7f27400b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f27475e5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27400b2d00 0x7f27400cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f27475e5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400b3540 con 0x7f274015db20 2023-11-24T08:00:33.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f27475e5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27401f31f0 con 0x7f27400b2d00 2023-11-24T08:00:33.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f27475e5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274009d7b0 con 0x7f27400cff40 2023-11-24T08:00:33.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9a59c640 1 -- 172.21.15.161:0/2680564768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 msgr2=0x7f0e9c13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9a59c640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 0x7f0e9c13d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9a59c640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9000fd00 con 0x7f0e9c06e380 2023-11-24T08:00:33.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f548806bbb0 con 0x7f5480039290 2023-11-24T08:00:33.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9ad9d640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 0x7f0e9c13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:33.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7fe7a359e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40d0a10 con 0x7fe7a40cf9f0 2023-11-24T08:00:33.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.937+0000 7fe7a359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40cf080 con 0x7fe7a4160920 2023-11-24T08:00:33.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7fe7a2d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7a4161010 0x7fe7a41614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7fe7a1d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7a40cf9f0 0x7fe7a40cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7fe7a2d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe7a4161010 0x7fe7a41614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56694/0 (socket says 172.21.15.161:56694) 2023-11-24T08:00:33.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7fe7a2d9d640 1 -- 172.21.15.161:0/3519251331 learned_addr learned my addr 172.21.15.161:0/3519251331 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f547effd640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f546c06ae90 0x7f546c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5488102bb0 con 0x7f5480039290 2023-11-24T08:00:33.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f2744b80640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 0x7f27400b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.938+0000 7f0e9a59c640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 0x7f0e9c152dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0e90014500 tx=0x7f0e900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f2744b80640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 0x7f27400b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56704/0 (socket says 172.21.15.161:56704) 2023-11-24T08:00:33.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f2744b80640 1 -- 172.21.15.161:0/3681084654 learned_addr learned my addr 172.21.15.161:0/3681084654 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7fe7a259c640 1 --2- 172.21.15.161:0/3519251331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4160920 0x7fe7a40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.936+0000 7f0da3761640 1 Processor -- start 2023-11-24T08:00:33.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7fe7a2d9d640 1 -- 172.21.15.161:0/3519251331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4160920 msgr2=0x7fe7a40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f2745381640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27400cff40 0x7f274014e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7fe7a2d9d640 1 --2- 172.21.15.161:0/3519251331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4160920 0x7fe7a40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f0da3761640 1 -- start start 2023-11-24T08:00:33.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7fe7a2d9d640 1 -- 172.21.15.161:0/3519251331 >> v2:172.21.15.175:3300/0 conn(0x7fe7a40cf9f0 msgr2=0x7fe7a40cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7fe7a2d9d640 1 --2- 172.21.15.161:0/3519251331 >> v2:172.21.15.175:3300/0 conn(0x7fe7a40cf9f0 0x7fe7a40cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7fe7a2d9d640 1 -- 172.21.15.161:0/3519251331 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a40c6be0 con 0x7fe7a4161010 2023-11-24T08:00:33.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7ff00c60e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0040cf9a0 0x7ff004070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7ff00c60e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff004070ea0 0x7ff0040cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7ff00c60e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff004071690 con 0x7ff00414b2c0 2023-11-24T08:00:33.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7ff00c60e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00414b6a0 con 0x7ff0040cf9a0 2023-11-24T08:00:33.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7ff00c60e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff004071970 con 0x7ff004070ea0 2023-11-24T08:00:33.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90040c90 con 0x7f0e9c06e380 2023-11-24T08:00:33.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f2744b80640 1 -- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27400cff40 msgr2=0x7f274014e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f2744b80640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27400cff40 0x7f274014e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f2744b80640 1 -- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27400b2d00 msgr2=0x7f27400cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f2744b80640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27400b2d00 0x7f27400cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f2744b80640 1 -- 172.21.15.161:0/3681084654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0094d0 con 0x7f274015db20 2023-11-24T08:00:33.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90046040 con 0x7f0e9c06e380 2023-11-24T08:00:33.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9004a3f0 con 0x7f0e9c06e380 2023-11-24T08:00:33.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7ff00abab640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff004070ea0 0x7ff0040cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c0cbfb0 con 0x7f0e9c06e380 2023-11-24T08:00:33.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c0cc570 con 0x7f0e9c06e380 2023-11-24T08:00:33.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7ff009ba9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0040cf9a0 0x7ff004070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7ff009ba9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0040cf9a0 0x7ff004070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56708/0 (socket says 172.21.15.161:56708) 2023-11-24T08:00:33.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7ff009ba9640 1 -- 172.21.15.161:0/3036967615 learned_addr learned my addr 172.21.15.161:0/3036967615 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f2744b80640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 0x7f27400b27c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f273000c400 tx=0x7f273000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f3ce90c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce40c6d80 0x7f3ce4156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.939+0000 7f3ce90c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 0x7f3ce40cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f3ce90c2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40cbc50 0x7f3ce4163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f3ce259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 0x7f3ce40cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7ff009ba9640 1 -- 172.21.15.161:0/3036967615 >> v2:172.21.15.175:3300/0 conn(0x7ff004070ea0 msgr2=0x7ff0040cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7ff009ba9640 1 --2- 172.21.15.161:0/3036967615 >> v2:172.21.15.175:3300/0 conn(0x7ff004070ea0 0x7ff0040cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7ff009ba9640 1 -- 172.21.15.161:0/3036967615 >> v1:172.21.15.161:6789/0 conn(0x7ff00414b2c0 legacy=0x7ff0040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:33.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7ff009ba9640 1 -- 172.21.15.161:0/3036967615 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004071c50 con 0x7ff0040cf9a0 2023-11-24T08:00:33.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f3ce259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 0x7f3ce40cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51512/0 (socket says 172.21.15.161:51512) 2023-11-24T08:00:33.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f3ce259c640 1 -- 172.21.15.161:0/2443633842 learned_addr learned my addr 172.21.15.161:0/2443633842 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:33.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.940+0000 7f3ce90c2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40cb280 con 0x7f3ce40cbc50 2023-11-24T08:00:33.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40ca670 con 0x7f3ce40c6d80 2023-11-24T08:00:33.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40ca950 con 0x7f3ce40d1540 2023-11-24T08:00:33.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f3ce2d9d640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce40c6d80 0x7f3ce4156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.941+0000 7f3ce359e640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40cbc50 0x7f3ce4163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7f548dbb0640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f546c06ae90 0x7f546c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:33.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7f3ce259c640 1 -- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce40c6d80 msgr2=0x7f3ce4156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7f3ce259c640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce40c6d80 0x7f3ce4156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7f3ce259c640 1 -- 172.21.15.161:0/2443633842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40cbc50 msgr2=0x7f3ce4163760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:33.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7f3ce259c640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40cbc50 0x7f3ce4163760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:33.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7f3ce259c640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc009a70 con 0x7f3ce40d1540 2023-11-24T08:00:33.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.942+0000 7fe7a2d9d640 1 --2- 172.21.15.161:0/3519251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a4161010 0x7fe7a41614a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7a408d300 tx=0x7fe79c02bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f60e40b06f3b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c0710c0 con 0x7f0e9c06e380 2023-11-24T08:00:33.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da3761640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d9c15f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:33.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7fe7a159a640 1 -- 172.21.15.161:0/3519251331 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c02caa0 con 0x7fe7a4161010 2023-11-24T08:00:33.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27300052d0 con 0x7f274015db20 2023-11-24T08:00:33.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f548dbb0640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f546c06ae90 0x7f546c06d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5484001220 tx=0x7f54840011b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2730005430 con 0x7f274015db20 2023-11-24T08:00:33.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2730003830 con 0x7f274015db20 2023-11-24T08:00:33.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f3ce259c640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 0x7f3ce40cb710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400e980 tx=0x7f3cd400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:33.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54880cdd00 con 0x7f5480039290 2023-11-24T08:00:33.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7fe7a159a640 1 -- 172.21.15.161:0/3519251331 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c02cc00 con 0x7fe7a4161010 2023-11-24T08:00:33.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7fe7a159a640 1 -- 172.21.15.161:0/3519251331 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79c0343f0 con 0x7fe7a4161010 2023-11-24T08:00:34.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27400b3260 con 0x7f274015db20 2023-11-24T08:00:34.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274009d440 con 0x7f274015db20 2023-11-24T08:00:34.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4009670 con 0x7f3ce40d1540 2023-11-24T08:00:34.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce40cac30 con 0x7f3ce40d1540 2023-11-24T08:00:34.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce40ca300 con 0x7f3ce40d1540 2023-11-24T08:00:34.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400ca00 con 0x7f3ce40d1540 2023-11-24T08:00:34.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4009670 con 0x7f3ce40d1540 2023-11-24T08:00:34.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da3761640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d9c15db70 0x7f0d9c15f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da3761640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d9c1f5ca0 0x7f0d9c1f6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da3761640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c15ec40 con 0x7f0d88005180 2023-11-24T08:00:34.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da3761640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c15e030 con 0x7f0d9c1f5ca0 2023-11-24T08:00:34.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da3761640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9c15e310 con 0x7f0d9c15db70 2023-11-24T08:00:34.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da14fd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d9c15f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.943+0000 7f0da14fd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d9c15f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56716/0 (socket says 172.21.15.161:56716) 2023-11-24T08:00:34.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f0da1cfe640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d9c1f5ca0 0x7f0d9c1f6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7f0da14fd640 1 -- 172.21.15.161:0/4188514251 learned_addr learned my addr 172.21.15.161:0/4188514251 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:34.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f0da14fd640 1 -- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d9c15db70 msgr2=0x7f0d9c15f7a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:00:34.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f0da14fd640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d9c15db70 0x7f0d9c15f7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f0da14fd640 1 -- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d9c1f5ca0 msgr2=0x7f0d9c1f6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f0da14fd640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d9c1f5ca0 0x7f0d9c1f6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f0da14fd640 1 -- 172.21.15.161:0/4188514251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c15e5f0 con 0x7f0d88005180 2023-11-24T08:00:34.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e9004a570 con 0x7f0e9c06e380 2023-11-24T08:00:34.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7ff009ba9640 1 --2- 172.21.15.161:0/3036967615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0040cf9a0 0x7ff004070960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff004165330 tx=0x7feff402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de635ca1213a35d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7ff0093a8640 1 -- 172.21.15.161:0/3036967615 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4031870 con 0x7ff0040cf9a0 2023-11-24T08:00:34.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 -- 172.21.15.161:0/3519251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a4161010 msgr2=0x7fe7a41614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 --2- 172.21.15.161:0/3519251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a4161010 0x7fe7a41614a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe7a408d300 tx=0x7fe79c02bf00 comp rx=0 tx=0).stop 2023-11-24T08:00:34.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 -- 172.21.15.161:0/3519251331 shutdown_connections 2023-11-24T08:00:34.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 --2- 172.21.15.161:0/3519251331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a4161010 0x7fe7a41614a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 --2- 172.21.15.161:0/3519251331 >> v2:172.21.15.175:3300/0 conn(0x7fe7a40cf9f0 0x7fe7a40cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 --2- 172.21.15.161:0/3519251331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4160920 0x7fe7a40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.944+0000 7fe7a359e640 1 -- 172.21.15.161:0/3519251331 >> 172.21.15.161:0/3519251331 conn(0x7fe7a40d3090 msgr2=0x7fe7a40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7fe7a359e640 1 -- 172.21.15.161:0/3519251331 shutdown_connections 2023-11-24T08:00:34.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.945+0000 7fe7a359e640 1 -- 172.21.15.161:0/3519251331 wait complete. 2023-11-24T08:00:34.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.946+0000 7f0da14fd640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d9c15f260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c730 tx=0x7f0d8c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.947+0000 7f0e8affd640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0e7c06af10 0x7f0e7c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.947+0000 7ff0093a8640 1 -- 172.21.15.161:0/3036967615 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff40319d0 con 0x7ff0040cf9a0 2023-11-24T08:00:34.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.947+0000 7ff0093a8640 1 -- 172.21.15.161:0/3036967615 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4031d60 con 0x7ff0040cf9a0 2023-11-24T08:00:34.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.947+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e900b5cc0 con 0x7f0e9c06e380 2023-11-24T08:00:34.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.947+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27400675d0 con 0x7f274015db20 2023-11-24T08:00:34.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7fe7a359e640 1 Processor -- start 2023-11-24T08:00:34.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0052f0 con 0x7f0d88005180 2023-11-24T08:00:34.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c005490 con 0x7f0d88005180 2023-11-24T08:00:34.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7ff00c60e640 1 -- 172.21.15.161:0/3036967615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0040cf9a0 msgr2=0x7ff004070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7ff00c60e640 1 --2- 172.21.15.161:0/3036967615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0040cf9a0 0x7ff004070960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff004165330 tx=0x7feff402b910 comp rx=0 tx=0).stop 2023-11-24T08:00:34.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c00a860 con 0x7f0d88005180 2023-11-24T08:00:34.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7f0e99d9b640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0e7c06af10 0x7f0e7c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.947+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc4005250 con 0x7f3ce40d1540 2023-11-24T08:00:34.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3cd400cb70 con 0x7f3ce40d1540 2023-11-24T08:00:34.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7f3ccb7fe640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3cd006aea0 0x7f3cd006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cd40893c0 con 0x7f3ce40d1540 2023-11-24T08:00:34.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9c15e8d0 con 0x7f0d88005180 2023-11-24T08:00:34.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2730003990 con 0x7f274015db20 2023-11-24T08:00:34.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7ff00c60e640 1 -- 172.21.15.161:0/3036967615 shutdown_connections 2023-11-24T08:00:34.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7ff00c60e640 1 --2- 172.21.15.161:0/3036967615 >> v2:172.21.15.175:3300/0 conn(0x7ff004070ea0 0x7ff0040cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7ff00c60e640 1 --2- 172.21.15.161:0/3036967615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0040cf9a0 0x7ff004070960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7ff00c60e640 1 -- 172.21.15.161:0/3036967615 >> 172.21.15.161:0/3036967615 conn(0x7ff00406a800 msgr2=0x7ff00406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7ff00c60e640 1 -- 172.21.15.161:0/3036967615 shutdown_connections 2023-11-24T08:00:34.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.951+0000 7ff00c60e640 1 -- 172.21.15.161:0/3036967615 wait complete. 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.948+0000 7fe7a359e640 1 -- start start 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7fe7a359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a40cf9f0 0x7fe7a40cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 0x7fe7a41f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4161010 0x7fe7a40cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a4157d00 con 0x7fe7a40cf9f0 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 0x7fe7a41f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a359e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40cb370 con 0x7fe7a4160920 2023-11-24T08:00:34.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40cb650 con 0x7fe7a4161010 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7fe7a1d9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 0x7fe7a41f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:48944/0 (socket says 172.21.15.161:48944) 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.951+0000 7fe7a2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4161010 0x7fe7a40cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.951+0000 7fe7a1d9b640 1 -- 172.21.15.161:0/2817332326 learned_addr learned my addr 172.21.15.161:0/2817332326 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.951+0000 7fe7a1d9b640 1 -- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4161010 msgr2=0x7fe7a40cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.951+0000 7fe7a1d9b640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4161010 0x7fe7a40cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.951+0000 7fe7a1d9b640 1 -- 172.21.15.161:0/2817332326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a40cf9f0 msgr2=0x7fe7a40cccb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.949+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9c155c90 con 0x7f0d88005180 2023-11-24T08:00:34.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.950+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d9c15edf0 con 0x7f0d88005180 2023-11-24T08:00:34.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.952+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d8c00a9c0 con 0x7f0d88005180 2023-11-24T08:00:34.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.952+0000 7f0e99d9b640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0e7c06af10 0x7f0e7c06d3d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c157cd0 tx=0x7f0e8c009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.952+0000 7f2735ffb640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f272406ae70 0x7f272406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.952+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2730088bf0 con 0x7f274015db20 2023-11-24T08:00:34.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.953+0000 7fe7a259c640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a40cf9f0 0x7fe7a40cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.953+0000 7f3ce2d9d640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3cd006aea0 0x7f3cd006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.953+0000 7ff00c60e640 1 Processor -- start 2023-11-24T08:00:34.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.953+0000 7fe7a1d9b640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a40cf9f0 0x7fe7a40cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.953+0000 7fe7a1d9b640 1 -- 172.21.15.161:0/2817332326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c009b30 con 0x7fe7a4160920 2023-11-24T08:00:34.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.953+0000 7fe7a259c640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a40cf9f0 0x7fe7a40cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:34.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.954+0000 7ff00c60e640 1 -- start start 2023-11-24T08:00:34.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.954+0000 7f0d91ffb640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0d8006ae90 0x7f0d8006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.954+0000 7f2745381640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f272406ae70 0x7f272406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.954+0000 7fe7a1d9b640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 0x7fe7a41f6d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe79800e870 tx=0x7fe79800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.955+0000 7f0da0cfc640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0d8006ae90 0x7f0d8006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.955+0000 7f2745381640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f272406ae70 0x7f272406d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f273c036000 tx=0x7f273c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.955+0000 7f3ce2d9d640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3cd006aea0 0x7f3cd006d360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc036000 tx=0x7f3cdc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.955+0000 7ff00c60e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 0x7ff0041453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7f0da0cfc640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0d8006ae90 0x7f0d8006d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c155520 tx=0x7f0d98007d50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00c60e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040cf9a0 0x7ff004161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00c60e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff00414b2c0 0x7ff0041623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00c60e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041649d0 con 0x7ff004070ea0 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00c60e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041409d0 con 0x7ff0040cf9a0 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00c60e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041406a0 con 0x7ff00414b2c0 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00a3aa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 0x7ff0041453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00a3aa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 0x7ff0041453d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56740/0 (socket says 172.21.15.161:56740) 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00a3aa640 1 -- 172.21.15.161:0/828944761 learned_addr learned my addr 172.21.15.161:0/828944761 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.956+0000 7ff00abab640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff00414b2c0 0x7ff0041623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff009ba9640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040cf9a0 0x7ff004161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff00a3aa640 1 -- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff00414b2c0 msgr2=0x7ff0041623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff00a3aa640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff00414b2c0 0x7ff0041623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff00a3aa640 1 -- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040cf9a0 msgr2=0x7ff004161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff00a3aa640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040cf9a0 0x7ff004161e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff00a3aa640 1 -- 172.21.15.161:0/828944761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40094d0 con 0x7ff004070ea0 2023-11-24T08:00:34.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.957+0000 7ff00abab640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff00414b2c0 0x7ff0041623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:34.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.958+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d8c058000 con 0x7f0d88005180 2023-11-24T08:00:34.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.958+0000 7ff00a3aa640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 0x7ff0041453d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b3f0 tx=0x7ff00000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.959+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2730053b70 con 0x7f274015db20 2023-11-24T08:00:34.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.961+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79800ee60 con 0x7fe7a4160920 2023-11-24T08:00:34.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.961+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a41f6270 con 0x7fe7a4160920 2023-11-24T08:00:34.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.961+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a41f6830 con 0x7fe7a4160920 2023-11-24T08:00:34.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.961+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79800c940 con 0x7fe7a4160920 2023-11-24T08:00:34.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.961+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79800ccf0 con 0x7fe7a4160920 2023-11-24T08:00:34.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.962+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e90080f00 con 0x7f0e9c06e380 2023-11-24T08:00:34.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.964+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011830 con 0x7ff004070ea0 2023-11-24T08:00:34.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.964+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000011990 con 0x7ff004070ea0 2023-11-24T08:00:34.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.964+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000011d40 con 0x7ff004070ea0 2023-11-24T08:00:34.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.964+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff004164130 con 0x7ff004070ea0 2023-11-24T08:00:34.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.964+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0041646f0 con 0x7ff004070ea0 2023-11-24T08:00:34.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.964+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d9c15edf0 con 0x7f0d88005180 2023-11-24T08:00:34.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.963+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe788005250 con 0x7fe7a4160920 2023-11-24T08:00:34.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.966+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe798005990 con 0x7fe7a4160920 2023-11-24T08:00:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.967+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0040675d0 con 0x7ff004070ea0 2023-11-24T08:00:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.967+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3cd4054510 con 0x7f3ce40d1540 2023-11-24T08:00:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.968+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff00001a400 con 0x7ff004070ea0 2023-11-24T08:00:34.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.968+0000 7fe792ffd640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe78406ae40 0x7fe78406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.968+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe798089690 con 0x7fe7a4160920 2023-11-24T08:00:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.969+0000 7feffaffd640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fefe806af10 0x7fefe806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.969+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff000089650 con 0x7ff004070ea0 2023-11-24T08:00:34.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.969+0000 7fe7a259c640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe78406ae40 0x7fe78406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.970+0000 7ff009ba9640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fefe806af10 0x7fefe806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:34.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.971+0000 7ff009ba9640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fefe806af10 0x7fefe806d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feff4036000 tx=0x7feff403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.973+0000 7fe7a259c640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe78406ae40 0x7fe78406d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe794008890 tx=0x7fe794008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:34.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.975+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff000054790 con 0x7ff004070ea0 2023-11-24T08:00:34.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:33.979+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe7980547d0 con 0x7fe7a4160920 2023-11-24T08:00:34.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.334+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0950005500 con 0x7f09680df3e0 2023-11-24T08:00:34.338 INFO:teuthology.orchestra.run.smithi161.stdout:60129542148 2023-11-24T08:00:34.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.335+0000 7f0965ffb640 1 -- 172.21.15.161:0/373612821 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0960017070 con 0x7f09680df3e0 2023-11-24T08:00:34.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.338+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f095406ae90 msgr2=0x7f095406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.338+0000 7f09761a5640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f095406ae90 0x7f095406d350 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f096c035000 tx=0x7f096c03b040 comp rx=0 tx=0).stop 2023-11-24T08:00:34.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.338+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 msgr2=0x7f096804a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.338+0000 7f09761a5640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 0x7f096804a5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f096000c3c0 tx=0x7f096000c880 comp rx=0 tx=0).stop 2023-11-24T08:00:34.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.339+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 shutdown_connections 2023-11-24T08:00:34.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.339+0000 7f09761a5640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f095406ae90 0x7f095406d350 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.339+0000 7f09761a5640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f09680df3e0 0x7f096804a5a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.339+0000 7f09761a5640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f096804fa50 0x7f09680ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.339+0000 7f09761a5640 1 --2- 172.21.15.161:0/373612821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f09680387c0 0x7f09680cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.339+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 >> 172.21.15.161:0/373612821 conn(0x7f0968009f70 msgr2=0x7f09680de150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.340+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 shutdown_connections 2023-11-24T08:00:34.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.340+0000 7f09761a5640 1 -- 172.21.15.161:0/373612821 wait complete. 2023-11-24T08:00:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.366+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5480008990 con 0x7f5480039290 2023-11-24T08:00:34.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542148 for osd.0 2023-11-24T08:00:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.367+0000 7f547effd640 1 -- 172.21.15.161:0/2317109923 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f548806be60 con 0x7f5480039290 2023-11-24T08:00:34.370 INFO:teuthology.orchestra.run.smithi161.stdout:64424509443 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f546c06ae90 msgr2=0x7f546c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f546c06ae90 0x7f546c06d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5484001220 tx=0x7f54840011b0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 msgr2=0x7f54800c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800c3fa0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5488067b00 tx=0x7f54880748f0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 shutdown_connections 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f546c06ae90 0x7f546c06d350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54800df3e0 0x7f5480180480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548004fa50 0x7f548004bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 --2- 172.21.15.161:0/2317109923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5480039290 0x7f54800c3fa0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.371+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 >> 172.21.15.161:0/2317109923 conn(0x7f5480009f70 msgr2=0x7f5480039750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.372+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 shutdown_connections 2023-11-24T08:00:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.372+0000 7f548f3b3640 1 -- 172.21.15.161:0/2317109923 wait complete. 2023-11-24T08:00:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.375+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e9c0675d0 con 0x7f0e9c06e380 2023-11-24T08:00:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.376+0000 7f0e8affd640 1 -- 172.21.15.161:0/2680564768 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e90084520 con 0x7f0e9c06e380 2023-11-24T08:00:34.378 INFO:teuthology.orchestra.run.smithi161.stdout:64424509445 2023-11-24T08:00:34.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.376+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cc4005500 con 0x7f3ce40d1540 2023-11-24T08:00:34.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.377+0000 7f3ccb7fe640 1 -- 172.21.15.161:0/2443633842 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cd4057b30 con 0x7f3ce40d1540 2023-11-24T08:00:34.380 INFO:teuthology.orchestra.run.smithi161.stdout:60129542147 2023-11-24T08:00:34.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.378+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f274009d8f0 con 0x7f274015db20 2023-11-24T08:00:34.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.378+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0e7c06af10 msgr2=0x7f0e7c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.378+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0e7c06af10 0x7f0e7c06d3d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c157cd0 tx=0x7f0e8c009110 comp rx=0 tx=0).stop 2023-11-24T08:00:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.378+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 msgr2=0x7f0e9c152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.378+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 0x7f0e9c152dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0e90014500 tx=0x7f0e900046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.378+0000 7f2735ffb640 1 -- 172.21.15.161:0/3681084654 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2730017020 con 0x7f274015db20 2023-11-24T08:00:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 shutdown_connections 2023-11-24T08:00:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0e7c06af10 0x7f0e7c06d3d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0e9c15d460 0x7f0e9c13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0e9c0b1ee0 0x7f0e9c13d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 --2- 172.21.15.161:0/2680564768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e9c06e380 0x7f0e9c152dd0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0e90014500 tx=0x7f0e900046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 >> 172.21.15.161:0/2680564768 conn(0x7f0e9c0b0be0 msgr2=0x7f0e9c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.382 INFO:teuthology.orchestra.run.smithi161.stdout:64424509443 2023-11-24T08:00:34.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 shutdown_connections 2023-11-24T08:00:34.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.379+0000 7f0ea0c31640 1 -- 172.21.15.161:0/2680564768 wait complete. 2023-11-24T08:00:34.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.381+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0d9c0675d0 con 0x7f0d88005180 2023-11-24T08:00:34.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f0d91ffb640 1 -- 172.21.15.161:0/4188514251 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d8c017020 con 0x7f0d88005180 2023-11-24T08:00:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3cd006aea0 msgr2=0x7f3cd006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3cd006aea0 0x7f3cd006d360 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc036000 tx=0x7f3cdc030000 comp rx=0 tx=0).stop 2023-11-24T08:00:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 msgr2=0x7f3ce40cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 0x7f3ce40cb710 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400e980 tx=0x7f3cd400ee40 comp rx=0 tx=0).stop 2023-11-24T08:00:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 shutdown_connections 2023-11-24T08:00:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3cd006aea0 0x7f3cd006d360 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc036000 tx=0x7f3cdc030000 comp rx=0 tx=0).stop 2023-11-24T08:00:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ce40cbc50 0x7f3ce4163760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ce40d1540 0x7f3ce40cb710 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 --2- 172.21.15.161:0/2443633842 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ce40c6d80 0x7f3ce4156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 >> 172.21.15.161:0/2443633842 conn(0x7f3ce408cc50 msgr2=0x7f3ce4160bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.385 INFO:teuthology.orchestra.run.smithi161.stdout:60129542149 2023-11-24T08:00:34.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f272406ae70 msgr2=0x7f272406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f27475e5640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f272406ae70 0x7f272406d330 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f273c036000 tx=0x7f273c008030 comp rx=0 tx=0).stop 2023-11-24T08:00:34.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 msgr2=0x7f27400b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f27475e5640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 0x7f27400b27c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f273000c400 tx=0x7f273000c8c0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 shutdown_connections 2023-11-24T08:00:34.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.382+0000 7f3ce90c2640 1 -- 172.21.15.161:0/2443633842 wait complete. 2023-11-24T08:00:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 shutdown_connections 2023-11-24T08:00:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f272406ae70 0x7f272406d330 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f27400b2d00 0x7f27400cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f274015db20 0x7f27400b27c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 --2- 172.21.15.161:0/3681084654 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27400cff40 0x7f274014e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 >> 172.21.15.161:0/3681084654 conn(0x7f274009c550 msgr2=0x7f27400cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 shutdown_connections 2023-11-24T08:00:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.383+0000 7f27475e5640 1 -- 172.21.15.161:0/3681084654 wait complete. 2023-11-24T08:00:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0d8006ae90 msgr2=0x7f0d8006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0d8006ae90 0x7f0d8006d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c155520 tx=0x7f0d98007d50 comp rx=0 tx=0).stop 2023-11-24T08:00:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 msgr2=0x7f0d9c15f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d9c15f260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c730 tx=0x7f0d8c00cbf0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 shutdown_connections 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0d8006ae90 0x7f0d8006d350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d9c1f5ca0 0x7f0d9c1f6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d9c15db70 0x7f0d9c15f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 --2- 172.21.15.161:0/4188514251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0d88005180 0x7f0d9c15f260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 >> 172.21.15.161:0/4188514251 conn(0x7f0d9c09c540 msgr2=0x7f0d9c15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.386+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 shutdown_connections 2023-11-24T08:00:34.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.387+0000 7f0da3761640 1 -- 172.21.15.161:0/4188514251 wait complete. 2023-11-24T08:00:34.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.392+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff0040b2970 con 0x7ff004070ea0 2023-11-24T08:00:34.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.392+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe7880057d0 con 0x7fe7a4160920 2023-11-24T08:00:34.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.392+0000 7feffaffd640 1 -- 172.21.15.161:0/828944761 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff000057db0 con 0x7ff004070ea0 2023-11-24T08:00:34.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.394+0000 7fe792ffd640 1 -- 172.21.15.161:0/2817332326 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe798021020 con 0x7fe7a4160920 2023-11-24T08:00:34.396 INFO:teuthology.orchestra.run.smithi161.stdout:64424509445 2023-11-24T08:00:34.397 INFO:teuthology.orchestra.run.smithi161.stdout:64424509444 2023-11-24T08:00:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fefe806af10 msgr2=0x7fefe806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fefe806af10 0x7fefe806d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feff4036000 tx=0x7feff403c040 comp rx=0 tx=0).stop 2023-11-24T08:00:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe78406ae40 msgr2=0x7fe78406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe78406ae40 0x7fe78406d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe794008890 tx=0x7fe794008040 comp rx=0 tx=0).stop 2023-11-24T08:00:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 msgr2=0x7fe7a41f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 0x7fe7a41f6d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe79800e870 tx=0x7fe79800ed30 comp rx=0 tx=0).stop 2023-11-24T08:00:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 msgr2=0x7ff0041453d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 0x7ff0041453d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b3f0 tx=0x7ff00000b8b0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 shutdown_connections 2023-11-24T08:00:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe78406ae40 0x7fe78406d300 secure :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe794008890 tx=0x7fe794008040 comp rx=0 tx=0).stop 2023-11-24T08:00:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7a4161010 0x7fe7a40cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7a4160920 0x7fe7a41f6d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 --2- 172.21.15.161:0/2817332326 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe7a40cf9f0 0x7fe7a40cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 >> 172.21.15.161:0/2817332326 conn(0x7fe7a40d3090 msgr2=0x7fe7a40cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 shutdown_connections 2023-11-24T08:00:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7fe7a359e640 1 -- 172.21.15.161:0/2817332326 wait complete. 2023-11-24T08:00:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 shutdown_connections 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fefe806af10 0x7fefe806d3d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff00414b2c0 0x7ff0041623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0040cf9a0 0x7ff004161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 --2- 172.21.15.161:0/828944761 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff004070ea0 0x7ff0041453d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.397+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 >> 172.21.15.161:0/828944761 conn(0x7ff00406a800 msgr2=0x7ff0040b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.398+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 shutdown_connections 2023-11-24T08:00:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:34.398+0000 7ff00c60e640 1 -- 172.21.15.161:0/828944761 wait complete. 2023-11-24T08:00:34.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.2 2023-11-24T08:00:34.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.3 2023-11-24T08:00:34.412 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.1 2023-11-24T08:00:34.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509443 for osd.5 2023-11-24T08:00:34.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542149 for osd.4 2023-11-24T08:00:34.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.6 2023-11-24T08:00:34.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.7 2023-11-24T08:00:35.371 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T08:00:35.404 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T08:00:35.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T08:00:35.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T08:00:35.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T08:00:35.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T08:00:35.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T08:00:35.423 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.656+0000 7fe19359e640 1 Processor -- start 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.656+0000 7fe19359e640 1 -- start start 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.658+0000 7fe19359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe1940b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.658+0000 7fe19359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1940b33e0 0x7fe19406dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.659+0000 7fe19359e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1940720b0 con 0x7fe19406e0f0 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.659+0000 7fe19359e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1940b3860 con 0x7fe1940b33e0 2023-11-24T08:00:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.659+0000 7fe19359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19406e790 con 0x7fe194153680 2023-11-24T08:00:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.659+0000 7fe19259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe1940b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.659+0000 7fe191d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1940b33e0 0x7fe19406dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.660+0000 7fe191d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe1940b33e0 0x7fe19406dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56756/0 (socket says 172.21.15.161:56756) 2023-11-24T08:00:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.660+0000 7fe191d9b640 1 -- 172.21.15.161:0/263714493 learned_addr learned my addr 172.21.15.161:0/263714493 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.661+0000 7fe191d9b640 1 -- 172.21.15.161:0/263714493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 msgr2=0x7fe1940b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.661+0000 7fe191d9b640 1 --2- 172.21.15.161:0/263714493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe1940b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.661+0000 7fe191d9b640 1 -- 172.21.15.161:0/263714493 >> v1:172.21.15.161:6789/0 conn(0x7fe19406e0f0 legacy=0x7fe19415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.661+0000 7fe191d9b640 1 -- 172.21.15.161:0/263714493 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19406e560 con 0x7fe1940b33e0 2023-11-24T08:00:35.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.663+0000 7fe191d9b640 1 --2- 172.21.15.161:0/263714493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1940b33e0 0x7fe19406dbb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe184009870 tx=0x7fe18402def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ebbd81502173c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.664+0000 7fe19159a640 1 -- 172.21.15.161:0/263714493 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18402eca0 con 0x7fe1940b33e0 2023-11-24T08:00:35.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.664+0000 7fe19159a640 1 -- 172.21.15.161:0/263714493 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18402ee00 con 0x7fe1940b33e0 2023-11-24T08:00:35.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.665+0000 7fe19359e640 1 -- 172.21.15.161:0/263714493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1940b33e0 msgr2=0x7fe19406dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.665+0000 7fe19359e640 1 --2- 172.21.15.161:0/263714493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1940b33e0 0x7fe19406dbb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe184009870 tx=0x7fe18402def0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.669+0000 7fe19359e640 1 -- 172.21.15.161:0/263714493 shutdown_connections 2023-11-24T08:00:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.669+0000 7fe19359e640 1 --2- 172.21.15.161:0/263714493 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1940b33e0 0x7fe19406dbb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.669+0000 7fe19359e640 1 --2- 172.21.15.161:0/263714493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe1940b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.669+0000 7fe19359e640 1 -- 172.21.15.161:0/263714493 >> 172.21.15.161:0/263714493 conn(0x7fe1940b0a90 msgr2=0x7fe1940b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.669+0000 7fe19359e640 1 -- 172.21.15.161:0/263714493 shutdown_connections 2023-11-24T08:00:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.669+0000 7fe19359e640 1 -- 172.21.15.161:0/263714493 wait complete. 2023-11-24T08:00:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.672+0000 7fe19359e640 1 Processor -- start 2023-11-24T08:00:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.673+0000 7fe19359e640 1 -- start start 2023-11-24T08:00:35.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.675+0000 7fe19359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 0x7fe194148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.676+0000 7fe19259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 0x7fe194148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.676+0000 7fe19259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 0x7fe194148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56768/0 (socket says 172.21.15.161:56768) 2023-11-24T08:00:35.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.676+0000 7fe19259c640 1 -- 172.21.15.161:0/1231557100 learned_addr learned my addr 172.21.15.161:0/1231557100 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.676+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1940b33e0 0x7fe194158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.677+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe194158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.677+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19414a5b0 con 0x7fe19406e0f0 2023-11-24T08:00:35.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.677+0000 7fe191d9b640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1940b33e0 0x7fe194158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.677+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19414a890 con 0x7fe1940b33e0 2023-11-24T08:00:35.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.678+0000 7fe192d9d640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe194158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.678+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19414ab70 con 0x7fe194153680 2023-11-24T08:00:35.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.679+0000 7fe191d9b640 1 -- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 msgr2=0x7fe194158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.679+0000 7fe191d9b640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe194158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.679+0000 7fe191d9b640 1 -- 172.21.15.161:0/1231557100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 msgr2=0x7fe194148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.680+0000 7fe191d9b640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 0x7fe194148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.680+0000 7fe191d9b640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840094d0 con 0x7fe1940b33e0 2023-11-24T08:00:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.680+0000 7fe19259c640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 0x7fe194148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.681+0000 7fe191d9b640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1940b33e0 0x7fe194158120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe184035000 tx=0x7fe1840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.682+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184034850 con 0x7fe1940b33e0 2023-11-24T08:00:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.682+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19414ae50 con 0x7fe1940b33e0 2023-11-24T08:00:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.682+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe194148870 con 0x7fe1940b33e0 2023-11-24T08:00:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.682+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18400c040 con 0x7fe1940b33e0 2023-11-24T08:00:35.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.682+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184034850 con 0x7fe1940b33e0 2023-11-24T08:00:35.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.684+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178005250 con 0x7fe1940b33e0 2023-11-24T08:00:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.686+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe1840349b0 con 0x7fe1940b33e0 2023-11-24T08:00:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.688+0000 7fe182ffd640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe17406aea0 0x7fe17406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.689+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1840ab370 con 0x7fe1940b33e0 2023-11-24T08:00:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.689+0000 7fe19259c640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe17406aea0 0x7fe17406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.691+0000 7fe19259c640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe17406aea0 0x7fe17406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe194155710 tx=0x7fe188017040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.703+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1840765e0 con 0x7fe1940b33e0 2023-11-24T08:00:35.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.716+0000 7efd4046b640 1 Processor -- start 2023-11-24T08:00:35.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.716+0000 7efd4046b640 1 -- start start 2023-11-24T08:00:35.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.718+0000 7efd4046b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 0x7efd3815ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.718+0000 7efd4046b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd38153b40 0x7efd3815d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.718+0000 7efd4046b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd380b2e50 con 0x7efd380b16d0 2023-11-24T08:00:35.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.718+0000 7efd4046b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd380b3130 con 0x7efd38153b40 2023-11-24T08:00:35.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.718+0000 7efd4046b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd380b3410 con 0x7efd381536e0 2023-11-24T08:00:35.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.719+0000 7efd3e207640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efd380b16d0 0x7efd380cb0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:49820/0 (socket says 172.21.15.161:49820) 2023-11-24T08:00:35.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.719+0000 7efd3da06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 0x7efd3815ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.719+0000 7fd6155b0640 1 Processor -- start 2023-11-24T08:00:35.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.719+0000 7efd3da06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 0x7efd3815ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51548/0 (socket says 172.21.15.161:51548) 2023-11-24T08:00:35.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.719+0000 7efd3da06640 1 -- 172.21.15.161:0/951386561 learned_addr learned my addr 172.21.15.161:0/951386561 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.720+0000 7efd3ea08640 1 --2- 172.21.15.161:0/951386561 >> v2:172.21.15.175:3300/0 conn(0x7efd38153b40 0x7efd3815d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.720+0000 7efd3da06640 1 -- 172.21.15.161:0/951386561 >> v2:172.21.15.175:3300/0 conn(0x7efd38153b40 msgr2=0x7efd3815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.720+0000 7fd6155b0640 1 -- start start 2023-11-24T08:00:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.720+0000 7efd3da06640 1 --2- 172.21.15.161:0/951386561 >> v2:172.21.15.175:3300/0 conn(0x7efd38153b40 0x7efd3815d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.720+0000 7efd3da06640 1 -- 172.21.15.161:0/951386561 >> v1:172.21.15.175:6789/0 conn(0x7efd380b16d0 legacy=0x7efd380cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.720+0000 7efd3da06640 1 -- 172.21.15.161:0/951386561 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380b36f0 con 0x7efd381536e0 2023-11-24T08:00:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.722+0000 7efd3ea08640 1 --2- 172.21.15.161:0/951386561 >> v2:172.21.15.175:3300/0 conn(0x7efd38153b40 0x7efd3815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.722+0000 7efd3da06640 1 --2- 172.21.15.161:0/951386561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 0x7efd3815ce90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd24009870 tx=0x7efd2402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b052a40fc1da5eae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.723+0000 7efd3d205640 1 -- 172.21.15.161:0/951386561 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24031740 con 0x7efd381536e0 2023-11-24T08:00:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.723+0000 7efd3d205640 1 -- 172.21.15.161:0/951386561 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd240318a0 con 0x7efd381536e0 2023-11-24T08:00:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.723+0000 7efd3d205640 1 -- 172.21.15.161:0/951386561 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd24031c30 con 0x7efd381536e0 2023-11-24T08:00:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7fd6155b0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd610153950 0x7fd6100cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7fd6155b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd61015ce90 0x7fd61015d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7fd6155b0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd610153d30 con 0x7fd6101598a0 2023-11-24T08:00:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7fd6155b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61015d860 con 0x7fd61015ce90 2023-11-24T08:00:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7fd6155b0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6100b2b70 con 0x7fd610153950 2023-11-24T08:00:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7efd4046b640 1 -- 172.21.15.161:0/951386561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 msgr2=0x7efd3815ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.725+0000 7efd4046b640 1 --2- 172.21.15.161:0/951386561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 0x7efd3815ce90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd24009870 tx=0x7efd2402b880 comp rx=0 tx=0).stop 2023-11-24T08:00:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7efd4046b640 1 -- 172.21.15.161:0/951386561 shutdown_connections 2023-11-24T08:00:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7efd4046b640 1 --2- 172.21.15.161:0/951386561 >> v2:172.21.15.175:3300/0 conn(0x7efd38153b40 0x7efd3815d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7efd4046b640 1 --2- 172.21.15.161:0/951386561 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd381536e0 0x7efd3815ce90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7efd4046b640 1 -- 172.21.15.161:0/951386561 >> 172.21.15.161:0/951386561 conn(0x7efd380b0be0 msgr2=0x7efd380b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fd60effd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd610153950 0x7fd6100cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7efd4046b640 1 -- 172.21.15.161:0/951386561 shutdown_connections 2023-11-24T08:00:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fd60effd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd610153950 0x7fd6100cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:48982/0 (socket says 172.21.15.161:48982) 2023-11-24T08:00:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fd60effd640 1 -- 172.21.15.161:0/4005835772 learned_addr learned my addr 172.21.15.161:0/4005835772 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fd60e7fc640 1 --2- 172.21.15.161:0/4005835772 >> v2:172.21.15.161:3300/0 conn(0x7fd61015ce90 0x7fd61015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fd60effd640 1 -- 172.21.15.161:0/4005835772 >> v2:172.21.15.161:3300/0 conn(0x7fd61015ce90 msgr2=0x7fd61015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.728+0000 7fd60effd640 1 --2- 172.21.15.161:0/4005835772 >> v2:172.21.15.161:3300/0 conn(0x7fd61015ce90 0x7fd61015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.728+0000 7fd60effd640 1 -- 172.21.15.161:0/4005835772 >> v1:172.21.15.161:6789/0 conn(0x7fd6101598a0 legacy=0x7fd610159cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T08:00:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fcda8883640 1 Processor -- start 2023-11-24T08:00:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.728+0000 7efd4046b640 1 -- 172.21.15.161:0/951386561 wait complete. 2023-11-24T08:00:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.728+0000 7f12441b0640 1 Processor -- start 2023-11-24T08:00:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.727+0000 7fcda8883640 1 -- start start 2023-11-24T08:00:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.728+0000 7fd60effd640 1 -- 172.21.15.161:0/4005835772 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6100b2e50 con 0x7fd610153950 2023-11-24T08:00:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fd60e7fc640 1 --2- 172.21.15.161:0/4005835772 >> v2:172.21.15.161:3300/0 conn(0x7fd61015ce90 0x7fd61015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.729+0000 7f12441b0640 1 -- start start 2023-11-24T08:00:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda8883640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcda40cf9a0 0x7fcda4070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fd60effd640 1 --2- 172.21.15.161:0/4005835772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd610153950 0x7fd6100cb0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd61015dfb0 tx=0x7fd60002e110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86876d8930351a23 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7fd60dffb640 1 -- 172.21.15.161:0/4005835772 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600036440 con 0x7fd610153950 2023-11-24T08:00:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7efd4046b640 1 Processor -- start 2023-11-24T08:00:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7efd4046b640 1 -- start start 2023-11-24T08:00:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda8883640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda40cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7fd60dffb640 1 -- 172.21.15.161:0/4005835772 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6000365a0 con 0x7fd610153950 2023-11-24T08:00:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda8883640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda4071690 con 0x7fcda414b2c0 2023-11-24T08:00:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda8883640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda414b6a0 con 0x7fcda40cf9a0 2023-11-24T08:00:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda8883640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4071970 con 0x7fcda4070ea0 2023-11-24T08:00:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7fd60dffb640 1 -- 172.21.15.161:0/4005835772 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600036970 con 0x7fd610153950 2023-11-24T08:00:35.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda2d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda40cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda259c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcda414b2c0 0x7fcda40cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40080/0 (socket says 172.21.15.161:40080) 2023-11-24T08:00:35.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.730+0000 7fcda259c640 1 -- 172.21.15.161:0/2363658097 learned_addr learned my addr 172.21.15.161:0/2363658097 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7f12441b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f123c15d380 0x7f123c0d3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7f12441b0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f123c15d760 0x7f123c0d3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7f12441b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0d1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7f12441b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0d3a80 con 0x7f123c15d380 2023-11-24T08:00:35.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7f12441b0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0d1850 con 0x7f123c15d760 2023-11-24T08:00:35.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.731+0000 7f12441b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0d1b20 con 0x7f123c0d0e80 2023-11-24T08:00:35.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda1d9b640 1 --2- 172.21.15.161:0/2363658097 >> v2:172.21.15.161:3300/0 conn(0x7fcda40cf9a0 0x7fcda4070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda159a640 1 -- 172.21.15.161:0/2363658097 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616425632 0 0) 0x7fcda4071690 con 0x7fcda414b2c0 2023-11-24T08:00:35.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda159a640 1 -- 172.21.15.161:0/2363658097 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8c003520 con 0x7fcda414b2c0 2023-11-24T08:00:35.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7f124274d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0d1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7fd6155b0640 1 -- 172.21.15.161:0/4005835772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd610153950 msgr2=0x7fd6100cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4005835772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd610153950 0x7fd6100cb0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd61015dfb0 tx=0x7fd60002e110 comp rx=0 tx=0).stop 2023-11-24T08:00:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7f124274d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0d1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51558/0 (socket says 172.21.15.161:51558) 2023-11-24T08:00:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7f124274d640 1 -- 172.21.15.161:0/480857583 learned_addr learned my addr 172.21.15.161:0/480857583 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7f1241f4c640 1 --2- 172.21.15.161:0/480857583 >> v2:172.21.15.161:3300/0 conn(0x7f123c15d380 0x7f123c0d3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7fd6155b0640 1 -- 172.21.15.161:0/4005835772 shutdown_connections 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4005835772 >> v2:172.21.15.161:3300/0 conn(0x7fd61015ce90 0x7fd61015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4005835772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd610153950 0x7fd6100cb0d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7fd6155b0640 1 -- 172.21.15.161:0/4005835772 >> 172.21.15.161:0/4005835772 conn(0x7fd6100b0be0 msgr2=0x7fd6100b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd4046b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd380b16d0 0x7efd380ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd4046b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd381536e0 0x7efd380c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd4046b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd38153b40 0x7efd38148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd4046b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd38155270 con 0x7efd38153b40 2023-11-24T08:00:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd3e207640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd380b16d0 0x7efd380ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd4046b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd38155c00 con 0x7efd381536e0 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd3e207640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd380b16d0 0x7efd380ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51568/0 (socket says 172.21.15.161:51568) 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd4046b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd38155510 con 0x7efd380b16d0 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd3ea08640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd38153b40 0x7efd38148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7f598930f640 1 Processor -- start 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7f598930f640 1 -- start start 2023-11-24T08:00:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda2d9d640 1 -- 172.21.15.161:0/2363658097 >> v2:172.21.15.161:3300/0 conn(0x7fcda40cf9a0 msgr2=0x7fcda4070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda2d9d640 1 --2- 172.21.15.161:0/2363658097 >> v2:172.21.15.161:3300/0 conn(0x7fcda40cf9a0 0x7fcda4070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda2d9d640 1 -- 172.21.15.161:0/2363658097 >> v1:172.21.15.161:6789/0 conn(0x7fcda414b2c0 legacy=0x7fcda40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.732+0000 7fcda2d9d640 1 -- 172.21.15.161:0/2363658097 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4071c50 con 0x7fcda4070ea0 2023-11-24T08:00:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7efd3e207640 1 -- 172.21.15.161:0/2578750577 learned_addr learned my addr 172.21.15.161:0/2578750577 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.734+0000 7fcda2d9d640 1 --2- 172.21.15.161:0/2363658097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda40cc160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=301df9b13f7074d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7f124274d640 1 -- 172.21.15.161:0/480857583 >> v2:172.21.15.175:3300/0 conn(0x7f123c15d760 msgr2=0x7f123c0d3540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T08:00:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7f124274d640 1 --2- 172.21.15.161:0/480857583 >> v2:172.21.15.175:3300/0 conn(0x7f123c15d760 0x7f123c0d3540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7f124274d640 1 -- 172.21.15.161:0/480857583 >> v2:172.21.15.161:3300/0 conn(0x7f123c15d380 msgr2=0x7f123c0d3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7f124274d640 1 --2- 172.21.15.161:0/480857583 >> v2:172.21.15.161:3300/0 conn(0x7f123c15d380 0x7f123c0d3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.733+0000 7f124274d640 1 -- 172.21.15.161:0/480857583 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0d1e00 con 0x7f123c0d0e80 2023-11-24T08:00:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7fcda159a640 1 -- 172.21.15.161:0/2363658097 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c02cc90 con 0x7fcda4070ea0 2023-11-24T08:00:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7fcda159a640 1 -- 172.21.15.161:0/2363658097 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c02cdf0 con 0x7fcda4070ea0 2023-11-24T08:00:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7fcda159a640 1 -- 172.21.15.161:0/2363658097 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c034660 con 0x7fcda4070ea0 2023-11-24T08:00:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7f124274d640 1 --2- 172.21.15.161:0/480857583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0d1310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b5ea0 tx=0x7f123402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=613a50ecf246993 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7efd3da06640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd381536e0 0x7efd380c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7fd6155b0640 1 -- 172.21.15.161:0/4005835772 shutdown_connections 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.735+0000 7fd6155b0640 1 -- 172.21.15.161:0/4005835772 wait complete. 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7efd3ea08640 1 -- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd380b16d0 msgr2=0x7efd380ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7efd3ea08640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd380b16d0 0x7efd380ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7efd3ea08640 1 -- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd381536e0 msgr2=0x7efd380c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7efd3ea08640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd381536e0 0x7efd380c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7efd3ea08640 1 -- 172.21.15.161:0/2578750577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240094d0 con 0x7efd38153b40 2023-11-24T08:00:35.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7fcda8883640 1 -- 172.21.15.161:0/2363658097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 msgr2=0x7fcda40cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7fcda8883640 1 --2- 172.21.15.161:0/2363658097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda40cc160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c02bee0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.736+0000 7efd3ea08640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd38153b40 0x7efd38148170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c590 tx=0x7efd3000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7f1240f4a640 1 -- 172.21.15.161:0/480857583 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123402cac0 con 0x7f123c0d0e80 2023-11-24T08:00:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7f1240f4a640 1 -- 172.21.15.161:0/480857583 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123402cc20 con 0x7f123c0d0e80 2023-11-24T08:00:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7f1240f4a640 1 -- 172.21.15.161:0/480857583 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12340343f0 con 0x7f123c0d0e80 2023-11-24T08:00:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30011800 con 0x7efd38153b40 2023-11-24T08:00:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd30011960 con 0x7efd38153b40 2023-11-24T08:00:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7f598930f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f598415d590 0x7f59840cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 -- 172.21.15.161:0/480857583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 msgr2=0x7f123c0d1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 --2- 172.21.15.161:0/480857583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0d1310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b5ea0 tx=0x7f123402bf20 comp rx=0 tx=0).stop 2023-11-24T08:00:35.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f598930f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59840d00b0 0x7f59840ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 -- 172.21.15.161:0/480857583 shutdown_connections 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 --2- 172.21.15.161:0/480857583 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0d1310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 --2- 172.21.15.161:0/480857583 >> v2:172.21.15.175:3300/0 conn(0x7f123c15d760 0x7f123c0d3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 --2- 172.21.15.161:0/480857583 >> v2:172.21.15.161:3300/0 conn(0x7f123c15d380 0x7f123c0d3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7f12441b0640 1 -- 172.21.15.161:0/480857583 >> 172.21.15.161:0/480857583 conn(0x7f123c08ccf0 msgr2=0x7f123c09c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7fcda8883640 1 -- 172.21.15.161:0/2363658097 shutdown_connections 2023-11-24T08:00:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7fcda8883640 1 --2- 172.21.15.161:0/2363658097 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda40cc160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7fcda8883640 1 --2- 172.21.15.161:0/2363658097 >> v2:172.21.15.161:3300/0 conn(0x7fcda40cf9a0 0x7fcda4070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd30011d10 con 0x7efd38153b40 2023-11-24T08:00:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.738+0000 7fcda8883640 1 -- 172.21.15.161:0/2363658097 >> 172.21.15.161:0/2363658097 conn(0x7fcda406a800 msgr2=0x7fcda406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd38155ea0 con 0x7efd38153b40 2023-11-24T08:00:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.737+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd380ca440 con 0x7efd38153b40 2023-11-24T08:00:35.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f5982ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f598415d590 0x7f59840cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7fd6155b0640 1 Processor -- start 2023-11-24T08:00:35.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7fcda8883640 1 -- 172.21.15.161:0/2363658097 shutdown_connections 2023-11-24T08:00:35.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f12441b0640 1 -- 172.21.15.161:0/480857583 shutdown_connections 2023-11-24T08:00:35.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f5982ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f598415d590 0x7f59840cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:48998/0 (socket says 172.21.15.161:48998) 2023-11-24T08:00:35.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f5982ffd640 1 -- 172.21.15.161:0/2252392062 learned_addr learned my addr 172.21.15.161:0/2252392062 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7fd6155b0640 1 -- start start 2023-11-24T08:00:35.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59840b6750 con 0x7f59840ce6f0 2023-11-24T08:00:35.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840d0530 con 0x7f59840d00b0 2023-11-24T08:00:35.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59840cf1f0 con 0x7f598415d590 2023-11-24T08:00:35.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.740+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd38067000 con 0x7efd38153b40 2023-11-24T08:00:35.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.740+0000 7faaa4501640 1 Processor -- start 2023-11-24T08:00:35.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.741+0000 7fd6155b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 0x7fd6101f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7f12441b0640 1 -- 172.21.15.161:0/480857583 wait complete. 2023-11-24T08:00:35.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.741+0000 7fd6155b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6101598a0 0x7fd610149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.739+0000 7fcda8883640 1 -- 172.21.15.161:0/2363658097 wait complete. 2023-11-24T08:00:35.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.740+0000 7f5982ffd640 1 -- 172.21.15.161:0/2252392062 >> v2:172.21.15.161:3300/0 conn(0x7f59840d00b0 msgr2=0x7f59840ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.740+0000 7f5982ffd640 1 --2- 172.21.15.161:0/2252392062 >> v2:172.21.15.161:3300/0 conn(0x7f59840d00b0 0x7f59840ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.740+0000 7f5982ffd640 1 -- 172.21.15.161:0/2252392062 >> v1:172.21.15.161:6789/0 conn(0x7f59840ce6f0 legacy=0x7f59840d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.740+0000 7f5982ffd640 1 -- 172.21.15.161:0/2252392062 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59840cef10 con 0x7f598415d590 2023-11-24T08:00:35.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd6155b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd61015ce90 0x7fd610151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd6155b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6100cccb0 con 0x7fd61015ce90 2023-11-24T08:00:35.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd6155b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61014b250 con 0x7fd6101598a0 2023-11-24T08:00:35.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd6155b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61014b530 con 0x7fd610153950 2023-11-24T08:00:35.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd60effd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 0x7fd6101f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd60effd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 0x7fd6101f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51584/0 (socket says 172.21.15.161:51584) 2023-11-24T08:00:35.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd60effd640 1 -- 172.21.15.161:0/4022693014 learned_addr learned my addr 172.21.15.161:0/4022693014 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7f5982ffd640 1 --2- 172.21.15.161:0/2252392062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f598415d590 0x7f59840cfb70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f598406d4d0 tx=0x7f597c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39b5aecfa6f9b69f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.741+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd30018360 con 0x7efd38153b40 2023-11-24T08:00:35.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7efd36ffd640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd1c06af10 0x7efd1c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.741+0000 7faaa4501640 1 -- start start 2023-11-24T08:00:35.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd30089550 con 0x7efd38153b40 2023-11-24T08:00:35.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.742+0000 7fd60e7fc640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6101598a0 0x7fd610149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7f5981ffb640 1 -- 172.21.15.161:0/2252392062 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c02ca80 con 0x7f598415d590 2023-11-24T08:00:35.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa4501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c15d590 0x7faa9c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa4501640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9c0b6750 con 0x7faa9c0d00b0 2023-11-24T08:00:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa4501640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9c0cf1f0 con 0x7faa9c0ce8c0 2023-11-24T08:00:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa4501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c0ced20 con 0x7faa9c15d590 2023-11-24T08:00:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7efd3e207640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd1c06af10 0x7efd1c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7f5981ffb640 1 -- 172.21.15.161:0/2252392062 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c02cbe0 con 0x7f598415d590 2023-11-24T08:00:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7f5981ffb640 1 -- 172.21.15.161:0/2252392062 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c0343f0 con 0x7f598415d590 2023-11-24T08:00:35.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7fd60effd640 1 -- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6101598a0 msgr2=0x7fd610149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa229d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c15d590 0x7faa9c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa1a9c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faa9c0d00b0 0x7faa9c0ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40096/0 (socket says 172.21.15.161:40096) 2023-11-24T08:00:35.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7faaa1a9c640 1 -- 172.21.15.161:0/3488908845 learned_addr learned my addr 172.21.15.161:0/3488908845 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:35.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7fd60effd640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6101598a0 0x7fd610149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7fd60effd640 1 -- 172.21.15.161:0/4022693014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd61015ce90 msgr2=0x7fd610151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7fd60effd640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd61015ce90 0x7fd610151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7f12441b0640 1 Processor -- start 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7fd60effd640 1 -- 172.21.15.161:0/4022693014 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60000b770 con 0x7fd610153950 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.743+0000 7fd60effd640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 0x7fd6101f7020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd600000c00 tx=0x7fd6000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600036440 con 0x7fd610153950 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd600034b80 con 0x7fd610153950 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600041440 con 0x7fd610153950 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7faaa229d640 1 -- 172.21.15.161:0/3488908845 >> v1:172.21.15.175:6789/0 conn(0x7faa9c0ce8c0 legacy=0x7faa9c0b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7faaa229d640 1 -- 172.21.15.161:0/3488908845 >> v1:172.21.15.161:6789/0 conn(0x7faa9c0d00b0 legacy=0x7faa9c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.744+0000 7faaa229d640 1 -- 172.21.15.161:0/3488908845 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c0cef10 con 0x7faa9c15d590 2023-11-24T08:00:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f598415d590 msgr2=0x7f59840cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7f598930f640 1 --2- 172.21.15.161:0/2252392062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f598415d590 0x7f59840cfb70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f598406d4d0 tx=0x7f597c02bee0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7efd3e207640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd1c06af10 0x7efd1c06d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0012e0 tx=0x7efd2c001960 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61014b810 con 0x7fd610153950 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 shutdown_connections 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7f598930f640 1 --2- 172.21.15.161:0/2252392062 >> v2:172.21.15.161:3300/0 conn(0x7f59840d00b0 0x7f59840ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7f598930f640 1 --2- 172.21.15.161:0/2252392062 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f598415d590 0x7f59840cfb70 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f598406d4d0 tx=0x7f597c02bee0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 >> 172.21.15.161:0/2252392062 conn(0x7f598409c540 msgr2=0x7f59840d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.745+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6101f7560 con 0x7fd610153950 2023-11-24T08:00:35.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.746+0000 7faaa229d640 1 --2- 172.21.15.161:0/3488908845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c15d590 0x7faa9c0cfb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa90009dc0 tx=0x7faa9002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=581368e6e44be8b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.746+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6100cd100 con 0x7fd610153950 2023-11-24T08:00:35.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.746+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 shutdown_connections 2023-11-24T08:00:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.746+0000 7f598930f640 1 -- 172.21.15.161:0/2252392062 wait complete. 2023-11-24T08:00:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.747+0000 7faaa129b640 1 -- 172.21.15.161:0/3488908845 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9002cce0 con 0x7faa9c15d590 2023-11-24T08:00:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.747+0000 7faaa129b640 1 -- 172.21.15.161:0/3488908845 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9002ce40 con 0x7faa9c15d590 2023-11-24T08:00:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.747+0000 7faaa129b640 1 -- 172.21.15.161:0/3488908845 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90034660 con 0x7faa9c15d590 2023-11-24T08:00:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.747+0000 7fcda8883640 1 Processor -- start 2023-11-24T08:00:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6000403e0 con 0x7fd610153950 2023-11-24T08:00:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7fd5f77fe640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd5fc06ae70 0x7fd5fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7f12441b0640 1 -- start start 2023-11-24T08:00:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f12441b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f12441b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f123c15d380 0x7f123c158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f12441b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f123c15d760 0x7f123c14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f12441b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b14c0 con 0x7f123c15d760 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f12441b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0c8290 con 0x7f123c15d380 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f12441b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0c8520 con 0x7f123c0d0e80 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f124174b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f123c15d380 0x7f123c158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f1241f4c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f1241f4c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51608/0 (socket says 172.21.15.161:51608) 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f1241f4c640 1 -- 172.21.15.161:0/1691005469 learned_addr learned my addr 172.21.15.161:0/1691005469 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f124274d640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f123c15d760 0x7f123c14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7f598930f640 1 Processor -- start 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7f598930f640 1 -- start start 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f598930f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 0x7f59840c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f598930f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59840d00b0 0x7f598415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.749+0000 7f598930f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59840c1bc0 0x7f59840c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f598930f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598415c600 con 0x7f59840ce6f0 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f598930f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59840c2940 con 0x7f59840d00b0 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f598930f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59840c6ca0 con 0x7f59840c1bc0 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 0x7f59840c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f5982ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 0x7f59840c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56836/0 (socket says 172.21.15.161:56836) 2023-11-24T08:00:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.750+0000 7f5982ffd640 1 -- 172.21.15.161:0/2969895643 learned_addr learned my addr 172.21.15.161:0/2969895643 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.747+0000 7fcda8883640 1 -- start start 2023-11-24T08:00:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7faaa4501640 1 -- 172.21.15.161:0/3488908845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c15d590 msgr2=0x7faa9c0cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7faaa4501640 1 --2- 172.21.15.161:0/3488908845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c15d590 0x7faa9c0cfb70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7faa90009dc0 tx=0x7faa9002bf30 comp rx=0 tx=0).stop 2023-11-24T08:00:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7faaa4501640 1 -- 172.21.15.161:0/3488908845 shutdown_connections 2023-11-24T08:00:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7faaa4501640 1 --2- 172.21.15.161:0/3488908845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c15d590 0x7faa9c0cfb70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.748+0000 7faaa4501640 1 -- 172.21.15.161:0/3488908845 >> 172.21.15.161:0/3488908845 conn(0x7faa9c09c540 msgr2=0x7faa9c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6000abdb0 con 0x7fd610153950 2023-11-24T08:00:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f1241f4c640 1 -- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f123c15d380 msgr2=0x7f123c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f1241f4c640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f123c15d380 0x7f123c158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f1241f4c640 1 -- 172.21.15.161:0/1691005469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f123c15d760 msgr2=0x7f123c14d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f1241f4c640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f123c15d760 0x7f123c14d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7faaa4501640 1 -- 172.21.15.161:0/3488908845 shutdown_connections 2023-11-24T08:00:35.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7faaa4501640 1 -- 172.21.15.161:0/3488908845 wait complete. 2023-11-24T08:00:35.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7fd60e7fc640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd5fc06ae70 0x7fd5fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f1241f4c640 1 -- 172.21.15.161:0/1691005469 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009b30 con 0x7f123c0d0e80 2023-11-24T08:00:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f124274d640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f123c15d760 0x7f123c14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:00:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.751+0000 7f59837fe640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59840c1bc0 0x7f59840c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f5982ffd640 1 -- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59840c1bc0 msgr2=0x7f59840c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f5982ffd640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59840c1bc0 0x7f59840c2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f5982ffd640 1 -- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59840d00b0 msgr2=0x7f598415c0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T08:00:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f59827fc640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59840d00b0 0x7f598415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f1241f4c640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0b5ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c7f0 tx=0x7f122c00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f5982ffd640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59840d00b0 0x7f598415c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda8883640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda41fa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.752+0000 7f5982ffd640 1 -- 172.21.15.161:0/2969895643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c009b30 con 0x7f59840ce6f0 2023-11-24T08:00:35.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda8883640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40cf9a0 0x7fcda41f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda8883640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414b2c0 0x7fcda40cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda8883640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41fadd0 con 0x7fcda40cf9a0 2023-11-24T08:00:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda8883640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41fb0b0 con 0x7fcda414b2c0 2023-11-24T08:00:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7f5982ffd640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 0x7f59840c7740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f597c036040 tx=0x7f597c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7f59827fc640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59840d00b0 0x7f598415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda41fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda41fa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51618/0 (socket says 172.21.15.161:51618) 2023-11-24T08:00:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd30054760 con 0x7efd38153b40 2023-11-24T08:00:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7faaa4501640 1 Processor -- start 2023-11-24T08:00:35.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda259c640 1 -- 172.21.15.161:0/2929403044 learned_addr learned my addr 172.21.15.161:0/2929403044 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.753+0000 7fcda1d9b640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40cf9a0 0x7fcda41f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7fcda2d9d640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414b2c0 0x7fcda40cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41fb390 con 0x7fcda4070ea0 2023-11-24T08:00:35.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7faaa4501640 1 -- start start 2023-11-24T08:00:35.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c03e450 con 0x7f59840ce6f0 2023-11-24T08:00:35.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c03e5b0 con 0x7f59840ce6f0 2023-11-24T08:00:35.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c03e940 con 0x7f59840ce6f0 2023-11-24T08:00:35.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59840c2660 con 0x7f59840ce6f0 2023-11-24T08:00:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda1d9b640 1 -- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 msgr2=0x7fcda41fa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda1d9b640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda41fa4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda1d9b640 1 -- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414b2c0 msgr2=0x7fcda40cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda1d9b640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414b2c0 0x7fcda40cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.754+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59840c7220 con 0x7f59840ce6f0 2023-11-24T08:00:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda1d9b640 1 -- 172.21.15.161:0/2929403044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c009a70 con 0x7fcda40cf9a0 2023-11-24T08:00:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda259c640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda41fa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.755+0000 7fcda2d9d640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414b2c0 0x7fcda40cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.756+0000 7fcda1d9b640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40cf9a0 0x7fcda41f77f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d5f0 tx=0x7fcd9800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa4501640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa9c0ce8c0 0x7faa9c1f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.756+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59840c6030 con 0x7f59840ce6f0 2023-11-24T08:00:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd980125f0 con 0x7fcda40cf9a0 2023-11-24T08:00:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98012750 con 0x7fcda40cf9a0 2023-11-24T08:00:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98012b00 con 0x7fcda40cf9a0 2023-11-24T08:00:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7fd60e7fc640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd5fc06ae70 0x7fd5fc06d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a950 tx=0x7fd604008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa4501640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa9c15d590 0x7faa9c0c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa4501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 0x7faa9c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa4501640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c158610 con 0x7faa9c0ce8c0 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa4501640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c1588f0 con 0x7faa9c15d590 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa4501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9c158bd0 con 0x7faa9c0c9570 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7faaa229d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa9c0ce8c0 0x7faa9c1f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.757+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda41f6ff0 con 0x7fcda40cf9a0 2023-11-24T08:00:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.758+0000 7faaa2a9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 0x7faa9c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.758+0000 7faaa1a9c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa9c15d590 0x7faa9c0c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.758+0000 7faaa2a9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 0x7faa9c0b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51620/0 (socket says 172.21.15.161:51620) 2023-11-24T08:00:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.758+0000 7faaa2a9e640 1 -- 172.21.15.161:0/1864010729 learned_addr learned my addr 172.21.15.161:0/1864010729 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.758+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda41faa10 con 0x7fcda40cf9a0 2023-11-24T08:00:35.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa1a9c640 1 -- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 msgr2=0x7faa9c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa1a9c640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 0x7faa9c0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa1a9c640 1 -- 172.21.15.161:0/1864010729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa9c0ce8c0 msgr2=0x7faa9c1f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa1a9c640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa9c0ce8c0 0x7faa9c1f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa1a9c640 1 -- 172.21.15.161:0/1864010729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa90009a70 con 0x7faa9c15d590 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c004220 con 0x7f123c0d0e80 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c0043a0 con 0x7f123c0d0e80 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c007860 con 0x7f123c0d0e80 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0b1710 con 0x7f123c0d0e80 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c0b1cd0 con 0x7f123c0d0e80 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa2a9e640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 0x7faa9c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:35.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7faaa229d640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa9c0ce8c0 0x7faa9c1f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:00:35.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.759+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f597c02cd50 con 0x7f59840ce6f0 2023-11-24T08:00:35.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.760+0000 7f597b7fe640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f596406af10 0x7f596406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.761+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f597c0ac350 con 0x7f59840ce6f0 2023-11-24T08:00:35.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.761+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd600076fd0 con 0x7fd610153950 2023-11-24T08:00:35.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.761+0000 7faaa1a9c640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa9c15d590 0x7faa9c0c9030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa9c08d970 tx=0x7faa88001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.761+0000 7f59827fc640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f596406af10 0x7f596406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c0b1ef0 con 0x7f123c0d0e80 2023-11-24T08:00:35.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88005ce0 con 0x7faa9c15d590 2023-11-24T08:00:35.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88005e40 con 0x7faa9c15d590 2023-11-24T08:00:35.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa880072d0 con 0x7faa9c15d590 2023-11-24T08:00:35.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9c158eb0 con 0x7faa9c15d590 2023-11-24T08:00:35.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd98012c60 con 0x7fcda40cf9a0 2023-11-24T08:00:35.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9c0c8360 con 0x7faa9c15d590 2023-11-24T08:00:35.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.763+0000 7f59827fc640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f596406af10 0x7f596406d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f596c006fd0 tx=0x7f596c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.762+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda40675d0 con 0x7fcda40cf9a0 2023-11-24T08:00:35.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.764+0000 7fcd92ffd640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd8406ae90 0x7fcd8406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.765+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd980898e0 con 0x7fcda40cf9a0 2023-11-24T08:00:35.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.765+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9c0b63a0 con 0x7faa9c15d590 2023-11-24T08:00:35.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.765+0000 7fcda259c640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd8406ae90 0x7fcd8406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.766+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f122c007bd0 con 0x7f123c0d0e80 2023-11-24T08:00:35.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.767+0000 7fcda259c640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd8406ae90 0x7fcd8406d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd940011e0 tx=0x7fcd94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.767+0000 7f12327fc640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae90 0x7f122006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.767+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f122c089940 con 0x7f123c0d0e80 2023-11-24T08:00:35.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.768+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa88007430 con 0x7faa9c15d590 2023-11-24T08:00:35.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.769+0000 7f124174b640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae90 0x7f122006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.769+0000 7faa9affd640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8006af40 0x7faa8006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.769+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f597c077510 con 0x7f59840ce6f0 2023-11-24T08:00:35.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.769+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa880889a0 con 0x7faa9c15d590 2023-11-24T08:00:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.770+0000 7faaa229d640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8006af40 0x7faa8006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.770+0000 7f124174b640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae90 0x7f122006d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f123c073740 tx=0x7f1238009060 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.772+0000 7faaa229d640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8006af40 0x7faa8006d400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa90036000 tx=0x7faa90030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.777+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd98054b20 con 0x7fcda40cf9a0 2023-11-24T08:00:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.779+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f122c054b10 con 0x7f123c0d0e80 2023-11-24T08:00:35.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.783+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa88053b70 con 0x7faa9c15d590 2023-11-24T08:00:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.786+0000 7ff702cee640 1 Processor -- start 2023-11-24T08:00:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.786+0000 7ff702cee640 1 -- start start 2023-11-24T08:00:35.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.788+0000 7ff702cee640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc08a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.788+0000 7ff702cee640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6fc16e0c0 0x7ff6fc08a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff702cee640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0711b0 con 0x7ff6fc16dce0 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff702cee640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc071490 con 0x7ff6fc16e0c0 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff702cee640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc071770 con 0x7ff6fc070cd0 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff70128b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6fc16e0c0 0x7ff6fc08a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc08a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff70128b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff6fc16e0c0 0x7ff6fc08a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:49052/0 (socket says 172.21.15.161:49052) 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc08a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51630/0 (socket says 172.21.15.161:51630) 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.789+0000 7ff70128b640 1 -- 172.21.15.161:0/1598324558 learned_addr learned my addr 172.21.15.161:0/1598324558 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.790+0000 7ff70128b640 1 -- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 msgr2=0x7ff6fc08a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:35.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.790+0000 7ff70128b640 1 --2- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc08a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.790+0000 7ff70128b640 1 -- 172.21.15.161:0/1598324558 >> v1:172.21.15.175:6789/0 conn(0x7ff6fc16dce0 legacy=0x7ff6fc06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.790+0000 7ff70128b640 1 -- 172.21.15.161:0/1598324558 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc071a50 con 0x7ff6fc16e0c0 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.792+0000 7ff70128b640 1 --2- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc08a720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400bb00 tx=0x7ff6e402df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cb6185bdb1b73e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.793+0000 7ff6fb7fe640 1 -- 172.21.15.161:0/1598324558 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e402ed00 con 0x7ff6fc16e0c0 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.793+0000 7ff6fb7fe640 1 -- 172.21.15.161:0/1598324558 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e4032070 con 0x7ff6fc16e0c0 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.793+0000 7ff6fb7fe640 1 -- 172.21.15.161:0/1598324558 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e402eea0 con 0x7ff6fc16e0c0 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.796+0000 7ff702cee640 1 -- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 msgr2=0x7ff6fc08a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.796+0000 7ff702cee640 1 --2- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc08a720 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6e400bb00 tx=0x7ff6e402df50 comp rx=0 tx=0).stop 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.797+0000 7ff702cee640 1 -- 172.21.15.161:0/1598324558 shutdown_connections 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.797+0000 7ff702cee640 1 --2- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc08a720 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.797+0000 7ff702cee640 1 --2- 172.21.15.161:0/1598324558 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc08a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.797+0000 7ff702cee640 1 -- 172.21.15.161:0/1598324558 >> 172.21.15.161:0/1598324558 conn(0x7ff6fc0b0be0 msgr2=0x7ff6fc0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.797+0000 7ff702cee640 1 -- 172.21.15.161:0/1598324558 shutdown_connections 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.797+0000 7ff702cee640 1 -- 172.21.15.161:0/1598324558 wait complete. 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.800+0000 7ff702cee640 1 Processor -- start 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.801+0000 7ff702cee640 1 -- start start 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.803+0000 7ff702cee640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.803+0000 7ff702cee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 0x7ff6fc0aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.803+0000 7ff700a8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.803+0000 7ff700a8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51640/0 (socket says 172.21.15.161:51640) 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff702cee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc0ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff702cee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0ae370 con 0x7ff6fc16dce0 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff702cee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1f49d0 con 0x7ff6fc16e0c0 2023-11-24T08:00:35.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff702cee640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0ae090 con 0x7ff6fc070cd0 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 0x7ff6fc0aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff6fbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 0x7ff6fc0aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56864/0 (socket says 172.21.15.161:56864) 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff6fbfff640 1 -- 172.21.15.161:0/404053259 learned_addr learned my addr 172.21.15.161:0/404053259 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.804+0000 7ff70128b640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc0ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.805+0000 7ff6fbfff640 1 -- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 msgr2=0x7ff6fc1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.805+0000 7ff6fbfff640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.805+0000 7ff6fbfff640 1 -- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 msgr2=0x7ff6fc0ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.805+0000 7ff6fbfff640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc0ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.805+0000 7ff6fbfff640 1 -- 172.21.15.161:0/404053259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e400b760 con 0x7ff6fc16dce0 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.805+0000 7ff6fbfff640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 0x7ff6fc0aad80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec007f20 tx=0x7ff6ec00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.806+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec014620 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.806+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec014780 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.806+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec014b30 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.807+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc1f4380 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.808+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc169c60 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.809+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc1f4b60 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.812+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff6ec014c90 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.813+0000 7ff6f97fa640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff6dc06af10 0x7ff6dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.814+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6ec089de0 con 0x7ff6fc16dce0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.814+0000 7ff700a8a640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff6dc06af10 0x7ff6dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.815+0000 7ff700a8a640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff6dc06af10 0x7ff6dc06d3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0cd860 tx=0x7ff6f4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:35.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:35.821+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff6ec054fb0 con 0x7ff6fc16dce0 2023-11-24T08:00:36.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.115+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe178005500 con 0x7fe1940b33e0 2023-11-24T08:00:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.116+0000 7fe182ffd640 1 -- 172.21.15.161:0/1231557100 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1840765e0 con 0x7fe1940b33e0 2023-11-24T08:00:36.119 INFO:teuthology.orchestra.run.smithi161.stdout:60129542150 2023-11-24T08:00:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.121+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe17406aea0 msgr2=0x7fe17406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.121+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe17406aea0 0x7fe17406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe194155710 tx=0x7fe188017040 comp rx=0 tx=0).stop 2023-11-24T08:00:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.121+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1940b33e0 msgr2=0x7fe194158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.121+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1940b33e0 0x7fe194158120 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe184035000 tx=0x7fe1840046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.121+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 shutdown_connections 2023-11-24T08:00:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.122+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe17406aea0 0x7fe17406d360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.122+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe194153680 0x7fe194158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.122+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1940b33e0 0x7fe194158120 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.122+0000 7fe19359e640 1 --2- 172.21.15.161:0/1231557100 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe19406e0f0 0x7fe194148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.122+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 >> 172.21.15.161:0/1231557100 conn(0x7fe1940b0a90 msgr2=0x7fe1940b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.122+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 shutdown_connections 2023-11-24T08:00:36.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.123+0000 7fe19359e640 1 -- 172.21.15.161:0/1231557100 wait complete. 2023-11-24T08:00:36.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2023-11-24T08:00:36.153 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.164+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faa9c158a30 con 0x7faa9c15d590 2023-11-24T08:00:36.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.165+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efd38156090 con 0x7efd38153b40 2023-11-24T08:00:36.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.165+0000 7faa9affd640 1 -- 172.21.15.161:0/1864010729 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa9c158a30 con 0x7faa9c15d590 2023-11-24T08:00:36.169 INFO:teuthology.orchestra.run.smithi161.stdout:64424509447 2023-11-24T08:00:36.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.166+0000 7efd36ffd640 1 -- 172.21.15.161:0/2578750577 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd30057d80 con 0x7efd38153b40 2023-11-24T08:00:36.170 INFO:teuthology.orchestra.run.smithi161.stdout:64424509446 2023-11-24T08:00:36.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8006af40 msgr2=0x7faa8006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8006af40 0x7faa8006d400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa90036000 tx=0x7faa90030000 comp rx=0 tx=0).stop 2023-11-24T08:00:36.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa9c15d590 msgr2=0x7faa9c0c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa9c15d590 0x7faa9c0c9030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa9c08d970 tx=0x7faa88001e70 comp rx=0 tx=0).stop 2023-11-24T08:00:36.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 shutdown_connections 2023-11-24T08:00:36.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8006af40 0x7faa8006d400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa9c0c9570 0x7faa9c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa9c15d590 0x7faa9c0c9030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 --2- 172.21.15.161:0/1864010729 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa9c0ce8c0 0x7faa9c1f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 >> 172.21.15.161:0/1864010729 conn(0x7faa9c09c540 msgr2=0x7faa9c0b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd1c06af10 msgr2=0x7efd1c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd1c06af10 0x7efd1c06d3d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efd2c0012e0 tx=0x7efd2c001960 comp rx=0 tx=0).stop 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd38153b40 msgr2=0x7efd38148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd38153b40 0x7efd38148170 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efd3000c590 tx=0x7efd3000ca50 comp rx=0 tx=0).stop 2023-11-24T08:00:36.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 shutdown_connections 2023-11-24T08:00:36.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 shutdown_connections 2023-11-24T08:00:36.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd1c06af10 0x7efd1c06d3d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd38153b40 0x7efd38148170 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd381536e0 0x7efd380c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7efd4046b640 1 --2- 172.21.15.161:0/2578750577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd380b16d0 0x7efd380ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.171+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 >> 172.21.15.161:0/2578750577 conn(0x7efd380b0be0 msgr2=0x7efd380b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.170+0000 7faaa4501640 1 -- 172.21.15.161:0/1864010729 wait complete. 2023-11-24T08:00:36.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.171+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 shutdown_connections 2023-11-24T08:00:36.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.171+0000 7efd4046b640 1 -- 172.21.15.161:0/2578750577 wait complete. 2023-11-24T08:00:36.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.172+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd61014b670 con 0x7fd610153950 2023-11-24T08:00:36.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.173+0000 7fd5f77fe640 1 -- 172.21.15.161:0/4022693014 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd61014b670 con 0x7fd610153950 2023-11-24T08:00:36.177 INFO:teuthology.orchestra.run.smithi161.stdout:64424509445 2023-11-24T08:00:36.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.176+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f59840c7440 con 0x7f59840ce6f0 2023-11-24T08:00:36.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.177+0000 7f597b7fe640 1 -- 172.21.15.161:0/2969895643 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f597c07ab30 con 0x7f59840ce6f0 2023-11-24T08:00:36.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.177+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd5fc06ae70 msgr2=0x7fd5fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.177+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd5fc06ae70 0x7fd5fc06d330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a950 tx=0x7fd604008040 comp rx=0 tx=0).stop 2023-11-24T08:00:36.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.177+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 msgr2=0x7fd6101f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.177+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 0x7fd6101f7020 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd600000c00 tx=0x7fd6000046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.182 INFO:teuthology.orchestra.run.smithi161.stdout:64424509445 2023-11-24T08:00:36.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 shutdown_connections 2023-11-24T08:00:36.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd5fc06ae70 0x7fd5fc06d330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd61015ce90 0x7fd610151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd6101598a0 0x7fd610149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 --2- 172.21.15.161:0/4022693014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd610153950 0x7fd6101f7020 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 >> 172.21.15.161:0/4022693014 conn(0x7fd6100b0be0 msgr2=0x7fd610158090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 shutdown_connections 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.180+0000 7fd6155b0640 1 -- 172.21.15.161:0/4022693014 wait complete. 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.181+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f596406af10 msgr2=0x7f596406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.181+0000 7f598930f640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f596406af10 0x7f596406d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f596c006fd0 tx=0x7f596c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.181+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 msgr2=0x7f59840c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.181+0000 7f598930f640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 0x7f59840c7740 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f597c036040 tx=0x7f597c004a40 comp rx=0 tx=0).stop 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 shutdown_connections 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f596406af10 0x7f596406d3d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59840c1bc0 0x7f59840c2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59840d00b0 0x7f598415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 --2- 172.21.15.161:0/2969895643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59840ce6f0 0x7f59840c7740 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 >> 172.21.15.161:0/2969895643 conn(0x7f598409c540 msgr2=0x7f598415fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 shutdown_connections 2023-11-24T08:00:36.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.183+0000 7f598930f640 1 -- 172.21.15.161:0/2969895643 wait complete. 2023-11-24T08:00:36.194 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.6 2023-11-24T08:00:36.194 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.194+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcda40cf230 con 0x7fcda40cf9a0 2023-11-24T08:00:36.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.195+0000 7fcd92ffd640 1 -- 172.21.15.161:0/2929403044 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcd98058140 con 0x7fcda40cf9a0 2023-11-24T08:00:36.197 INFO:teuthology.orchestra.run.smithi161.stdout:60129542151 2023-11-24T08:00:36.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.196+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f123c067640 con 0x7f123c0d0e80 2023-11-24T08:00:36.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.197+0000 7f12327fc640 1 -- 172.21.15.161:0/1691005469 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f122c01e090 con 0x7f123c0d0e80 2023-11-24T08:00:36.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd8406ae90 msgr2=0x7fcd8406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd8406ae90 0x7fcd8406d350 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcd940011e0 tx=0x7fcd94009040 comp rx=0 tx=0).stop 2023-11-24T08:00:36.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40cf9a0 msgr2=0x7fcda41f77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40cf9a0 0x7fcda41f77f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800d5f0 tx=0x7fcd9800dab0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.200 INFO:teuthology.orchestra.run.smithi161.stdout:60129542149 2023-11-24T08:00:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 shutdown_connections 2023-11-24T08:00:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd8406ae90 0x7fcd8406d350 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcda414b2c0 0x7fcda40cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcda40cf9a0 0x7fcda41f77f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 --2- 172.21.15.161:0/2929403044 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcda4070ea0 0x7fcda41fa4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.198+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 >> 172.21.15.161:0/2929403044 conn(0x7fcda406a800 msgr2=0x7fcda406d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.3 2023-11-24T08:00:36.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.199+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 shutdown_connections 2023-11-24T08:00:36.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.199+0000 7fcda8883640 1 -- 172.21.15.161:0/2929403044 wait complete. 2023-11-24T08:00:36.203 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae90 msgr2=0x7f122006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae90 0x7f122006d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f123c073740 tx=0x7f1238009060 comp rx=0 tx=0).stop 2023-11-24T08:00:36.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 msgr2=0x7f123c0b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0b5ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c7f0 tx=0x7f122c00ccb0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 shutdown_connections 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae90 0x7f122006d350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f123c15d760 0x7f123c14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f123c15d380 0x7f123c158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 --2- 172.21.15.161:0/1691005469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f123c0d0e80 0x7f123c0b5ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.201+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 >> 172.21.15.161:0/1691005469 conn(0x7f123c08ccf0 msgr2=0x7f123c15be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.202+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 shutdown_connections 2023-11-24T08:00:36.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.202+0000 7f12441b0640 1 -- 172.21.15.161:0/1691005469 wait complete. 2023-11-24T08:00:36.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.2 2023-11-24T08:00:36.209 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509445 for osd.5 2023-11-24T08:00:36.210 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2023-11-24T08:00:36.221 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2023-11-24T08:00:36.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.219+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff6fc0675d0 con 0x7ff6fc16dce0 2023-11-24T08:00:36.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.220+0000 7ff6f97fa640 1 -- 172.21.15.161:0/404053259 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6ec0585d0 con 0x7ff6fc16dce0 2023-11-24T08:00:36.223 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.223 INFO:teuthology.orchestra.run.smithi161.stdout:64424509447 2023-11-24T08:00:36.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff6dc06af10 msgr2=0x7ff6dc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff6dc06af10 0x7ff6dc06d3d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0cd860 tx=0x7ff6f4009040 comp rx=0 tx=0).stop 2023-11-24T08:00:36.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 msgr2=0x7ff6fc0aad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 0x7ff6fc0aad80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec007f20 tx=0x7ff6ec00e570 comp rx=0 tx=0).stop 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 shutdown_connections 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff6dc06af10 0x7ff6dc06d3d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff6fc16e0c0 0x7ff6fc0ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6fc16dce0 0x7ff6fc0aad80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 --2- 172.21.15.161:0/404053259 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff6fc070cd0 0x7ff6fc1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 >> 172.21.15.161:0/404053259 conn(0x7ff6fc0b0be0 msgr2=0x7ff6fc0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 shutdown_connections 2023-11-24T08:00:36.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.222+0000 7ff702cee640 1 -- 172.21.15.161:0/404053259 wait complete. 2023-11-24T08:00:36.241 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.7 2023-11-24T08:00:36.241 DEBUG:teuthology.parallel:result is None 2023-11-24T08:00:36.241 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:00:36.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:00:36.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.494+0000 7fb241abb640 1 Processor -- start 2023-11-24T08:00:36.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.494+0000 7fb241abb640 1 -- start start 2023-11-24T08:00:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb241abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c143ae0 0x7fb23c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb241abb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb23c0cf7d0 0x7fb23c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb241abb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb23c15e1e0 0x7fb23c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb241abb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0cfc30 con 0x7fb23c15e1e0 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb241abb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c0b1ee0 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb241abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0b2780 con 0x7fb23c143ae0 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb23c15e1e0 0x7fb23c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb23c15e1e0 0x7fb23c15a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56868/0 (socket says 172.21.15.161:56868) 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 -- 172.21.15.161:0/1095932669 learned_addr learned my addr 172.21.15.161:0/1095932669 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23b7fe640 1 --2- 172.21.15.161:0/1095932669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c143ae0 0x7fb23c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb233fff640 1 --2- 172.21.15.161:0/1095932669 >> v2:172.21.15.175:3300/0 conn(0x7fb23c0cf7d0 0x7fb23c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 -- 172.21.15.161:0/1095932669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c143ae0 msgr2=0x7fb23c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:36.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 --2- 172.21.15.161:0/1095932669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c143ae0 0x7fb23c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 -- 172.21.15.161:0/1095932669 >> v2:172.21.15.175:3300/0 conn(0x7fb23c0cf7d0 msgr2=0x7fb23c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:36.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 --2- 172.21.15.161:0/1095932669 >> v2:172.21.15.175:3300/0 conn(0x7fb23c0cf7d0 0x7fb23c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb23bfff640 1 -- 172.21.15.161:0/1095932669 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c15e990 con 0x7fb23c15e1e0 2023-11-24T08:00:36.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.496+0000 7fb233fff640 1 --2- 172.21.15.161:0/1095932669 >> v2:172.21.15.175:3300/0 conn(0x7fb23c0cf7d0 0x7fb23c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:36.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.497+0000 7fb23bfff640 1 --2- 172.21.15.161:0/1095932669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c15e1e0 0x7fb23c15a670 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb23c06e350 tx=0x7fb23402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4902133d2a9a960 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:36.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb23affd640 1 -- 172.21.15.161:0/1095932669 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23402ca70 con 0x7fb23c15e1e0 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb23affd640 1 -- 172.21.15.161:0/1095932669 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23402cbd0 con 0x7fb23c15e1e0 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb23affd640 1 -- 172.21.15.161:0/1095932669 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2340343f0 con 0x7fb23c15e1e0 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 -- 172.21.15.161:0/1095932669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c15e1e0 msgr2=0x7fb23c15a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 --2- 172.21.15.161:0/1095932669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c15e1e0 0x7fb23c15a670 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb23c06e350 tx=0x7fb23402bed0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 -- 172.21.15.161:0/1095932669 shutdown_connections 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 --2- 172.21.15.161:0/1095932669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c15e1e0 0x7fb23c15a670 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 --2- 172.21.15.161:0/1095932669 >> v2:172.21.15.175:3300/0 conn(0x7fb23c0cf7d0 0x7fb23c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 --2- 172.21.15.161:0/1095932669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c143ae0 0x7fb23c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 -- 172.21.15.161:0/1095932669 >> 172.21.15.161:0/1095932669 conn(0x7fb23c06a800 msgr2=0x7fb23c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 -- 172.21.15.161:0/1095932669 shutdown_connections 2023-11-24T08:00:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.498+0000 7fb241abb640 1 -- 172.21.15.161:0/1095932669 wait complete. 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.500+0000 7fb241abb640 1 Processor -- start 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.500+0000 7fb241abb640 1 -- start start 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb241abb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 0x7fb23c1f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb241abb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb23c143ae0 0x7fb23c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb241abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c15e1e0 0x7fb23c0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb241abb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c1f7240 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb241abb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0ad810 con 0x7fb23c143ae0 2023-11-24T08:00:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb241abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c0acc00 con 0x7fb23c15e1e0 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb23b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 0x7fb23c1f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb23b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 0x7fb23c1f6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56874/0 (socket says 172.21.15.161:56874) 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.501+0000 7fb23b7fe640 1 -- 172.21.15.161:0/4048722211 learned_addr learned my addr 172.21.15.161:0/4048722211 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb233fff640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb23c143ae0 0x7fb23c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb23b7fe640 1 -- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c15e1e0 msgr2=0x7fb23c0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb23b7fe640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c15e1e0 0x7fb23c0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb23b7fe640 1 -- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb23c143ae0 msgr2=0x7fb23c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb23b7fe640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb23c143ae0 0x7fb23c159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb23b7fe640 1 -- 172.21.15.161:0/4048722211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb234009b30 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb23b7fe640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 0x7fb23c1f6d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c820 tx=0x7fb22c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c004220 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c004380 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c007a70 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c0acee0 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.502+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c0ad4a0 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.503+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c071200 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.504+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb22c007bd0 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.505+0000 7fb238ff9640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb21c06ae40 0x7fb21c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.506+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb22c0893e0 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.506+0000 7fb233fff640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb21c06ae40 0x7fb21c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.507+0000 7fb233fff640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb21c06ae40 0x7fb21c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb224006fd0 tx=0x7fb224008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:36.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.510+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb22c054480 con 0x7fb23c0cf7d0 2023-11-24T08:00:36.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.686+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb23c15e640 con 0x7fb21c06ae40 2023-11-24T08:00:36.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.708+0000 7fb238ff9640 1 -- 172.21.15.161:0/4048722211 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264341 (secure 0 0 0) 0x7fb22400c040 con 0x7fb21c06ae40 2023-11-24T08:00:36.714 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:36.716 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:00:36.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb21c06ae40 msgr2=0x7fb21c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb21c06ae40 0x7fb21c06d300 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb224006fd0 tx=0x7fb224008040 comp rx=0 tx=0).stop 2023-11-24T08:00:36.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 msgr2=0x7fb23c1f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 0x7fb23c1f6d00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00c820 tx=0x7fb22c00cce0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 shutdown_connections 2023-11-24T08:00:36.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb21c06ae40 0x7fb21c06d300 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb23c15e1e0 0x7fb23c0cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb23c143ae0 0x7fb23c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 --2- 172.21.15.161:0/4048722211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb23c0cf7d0 0x7fb23c1f6d00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 >> 172.21.15.161:0/4048722211 conn(0x7fb23c06a800 msgr2=0x7fb23c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 shutdown_connections 2023-11-24T08:00:36.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.713+0000 7fb241abb640 1 -- 172.21.15.161:0/4048722211 wait complete. 2023-11-24T08:00:36.734 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-24T08:00:36.529394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219124,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":3022848,"data_stored":1802996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.800942"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174603+0000","last_change":"2023-11-24T08:00:26.768948+0000","last_active":"2023-11-24T08:00:28.174603+0000","last_peered":"2023-11-24T08:00:28.174603+0000","last_clean":"2023-11-24T08:00:28.174603+0000","last_became_active":"2023-11-24T08:00:26.768601+0000","last_became_peered":"2023-11-24T08:00:26.768601+0000","last_unstale":"2023-11-24T08:00:28.174603+0000","last_undegraded":"2023-11-24T08:00:28.174603+0000","last_fullsized":"2023-11-24T08:00:28.174603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765866+0000","last_change":"2023-11-24T08:00:26.766088+0000","last_active":"2023-11-24T08:00:27.765866+0000","last_peered":"2023-11-24T08:00:27.765866+0000","last_clean":"2023-11-24T08:00:27.765866+0000","last_became_active":"2023-11-24T08:00:26.765786+0000","last_became_peered":"2023-11-24T08:00:26.765786+0000","last_unstale":"2023-11-24T08:00:27.765866+0000","last_undegraded":"2023-11-24T08:00:27.765866+0000","last_fullsized":"2023-11-24T08:00:27.765866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:15.798578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173544+0000","last_change":"2023-11-24T08:00:26.762423+0000","last_active":"2023-11-24T08:00:28.173544+0000","last_peered":"2023-11-24T08:00:28.173544+0000","last_clean":"2023-11-24T08:00:28.173544+0000","last_became_active":"2023-11-24T08:00:26.760624+0000","last_became_peered":"2023-11-24T08:00:26.760624+0000","last_unstale":"2023-11-24T08:00:28.173544+0000","last_undegraded":"2023-11-24T08:00:28.173544+0000","last_fullsized":"2023-11-24T08:00:28.173544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:43.741603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768385+0000","last_change":"2023-11-24T08:00:26.777163+0000","last_active":"2023-11-24T08:00:27.768385+0000","last_peered":"2023-11-24T08:00:27.768385+0000","last_clean":"2023-11-24T08:00:27.768385+0000","last_became_active":"2023-11-24T08:00:26.776740+0000","last_became_peered":"2023-11-24T08:00:26.776740+0000","last_unstale":"2023-11-24T08:00:27.768385+0000","last_undegraded":"2023-11-24T08:00:27.768385+0000","last_fullsized":"2023-11-24T08:00:27.768385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173729+0000","last_change":"2023-11-24T08:00:26.763129+0000","last_active":"2023-11-24T08:00:28.173729+0000","last_peered":"2023-11-24T08:00:28.173729+0000","last_clean":"2023-11-24T08:00:28.173729+0000","last_became_active":"2023-11-24T08:00:26.762767+0000","last_became_peered":"2023-11-24T08:00:26.762767+0000","last_unstale":"2023-11-24T08:00:28.173729+0000","last_undegraded":"2023-11-24T08:00:28.173729+0000","last_fullsized":"2023-11-24T08:00:28.173729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768358+0000","last_change":"2023-11-24T08:00:26.772489+0000","last_active":"2023-11-24T08:00:27.768358+0000","last_peered":"2023-11-24T08:00:27.768358+0000","last_clean":"2023-11-24T08:00:27.768358+0000","last_became_active":"2023-11-24T08:00:26.769412+0000","last_became_peered":"2023-11-24T08:00:26.769412+0000","last_unstale":"2023-11-24T08:00:27.768358+0000","last_undegraded":"2023-11-24T08:00:27.768358+0000","last_fullsized":"2023-11-24T08:00:27.768358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172502+0000","last_change":"2023-11-24T08:00:26.771569+0000","last_active":"2023-11-24T08:00:28.172502+0000","last_peered":"2023-11-24T08:00:28.172502+0000","last_clean":"2023-11-24T08:00:28.172502+0000","last_became_active":"2023-11-24T08:00:26.771170+0000","last_became_peered":"2023-11-24T08:00:26.771170+0000","last_unstale":"2023-11-24T08:00:28.172502+0000","last_undegraded":"2023-11-24T08:00:28.172502+0000","last_fullsized":"2023-11-24T08:00:28.172502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172266+0000","last_change":"2023-11-24T08:00:26.770049+0000","last_active":"2023-11-24T08:00:28.172266+0000","last_peered":"2023-11-24T08:00:28.172266+0000","last_clean":"2023-11-24T08:00:28.172266+0000","last_became_active":"2023-11-24T08:00:26.769256+0000","last_became_peered":"2023-11-24T08:00:26.769256+0000","last_unstale":"2023-11-24T08:00:28.172266+0000","last_undegraded":"2023-11-24T08:00:28.172266+0000","last_fullsized":"2023-11-24T08:00:28.172266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174837+0000","last_change":"2023-11-24T08:00:26.782744+0000","last_active":"2023-11-24T08:00:28.174837+0000","last_peered":"2023-11-24T08:00:28.174837+0000","last_clean":"2023-11-24T08:00:28.174837+0000","last_became_active":"2023-11-24T08:00:26.780825+0000","last_became_peered":"2023-11-24T08:00:26.780825+0000","last_unstale":"2023-11-24T08:00:28.174837+0000","last_undegraded":"2023-11-24T08:00:28.174837+0000","last_fullsized":"2023-11-24T08:00:28.174837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:26.750802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768128+0000","last_change":"2023-11-24T08:00:26.771369+0000","last_active":"2023-11-24T08:00:27.768128+0000","last_peered":"2023-11-24T08:00:27.768128+0000","last_clean":"2023-11-24T08:00:27.768128+0000","last_became_active":"2023-11-24T08:00:26.769019+0000","last_became_peered":"2023-11-24T08:00:26.769019+0000","last_unstale":"2023-11-24T08:00:27.768128+0000","last_undegraded":"2023-11-24T08:00:27.768128+0000","last_fullsized":"2023-11-24T08:00:27.768128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768021+0000","last_change":"2023-11-24T08:00:26.768671+0000","last_active":"2023-11-24T08:00:27.768021+0000","last_peered":"2023-11-24T08:00:27.768021+0000","last_clean":"2023-11-24T08:00:27.768021+0000","last_became_active":"2023-11-24T08:00:26.768353+0000","last_became_peered":"2023-11-24T08:00:26.768353+0000","last_unstale":"2023-11-24T08:00:27.768021+0000","last_undegraded":"2023-11-24T08:00:27.768021+0000","last_fullsized":"2023-11-24T08:00:27.768021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172934+0000","last_change":"2023-11-24T08:00:26.749810+0000","last_active":"2023-11-24T08:00:28.172934+0000","last_peered":"2023-11-24T08:00:28.172934+0000","last_clean":"2023-11-24T08:00:28.172934+0000","last_became_active":"2023-11-24T08:00:26.749245+0000","last_became_peered":"2023-11-24T08:00:26.749245+0000","last_unstale":"2023-11-24T08:00:28.172934+0000","last_undegraded":"2023-11-24T08:00:28.172934+0000","last_fullsized":"2023-11-24T08:00:28.172934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:05.561300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174534+0000","last_change":"2023-11-24T08:00:26.765178+0000","last_active":"2023-11-24T08:00:28.174534+0000","last_peered":"2023-11-24T08:00:28.174534+0000","last_clean":"2023-11-24T08:00:28.174534+0000","last_became_active":"2023-11-24T08:00:26.764424+0000","last_became_peered":"2023-11-24T08:00:26.764424+0000","last_unstale":"2023-11-24T08:00:28.174534+0000","last_undegraded":"2023-11-24T08:00:28.174534+0000","last_fullsized":"2023-11-24T08:00:28.174534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171916+0000","last_change":"2023-11-24T08:00:26.764196+0000","last_active":"2023-11-24T08:00:28.171916+0000","last_peered":"2023-11-24T08:00:28.171916+0000","last_clean":"2023-11-24T08:00:28.171916+0000","last_became_active":"2023-11-24T08:00:26.763658+0000","last_became_peered":"2023-11-24T08:00:26.763658+0000","last_unstale":"2023-11-24T08:00:28.171916+0000","last_undegraded":"2023-11-24T08:00:28.171916+0000","last_fullsized":"2023-11-24T08:00:28.171916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:21.367690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765068+0000","last_change":"2023-11-24T08:00:26.756725+0000","last_active":"2023-11-24T08:00:27.765068+0000","last_peered":"2023-11-24T08:00:27.765068+0000","last_clean":"2023-11-24T08:00:27.765068+0000","last_became_active":"2023-11-24T08:00:26.755826+0000","last_became_peered":"2023-11-24T08:00:26.755826+0000","last_unstale":"2023-11-24T08:00:27.765068+0000","last_undegraded":"2023-11-24T08:00:27.765068+0000","last_fullsized":"2023-11-24T08:00:27.765068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:34.349090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767981+0000","last_change":"2023-11-24T08:00:26.765661+0000","last_active":"2023-11-24T08:00:27.767981+0000","last_peered":"2023-11-24T08:00:27.767981+0000","last_clean":"2023-11-24T08:00:27.767981+0000","last_became_active":"2023-11-24T08:00:26.765342+0000","last_became_peered":"2023-11-24T08:00:26.765342+0000","last_unstale":"2023-11-24T08:00:27.767981+0000","last_undegraded":"2023-11-24T08:00:27.767981+0000","last_fullsized":"2023-11-24T08:00:27.767981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769287+0000","last_change":"2023-11-24T08:00:26.775973+0000","last_active":"2023-11-24T08:00:27.769287+0000","last_peered":"2023-11-24T08:00:27.769287+0000","last_clean":"2023-11-24T08:00:27.769287+0000","last_became_active":"2023-11-24T08:00:26.775605+0000","last_became_peered":"2023-11-24T08:00:26.775605+0000","last_unstale":"2023-11-24T08:00:27.769287+0000","last_undegraded":"2023-11-24T08:00:27.769287+0000","last_fullsized":"2023-11-24T08:00:27.769287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171624+0000","last_change":"2023-11-24T08:00:26.759204+0000","last_active":"2023-11-24T08:00:28.171624+0000","last_peered":"2023-11-24T08:00:28.171624+0000","last_clean":"2023-11-24T08:00:28.171624+0000","last_became_active":"2023-11-24T08:00:26.758953+0000","last_became_peered":"2023-11-24T08:00:26.758953+0000","last_unstale":"2023-11-24T08:00:28.171624+0000","last_undegraded":"2023-11-24T08:00:28.171624+0000","last_fullsized":"2023-11-24T08:00:28.171624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:13.212470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174627+0000","last_change":"2023-11-24T08:00:26.763759+0000","last_active":"2023-11-24T08:00:28.174627+0000","last_peered":"2023-11-24T08:00:28.174627+0000","last_clean":"2023-11-24T08:00:28.174627+0000","last_became_active":"2023-11-24T08:00:26.763404+0000","last_became_peered":"2023-11-24T08:00:26.763404+0000","last_unstale":"2023-11-24T08:00:28.174627+0000","last_undegraded":"2023-11-24T08:00:28.174627+0000","last_fullsized":"2023-11-24T08:00:28.174627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767389+0000","last_change":"2023-11-24T08:00:26.755257+0000","last_active":"2023-11-24T08:00:27.767389+0000","last_peered":"2023-11-24T08:00:27.767389+0000","last_clean":"2023-11-24T08:00:27.767389+0000","last_became_active":"2023-11-24T08:00:26.754494+0000","last_became_peered":"2023-11-24T08:00:26.754494+0000","last_unstale":"2023-11-24T08:00:27.767389+0000","last_undegraded":"2023-11-24T08:00:27.767389+0000","last_fullsized":"2023-11-24T08:00:27.767389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172553+0000","last_change":"2023-11-24T08:00:26.768879+0000","last_active":"2023-11-24T08:00:28.172553+0000","last_peered":"2023-11-24T08:00:28.172553+0000","last_clean":"2023-11-24T08:00:28.172553+0000","last_became_active":"2023-11-24T08:00:26.768610+0000","last_became_peered":"2023-11-24T08:00:26.768610+0000","last_unstale":"2023-11-24T08:00:28.172553+0000","last_undegraded":"2023-11-24T08:00:28.172553+0000","last_fullsized":"2023-11-24T08:00:28.172553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:37.160020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768724+0000","last_change":"2023-11-24T08:00:26.772226+0000","last_active":"2023-11-24T08:00:27.768724+0000","last_peered":"2023-11-24T08:00:27.768724+0000","last_clean":"2023-11-24T08:00:27.768724+0000","last_became_active":"2023-11-24T08:00:26.769115+0000","last_became_peered":"2023-11-24T08:00:26.769115+0000","last_unstale":"2023-11-24T08:00:27.768724+0000","last_undegraded":"2023-11-24T08:00:27.768724+0000","last_fullsized":"2023-11-24T08:00:27.768724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173030+0000","last_change":"2023-11-24T08:00:26.763479+0000","last_active":"2023-11-24T08:00:28.173030+0000","last_peered":"2023-11-24T08:00:28.173030+0000","last_clean":"2023-11-24T08:00:28.173030+0000","last_became_active":"2023-11-24T08:00:26.763174+0000","last_became_peered":"2023-11-24T08:00:26.763174+0000","last_unstale":"2023-11-24T08:00:28.173030+0000","last_undegraded":"2023-11-24T08:00:28.173030+0000","last_fullsized":"2023-11-24T08:00:28.173030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768104+0000","last_change":"2023-11-24T08:00:26.765894+0000","last_active":"2023-11-24T08:00:27.768104+0000","last_peered":"2023-11-24T08:00:27.768104+0000","last_clean":"2023-11-24T08:00:27.768104+0000","last_became_active":"2023-11-24T08:00:26.764976+0000","last_became_peered":"2023-11-24T08:00:26.764976+0000","last_unstale":"2023-11-24T08:00:27.768104+0000","last_undegraded":"2023-11-24T08:00:27.768104+0000","last_fullsized":"2023-11-24T08:00:27.768104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175290+0000","last_change":"2023-11-24T08:00:26.768006+0000","last_active":"2023-11-24T08:00:28.175290+0000","last_peered":"2023-11-24T08:00:28.175290+0000","last_clean":"2023-11-24T08:00:28.175290+0000","last_became_active":"2023-11-24T08:00:26.767556+0000","last_became_peered":"2023-11-24T08:00:26.767556+0000","last_unstale":"2023-11-24T08:00:28.175290+0000","last_undegraded":"2023-11-24T08:00:28.175290+0000","last_fullsized":"2023-11-24T08:00:28.175290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768993+0000","last_change":"2023-11-24T08:00:26.758837+0000","last_active":"2023-11-24T08:00:27.768993+0000","last_peered":"2023-11-24T08:00:27.768993+0000","last_clean":"2023-11-24T08:00:27.768993+0000","last_became_active":"2023-11-24T08:00:26.758557+0000","last_became_peered":"2023-11-24T08:00:26.758557+0000","last_unstale":"2023-11-24T08:00:27.768993+0000","last_undegraded":"2023-11-24T08:00:27.768993+0000","last_fullsized":"2023-11-24T08:00:27.768993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765777+0000","last_change":"2023-11-24T08:00:26.759241+0000","last_active":"2023-11-24T08:00:27.765777+0000","last_peered":"2023-11-24T08:00:27.765777+0000","last_clean":"2023-11-24T08:00:27.765777+0000","last_became_active":"2023-11-24T08:00:26.758911+0000","last_became_peered":"2023-11-24T08:00:26.758911+0000","last_unstale":"2023-11-24T08:00:27.765777+0000","last_undegraded":"2023-11-24T08:00:27.765777+0000","last_fullsized":"2023-11-24T08:00:27.765777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:46.400061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174708+0000","last_change":"2023-11-24T08:00:26.765218+0000","last_active":"2023-11-24T08:00:28.174708+0000","last_peered":"2023-11-24T08:00:28.174708+0000","last_clean":"2023-11-24T08:00:28.174708+0000","last_became_active":"2023-11-24T08:00:26.763830+0000","last_became_peered":"2023-11-24T08:00:26.763830+0000","last_unstale":"2023-11-24T08:00:28.174708+0000","last_undegraded":"2023-11-24T08:00:28.174708+0000","last_fullsized":"2023-11-24T08:00:28.174708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173620+0000","last_change":"2023-11-24T08:00:26.765008+0000","last_active":"2023-11-24T08:00:28.173620+0000","last_peered":"2023-11-24T08:00:28.173620+0000","last_clean":"2023-11-24T08:00:28.173620+0000","last_became_active":"2023-11-24T08:00:26.764497+0000","last_became_peered":"2023-11-24T08:00:26.764497+0000","last_unstale":"2023-11-24T08:00:28.173620+0000","last_undegraded":"2023-11-24T08:00:28.173620+0000","last_fullsized":"2023-11-24T08:00:28.173620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:34.349090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768747+0000","last_change":"2023-11-24T08:00:26.772754+0000","last_active":"2023-11-24T08:00:27.768747+0000","last_peered":"2023-11-24T08:00:27.768747+0000","last_clean":"2023-11-24T08:00:27.768747+0000","last_became_active":"2023-11-24T08:00:26.768109+0000","last_became_peered":"2023-11-24T08:00:26.768109+0000","last_unstale":"2023-11-24T08:00:27.768747+0000","last_undegraded":"2023-11-24T08:00:27.768747+0000","last_fullsized":"2023-11-24T08:00:27.768747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170980+0000","last_change":"2023-11-24T08:00:26.768358+0000","last_active":"2023-11-24T08:00:28.170980+0000","last_peered":"2023-11-24T08:00:28.170980+0000","last_clean":"2023-11-24T08:00:28.170980+0000","last_became_active":"2023-11-24T08:00:26.768127+0000","last_became_peered":"2023-11-24T08:00:26.768127+0000","last_unstale":"2023-11-24T08:00:28.170980+0000","last_undegraded":"2023-11-24T08:00:28.170980+0000","last_fullsized":"2023-11-24T08:00:28.170980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:19.015329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767410+0000","last_change":"2023-11-24T08:00:26.759713+0000","last_active":"2023-11-24T08:00:27.767410+0000","last_peered":"2023-11-24T08:00:27.767410+0000","last_clean":"2023-11-24T08:00:27.767410+0000","last_became_active":"2023-11-24T08:00:26.759342+0000","last_became_peered":"2023-11-24T08:00:26.759342+0000","last_unstale":"2023-11-24T08:00:27.767410+0000","last_undegraded":"2023-11-24T08:00:27.767410+0000","last_fullsized":"2023-11-24T08:00:27.767410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171879+0000","last_change":"2023-11-24T08:00:26.756578+0000","last_active":"2023-11-24T08:00:28.171879+0000","last_peered":"2023-11-24T08:00:28.171879+0000","last_clean":"2023-11-24T08:00:28.171879+0000","last_became_active":"2023-11-24T08:00:26.756310+0000","last_became_peered":"2023-11-24T08:00:26.756310+0000","last_unstale":"2023-11-24T08:00:28.171879+0000","last_undegraded":"2023-11-24T08:00:28.171879+0000","last_fullsized":"2023-11-24T08:00:28.171879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:23.219831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174796+0000","last_change":"2023-11-24T08:00:25.487322+0000","last_active":"2023-11-24T08:00:28.174796+0000","last_peered":"2023-11-24T08:00:28.174796+0000","last_clean":"2023-11-24T08:00:28.174796+0000","last_became_active":"2023-11-24T08:00:25.486807+0000","last_became_peered":"2023-11-24T08:00:25.486807+0000","last_unstale":"2023-11-24T08:00:28.174796+0000","last_undegraded":"2023-11-24T08:00:28.174796+0000","last_fullsized":"2023-11-24T08:00:28.174796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173508+0000","last_change":"2023-11-24T08:00:26.763826+0000","last_active":"2023-11-24T08:00:28.173508+0000","last_peered":"2023-11-24T08:00:28.173508+0000","last_clean":"2023-11-24T08:00:28.173508+0000","last_became_active":"2023-11-24T08:00:26.761268+0000","last_became_peered":"2023-11-24T08:00:26.761268+0000","last_unstale":"2023-11-24T08:00:28.173508+0000","last_undegraded":"2023-11-24T08:00:28.173508+0000","last_fullsized":"2023-11-24T08:00:28.173508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:51.537813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767502+0000","last_change":"2023-11-24T08:00:25.484440+0000","last_active":"2023-11-24T08:00:27.767502+0000","last_peered":"2023-11-24T08:00:27.767502+0000","last_clean":"2023-11-24T08:00:27.767502+0000","last_became_active":"2023-11-24T08:00:25.484176+0000","last_became_peered":"2023-11-24T08:00:25.484176+0000","last_unstale":"2023-11-24T08:00:27.767502+0000","last_undegraded":"2023-11-24T08:00:27.767502+0000","last_fullsized":"2023-11-24T08:00:27.767502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173120+0000","last_change":"2023-11-24T08:00:25.477583+0000","last_active":"2023-11-24T08:00:28.173120+0000","last_peered":"2023-11-24T08:00:28.173120+0000","last_clean":"2023-11-24T08:00:28.173120+0000","last_became_active":"2023-11-24T08:00:25.477315+0000","last_became_peered":"2023-11-24T08:00:25.477315+0000","last_unstale":"2023-11-24T08:00:28.173120+0000","last_undegraded":"2023-11-24T08:00:28.173120+0000","last_fullsized":"2023-11-24T08:00:28.173120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172762+0000","last_change":"2023-11-24T08:00:26.768787+0000","last_active":"2023-11-24T08:00:28.172762+0000","last_peered":"2023-11-24T08:00:28.172762+0000","last_clean":"2023-11-24T08:00:28.172762+0000","last_became_active":"2023-11-24T08:00:26.766444+0000","last_became_peered":"2023-11-24T08:00:26.766444+0000","last_unstale":"2023-11-24T08:00:28.172762+0000","last_undegraded":"2023-11-24T08:00:28.172762+0000","last_fullsized":"2023-11-24T08:00:28.172762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768123+0000","last_change":"2023-11-24T08:00:25.492070+0000","last_active":"2023-11-24T08:00:27.768123+0000","last_peered":"2023-11-24T08:00:27.768123+0000","last_clean":"2023-11-24T08:00:27.768123+0000","last_became_active":"2023-11-24T08:00:25.489186+0000","last_became_peered":"2023-11-24T08:00:25.489186+0000","last_unstale":"2023-11-24T08:00:27.768123+0000","last_undegraded":"2023-11-24T08:00:27.768123+0000","last_fullsized":"2023-11-24T08:00:27.768123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.764650+0000","last_change":"2023-11-24T08:00:26.759451+0000","last_active":"2023-11-24T08:00:27.764650+0000","last_peered":"2023-11-24T08:00:27.764650+0000","last_clean":"2023-11-24T08:00:27.764650+0000","last_became_active":"2023-11-24T08:00:26.758996+0000","last_became_peered":"2023-11-24T08:00:26.758996+0000","last_unstale":"2023-11-24T08:00:27.764650+0000","last_undegraded":"2023-11-24T08:00:27.764650+0000","last_fullsized":"2023-11-24T08:00:27.764650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:43.741603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768950+0000","last_change":"2023-11-24T08:00:25.493105+0000","last_active":"2023-11-24T08:00:27.768950+0000","last_peered":"2023-11-24T08:00:27.768950+0000","last_clean":"2023-11-24T08:00:27.768950+0000","last_became_active":"2023-11-24T08:00:25.492800+0000","last_became_peered":"2023-11-24T08:00:25.492800+0000","last_unstale":"2023-11-24T08:00:27.768950+0000","last_undegraded":"2023-11-24T08:00:27.768950+0000","last_fullsized":"2023-11-24T08:00:27.768950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768631+0000","last_change":"2023-11-24T08:00:26.777968+0000","last_active":"2023-11-24T08:00:27.768631+0000","last_peered":"2023-11-24T08:00:27.768631+0000","last_clean":"2023-11-24T08:00:27.768631+0000","last_became_active":"2023-11-24T08:00:26.774815+0000","last_became_peered":"2023-11-24T08:00:26.774815+0000","last_unstale":"2023-11-24T08:00:27.768631+0000","last_undegraded":"2023-11-24T08:00:27.768631+0000","last_fullsized":"2023-11-24T08:00:27.768631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768646+0000","last_change":"2023-11-24T08:00:25.491014+0000","last_active":"2023-11-24T08:00:27.768646+0000","last_peered":"2023-11-24T08:00:27.768646+0000","last_clean":"2023-11-24T08:00:27.768646+0000","last_became_active":"2023-11-24T08:00:25.490752+0000","last_became_peered":"2023-11-24T08:00:25.490752+0000","last_unstale":"2023-11-24T08:00:27.768646+0000","last_undegraded":"2023-11-24T08:00:27.768646+0000","last_fullsized":"2023-11-24T08:00:27.768646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173992+0000","last_change":"2023-11-24T08:00:26.777398+0000","last_active":"2023-11-24T08:00:28.173992+0000","last_peered":"2023-11-24T08:00:28.173992+0000","last_clean":"2023-11-24T08:00:28.173992+0000","last_became_active":"2023-11-24T08:00:26.777180+0000","last_became_peered":"2023-11-24T08:00:26.777180+0000","last_unstale":"2023-11-24T08:00:28.173992+0000","last_undegraded":"2023-11-24T08:00:28.173992+0000","last_fullsized":"2023-11-24T08:00:28.173992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:15.798578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757016+0000","last_change":"2023-11-24T08:00:25.493583+0000","last_active":"2023-11-24T08:00:27.757016+0000","last_peered":"2023-11-24T08:00:27.757016+0000","last_clean":"2023-11-24T08:00:27.757016+0000","last_became_active":"2023-11-24T08:00:25.493049+0000","last_became_peered":"2023-11-24T08:00:25.493049+0000","last_unstale":"2023-11-24T08:00:27.757016+0000","last_undegraded":"2023-11-24T08:00:27.757016+0000","last_fullsized":"2023-11-24T08:00:27.757016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:04.556704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173051+0000","last_change":"2023-11-24T08:00:26.771496+0000","last_active":"2023-11-24T08:00:28.173051+0000","last_peered":"2023-11-24T08:00:28.173051+0000","last_clean":"2023-11-24T08:00:28.173051+0000","last_became_active":"2023-11-24T08:00:26.768866+0000","last_became_peered":"2023-11-24T08:00:26.768866+0000","last_unstale":"2023-11-24T08:00:28.173051+0000","last_undegraded":"2023-11-24T08:00:28.173051+0000","last_fullsized":"2023-11-24T08:00:28.173051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:48.837595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767521+0000","last_change":"2023-11-24T08:00:25.470991+0000","last_active":"2023-11-24T08:00:27.767521+0000","last_peered":"2023-11-24T08:00:27.767521+0000","last_clean":"2023-11-24T08:00:27.767521+0000","last_became_active":"2023-11-24T08:00:25.467281+0000","last_became_peered":"2023-11-24T08:00:25.467281+0000","last_unstale":"2023-11-24T08:00:27.767521+0000","last_undegraded":"2023-11-24T08:00:27.767521+0000","last_fullsized":"2023-11-24T08:00:27.767521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173928+0000","last_change":"2023-11-24T08:00:26.761810+0000","last_active":"2023-11-24T08:00:28.173928+0000","last_peered":"2023-11-24T08:00:28.173928+0000","last_clean":"2023-11-24T08:00:28.173928+0000","last_became_active":"2023-11-24T08:00:26.761443+0000","last_became_peered":"2023-11-24T08:00:26.761443+0000","last_unstale":"2023-11-24T08:00:28.173928+0000","last_undegraded":"2023-11-24T08:00:28.173928+0000","last_fullsized":"2023-11-24T08:00:28.173928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757793+0000","last_change":"2023-11-24T08:00:25.476805+0000","last_active":"2023-11-24T08:00:27.757793+0000","last_peered":"2023-11-24T08:00:27.757793+0000","last_clean":"2023-11-24T08:00:27.757793+0000","last_became_active":"2023-11-24T08:00:25.476150+0000","last_became_peered":"2023-11-24T08:00:25.476150+0000","last_unstale":"2023-11-24T08:00:27.757793+0000","last_undegraded":"2023-11-24T08:00:27.757793+0000","last_fullsized":"2023-11-24T08:00:27.757793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172213+0000","last_change":"2023-11-24T08:00:26.770849+0000","last_active":"2023-11-24T08:00:28.172213+0000","last_peered":"2023-11-24T08:00:28.172213+0000","last_clean":"2023-11-24T08:00:28.172213+0000","last_became_active":"2023-11-24T08:00:26.769532+0000","last_became_peered":"2023-11-24T08:00:26.769532+0000","last_unstale":"2023-11-24T08:00:28.172213+0000","last_undegraded":"2023-11-24T08:00:28.172213+0000","last_fullsized":"2023-11-24T08:00:28.172213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:50.279093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768910+0000","last_change":"2023-11-24T08:00:25.489658+0000","last_active":"2023-11-24T08:00:27.768910+0000","last_peered":"2023-11-24T08:00:27.768910+0000","last_clean":"2023-11-24T08:00:27.768910+0000","last_became_active":"2023-11-24T08:00:25.489387+0000","last_became_peered":"2023-11-24T08:00:25.489387+0000","last_unstale":"2023-11-24T08:00:27.768910+0000","last_undegraded":"2023-11-24T08:00:27.768910+0000","last_fullsized":"2023-11-24T08:00:27.768910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:12.207873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174020+0000","last_change":"2023-11-24T08:00:26.773222+0000","last_active":"2023-11-24T08:00:28.174020+0000","last_peered":"2023-11-24T08:00:28.174020+0000","last_clean":"2023-11-24T08:00:28.174020+0000","last_became_active":"2023-11-24T08:00:26.772961+0000","last_became_peered":"2023-11-24T08:00:26.772961+0000","last_unstale":"2023-11-24T08:00:28.174020+0000","last_undegraded":"2023-11-24T08:00:28.174020+0000","last_fullsized":"2023-11-24T08:00:28.174020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767377+0000","last_change":"2023-11-24T08:00:25.480070+0000","last_active":"2023-11-24T08:00:27.767377+0000","last_peered":"2023-11-24T08:00:27.767377+0000","last_clean":"2023-11-24T08:00:27.767377+0000","last_became_active":"2023-11-24T08:00:25.479345+0000","last_became_peered":"2023-11-24T08:00:25.479345+0000","last_unstale":"2023-11-24T08:00:27.767377+0000","last_undegraded":"2023-11-24T08:00:27.767377+0000","last_fullsized":"2023-11-24T08:00:27.767377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767763+0000","last_change":"2023-11-24T08:00:26.760511+0000","last_active":"2023-11-24T08:00:27.767763+0000","last_peered":"2023-11-24T08:00:27.767763+0000","last_clean":"2023-11-24T08:00:27.767763+0000","last_became_active":"2023-11-24T08:00:26.760206+0000","last_became_peered":"2023-11-24T08:00:26.760206+0000","last_unstale":"2023-11-24T08:00:27.767763+0000","last_undegraded":"2023-11-24T08:00:27.767763+0000","last_fullsized":"2023-11-24T08:00:27.767763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170764+0000","last_change":"2023-11-24T08:00:25.477302+0000","last_active":"2023-11-24T08:00:28.170764+0000","last_peered":"2023-11-24T08:00:28.170764+0000","last_clean":"2023-11-24T08:00:28.170764+0000","last_became_active":"2023-11-24T08:00:25.477026+0000","last_became_peered":"2023-11-24T08:00:25.477026+0000","last_unstale":"2023-11-24T08:00:28.170764+0000","last_undegraded":"2023-11-24T08:00:28.170764+0000","last_fullsized":"2023-11-24T08:00:28.170764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:47.411014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173040+0000","last_change":"2023-11-24T08:00:26.771081+0000","last_active":"2023-11-24T08:00:28.173040+0000","last_peered":"2023-11-24T08:00:28.173040+0000","last_clean":"2023-11-24T08:00:28.173040+0000","last_became_active":"2023-11-24T08:00:26.767738+0000","last_became_peered":"2023-11-24T08:00:26.767738+0000","last_unstale":"2023-11-24T08:00:28.173040+0000","last_undegraded":"2023-11-24T08:00:28.173040+0000","last_fullsized":"2023-11-24T08:00:28.173040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.759653+0000","last_change":"2023-11-24T08:00:25.473084+0000","last_active":"2023-11-24T08:00:27.759653+0000","last_peered":"2023-11-24T08:00:27.759653+0000","last_clean":"2023-11-24T08:00:27.759653+0000","last_became_active":"2023-11-24T08:00:25.472511+0000","last_became_peered":"2023-11-24T08:00:25.472511+0000","last_unstale":"2023-11-24T08:00:27.759653+0000","last_undegraded":"2023-11-24T08:00:27.759653+0000","last_fullsized":"2023-11-24T08:00:27.759653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:30.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174602+0000","last_change":"2023-11-24T08:00:26.770832+0000","last_active":"2023-11-24T08:00:28.174602+0000","last_peered":"2023-11-24T08:00:28.174602+0000","last_clean":"2023-11-24T08:00:28.174602+0000","last_became_active":"2023-11-24T08:00:26.770425+0000","last_became_peered":"2023-11-24T08:00:26.770425+0000","last_unstale":"2023-11-24T08:00:28.174602+0000","last_undegraded":"2023-11-24T08:00:28.174602+0000","last_fullsized":"2023-11-24T08:00:28.174602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171853+0000","last_change":"2023-11-24T08:00:25.479082+0000","last_active":"2023-11-24T08:00:28.171853+0000","last_peered":"2023-11-24T08:00:28.171853+0000","last_clean":"2023-11-24T08:00:28.171853+0000","last_became_active":"2023-11-24T08:00:25.478759+0000","last_became_peered":"2023-11-24T08:00:25.478759+0000","last_unstale":"2023-11-24T08:00:28.171853+0000","last_undegraded":"2023-11-24T08:00:28.171853+0000","last_fullsized":"2023-11-24T08:00:28.171853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175030+0000","last_change":"2023-11-24T08:00:26.766352+0000","last_active":"2023-11-24T08:00:28.175030+0000","last_peered":"2023-11-24T08:00:28.175030+0000","last_clean":"2023-11-24T08:00:28.175030+0000","last_became_active":"2023-11-24T08:00:26.765178+0000","last_became_peered":"2023-11-24T08:00:26.765178+0000","last_unstale":"2023-11-24T08:00:28.175030+0000","last_undegraded":"2023-11-24T08:00:28.175030+0000","last_fullsized":"2023-11-24T08:00:28.175030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:31.302140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757035+0000","last_change":"2023-11-24T08:00:25.480774+0000","last_active":"2023-11-24T08:00:27.757035+0000","last_peered":"2023-11-24T08:00:27.757035+0000","last_clean":"2023-11-24T08:00:27.757035+0000","last_became_active":"2023-11-24T08:00:25.480505+0000","last_became_peered":"2023-11-24T08:00:25.480505+0000","last_unstale":"2023-11-24T08:00:27.757035+0000","last_undegraded":"2023-11-24T08:00:27.757035+0000","last_fullsized":"2023-11-24T08:00:27.757035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:47.832998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768605+0000","last_change":"2023-11-24T08:00:26.777032+0000","last_active":"2023-11-24T08:00:27.768605+0000","last_peered":"2023-11-24T08:00:27.768605+0000","last_clean":"2023-11-24T08:00:27.768605+0000","last_became_active":"2023-11-24T08:00:26.776390+0000","last_became_peered":"2023-11-24T08:00:26.776390+0000","last_unstale":"2023-11-24T08:00:27.768605+0000","last_undegraded":"2023-11-24T08:00:27.768605+0000","last_fullsized":"2023-11-24T08:00:27.768605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171558+0000","last_change":"2023-11-24T08:00:25.482325+0000","last_active":"2023-11-24T08:00:28.171558+0000","last_peered":"2023-11-24T08:00:28.171558+0000","last_clean":"2023-11-24T08:00:28.171558+0000","last_became_active":"2023-11-24T08:00:25.481949+0000","last_became_peered":"2023-11-24T08:00:25.481949+0000","last_unstale":"2023-11-24T08:00:28.171558+0000","last_undegraded":"2023-11-24T08:00:28.171558+0000","last_fullsized":"2023-11-24T08:00:28.171558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174954+0000","last_change":"2023-11-24T08:00:26.768210+0000","last_active":"2023-11-24T08:00:28.174954+0000","last_peered":"2023-11-24T08:00:28.174954+0000","last_clean":"2023-11-24T08:00:28.174954+0000","last_became_active":"2023-11-24T08:00:26.767945+0000","last_became_peered":"2023-11-24T08:00:26.767945+0000","last_unstale":"2023-11-24T08:00:28.174954+0000","last_undegraded":"2023-11-24T08:00:28.174954+0000","last_fullsized":"2023-11-24T08:00:28.174954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:14.495500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.745147+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:00:26.745147+0000","last_peered":"2023-11-24T08:00:26.745147+0000","last_clean":"2023-11-24T08:00:26.745147+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:00:26.745147+0000","last_undegraded":"2023-11-24T08:00:26.745147+0000","last_fullsized":"2023-11-24T08:00:26.745147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768099+0000","last_change":"2023-11-24T08:00:25.482920+0000","last_active":"2023-11-24T08:00:27.768099+0000","last_peered":"2023-11-24T08:00:27.768099+0000","last_clean":"2023-11-24T08:00:27.768099+0000","last_became_active":"2023-11-24T08:00:25.482550+0000","last_became_peered":"2023-11-24T08:00:25.482550+0000","last_unstale":"2023-11-24T08:00:27.768099+0000","last_undegraded":"2023-11-24T08:00:27.768099+0000","last_fullsized":"2023-11-24T08:00:27.768099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174979+0000","last_change":"2023-11-24T08:00:26.771428+0000","last_active":"2023-11-24T08:00:28.174979+0000","last_peered":"2023-11-24T08:00:28.174979+0000","last_clean":"2023-11-24T08:00:28.174979+0000","last_became_active":"2023-11-24T08:00:26.771067+0000","last_became_peered":"2023-11-24T08:00:26.771067+0000","last_unstale":"2023-11-24T08:00:28.174979+0000","last_undegraded":"2023-11-24T08:00:28.174979+0000","last_fullsized":"2023-11-24T08:00:28.174979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172499+0000","last_change":"2023-11-24T08:00:25.494571+0000","last_active":"2023-11-24T08:00:28.172499+0000","last_peered":"2023-11-24T08:00:28.172499+0000","last_clean":"2023-11-24T08:00:28.172499+0000","last_became_active":"2023-11-24T08:00:25.493557+0000","last_became_peered":"2023-11-24T08:00:25.493557+0000","last_unstale":"2023-11-24T08:00:28.172499+0000","last_undegraded":"2023-11-24T08:00:28.172499+0000","last_fullsized":"2023-11-24T08:00:28.172499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171943+0000","last_change":"2023-11-24T08:00:26.762814+0000","last_active":"2023-11-24T08:00:28.171943+0000","last_peered":"2023-11-24T08:00:28.171943+0000","last_clean":"2023-11-24T08:00:28.171943+0000","last_became_active":"2023-11-24T08:00:26.761448+0000","last_became_peered":"2023-11-24T08:00:26.761448+0000","last_unstale":"2023-11-24T08:00:28.171943+0000","last_undegraded":"2023-11-24T08:00:28.171943+0000","last_fullsized":"2023-11-24T08:00:28.171943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:43.356429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170966+0000","last_change":"2023-11-24T08:00:25.478945+0000","last_active":"2023-11-24T08:00:28.170966+0000","last_peered":"2023-11-24T08:00:28.170966+0000","last_clean":"2023-11-24T08:00:28.170966+0000","last_became_active":"2023-11-24T08:00:25.478645+0000","last_became_peered":"2023-11-24T08:00:25.478645+0000","last_unstale":"2023-11-24T08:00:28.170966+0000","last_undegraded":"2023-11-24T08:00:28.170966+0000","last_fullsized":"2023-11-24T08:00:28.170966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:26:36.241356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.764572+0000","last_change":"2023-11-24T08:00:26.756524+0000","last_active":"2023-11-24T08:00:27.764572+0000","last_peered":"2023-11-24T08:00:27.764572+0000","last_clean":"2023-11-24T08:00:27.764572+0000","last_became_active":"2023-11-24T08:00:26.754522+0000","last_became_peered":"2023-11-24T08:00:26.754522+0000","last_unstale":"2023-11-24T08:00:27.764572+0000","last_undegraded":"2023-11-24T08:00:27.764572+0000","last_fullsized":"2023-11-24T08:00:27.764572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:51.537813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768991+0000","last_change":"2023-11-24T08:00:25.489726+0000","last_active":"2023-11-24T08:00:27.768991+0000","last_peered":"2023-11-24T08:00:27.768991+0000","last_clean":"2023-11-24T08:00:27.768991+0000","last_became_active":"2023-11-24T08:00:25.489421+0000","last_became_peered":"2023-11-24T08:00:25.489421+0000","last_unstale":"2023-11-24T08:00:27.768991+0000","last_undegraded":"2023-11-24T08:00:27.768991+0000","last_fullsized":"2023-11-24T08:00:27.768991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172280+0000","last_change":"2023-11-24T08:00:26.766472+0000","last_active":"2023-11-24T08:00:28.172280+0000","last_peered":"2023-11-24T08:00:28.172280+0000","last_clean":"2023-11-24T08:00:28.172280+0000","last_became_active":"2023-11-24T08:00:26.765996+0000","last_became_peered":"2023-11-24T08:00:26.765996+0000","last_unstale":"2023-11-24T08:00:28.172280+0000","last_undegraded":"2023-11-24T08:00:28.172280+0000","last_fullsized":"2023-11-24T08:00:28.172280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:07:22.755097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.756982+0000","last_change":"2023-11-24T08:00:25.481042+0000","last_active":"2023-11-24T08:00:27.756982+0000","last_peered":"2023-11-24T08:00:27.756982+0000","last_clean":"2023-11-24T08:00:27.756982+0000","last_became_active":"2023-11-24T08:00:25.480733+0000","last_became_peered":"2023-11-24T08:00:25.480733+0000","last_unstale":"2023-11-24T08:00:27.756982+0000","last_undegraded":"2023-11-24T08:00:27.756982+0000","last_fullsized":"2023-11-24T08:00:27.756982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:41.051307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769401+0000","last_change":"2023-11-24T08:00:26.775027+0000","last_active":"2023-11-24T08:00:27.769401+0000","last_peered":"2023-11-24T08:00:27.769401+0000","last_clean":"2023-11-24T08:00:27.769401+0000","last_became_active":"2023-11-24T08:00:26.774593+0000","last_became_peered":"2023-11-24T08:00:26.774593+0000","last_unstale":"2023-11-24T08:00:27.769401+0000","last_undegraded":"2023-11-24T08:00:27.769401+0000","last_fullsized":"2023-11-24T08:00:27.769401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174850+0000","last_change":"2023-11-24T08:00:25.494481+0000","last_active":"2023-11-24T08:00:28.174850+0000","last_peered":"2023-11-24T08:00:28.174850+0000","last_clean":"2023-11-24T08:00:28.174850+0000","last_became_active":"2023-11-24T08:00:25.494253+0000","last_became_peered":"2023-11-24T08:00:25.494253+0000","last_unstale":"2023-11-24T08:00:28.174850+0000","last_undegraded":"2023-11-24T08:00:28.174850+0000","last_fullsized":"2023-11-24T08:00:28.174850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765589+0000","last_change":"2023-11-24T08:00:26.757666+0000","last_active":"2023-11-24T08:00:27.765589+0000","last_peered":"2023-11-24T08:00:27.765589+0000","last_clean":"2023-11-24T08:00:27.765589+0000","last_became_active":"2023-11-24T08:00:26.757401+0000","last_became_peered":"2023-11-24T08:00:26.757401+0000","last_unstale":"2023-11-24T08:00:27.765589+0000","last_undegraded":"2023-11-24T08:00:27.765589+0000","last_fullsized":"2023-11-24T08:00:27.765589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:29.359703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765913+0000","last_change":"2023-11-24T08:00:25.483011+0000","last_active":"2023-11-24T08:00:27.765913+0000","last_peered":"2023-11-24T08:00:27.765913+0000","last_clean":"2023-11-24T08:00:27.765913+0000","last_became_active":"2023-11-24T08:00:25.481668+0000","last_became_peered":"2023-11-24T08:00:25.481668+0000","last_unstale":"2023-11-24T08:00:27.765913+0000","last_undegraded":"2023-11-24T08:00:27.765913+0000","last_fullsized":"2023-11-24T08:00:27.765913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174672+0000","last_change":"2023-11-24T08:00:26.760962+0000","last_active":"2023-11-24T08:00:28.174672+0000","last_peered":"2023-11-24T08:00:28.174672+0000","last_clean":"2023-11-24T08:00:28.174672+0000","last_became_active":"2023-11-24T08:00:26.760541+0000","last_became_peered":"2023-11-24T08:00:26.760541+0000","last_unstale":"2023-11-24T08:00:28.174672+0000","last_undegraded":"2023-11-24T08:00:28.174672+0000","last_fullsized":"2023-11-24T08:00:28.174672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769002+0000","last_change":"2023-11-24T08:00:25.491430+0000","last_active":"2023-11-24T08:00:27.769002+0000","last_peered":"2023-11-24T08:00:27.769002+0000","last_clean":"2023-11-24T08:00:27.769002+0000","last_became_active":"2023-11-24T08:00:25.490656+0000","last_became_peered":"2023-11-24T08:00:25.490656+0000","last_unstale":"2023-11-24T08:00:27.769002+0000","last_undegraded":"2023-11-24T08:00:27.769002+0000","last_fullsized":"2023-11-24T08:00:27.769002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173988+0000","last_change":"2023-11-24T08:00:26.762592+0000","last_active":"2023-11-24T08:00:28.173988+0000","last_peered":"2023-11-24T08:00:28.173988+0000","last_clean":"2023-11-24T08:00:28.173988+0000","last_became_active":"2023-11-24T08:00:26.759772+0000","last_became_peered":"2023-11-24T08:00:26.759772+0000","last_unstale":"2023-11-24T08:00:28.173988+0000","last_undegraded":"2023-11-24T08:00:28.173988+0000","last_fullsized":"2023-11-24T08:00:28.173988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:46.400061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172271+0000","last_change":"2023-11-24T08:00:25.494768+0000","last_active":"2023-11-24T08:00:28.172271+0000","last_peered":"2023-11-24T08:00:28.172271+0000","last_clean":"2023-11-24T08:00:28.172271+0000","last_became_active":"2023-11-24T08:00:25.494268+0000","last_became_peered":"2023-11-24T08:00:25.494268+0000","last_unstale":"2023-11-24T08:00:28.172271+0000","last_undegraded":"2023-11-24T08:00:28.172271+0000","last_fullsized":"2023-11-24T08:00:28.172271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171955+0000","last_change":"2023-11-24T08:00:26.761236+0000","last_active":"2023-11-24T08:00:28.171955+0000","last_peered":"2023-11-24T08:00:28.171955+0000","last_clean":"2023-11-24T08:00:28.171955+0000","last_became_active":"2023-11-24T08:00:26.755777+0000","last_became_peered":"2023-11-24T08:00:26.755777+0000","last_unstale":"2023-11-24T08:00:28.171955+0000","last_undegraded":"2023-11-24T08:00:28.171955+0000","last_fullsized":"2023-11-24T08:00:28.171955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:15:38.288322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.756915+0000","last_change":"2023-11-24T08:00:25.483781+0000","last_active":"2023-11-24T08:00:27.756915+0000","last_peered":"2023-11-24T08:00:27.756915+0000","last_clean":"2023-11-24T08:00:27.756915+0000","last_became_active":"2023-11-24T08:00:25.483449+0000","last_became_peered":"2023-11-24T08:00:25.483449+0000","last_unstale":"2023-11-24T08:00:27.756915+0000","last_undegraded":"2023-11-24T08:00:27.756915+0000","last_fullsized":"2023-11-24T08:00:27.756915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:42.351833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172763+0000","last_change":"2023-11-24T08:00:26.770074+0000","last_active":"2023-11-24T08:00:28.172763+0000","last_peered":"2023-11-24T08:00:28.172763+0000","last_clean":"2023-11-24T08:00:28.172763+0000","last_became_active":"2023-11-24T08:00:26.767285+0000","last_became_peered":"2023-11-24T08:00:26.767285+0000","last_unstale":"2023-11-24T08:00:28.172763+0000","last_undegraded":"2023-11-24T08:00:28.172763+0000","last_fullsized":"2023-11-24T08:00:28.172763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.756933+0000","last_change":"2023-11-24T08:00:25.483961+0000","last_active":"2023-11-24T08:00:27.756933+0000","last_peered":"2023-11-24T08:00:27.756933+0000","last_clean":"2023-11-24T08:00:27.756933+0000","last_became_active":"2023-11-24T08:00:25.481836+0000","last_became_peered":"2023-11-24T08:00:25.481836+0000","last_unstale":"2023-11-24T08:00:27.756933+0000","last_undegraded":"2023-11-24T08:00:27.756933+0000","last_fullsized":"2023-11-24T08:00:27.756933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:09.816614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175247+0000","last_change":"2023-11-24T08:00:26.769858+0000","last_active":"2023-11-24T08:00:28.175247+0000","last_peered":"2023-11-24T08:00:28.175247+0000","last_clean":"2023-11-24T08:00:28.175247+0000","last_became_active":"2023-11-24T08:00:26.766200+0000","last_became_peered":"2023-11-24T08:00:26.766200+0000","last_unstale":"2023-11-24T08:00:28.175247+0000","last_undegraded":"2023-11-24T08:00:28.175247+0000","last_fullsized":"2023-11-24T08:00:28.175247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174355+0000","last_change":"2023-11-24T08:00:25.495132+0000","last_active":"2023-11-24T08:00:28.174355+0000","last_peered":"2023-11-24T08:00:28.174355+0000","last_clean":"2023-11-24T08:00:28.174355+0000","last_became_active":"2023-11-24T08:00:25.494764+0000","last_became_peered":"2023-11-24T08:00:25.494764+0000","last_unstale":"2023-11-24T08:00:28.174355+0000","last_undegraded":"2023-11-24T08:00:28.174355+0000","last_fullsized":"2023-11-24T08:00:28.174355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767414+0000","last_change":"2023-11-24T08:00:26.749850+0000","last_active":"2023-11-24T08:00:27.767414+0000","last_peered":"2023-11-24T08:00:27.767414+0000","last_clean":"2023-11-24T08:00:27.767414+0000","last_became_active":"2023-11-24T08:00:26.749536+0000","last_became_peered":"2023-11-24T08:00:26.749536+0000","last_unstale":"2023-11-24T08:00:27.767414+0000","last_undegraded":"2023-11-24T08:00:27.767414+0000","last_fullsized":"2023-11-24T08:00:27.767414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769202+0000","last_change":"2023-11-24T08:00:26.779787+0000","last_active":"2023-11-24T08:00:27.769202+0000","last_peered":"2023-11-24T08:00:27.769202+0000","last_clean":"2023-11-24T08:00:27.769202+0000","last_became_active":"2023-11-24T08:00:26.779470+0000","last_became_peered":"2023-11-24T08:00:26.779470+0000","last_unstale":"2023-11-24T08:00:27.769202+0000","last_undegraded":"2023-11-24T08:00:27.769202+0000","last_fullsized":"2023-11-24T08:00:27.769202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173834+0000","last_change":"2023-11-24T08:00:25.497773+0000","last_active":"2023-11-24T08:00:28.173834+0000","last_peered":"2023-11-24T08:00:28.173834+0000","last_clean":"2023-11-24T08:00:28.173834+0000","last_became_active":"2023-11-24T08:00:25.497355+0000","last_became_peered":"2023-11-24T08:00:25.497355+0000","last_unstale":"2023-11-24T08:00:28.173834+0000","last_undegraded":"2023-11-24T08:00:28.173834+0000","last_fullsized":"2023-11-24T08:00:28.173834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769447+0000","last_change":"2023-11-24T08:00:26.779853+0000","last_active":"2023-11-24T08:00:27.769447+0000","last_peered":"2023-11-24T08:00:27.769447+0000","last_clean":"2023-11-24T08:00:27.769447+0000","last_became_active":"2023-11-24T08:00:26.779449+0000","last_became_peered":"2023-11-24T08:00:26.779449+0000","last_unstale":"2023-11-24T08:00:27.769447+0000","last_undegraded":"2023-11-24T08:00:27.769447+0000","last_fullsized":"2023-11-24T08:00:27.769447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174399+0000","last_change":"2023-11-24T08:00:25.493174+0000","last_active":"2023-11-24T08:00:28.174399+0000","last_peered":"2023-11-24T08:00:28.174399+0000","last_clean":"2023-11-24T08:00:28.174399+0000","last_became_active":"2023-11-24T08:00:25.492565+0000","last_became_peered":"2023-11-24T08:00:25.492565+0000","last_unstale":"2023-11-24T08:00:28.174399+0000","last_undegraded":"2023-11-24T08:00:28.174399+0000","last_fullsized":"2023-11-24T08:00:28.174399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:16.328173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173696+0000","last_change":"2023-11-24T08:00:26.779709+0000","last_active":"2023-11-24T08:00:28.173696+0000","last_peered":"2023-11-24T08:00:28.173696+0000","last_clean":"2023-11-24T08:00:28.173696+0000","last_became_active":"2023-11-24T08:00:26.779501+0000","last_became_peered":"2023-11-24T08:00:26.779501+0000","last_unstale":"2023-11-24T08:00:28.173696+0000","last_undegraded":"2023-11-24T08:00:28.173696+0000","last_fullsized":"2023-11-24T08:00:28.173696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:29.359703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174361+0000","last_change":"2023-11-24T08:00:25.475566+0000","last_active":"2023-11-24T08:00:28.174361+0000","last_peered":"2023-11-24T08:00:28.174361+0000","last_clean":"2023-11-24T08:00:28.174361+0000","last_became_active":"2023-11-24T08:00:25.475286+0000","last_became_peered":"2023-11-24T08:00:25.475286+0000","last_unstale":"2023-11-24T08:00:28.174361+0000","last_undegraded":"2023-11-24T08:00:28.174361+0000","last_fullsized":"2023-11-24T08:00:28.174361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:25.827802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174531+0000","last_change":"2023-11-24T08:00:26.759142+0000","last_active":"2023-11-24T08:00:28.174531+0000","last_peered":"2023-11-24T08:00:28.174531+0000","last_clean":"2023-11-24T08:00:28.174531+0000","last_became_active":"2023-11-24T08:00:26.758874+0000","last_became_peered":"2023-11-24T08:00:26.758874+0000","last_unstale":"2023-11-24T08:00:28.174531+0000","last_undegraded":"2023-11-24T08:00:28.174531+0000","last_fullsized":"2023-11-24T08:00:28.174531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757913+0000","last_change":"2023-11-24T08:00:25.490543+0000","last_active":"2023-11-24T08:00:27.757913+0000","last_peered":"2023-11-24T08:00:27.757913+0000","last_clean":"2023-11-24T08:00:27.757913+0000","last_became_active":"2023-11-24T08:00:25.490222+0000","last_became_peered":"2023-11-24T08:00:25.490222+0000","last_unstale":"2023-11-24T08:00:27.757913+0000","last_undegraded":"2023-11-24T08:00:27.757913+0000","last_fullsized":"2023-11-24T08:00:27.757913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:34:32.891088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":668130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6709999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":77270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":77180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2639999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1389999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3050000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.367}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":668186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:00:36.741 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:00:36.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.983+0000 7f65f0b67640 1 Processor -- start 2023-11-24T08:00:36.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.984+0000 7f65f0b67640 1 -- start start 2023-11-24T08:00:36.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.985+0000 7f65f0b67640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec0b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.985+0000 7f65f0b67640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f65ec162810 0x7f65ec071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.985+0000 7f65f0b67640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65ec0b3650 0x7f65ec071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.985+0000 7f65f0b67640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ec071cc0 con 0x7f65ec0b3650 2023-11-24T08:00:36.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.985+0000 7f65f0b67640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65ec0702e0 con 0x7f65ec162810 2023-11-24T08:00:36.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.985+0000 7f65f0b67640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec0705c0 con 0x7f65ec162430 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65ec0b3650 0x7f65ec071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65ec0b3650 0x7f65ec071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56886/0 (socket says 172.21.15.161:56886) 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65eb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec0b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 -- 172.21.15.161:0/1532059236 learned_addr learned my addr 172.21.15.161:0/1532059236 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65eaffd640 1 --2- 172.21.15.161:0/1532059236 >> v2:172.21.15.175:3300/0 conn(0x7f65ec162810 0x7f65ec071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 -- 172.21.15.161:0/1532059236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 msgr2=0x7f65ec0b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 --2- 172.21.15.161:0/1532059236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec0b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 -- 172.21.15.161:0/1532059236 >> v2:172.21.15.175:3300/0 conn(0x7f65ec162810 msgr2=0x7f65ec071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 --2- 172.21.15.161:0/1532059236 >> v2:172.21.15.175:3300/0 conn(0x7f65ec162810 0x7f65ec071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.986+0000 7f65ebfff640 1 -- 172.21.15.161:0/1532059236 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec0708a0 con 0x7f65ec0b3650 2023-11-24T08:00:36.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.987+0000 7f65ebfff640 1 --2- 172.21.15.161:0/1532059236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec0b3650 0x7f65ec071780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65ec06e440 tx=0x7f65e402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfca9ad7bdd06e6c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:36.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.988+0000 7f65ea7fc640 1 -- 172.21.15.161:0/1532059236 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4031860 con 0x7f65ec0b3650 2023-11-24T08:00:36.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.988+0000 7f65ea7fc640 1 -- 172.21.15.161:0/1532059236 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e40319c0 con 0x7f65ec0b3650 2023-11-24T08:00:36.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.988+0000 7f65ea7fc640 1 -- 172.21.15.161:0/1532059236 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4031d50 con 0x7f65ec0b3650 2023-11-24T08:00:36.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.988+0000 7f65f0b67640 1 -- 172.21.15.161:0/1532059236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec0b3650 msgr2=0x7f65ec071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.988+0000 7f65f0b67640 1 --2- 172.21.15.161:0/1532059236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec0b3650 0x7f65ec071780 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f65ec06e440 tx=0x7f65e402b900 comp rx=0 tx=0).stop 2023-11-24T08:00:36.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 -- 172.21.15.161:0/1532059236 shutdown_connections 2023-11-24T08:00:36.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 --2- 172.21.15.161:0/1532059236 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec0b3650 0x7f65ec071780 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 --2- 172.21.15.161:0/1532059236 >> v2:172.21.15.175:3300/0 conn(0x7f65ec162810 0x7f65ec071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 --2- 172.21.15.161:0/1532059236 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec0b3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 -- 172.21.15.161:0/1532059236 >> 172.21.15.161:0/1532059236 conn(0x7f65ec06a800 msgr2=0x7f65ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:36.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 -- 172.21.15.161:0/1532059236 shutdown_connections 2023-11-24T08:00:36.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.989+0000 7f65f0b67640 1 -- 172.21.15.161:0/1532059236 wait complete. 2023-11-24T08:00:36.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.990+0000 7f65f0b67640 1 Processor -- start 2023-11-24T08:00:36.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.990+0000 7f65f0b67640 1 -- start start 2023-11-24T08:00:36.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.991+0000 7f65f0b67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec0b3650 0x7f65ec15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.991+0000 7f65f0b67640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.991+0000 7f65f0b67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 0x7f65ec159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.991+0000 7f65f0b67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec151d00 con 0x7f65ec1fa540 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.991+0000 7f65f0b67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec15b740 con 0x7f65ec0b3650 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.991+0000 7f65f0b67640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec15ba20 con 0x7f65ec162430 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 0x7f65ec159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 0x7f65ec159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56888/0 (socket says 172.21.15.161:56888) 2023-11-24T08:00:36.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 -- 172.21.15.161:0/275835266 learned_addr learned my addr 172.21.15.161:0/275835266 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:36.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 -- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 msgr2=0x7f65ec158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 -- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec0b3650 msgr2=0x7f65ec15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:36.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec0b3650 0x7f65ec15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:36.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 -- 172.21.15.161:0/275835266 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e40094d0 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65ebfff640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 0x7f65ec159080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65e402b940 tx=0x7f65e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e403ac60 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e403ade0 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.992+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec15bd00 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.993+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e4044630 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.993+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec15b310 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.994+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec15bf10 con 0x7f65ec1fa540 2023-11-24T08:00:36.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.995+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65e4044790 con 0x7f65ec1fa540 2023-11-24T08:00:36.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.996+0000 7f65e3fff640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f65cc06ae40 0x7f65cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:36.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.996+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65e40abb40 con 0x7f65ec1fa540 2023-11-24T08:00:36.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.996+0000 7f65eb7fe640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f65cc06ae40 0x7f65cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:36.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:36.997+0000 7f65eb7fe640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f65cc06ae40 0x7f65cc06d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f65dc006a90 tx=0x7f65dc006a20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.001+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65ec15bf10 con 0x7f65ec1fa540 2023-11-24T08:00:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.173+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65ec070e60 con 0x7f65cc06ae40 2023-11-24T08:00:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.194+0000 7f65e3fff640 1 -- 172.21.15.161:0/275835266 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264341 (secure 0 0 0) 0x7f65dc00e890 con 0x7f65cc06ae40 2023-11-24T08:00:37.200 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:00:37.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f65cc06ae40 msgr2=0x7f65cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f65cc06ae40 0x7f65cc06d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f65dc006a90 tx=0x7f65dc006a20 comp rx=0 tx=0).stop 2023-11-24T08:00:37.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 msgr2=0x7f65ec159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 0x7f65ec159080 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65e402b940 tx=0x7f65e40046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 shutdown_connections 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f65cc06ae40 0x7f65cc06d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65ec1fa540 0x7f65ec159080 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65ec162430 0x7f65ec158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 --2- 172.21.15.161:0/275835266 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65ec0b3650 0x7f65ec15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.199+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 >> 172.21.15.161:0/275835266 conn(0x7f65ec06a800 msgr2=0x7f65ec06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:37.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.200+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 shutdown_connections 2023-11-24T08:00:37.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.200+0000 7f65f0b67640 1 -- 172.21.15.161:0/275835266 wait complete. 2023-11-24T08:00:37.221 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-11-24T08:00:36.529394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219124,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755596,"statfs":{"total":773094113280,"available":772869730304,"internally_reserved":0,"allocated":3022848,"data_stored":1802996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.800942"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174603+0000","last_change":"2023-11-24T08:00:26.768948+0000","last_active":"2023-11-24T08:00:28.174603+0000","last_peered":"2023-11-24T08:00:28.174603+0000","last_clean":"2023-11-24T08:00:28.174603+0000","last_became_active":"2023-11-24T08:00:26.768601+0000","last_became_peered":"2023-11-24T08:00:26.768601+0000","last_unstale":"2023-11-24T08:00:28.174603+0000","last_undegraded":"2023-11-24T08:00:28.174603+0000","last_fullsized":"2023-11-24T08:00:28.174603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765866+0000","last_change":"2023-11-24T08:00:26.766088+0000","last_active":"2023-11-24T08:00:27.765866+0000","last_peered":"2023-11-24T08:00:27.765866+0000","last_clean":"2023-11-24T08:00:27.765866+0000","last_became_active":"2023-11-24T08:00:26.765786+0000","last_became_peered":"2023-11-24T08:00:26.765786+0000","last_unstale":"2023-11-24T08:00:27.765866+0000","last_undegraded":"2023-11-24T08:00:27.765866+0000","last_fullsized":"2023-11-24T08:00:27.765866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:15.798578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173544+0000","last_change":"2023-11-24T08:00:26.762423+0000","last_active":"2023-11-24T08:00:28.173544+0000","last_peered":"2023-11-24T08:00:28.173544+0000","last_clean":"2023-11-24T08:00:28.173544+0000","last_became_active":"2023-11-24T08:00:26.760624+0000","last_became_peered":"2023-11-24T08:00:26.760624+0000","last_unstale":"2023-11-24T08:00:28.173544+0000","last_undegraded":"2023-11-24T08:00:28.173544+0000","last_fullsized":"2023-11-24T08:00:28.173544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:43.741603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768385+0000","last_change":"2023-11-24T08:00:26.777163+0000","last_active":"2023-11-24T08:00:27.768385+0000","last_peered":"2023-11-24T08:00:27.768385+0000","last_clean":"2023-11-24T08:00:27.768385+0000","last_became_active":"2023-11-24T08:00:26.776740+0000","last_became_peered":"2023-11-24T08:00:26.776740+0000","last_unstale":"2023-11-24T08:00:27.768385+0000","last_undegraded":"2023-11-24T08:00:27.768385+0000","last_fullsized":"2023-11-24T08:00:27.768385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173729+0000","last_change":"2023-11-24T08:00:26.763129+0000","last_active":"2023-11-24T08:00:28.173729+0000","last_peered":"2023-11-24T08:00:28.173729+0000","last_clean":"2023-11-24T08:00:28.173729+0000","last_became_active":"2023-11-24T08:00:26.762767+0000","last_became_peered":"2023-11-24T08:00:26.762767+0000","last_unstale":"2023-11-24T08:00:28.173729+0000","last_undegraded":"2023-11-24T08:00:28.173729+0000","last_fullsized":"2023-11-24T08:00:28.173729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768358+0000","last_change":"2023-11-24T08:00:26.772489+0000","last_active":"2023-11-24T08:00:27.768358+0000","last_peered":"2023-11-24T08:00:27.768358+0000","last_clean":"2023-11-24T08:00:27.768358+0000","last_became_active":"2023-11-24T08:00:26.769412+0000","last_became_peered":"2023-11-24T08:00:26.769412+0000","last_unstale":"2023-11-24T08:00:27.768358+0000","last_undegraded":"2023-11-24T08:00:27.768358+0000","last_fullsized":"2023-11-24T08:00:27.768358+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172502+0000","last_change":"2023-11-24T08:00:26.771569+0000","last_active":"2023-11-24T08:00:28.172502+0000","last_peered":"2023-11-24T08:00:28.172502+0000","last_clean":"2023-11-24T08:00:28.172502+0000","last_became_active":"2023-11-24T08:00:26.771170+0000","last_became_peered":"2023-11-24T08:00:26.771170+0000","last_unstale":"2023-11-24T08:00:28.172502+0000","last_undegraded":"2023-11-24T08:00:28.172502+0000","last_fullsized":"2023-11-24T08:00:28.172502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172266+0000","last_change":"2023-11-24T08:00:26.770049+0000","last_active":"2023-11-24T08:00:28.172266+0000","last_peered":"2023-11-24T08:00:28.172266+0000","last_clean":"2023-11-24T08:00:28.172266+0000","last_became_active":"2023-11-24T08:00:26.769256+0000","last_became_peered":"2023-11-24T08:00:26.769256+0000","last_unstale":"2023-11-24T08:00:28.172266+0000","last_undegraded":"2023-11-24T08:00:28.172266+0000","last_fullsized":"2023-11-24T08:00:28.172266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174837+0000","last_change":"2023-11-24T08:00:26.782744+0000","last_active":"2023-11-24T08:00:28.174837+0000","last_peered":"2023-11-24T08:00:28.174837+0000","last_clean":"2023-11-24T08:00:28.174837+0000","last_became_active":"2023-11-24T08:00:26.780825+0000","last_became_peered":"2023-11-24T08:00:26.780825+0000","last_unstale":"2023-11-24T08:00:28.174837+0000","last_undegraded":"2023-11-24T08:00:28.174837+0000","last_fullsized":"2023-11-24T08:00:28.174837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:26.750802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768128+0000","last_change":"2023-11-24T08:00:26.771369+0000","last_active":"2023-11-24T08:00:27.768128+0000","last_peered":"2023-11-24T08:00:27.768128+0000","last_clean":"2023-11-24T08:00:27.768128+0000","last_became_active":"2023-11-24T08:00:26.769019+0000","last_became_peered":"2023-11-24T08:00:26.769019+0000","last_unstale":"2023-11-24T08:00:27.768128+0000","last_undegraded":"2023-11-24T08:00:27.768128+0000","last_fullsized":"2023-11-24T08:00:27.768128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768021+0000","last_change":"2023-11-24T08:00:26.768671+0000","last_active":"2023-11-24T08:00:27.768021+0000","last_peered":"2023-11-24T08:00:27.768021+0000","last_clean":"2023-11-24T08:00:27.768021+0000","last_became_active":"2023-11-24T08:00:26.768353+0000","last_became_peered":"2023-11-24T08:00:26.768353+0000","last_unstale":"2023-11-24T08:00:27.768021+0000","last_undegraded":"2023-11-24T08:00:27.768021+0000","last_fullsized":"2023-11-24T08:00:27.768021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172934+0000","last_change":"2023-11-24T08:00:26.749810+0000","last_active":"2023-11-24T08:00:28.172934+0000","last_peered":"2023-11-24T08:00:28.172934+0000","last_clean":"2023-11-24T08:00:28.172934+0000","last_became_active":"2023-11-24T08:00:26.749245+0000","last_became_peered":"2023-11-24T08:00:26.749245+0000","last_unstale":"2023-11-24T08:00:28.172934+0000","last_undegraded":"2023-11-24T08:00:28.172934+0000","last_fullsized":"2023-11-24T08:00:28.172934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:05.561300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174534+0000","last_change":"2023-11-24T08:00:26.765178+0000","last_active":"2023-11-24T08:00:28.174534+0000","last_peered":"2023-11-24T08:00:28.174534+0000","last_clean":"2023-11-24T08:00:28.174534+0000","last_became_active":"2023-11-24T08:00:26.764424+0000","last_became_peered":"2023-11-24T08:00:26.764424+0000","last_unstale":"2023-11-24T08:00:28.174534+0000","last_undegraded":"2023-11-24T08:00:28.174534+0000","last_fullsized":"2023-11-24T08:00:28.174534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:28.334008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171916+0000","last_change":"2023-11-24T08:00:26.764196+0000","last_active":"2023-11-24T08:00:28.171916+0000","last_peered":"2023-11-24T08:00:28.171916+0000","last_clean":"2023-11-24T08:00:28.171916+0000","last_became_active":"2023-11-24T08:00:26.763658+0000","last_became_peered":"2023-11-24T08:00:26.763658+0000","last_unstale":"2023-11-24T08:00:28.171916+0000","last_undegraded":"2023-11-24T08:00:28.171916+0000","last_fullsized":"2023-11-24T08:00:28.171916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:21.367690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765068+0000","last_change":"2023-11-24T08:00:26.756725+0000","last_active":"2023-11-24T08:00:27.765068+0000","last_peered":"2023-11-24T08:00:27.765068+0000","last_clean":"2023-11-24T08:00:27.765068+0000","last_became_active":"2023-11-24T08:00:26.755826+0000","last_became_peered":"2023-11-24T08:00:26.755826+0000","last_unstale":"2023-11-24T08:00:27.765068+0000","last_undegraded":"2023-11-24T08:00:27.765068+0000","last_fullsized":"2023-11-24T08:00:27.765068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:34.349090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767981+0000","last_change":"2023-11-24T08:00:26.765661+0000","last_active":"2023-11-24T08:00:27.767981+0000","last_peered":"2023-11-24T08:00:27.767981+0000","last_clean":"2023-11-24T08:00:27.767981+0000","last_became_active":"2023-11-24T08:00:26.765342+0000","last_became_peered":"2023-11-24T08:00:26.765342+0000","last_unstale":"2023-11-24T08:00:27.767981+0000","last_undegraded":"2023-11-24T08:00:27.767981+0000","last_fullsized":"2023-11-24T08:00:27.767981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769287+0000","last_change":"2023-11-24T08:00:26.775973+0000","last_active":"2023-11-24T08:00:27.769287+0000","last_peered":"2023-11-24T08:00:27.769287+0000","last_clean":"2023-11-24T08:00:27.769287+0000","last_became_active":"2023-11-24T08:00:26.775605+0000","last_became_peered":"2023-11-24T08:00:26.775605+0000","last_unstale":"2023-11-24T08:00:27.769287+0000","last_undegraded":"2023-11-24T08:00:27.769287+0000","last_fullsized":"2023-11-24T08:00:27.769287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171624+0000","last_change":"2023-11-24T08:00:26.759204+0000","last_active":"2023-11-24T08:00:28.171624+0000","last_peered":"2023-11-24T08:00:28.171624+0000","last_clean":"2023-11-24T08:00:28.171624+0000","last_became_active":"2023-11-24T08:00:26.758953+0000","last_became_peered":"2023-11-24T08:00:26.758953+0000","last_unstale":"2023-11-24T08:00:28.171624+0000","last_undegraded":"2023-11-24T08:00:28.171624+0000","last_fullsized":"2023-11-24T08:00:28.171624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:13.212470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174627+0000","last_change":"2023-11-24T08:00:26.763759+0000","last_active":"2023-11-24T08:00:28.174627+0000","last_peered":"2023-11-24T08:00:28.174627+0000","last_clean":"2023-11-24T08:00:28.174627+0000","last_became_active":"2023-11-24T08:00:26.763404+0000","last_became_peered":"2023-11-24T08:00:26.763404+0000","last_unstale":"2023-11-24T08:00:28.174627+0000","last_undegraded":"2023-11-24T08:00:28.174627+0000","last_fullsized":"2023-11-24T08:00:28.174627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767389+0000","last_change":"2023-11-24T08:00:26.755257+0000","last_active":"2023-11-24T08:00:27.767389+0000","last_peered":"2023-11-24T08:00:27.767389+0000","last_clean":"2023-11-24T08:00:27.767389+0000","last_became_active":"2023-11-24T08:00:26.754494+0000","last_became_peered":"2023-11-24T08:00:26.754494+0000","last_unstale":"2023-11-24T08:00:27.767389+0000","last_undegraded":"2023-11-24T08:00:27.767389+0000","last_fullsized":"2023-11-24T08:00:27.767389+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:17.332769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172553+0000","last_change":"2023-11-24T08:00:26.768879+0000","last_active":"2023-11-24T08:00:28.172553+0000","last_peered":"2023-11-24T08:00:28.172553+0000","last_clean":"2023-11-24T08:00:28.172553+0000","last_became_active":"2023-11-24T08:00:26.768610+0000","last_became_peered":"2023-11-24T08:00:26.768610+0000","last_unstale":"2023-11-24T08:00:28.172553+0000","last_undegraded":"2023-11-24T08:00:28.172553+0000","last_fullsized":"2023-11-24T08:00:28.172553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:31:37.160020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768724+0000","last_change":"2023-11-24T08:00:26.772226+0000","last_active":"2023-11-24T08:00:27.768724+0000","last_peered":"2023-11-24T08:00:27.768724+0000","last_clean":"2023-11-24T08:00:27.768724+0000","last_became_active":"2023-11-24T08:00:26.769115+0000","last_became_peered":"2023-11-24T08:00:26.769115+0000","last_unstale":"2023-11-24T08:00:27.768724+0000","last_undegraded":"2023-11-24T08:00:27.768724+0000","last_fullsized":"2023-11-24T08:00:27.768724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173030+0000","last_change":"2023-11-24T08:00:26.763479+0000","last_active":"2023-11-24T08:00:28.173030+0000","last_peered":"2023-11-24T08:00:28.173030+0000","last_clean":"2023-11-24T08:00:28.173030+0000","last_became_active":"2023-11-24T08:00:26.763174+0000","last_became_peered":"2023-11-24T08:00:26.763174+0000","last_unstale":"2023-11-24T08:00:28.173030+0000","last_undegraded":"2023-11-24T08:00:28.173030+0000","last_fullsized":"2023-11-24T08:00:28.173030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768104+0000","last_change":"2023-11-24T08:00:26.765894+0000","last_active":"2023-11-24T08:00:27.768104+0000","last_peered":"2023-11-24T08:00:27.768104+0000","last_clean":"2023-11-24T08:00:27.768104+0000","last_became_active":"2023-11-24T08:00:26.764976+0000","last_became_peered":"2023-11-24T08:00:26.764976+0000","last_unstale":"2023-11-24T08:00:27.768104+0000","last_undegraded":"2023-11-24T08:00:27.768104+0000","last_fullsized":"2023-11-24T08:00:27.768104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175290+0000","last_change":"2023-11-24T08:00:26.768006+0000","last_active":"2023-11-24T08:00:28.175290+0000","last_peered":"2023-11-24T08:00:28.175290+0000","last_clean":"2023-11-24T08:00:28.175290+0000","last_became_active":"2023-11-24T08:00:26.767556+0000","last_became_peered":"2023-11-24T08:00:26.767556+0000","last_unstale":"2023-11-24T08:00:28.175290+0000","last_undegraded":"2023-11-24T08:00:28.175290+0000","last_fullsized":"2023-11-24T08:00:28.175290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768993+0000","last_change":"2023-11-24T08:00:26.758837+0000","last_active":"2023-11-24T08:00:27.768993+0000","last_peered":"2023-11-24T08:00:27.768993+0000","last_clean":"2023-11-24T08:00:27.768993+0000","last_became_active":"2023-11-24T08:00:26.758557+0000","last_became_peered":"2023-11-24T08:00:26.758557+0000","last_unstale":"2023-11-24T08:00:27.768993+0000","last_undegraded":"2023-11-24T08:00:27.768993+0000","last_fullsized":"2023-11-24T08:00:27.768993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765777+0000","last_change":"2023-11-24T08:00:26.759241+0000","last_active":"2023-11-24T08:00:27.765777+0000","last_peered":"2023-11-24T08:00:27.765777+0000","last_clean":"2023-11-24T08:00:27.765777+0000","last_became_active":"2023-11-24T08:00:26.758911+0000","last_became_peered":"2023-11-24T08:00:26.758911+0000","last_unstale":"2023-11-24T08:00:27.765777+0000","last_undegraded":"2023-11-24T08:00:27.765777+0000","last_fullsized":"2023-11-24T08:00:27.765777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:46.400061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174708+0000","last_change":"2023-11-24T08:00:26.765218+0000","last_active":"2023-11-24T08:00:28.174708+0000","last_peered":"2023-11-24T08:00:28.174708+0000","last_clean":"2023-11-24T08:00:28.174708+0000","last_became_active":"2023-11-24T08:00:26.763830+0000","last_became_peered":"2023-11-24T08:00:26.763830+0000","last_unstale":"2023-11-24T08:00:28.174708+0000","last_undegraded":"2023-11-24T08:00:28.174708+0000","last_fullsized":"2023-11-24T08:00:28.174708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173620+0000","last_change":"2023-11-24T08:00:26.765008+0000","last_active":"2023-11-24T08:00:28.173620+0000","last_peered":"2023-11-24T08:00:28.173620+0000","last_clean":"2023-11-24T08:00:28.173620+0000","last_became_active":"2023-11-24T08:00:26.764497+0000","last_became_peered":"2023-11-24T08:00:26.764497+0000","last_unstale":"2023-11-24T08:00:28.173620+0000","last_undegraded":"2023-11-24T08:00:28.173620+0000","last_fullsized":"2023-11-24T08:00:28.173620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:57:34.349090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768747+0000","last_change":"2023-11-24T08:00:26.772754+0000","last_active":"2023-11-24T08:00:27.768747+0000","last_peered":"2023-11-24T08:00:27.768747+0000","last_clean":"2023-11-24T08:00:27.768747+0000","last_became_active":"2023-11-24T08:00:26.768109+0000","last_became_peered":"2023-11-24T08:00:26.768109+0000","last_unstale":"2023-11-24T08:00:27.768747+0000","last_undegraded":"2023-11-24T08:00:27.768747+0000","last_fullsized":"2023-11-24T08:00:27.768747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170980+0000","last_change":"2023-11-24T08:00:26.768358+0000","last_active":"2023-11-24T08:00:28.170980+0000","last_peered":"2023-11-24T08:00:28.170980+0000","last_clean":"2023-11-24T08:00:28.170980+0000","last_became_active":"2023-11-24T08:00:26.768127+0000","last_became_peered":"2023-11-24T08:00:26.768127+0000","last_unstale":"2023-11-24T08:00:28.170980+0000","last_undegraded":"2023-11-24T08:00:28.170980+0000","last_fullsized":"2023-11-24T08:00:28.170980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:19.015329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767410+0000","last_change":"2023-11-24T08:00:26.759713+0000","last_active":"2023-11-24T08:00:27.767410+0000","last_peered":"2023-11-24T08:00:27.767410+0000","last_clean":"2023-11-24T08:00:27.767410+0000","last_became_active":"2023-11-24T08:00:26.759342+0000","last_became_peered":"2023-11-24T08:00:26.759342+0000","last_unstale":"2023-11-24T08:00:27.767410+0000","last_undegraded":"2023-11-24T08:00:27.767410+0000","last_fullsized":"2023-11-24T08:00:27.767410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171879+0000","last_change":"2023-11-24T08:00:26.756578+0000","last_active":"2023-11-24T08:00:28.171879+0000","last_peered":"2023-11-24T08:00:28.171879+0000","last_clean":"2023-11-24T08:00:28.171879+0000","last_became_active":"2023-11-24T08:00:26.756310+0000","last_became_peered":"2023-11-24T08:00:26.756310+0000","last_unstale":"2023-11-24T08:00:28.171879+0000","last_undegraded":"2023-11-24T08:00:28.171879+0000","last_fullsized":"2023-11-24T08:00:28.171879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:57:23.219831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174796+0000","last_change":"2023-11-24T08:00:25.487322+0000","last_active":"2023-11-24T08:00:28.174796+0000","last_peered":"2023-11-24T08:00:28.174796+0000","last_clean":"2023-11-24T08:00:28.174796+0000","last_became_active":"2023-11-24T08:00:25.486807+0000","last_became_peered":"2023-11-24T08:00:25.486807+0000","last_unstale":"2023-11-24T08:00:28.174796+0000","last_undegraded":"2023-11-24T08:00:28.174796+0000","last_fullsized":"2023-11-24T08:00:28.174796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173508+0000","last_change":"2023-11-24T08:00:26.763826+0000","last_active":"2023-11-24T08:00:28.173508+0000","last_peered":"2023-11-24T08:00:28.173508+0000","last_clean":"2023-11-24T08:00:28.173508+0000","last_became_active":"2023-11-24T08:00:26.761268+0000","last_became_peered":"2023-11-24T08:00:26.761268+0000","last_unstale":"2023-11-24T08:00:28.173508+0000","last_undegraded":"2023-11-24T08:00:28.173508+0000","last_fullsized":"2023-11-24T08:00:28.173508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:51.537813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767502+0000","last_change":"2023-11-24T08:00:25.484440+0000","last_active":"2023-11-24T08:00:27.767502+0000","last_peered":"2023-11-24T08:00:27.767502+0000","last_clean":"2023-11-24T08:00:27.767502+0000","last_became_active":"2023-11-24T08:00:25.484176+0000","last_became_peered":"2023-11-24T08:00:25.484176+0000","last_unstale":"2023-11-24T08:00:27.767502+0000","last_undegraded":"2023-11-24T08:00:27.767502+0000","last_fullsized":"2023-11-24T08:00:27.767502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173120+0000","last_change":"2023-11-24T08:00:25.477583+0000","last_active":"2023-11-24T08:00:28.173120+0000","last_peered":"2023-11-24T08:00:28.173120+0000","last_clean":"2023-11-24T08:00:28.173120+0000","last_became_active":"2023-11-24T08:00:25.477315+0000","last_became_peered":"2023-11-24T08:00:25.477315+0000","last_unstale":"2023-11-24T08:00:28.173120+0000","last_undegraded":"2023-11-24T08:00:28.173120+0000","last_fullsized":"2023-11-24T08:00:28.173120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172762+0000","last_change":"2023-11-24T08:00:26.768787+0000","last_active":"2023-11-24T08:00:28.172762+0000","last_peered":"2023-11-24T08:00:28.172762+0000","last_clean":"2023-11-24T08:00:28.172762+0000","last_became_active":"2023-11-24T08:00:26.766444+0000","last_became_peered":"2023-11-24T08:00:26.766444+0000","last_unstale":"2023-11-24T08:00:28.172762+0000","last_undegraded":"2023-11-24T08:00:28.172762+0000","last_fullsized":"2023-11-24T08:00:28.172762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:05.771989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768123+0000","last_change":"2023-11-24T08:00:25.492070+0000","last_active":"2023-11-24T08:00:27.768123+0000","last_peered":"2023-11-24T08:00:27.768123+0000","last_clean":"2023-11-24T08:00:27.768123+0000","last_became_active":"2023-11-24T08:00:25.489186+0000","last_became_peered":"2023-11-24T08:00:25.489186+0000","last_unstale":"2023-11-24T08:00:27.768123+0000","last_undegraded":"2023-11-24T08:00:27.768123+0000","last_fullsized":"2023-11-24T08:00:27.768123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.764650+0000","last_change":"2023-11-24T08:00:26.759451+0000","last_active":"2023-11-24T08:00:27.764650+0000","last_peered":"2023-11-24T08:00:27.764650+0000","last_clean":"2023-11-24T08:00:27.764650+0000","last_became_active":"2023-11-24T08:00:26.758996+0000","last_became_peered":"2023-11-24T08:00:26.758996+0000","last_unstale":"2023-11-24T08:00:27.764650+0000","last_undegraded":"2023-11-24T08:00:27.764650+0000","last_fullsized":"2023-11-24T08:00:27.764650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:29:43.741603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768950+0000","last_change":"2023-11-24T08:00:25.493105+0000","last_active":"2023-11-24T08:00:27.768950+0000","last_peered":"2023-11-24T08:00:27.768950+0000","last_clean":"2023-11-24T08:00:27.768950+0000","last_became_active":"2023-11-24T08:00:25.492800+0000","last_became_peered":"2023-11-24T08:00:25.492800+0000","last_unstale":"2023-11-24T08:00:27.768950+0000","last_undegraded":"2023-11-24T08:00:27.768950+0000","last_fullsized":"2023-11-24T08:00:27.768950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768631+0000","last_change":"2023-11-24T08:00:26.777968+0000","last_active":"2023-11-24T08:00:27.768631+0000","last_peered":"2023-11-24T08:00:27.768631+0000","last_clean":"2023-11-24T08:00:27.768631+0000","last_became_active":"2023-11-24T08:00:26.774815+0000","last_became_peered":"2023-11-24T08:00:26.774815+0000","last_unstale":"2023-11-24T08:00:27.768631+0000","last_undegraded":"2023-11-24T08:00:27.768631+0000","last_fullsized":"2023-11-24T08:00:27.768631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768646+0000","last_change":"2023-11-24T08:00:25.491014+0000","last_active":"2023-11-24T08:00:27.768646+0000","last_peered":"2023-11-24T08:00:27.768646+0000","last_clean":"2023-11-24T08:00:27.768646+0000","last_became_active":"2023-11-24T08:00:25.490752+0000","last_became_peered":"2023-11-24T08:00:25.490752+0000","last_unstale":"2023-11-24T08:00:27.768646+0000","last_undegraded":"2023-11-24T08:00:27.768646+0000","last_fullsized":"2023-11-24T08:00:27.768646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173992+0000","last_change":"2023-11-24T08:00:26.777398+0000","last_active":"2023-11-24T08:00:28.173992+0000","last_peered":"2023-11-24T08:00:28.173992+0000","last_clean":"2023-11-24T08:00:28.173992+0000","last_became_active":"2023-11-24T08:00:26.777180+0000","last_became_peered":"2023-11-24T08:00:26.777180+0000","last_unstale":"2023-11-24T08:00:28.173992+0000","last_undegraded":"2023-11-24T08:00:28.173992+0000","last_fullsized":"2023-11-24T08:00:28.173992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:15.798578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757016+0000","last_change":"2023-11-24T08:00:25.493583+0000","last_active":"2023-11-24T08:00:27.757016+0000","last_peered":"2023-11-24T08:00:27.757016+0000","last_clean":"2023-11-24T08:00:27.757016+0000","last_became_active":"2023-11-24T08:00:25.493049+0000","last_became_peered":"2023-11-24T08:00:25.493049+0000","last_unstale":"2023-11-24T08:00:27.757016+0000","last_undegraded":"2023-11-24T08:00:27.757016+0000","last_fullsized":"2023-11-24T08:00:27.757016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:39:04.556704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173051+0000","last_change":"2023-11-24T08:00:26.771496+0000","last_active":"2023-11-24T08:00:28.173051+0000","last_peered":"2023-11-24T08:00:28.173051+0000","last_clean":"2023-11-24T08:00:28.173051+0000","last_became_active":"2023-11-24T08:00:26.768866+0000","last_became_peered":"2023-11-24T08:00:26.768866+0000","last_unstale":"2023-11-24T08:00:28.173051+0000","last_undegraded":"2023-11-24T08:00:28.173051+0000","last_fullsized":"2023-11-24T08:00:28.173051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:48.837595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767521+0000","last_change":"2023-11-24T08:00:25.470991+0000","last_active":"2023-11-24T08:00:27.767521+0000","last_peered":"2023-11-24T08:00:27.767521+0000","last_clean":"2023-11-24T08:00:27.767521+0000","last_became_active":"2023-11-24T08:00:25.467281+0000","last_became_peered":"2023-11-24T08:00:25.467281+0000","last_unstale":"2023-11-24T08:00:27.767521+0000","last_undegraded":"2023-11-24T08:00:27.767521+0000","last_fullsized":"2023-11-24T08:00:27.767521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:45.595352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173928+0000","last_change":"2023-11-24T08:00:26.761810+0000","last_active":"2023-11-24T08:00:28.173928+0000","last_peered":"2023-11-24T08:00:28.173928+0000","last_clean":"2023-11-24T08:00:28.173928+0000","last_became_active":"2023-11-24T08:00:26.761443+0000","last_became_peered":"2023-11-24T08:00:26.761443+0000","last_unstale":"2023-11-24T08:00:28.173928+0000","last_undegraded":"2023-11-24T08:00:28.173928+0000","last_fullsized":"2023-11-24T08:00:28.173928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:23.389884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757793+0000","last_change":"2023-11-24T08:00:25.476805+0000","last_active":"2023-11-24T08:00:27.757793+0000","last_peered":"2023-11-24T08:00:27.757793+0000","last_clean":"2023-11-24T08:00:27.757793+0000","last_became_active":"2023-11-24T08:00:25.476150+0000","last_became_peered":"2023-11-24T08:00:25.476150+0000","last_unstale":"2023-11-24T08:00:27.757793+0000","last_undegraded":"2023-11-24T08:00:27.757793+0000","last_fullsized":"2023-11-24T08:00:27.757793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172213+0000","last_change":"2023-11-24T08:00:26.770849+0000","last_active":"2023-11-24T08:00:28.172213+0000","last_peered":"2023-11-24T08:00:28.172213+0000","last_clean":"2023-11-24T08:00:28.172213+0000","last_became_active":"2023-11-24T08:00:26.769532+0000","last_became_peered":"2023-11-24T08:00:26.769532+0000","last_unstale":"2023-11-24T08:00:28.172213+0000","last_undegraded":"2023-11-24T08:00:28.172213+0000","last_fullsized":"2023-11-24T08:00:28.172213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:50.279093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768910+0000","last_change":"2023-11-24T08:00:25.489658+0000","last_active":"2023-11-24T08:00:27.768910+0000","last_peered":"2023-11-24T08:00:27.768910+0000","last_clean":"2023-11-24T08:00:27.768910+0000","last_became_active":"2023-11-24T08:00:25.489387+0000","last_became_peered":"2023-11-24T08:00:25.489387+0000","last_unstale":"2023-11-24T08:00:27.768910+0000","last_undegraded":"2023-11-24T08:00:27.768910+0000","last_fullsized":"2023-11-24T08:00:27.768910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:12.207873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174020+0000","last_change":"2023-11-24T08:00:26.773222+0000","last_active":"2023-11-24T08:00:28.174020+0000","last_peered":"2023-11-24T08:00:28.174020+0000","last_clean":"2023-11-24T08:00:28.174020+0000","last_became_active":"2023-11-24T08:00:26.772961+0000","last_became_peered":"2023-11-24T08:00:26.772961+0000","last_unstale":"2023-11-24T08:00:28.174020+0000","last_undegraded":"2023-11-24T08:00:28.174020+0000","last_fullsized":"2023-11-24T08:00:28.174020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767377+0000","last_change":"2023-11-24T08:00:25.480070+0000","last_active":"2023-11-24T08:00:27.767377+0000","last_peered":"2023-11-24T08:00:27.767377+0000","last_clean":"2023-11-24T08:00:27.767377+0000","last_became_active":"2023-11-24T08:00:25.479345+0000","last_became_peered":"2023-11-24T08:00:25.479345+0000","last_unstale":"2023-11-24T08:00:27.767377+0000","last_undegraded":"2023-11-24T08:00:27.767377+0000","last_fullsized":"2023-11-24T08:00:27.767377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767763+0000","last_change":"2023-11-24T08:00:26.760511+0000","last_active":"2023-11-24T08:00:27.767763+0000","last_peered":"2023-11-24T08:00:27.767763+0000","last_clean":"2023-11-24T08:00:27.767763+0000","last_became_active":"2023-11-24T08:00:26.760206+0000","last_became_peered":"2023-11-24T08:00:26.760206+0000","last_unstale":"2023-11-24T08:00:27.767763+0000","last_undegraded":"2023-11-24T08:00:27.767763+0000","last_fullsized":"2023-11-24T08:00:27.767763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:28:35.484430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170764+0000","last_change":"2023-11-24T08:00:25.477302+0000","last_active":"2023-11-24T08:00:28.170764+0000","last_peered":"2023-11-24T08:00:28.170764+0000","last_clean":"2023-11-24T08:00:28.170764+0000","last_became_active":"2023-11-24T08:00:25.477026+0000","last_became_peered":"2023-11-24T08:00:25.477026+0000","last_unstale":"2023-11-24T08:00:28.170764+0000","last_undegraded":"2023-11-24T08:00:28.170764+0000","last_fullsized":"2023-11-24T08:00:28.170764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:47.411014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173040+0000","last_change":"2023-11-24T08:00:26.771081+0000","last_active":"2023-11-24T08:00:28.173040+0000","last_peered":"2023-11-24T08:00:28.173040+0000","last_clean":"2023-11-24T08:00:28.173040+0000","last_became_active":"2023-11-24T08:00:26.767738+0000","last_became_peered":"2023-11-24T08:00:26.767738+0000","last_unstale":"2023-11-24T08:00:28.173040+0000","last_undegraded":"2023-11-24T08:00:28.173040+0000","last_fullsized":"2023-11-24T08:00:28.173040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.759653+0000","last_change":"2023-11-24T08:00:25.473084+0000","last_active":"2023-11-24T08:00:27.759653+0000","last_peered":"2023-11-24T08:00:27.759653+0000","last_clean":"2023-11-24T08:00:27.759653+0000","last_became_active":"2023-11-24T08:00:25.472511+0000","last_became_peered":"2023-11-24T08:00:25.472511+0000","last_unstale":"2023-11-24T08:00:27.759653+0000","last_undegraded":"2023-11-24T08:00:27.759653+0000","last_fullsized":"2023-11-24T08:00:27.759653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:34:30.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174602+0000","last_change":"2023-11-24T08:00:26.770832+0000","last_active":"2023-11-24T08:00:28.174602+0000","last_peered":"2023-11-24T08:00:28.174602+0000","last_clean":"2023-11-24T08:00:28.174602+0000","last_became_active":"2023-11-24T08:00:26.770425+0000","last_became_peered":"2023-11-24T08:00:26.770425+0000","last_unstale":"2023-11-24T08:00:28.174602+0000","last_undegraded":"2023-11-24T08:00:28.174602+0000","last_fullsized":"2023-11-24T08:00:28.174602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:38:15.623810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171853+0000","last_change":"2023-11-24T08:00:25.479082+0000","last_active":"2023-11-24T08:00:28.171853+0000","last_peered":"2023-11-24T08:00:28.171853+0000","last_clean":"2023-11-24T08:00:28.171853+0000","last_became_active":"2023-11-24T08:00:25.478759+0000","last_became_peered":"2023-11-24T08:00:25.478759+0000","last_unstale":"2023-11-24T08:00:28.171853+0000","last_undegraded":"2023-11-24T08:00:28.171853+0000","last_fullsized":"2023-11-24T08:00:28.171853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:33:21.224897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175030+0000","last_change":"2023-11-24T08:00:26.766352+0000","last_active":"2023-11-24T08:00:28.175030+0000","last_peered":"2023-11-24T08:00:28.175030+0000","last_clean":"2023-11-24T08:00:28.175030+0000","last_became_active":"2023-11-24T08:00:26.765178+0000","last_became_peered":"2023-11-24T08:00:26.765178+0000","last_unstale":"2023-11-24T08:00:28.175030+0000","last_undegraded":"2023-11-24T08:00:28.175030+0000","last_fullsized":"2023-11-24T08:00:28.175030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:31.302140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757035+0000","last_change":"2023-11-24T08:00:25.480774+0000","last_active":"2023-11-24T08:00:27.757035+0000","last_peered":"2023-11-24T08:00:27.757035+0000","last_clean":"2023-11-24T08:00:27.757035+0000","last_became_active":"2023-11-24T08:00:25.480505+0000","last_became_peered":"2023-11-24T08:00:25.480505+0000","last_unstale":"2023-11-24T08:00:27.757035+0000","last_undegraded":"2023-11-24T08:00:27.757035+0000","last_fullsized":"2023-11-24T08:00:27.757035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:47.832998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768605+0000","last_change":"2023-11-24T08:00:26.777032+0000","last_active":"2023-11-24T08:00:27.768605+0000","last_peered":"2023-11-24T08:00:27.768605+0000","last_clean":"2023-11-24T08:00:27.768605+0000","last_became_active":"2023-11-24T08:00:26.776390+0000","last_became_peered":"2023-11-24T08:00:26.776390+0000","last_unstale":"2023-11-24T08:00:27.768605+0000","last_undegraded":"2023-11-24T08:00:27.768605+0000","last_fullsized":"2023-11-24T08:00:27.768605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:03.790065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171558+0000","last_change":"2023-11-24T08:00:25.482325+0000","last_active":"2023-11-24T08:00:28.171558+0000","last_peered":"2023-11-24T08:00:28.171558+0000","last_clean":"2023-11-24T08:00:28.171558+0000","last_became_active":"2023-11-24T08:00:25.481949+0000","last_became_peered":"2023-11-24T08:00:25.481949+0000","last_unstale":"2023-11-24T08:00:28.171558+0000","last_undegraded":"2023-11-24T08:00:28.171558+0000","last_fullsized":"2023-11-24T08:00:28.171558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174954+0000","last_change":"2023-11-24T08:00:26.768210+0000","last_active":"2023-11-24T08:00:28.174954+0000","last_peered":"2023-11-24T08:00:28.174954+0000","last_clean":"2023-11-24T08:00:28.174954+0000","last_became_active":"2023-11-24T08:00:26.767945+0000","last_became_peered":"2023-11-24T08:00:26.767945+0000","last_unstale":"2023-11-24T08:00:28.174954+0000","last_undegraded":"2023-11-24T08:00:28.174954+0000","last_fullsized":"2023-11-24T08:00:28.174954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:14.495500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:26.745147+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:00:26.745147+0000","last_peered":"2023-11-24T08:00:26.745147+0000","last_clean":"2023-11-24T08:00:26.745147+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:00:26.745147+0000","last_undegraded":"2023-11-24T08:00:26.745147+0000","last_fullsized":"2023-11-24T08:00:26.745147+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768099+0000","last_change":"2023-11-24T08:00:25.482920+0000","last_active":"2023-11-24T08:00:27.768099+0000","last_peered":"2023-11-24T08:00:27.768099+0000","last_clean":"2023-11-24T08:00:27.768099+0000","last_became_active":"2023-11-24T08:00:25.482550+0000","last_became_peered":"2023-11-24T08:00:25.482550+0000","last_unstale":"2023-11-24T08:00:27.768099+0000","last_undegraded":"2023-11-24T08:00:27.768099+0000","last_fullsized":"2023-11-24T08:00:27.768099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:40:19.562218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174979+0000","last_change":"2023-11-24T08:00:26.771428+0000","last_active":"2023-11-24T08:00:28.174979+0000","last_peered":"2023-11-24T08:00:28.174979+0000","last_clean":"2023-11-24T08:00:28.174979+0000","last_became_active":"2023-11-24T08:00:26.771067+0000","last_became_peered":"2023-11-24T08:00:26.771067+0000","last_unstale":"2023-11-24T08:00:28.174979+0000","last_undegraded":"2023-11-24T08:00:28.174979+0000","last_fullsized":"2023-11-24T08:00:28.174979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:06.513368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172499+0000","last_change":"2023-11-24T08:00:25.494571+0000","last_active":"2023-11-24T08:00:28.172499+0000","last_peered":"2023-11-24T08:00:28.172499+0000","last_clean":"2023-11-24T08:00:28.172499+0000","last_became_active":"2023-11-24T08:00:25.493557+0000","last_became_peered":"2023-11-24T08:00:25.493557+0000","last_unstale":"2023-11-24T08:00:28.172499+0000","last_undegraded":"2023-11-24T08:00:28.172499+0000","last_fullsized":"2023-11-24T08:00:28.172499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:18.010733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171943+0000","last_change":"2023-11-24T08:00:26.762814+0000","last_active":"2023-11-24T08:00:28.171943+0000","last_peered":"2023-11-24T08:00:28.171943+0000","last_clean":"2023-11-24T08:00:28.171943+0000","last_became_active":"2023-11-24T08:00:26.761448+0000","last_became_peered":"2023-11-24T08:00:26.761448+0000","last_unstale":"2023-11-24T08:00:28.171943+0000","last_undegraded":"2023-11-24T08:00:28.171943+0000","last_fullsized":"2023-11-24T08:00:28.171943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:43.356429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.170966+0000","last_change":"2023-11-24T08:00:25.478945+0000","last_active":"2023-11-24T08:00:28.170966+0000","last_peered":"2023-11-24T08:00:28.170966+0000","last_clean":"2023-11-24T08:00:28.170966+0000","last_became_active":"2023-11-24T08:00:25.478645+0000","last_became_peered":"2023-11-24T08:00:25.478645+0000","last_unstale":"2023-11-24T08:00:28.170966+0000","last_undegraded":"2023-11-24T08:00:28.170966+0000","last_fullsized":"2023-11-24T08:00:28.170966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:26:36.241356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.764572+0000","last_change":"2023-11-24T08:00:26.756524+0000","last_active":"2023-11-24T08:00:27.764572+0000","last_peered":"2023-11-24T08:00:27.764572+0000","last_clean":"2023-11-24T08:00:27.764572+0000","last_became_active":"2023-11-24T08:00:26.754522+0000","last_became_peered":"2023-11-24T08:00:26.754522+0000","last_unstale":"2023-11-24T08:00:27.764572+0000","last_undegraded":"2023-11-24T08:00:27.764572+0000","last_fullsized":"2023-11-24T08:00:27.764572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:51.537813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.768991+0000","last_change":"2023-11-24T08:00:25.489726+0000","last_active":"2023-11-24T08:00:27.768991+0000","last_peered":"2023-11-24T08:00:27.768991+0000","last_clean":"2023-11-24T08:00:27.768991+0000","last_became_active":"2023-11-24T08:00:25.489421+0000","last_became_peered":"2023-11-24T08:00:25.489421+0000","last_unstale":"2023-11-24T08:00:27.768991+0000","last_undegraded":"2023-11-24T08:00:27.768991+0000","last_fullsized":"2023-11-24T08:00:27.768991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172280+0000","last_change":"2023-11-24T08:00:26.766472+0000","last_active":"2023-11-24T08:00:28.172280+0000","last_peered":"2023-11-24T08:00:28.172280+0000","last_clean":"2023-11-24T08:00:28.172280+0000","last_became_active":"2023-11-24T08:00:26.765996+0000","last_became_peered":"2023-11-24T08:00:26.765996+0000","last_unstale":"2023-11-24T08:00:28.172280+0000","last_undegraded":"2023-11-24T08:00:28.172280+0000","last_fullsized":"2023-11-24T08:00:28.172280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:07:22.755097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.756982+0000","last_change":"2023-11-24T08:00:25.481042+0000","last_active":"2023-11-24T08:00:27.756982+0000","last_peered":"2023-11-24T08:00:27.756982+0000","last_clean":"2023-11-24T08:00:27.756982+0000","last_became_active":"2023-11-24T08:00:25.480733+0000","last_became_peered":"2023-11-24T08:00:25.480733+0000","last_unstale":"2023-11-24T08:00:27.756982+0000","last_undegraded":"2023-11-24T08:00:27.756982+0000","last_fullsized":"2023-11-24T08:00:27.756982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:48:41.051307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769401+0000","last_change":"2023-11-24T08:00:26.775027+0000","last_active":"2023-11-24T08:00:27.769401+0000","last_peered":"2023-11-24T08:00:27.769401+0000","last_clean":"2023-11-24T08:00:27.769401+0000","last_became_active":"2023-11-24T08:00:26.774593+0000","last_became_peered":"2023-11-24T08:00:26.774593+0000","last_unstale":"2023-11-24T08:00:27.769401+0000","last_undegraded":"2023-11-24T08:00:27.769401+0000","last_fullsized":"2023-11-24T08:00:27.769401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:14.346809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174850+0000","last_change":"2023-11-24T08:00:25.494481+0000","last_active":"2023-11-24T08:00:28.174850+0000","last_peered":"2023-11-24T08:00:28.174850+0000","last_clean":"2023-11-24T08:00:28.174850+0000","last_became_active":"2023-11-24T08:00:25.494253+0000","last_became_peered":"2023-11-24T08:00:25.494253+0000","last_unstale":"2023-11-24T08:00:28.174850+0000","last_undegraded":"2023-11-24T08:00:28.174850+0000","last_fullsized":"2023-11-24T08:00:28.174850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:04.500006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765589+0000","last_change":"2023-11-24T08:00:26.757666+0000","last_active":"2023-11-24T08:00:27.765589+0000","last_peered":"2023-11-24T08:00:27.765589+0000","last_clean":"2023-11-24T08:00:27.765589+0000","last_became_active":"2023-11-24T08:00:26.757401+0000","last_became_peered":"2023-11-24T08:00:26.757401+0000","last_unstale":"2023-11-24T08:00:27.765589+0000","last_undegraded":"2023-11-24T08:00:27.765589+0000","last_fullsized":"2023-11-24T08:00:27.765589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:29.359703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.765913+0000","last_change":"2023-11-24T08:00:25.483011+0000","last_active":"2023-11-24T08:00:27.765913+0000","last_peered":"2023-11-24T08:00:27.765913+0000","last_clean":"2023-11-24T08:00:27.765913+0000","last_became_active":"2023-11-24T08:00:25.481668+0000","last_became_peered":"2023-11-24T08:00:25.481668+0000","last_unstale":"2023-11-24T08:00:27.765913+0000","last_undegraded":"2023-11-24T08:00:27.765913+0000","last_fullsized":"2023-11-24T08:00:27.765913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:46:23.299565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174672+0000","last_change":"2023-11-24T08:00:26.760962+0000","last_active":"2023-11-24T08:00:28.174672+0000","last_peered":"2023-11-24T08:00:28.174672+0000","last_clean":"2023-11-24T08:00:28.174672+0000","last_became_active":"2023-11-24T08:00:26.760541+0000","last_became_peered":"2023-11-24T08:00:26.760541+0000","last_unstale":"2023-11-24T08:00:28.174672+0000","last_undegraded":"2023-11-24T08:00:28.174672+0000","last_fullsized":"2023-11-24T08:00:28.174672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.318668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769002+0000","last_change":"2023-11-24T08:00:25.491430+0000","last_active":"2023-11-24T08:00:27.769002+0000","last_peered":"2023-11-24T08:00:27.769002+0000","last_clean":"2023-11-24T08:00:27.769002+0000","last_became_active":"2023-11-24T08:00:25.490656+0000","last_became_peered":"2023-11-24T08:00:25.490656+0000","last_unstale":"2023-11-24T08:00:27.769002+0000","last_undegraded":"2023-11-24T08:00:27.769002+0000","last_fullsized":"2023-11-24T08:00:27.769002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173988+0000","last_change":"2023-11-24T08:00:26.762592+0000","last_active":"2023-11-24T08:00:28.173988+0000","last_peered":"2023-11-24T08:00:28.173988+0000","last_clean":"2023-11-24T08:00:28.173988+0000","last_became_active":"2023-11-24T08:00:26.759772+0000","last_became_peered":"2023-11-24T08:00:26.759772+0000","last_unstale":"2023-11-24T08:00:28.173988+0000","last_undegraded":"2023-11-24T08:00:28.173988+0000","last_fullsized":"2023-11-24T08:00:28.173988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:07:46.400061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172271+0000","last_change":"2023-11-24T08:00:25.494768+0000","last_active":"2023-11-24T08:00:28.172271+0000","last_peered":"2023-11-24T08:00:28.172271+0000","last_clean":"2023-11-24T08:00:28.172271+0000","last_became_active":"2023-11-24T08:00:25.494268+0000","last_became_peered":"2023-11-24T08:00:25.494268+0000","last_unstale":"2023-11-24T08:00:28.172271+0000","last_undegraded":"2023-11-24T08:00:28.172271+0000","last_fullsized":"2023-11-24T08:00:28.172271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:07.710916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.171955+0000","last_change":"2023-11-24T08:00:26.761236+0000","last_active":"2023-11-24T08:00:28.171955+0000","last_peered":"2023-11-24T08:00:28.171955+0000","last_clean":"2023-11-24T08:00:28.171955+0000","last_became_active":"2023-11-24T08:00:26.755777+0000","last_became_peered":"2023-11-24T08:00:26.755777+0000","last_unstale":"2023-11-24T08:00:28.171955+0000","last_undegraded":"2023-11-24T08:00:28.171955+0000","last_fullsized":"2023-11-24T08:00:28.171955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:15:38.288322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.756915+0000","last_change":"2023-11-24T08:00:25.483781+0000","last_active":"2023-11-24T08:00:27.756915+0000","last_peered":"2023-11-24T08:00:27.756915+0000","last_clean":"2023-11-24T08:00:27.756915+0000","last_became_active":"2023-11-24T08:00:25.483449+0000","last_became_peered":"2023-11-24T08:00:25.483449+0000","last_unstale":"2023-11-24T08:00:27.756915+0000","last_undegraded":"2023-11-24T08:00:27.756915+0000","last_fullsized":"2023-11-24T08:00:27.756915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:14:42.351833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.172763+0000","last_change":"2023-11-24T08:00:26.770074+0000","last_active":"2023-11-24T08:00:28.172763+0000","last_peered":"2023-11-24T08:00:28.172763+0000","last_clean":"2023-11-24T08:00:28.172763+0000","last_became_active":"2023-11-24T08:00:26.767285+0000","last_became_peered":"2023-11-24T08:00:26.767285+0000","last_unstale":"2023-11-24T08:00:28.172763+0000","last_undegraded":"2023-11-24T08:00:28.172763+0000","last_fullsized":"2023-11-24T08:00:28.172763+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.756933+0000","last_change":"2023-11-24T08:00:25.483961+0000","last_active":"2023-11-24T08:00:27.756933+0000","last_peered":"2023-11-24T08:00:27.756933+0000","last_clean":"2023-11-24T08:00:27.756933+0000","last_became_active":"2023-11-24T08:00:25.481836+0000","last_became_peered":"2023-11-24T08:00:25.481836+0000","last_unstale":"2023-11-24T08:00:27.756933+0000","last_undegraded":"2023-11-24T08:00:27.756933+0000","last_fullsized":"2023-11-24T08:00:27.756933+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:59:09.816614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.175247+0000","last_change":"2023-11-24T08:00:26.769858+0000","last_active":"2023-11-24T08:00:28.175247+0000","last_peered":"2023-11-24T08:00:28.175247+0000","last_clean":"2023-11-24T08:00:28.175247+0000","last_became_active":"2023-11-24T08:00:26.766200+0000","last_became_peered":"2023-11-24T08:00:26.766200+0000","last_unstale":"2023-11-24T08:00:28.175247+0000","last_undegraded":"2023-11-24T08:00:28.175247+0000","last_fullsized":"2023-11-24T08:00:28.175247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:48.760815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174355+0000","last_change":"2023-11-24T08:00:25.495132+0000","last_active":"2023-11-24T08:00:28.174355+0000","last_peered":"2023-11-24T08:00:28.174355+0000","last_clean":"2023-11-24T08:00:28.174355+0000","last_became_active":"2023-11-24T08:00:25.494764+0000","last_became_peered":"2023-11-24T08:00:25.494764+0000","last_unstale":"2023-11-24T08:00:28.174355+0000","last_undegraded":"2023-11-24T08:00:28.174355+0000","last_fullsized":"2023-11-24T08:00:28.174355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:16:56.801268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.767414+0000","last_change":"2023-11-24T08:00:26.749850+0000","last_active":"2023-11-24T08:00:27.767414+0000","last_peered":"2023-11-24T08:00:27.767414+0000","last_clean":"2023-11-24T08:00:27.767414+0000","last_became_active":"2023-11-24T08:00:26.749536+0000","last_became_peered":"2023-11-24T08:00:26.749536+0000","last_unstale":"2023-11-24T08:00:27.767414+0000","last_undegraded":"2023-11-24T08:00:27.767414+0000","last_fullsized":"2023-11-24T08:00:27.767414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:32:05.504603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769202+0000","last_change":"2023-11-24T08:00:26.779787+0000","last_active":"2023-11-24T08:00:27.769202+0000","last_peered":"2023-11-24T08:00:27.769202+0000","last_clean":"2023-11-24T08:00:27.769202+0000","last_became_active":"2023-11-24T08:00:26.779470+0000","last_became_peered":"2023-11-24T08:00:26.779470+0000","last_unstale":"2023-11-24T08:00:27.769202+0000","last_undegraded":"2023-11-24T08:00:27.769202+0000","last_fullsized":"2023-11-24T08:00:27.769202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:17:34.243738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173834+0000","last_change":"2023-11-24T08:00:25.497773+0000","last_active":"2023-11-24T08:00:28.173834+0000","last_peered":"2023-11-24T08:00:28.173834+0000","last_clean":"2023-11-24T08:00:28.173834+0000","last_became_active":"2023-11-24T08:00:25.497355+0000","last_became_peered":"2023-11-24T08:00:25.497355+0000","last_unstale":"2023-11-24T08:00:28.173834+0000","last_undegraded":"2023-11-24T08:00:28.173834+0000","last_fullsized":"2023-11-24T08:00:28.173834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:35.928845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.769447+0000","last_change":"2023-11-24T08:00:26.779853+0000","last_active":"2023-11-24T08:00:27.769447+0000","last_peered":"2023-11-24T08:00:27.769447+0000","last_clean":"2023-11-24T08:00:27.769447+0000","last_became_active":"2023-11-24T08:00:26.779449+0000","last_became_peered":"2023-11-24T08:00:26.779449+0000","last_unstale":"2023-11-24T08:00:27.769447+0000","last_undegraded":"2023-11-24T08:00:27.769447+0000","last_fullsized":"2023-11-24T08:00:27.769447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:24:37.934139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174399+0000","last_change":"2023-11-24T08:00:25.493174+0000","last_active":"2023-11-24T08:00:28.174399+0000","last_peered":"2023-11-24T08:00:28.174399+0000","last_clean":"2023-11-24T08:00:28.174399+0000","last_became_active":"2023-11-24T08:00:25.492565+0000","last_became_peered":"2023-11-24T08:00:25.492565+0000","last_unstale":"2023-11-24T08:00:28.174399+0000","last_undegraded":"2023-11-24T08:00:28.174399+0000","last_fullsized":"2023-11-24T08:00:28.174399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:16.328173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.173696+0000","last_change":"2023-11-24T08:00:26.779709+0000","last_active":"2023-11-24T08:00:28.173696+0000","last_peered":"2023-11-24T08:00:28.173696+0000","last_clean":"2023-11-24T08:00:28.173696+0000","last_became_active":"2023-11-24T08:00:26.779501+0000","last_became_peered":"2023-11-24T08:00:26.779501+0000","last_unstale":"2023-11-24T08:00:28.173696+0000","last_undegraded":"2023-11-24T08:00:28.173696+0000","last_fullsized":"2023-11-24T08:00:28.173696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:59:29.359703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174361+0000","last_change":"2023-11-24T08:00:25.475566+0000","last_active":"2023-11-24T08:00:28.174361+0000","last_peered":"2023-11-24T08:00:28.174361+0000","last_clean":"2023-11-24T08:00:28.174361+0000","last_became_active":"2023-11-24T08:00:25.475286+0000","last_became_peered":"2023-11-24T08:00:25.475286+0000","last_unstale":"2023-11-24T08:00:28.174361+0000","last_undegraded":"2023-11-24T08:00:28.174361+0000","last_fullsized":"2023-11-24T08:00:28.174361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:00:25.827802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-24T08:00:28.174531+0000","last_change":"2023-11-24T08:00:26.759142+0000","last_active":"2023-11-24T08:00:28.174531+0000","last_peered":"2023-11-24T08:00:28.174531+0000","last_clean":"2023-11-24T08:00:28.174531+0000","last_became_active":"2023-11-24T08:00:26.758874+0000","last_became_peered":"2023-11-24T08:00:26.758874+0000","last_unstale":"2023-11-24T08:00:28.174531+0000","last_undegraded":"2023-11-24T08:00:28.174531+0000","last_fullsized":"2023-11-24T08:00:28.174531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:25.439165+0000","last_clean_scrub_stamp":"2023-11-24T08:00:25.439165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:48:38.158240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-24T08:00:27.757913+0000","last_change":"2023-11-24T08:00:25.490543+0000","last_active":"2023-11-24T08:00:27.757913+0000","last_peered":"2023-11-24T08:00:27.757913+0000","last_clean":"2023-11-24T08:00:27.757913+0000","last_became_active":"2023-11-24T08:00:25.490222+0000","last_became_peered":"2023-11-24T08:00:25.490222+0000","last_unstale":"2023-11-24T08:00:27.757913+0000","last_undegraded":"2023-11-24T08:00:27.757913+0000","last_fullsized":"2023-11-24T08:00:27.757913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:24.434569+0000","last_clean_scrub_stamp":"2023-11-24T08:00:24.434569+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:34:32.891088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":819200,"data_stored":668130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.266}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.738}]}]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6709999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]}]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":77270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]}]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":78792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.47}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4079999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":77180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1120000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":233472,"data_stored":77306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2639999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.093}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1389999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3050000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.647}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.367}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2090000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":827392,"data_stored":668186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4450000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:00:37.227 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:00:37.227 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T08:00:37.227 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T08:00:37.228 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T08:00:37.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.469+0000 7f5e06089640 1 Processor -- start 2023-11-24T08:00:37.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.470+0000 7f5e06089640 1 -- start start 2023-11-24T08:00:37.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5e06089640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e00143ae0 0x7f5e000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5e06089640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e0015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5e06089640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5e0015e1e0 0x7f5e0015a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5e06089640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000cfc30 con 0x7f5e00143ae0 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5e06089640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e000b1ee0 con 0x7f5e0015e1e0 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5e06089640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e000b2780 con 0x7f5e000cf7d0 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.471+0000 7f5dff7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e00143ae0 0x7f5e000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e00143ae0 0x7f5e000cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56902/0 (socket says 172.21.15.161:56902) 2023-11-24T08:00:37.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 -- 172.21.15.161:0/2353345510 learned_addr learned my addr 172.21.15.161:0/2353345510 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:37.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dfffff640 1 --2- 172.21.15.161:0/2353345510 >> v2:172.21.15.175:3300/0 conn(0x7f5e0015e1e0 0x7f5e0015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5df7fff640 1 --2- 172.21.15.161:0/2353345510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e0015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 -- 172.21.15.161:0/2353345510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 msgr2=0x7f5e0015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:37.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/2353345510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e0015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 -- 172.21.15.161:0/2353345510 >> v2:172.21.15.175:3300/0 conn(0x7f5e0015e1e0 msgr2=0x7f5e0015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:37.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/2353345510 >> v2:172.21.15.175:3300/0 conn(0x7f5e0015e1e0 0x7f5e0015a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.472+0000 7f5dff7fe640 1 -- 172.21.15.161:0/2353345510 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0015e990 con 0x7f5e00143ae0 2023-11-24T08:00:37.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.474+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/2353345510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e000cf290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e00072160 tx=0x7f5df002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eae56c09cc9dda53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.474+0000 7f5dfeffd640 1 -- 172.21.15.161:0/2353345510 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0031870 con 0x7f5e00143ae0 2023-11-24T08:00:37.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5dfeffd640 1 -- 172.21.15.161:0/2353345510 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df00319d0 con 0x7f5e00143ae0 2023-11-24T08:00:37.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5dfeffd640 1 -- 172.21.15.161:0/2353345510 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df0031d60 con 0x7f5e00143ae0 2023-11-24T08:00:37.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 -- 172.21.15.161:0/2353345510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 msgr2=0x7f5e000cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 --2- 172.21.15.161:0/2353345510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e000cf290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5e00072160 tx=0x7f5df002b910 comp rx=0 tx=0).stop 2023-11-24T08:00:37.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 -- 172.21.15.161:0/2353345510 shutdown_connections 2023-11-24T08:00:37.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 --2- 172.21.15.161:0/2353345510 >> v2:172.21.15.175:3300/0 conn(0x7f5e0015e1e0 0x7f5e0015a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 --2- 172.21.15.161:0/2353345510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e0015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 --2- 172.21.15.161:0/2353345510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e000cf290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 -- 172.21.15.161:0/2353345510 >> 172.21.15.161:0/2353345510 conn(0x7f5e0006a800 msgr2=0x7f5e0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:37.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.475+0000 7f5e06089640 1 -- 172.21.15.161:0/2353345510 shutdown_connections 2023-11-24T08:00:37.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.476+0000 7f5e06089640 1 -- 172.21.15.161:0/2353345510 wait complete. 2023-11-24T08:00:37.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.478+0000 7f5e06089640 1 Processor -- start 2023-11-24T08:00:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.478+0000 7f5e06089640 1 -- start start 2023-11-24T08:00:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5e06089640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e00159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5e06089640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e0015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5e06089640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e0015e1e0 0x7f5e0015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5e06089640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0015b860 con 0x7f5e00143ae0 2023-11-24T08:00:37.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5e06089640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0015bb40 con 0x7f5e0015e1e0 2023-11-24T08:00:37.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5e06089640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0013f220 con 0x7f5e000cf7d0 2023-11-24T08:00:37.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5df7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e0015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5df7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e0015aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56908/0 (socket says 172.21.15.161:56908) 2023-11-24T08:00:37.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.479+0000 7f5df7fff640 1 -- 172.21.15.161:0/65600331 learned_addr learned my addr 172.21.15.161:0/65600331 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:37.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e00159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5df7fff640 1 -- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 msgr2=0x7f5e00159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5df7fff640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e00159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5df7fff640 1 -- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e0015e1e0 msgr2=0x7f5e0015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5df7fff640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e0015e1e0 0x7f5e0015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5df7fff640 1 -- 172.21.15.161:0/65600331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00094d0 con 0x7f5e00143ae0 2023-11-24T08:00:37.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e00159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:37.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.480+0000 7f5df7fff640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e0015aef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e890 tx=0x7f5de800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.482+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800c8c0 con 0x7f5e00143ae0 2023-11-24T08:00:37.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.482+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800ca20 con 0x7f5e00143ae0 2023-11-24T08:00:37.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.482+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0013f500 con 0x7f5e00143ae0 2023-11-24T08:00:37.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.482+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800cdb0 con 0x7f5e00143ae0 2023-11-24T08:00:37.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.482+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e001f2a80 con 0x7f5e00143ae0 2023-11-24T08:00:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.483+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e000b2bf0 con 0x7f5e00143ae0 2023-11-24T08:00:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.484+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5de8013470 con 0x7f5e00143ae0 2023-11-24T08:00:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.485+0000 7f5dfcff9640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5de006ae90 0x7f5de006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.485+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5de8089650 con 0x7f5e00143ae0 2023-11-24T08:00:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.486+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5de006ae90 0x7f5de006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.487+0000 7f5dff7fe640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5de006ae90 0x7f5de006d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5df0036000 tx=0x7f5df003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.490+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e000b2bf0 con 0x7f5e00143ae0 2023-11-24T08:00:37.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.701+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5e000b2bf0 con 0x7f5e00143ae0 2023-11-24T08:00:37.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.702+0000 7f5dfcff9640 1 -- 172.21.15.161:0/65600331 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5e000b2bf0 con 0x7f5e00143ae0 2023-11-24T08:00:37.704 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:37.704 INFO:teuthology.orchestra.run.smithi161.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T08:00:37.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5de006ae90 msgr2=0x7f5de006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5de006ae90 0x7f5de006d350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5df0036000 tx=0x7f5df003c040 comp rx=0 tx=0).stop 2023-11-24T08:00:37.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 msgr2=0x7f5e0015aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e0015aef0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5de800e890 tx=0x7f5de800ed50 comp rx=0 tx=0).stop 2023-11-24T08:00:37.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 shutdown_connections 2023-11-24T08:00:37.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5de006ae90 0x7f5de006d350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e0015e1e0 0x7f5e0015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e00143ae0 0x7f5e0015aef0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 --2- 172.21.15.161:0/65600331 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e000cf7d0 0x7f5e00159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 >> 172.21.15.161:0/65600331 conn(0x7f5e0006a800 msgr2=0x7f5e000b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:37.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 shutdown_connections 2023-11-24T08:00:37.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.704+0000 7f5e06089640 1 -- 172.21.15.161:0/65600331 wait complete. 2023-11-24T08:00:37.724 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T08:00:37.725 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:37.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.924+0000 7fd265a1c640 1 Processor -- start 2023-11-24T08:00:37.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.924+0000 7fd265a1c640 1 -- start start 2023-11-24T08:00:37.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd265a1c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd26015e3b0 0x7fd260164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd265a1c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600b1ee0 con 0x7fd2600cf9a0 2023-11-24T08:00:37.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd265a1c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600b2780 con 0x7fd260143ae0 2023-11-24T08:00:37.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd265a1c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26015e990 con 0x7fd26015e3b0 2023-11-24T08:00:37.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd25f7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd26015e3b0 0x7fd260164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd257fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd2600cf9a0 0x7fd26015dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40104/0 (socket says 172.21.15.161:40104) 2023-11-24T08:00:37.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd257fff640 1 -- 172.21.15.161:0/4229788133 learned_addr learned my addr 172.21.15.161:0/4229788133 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:37.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd25f7fe640 1 -- 172.21.15.161:0/4229788133 >> v1:172.21.15.175:6789/0 conn(0x7fd260143ae0 legacy=0x7fd2600cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:37.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd25f7fe640 1 -- 172.21.15.161:0/4229788133 >> v1:172.21.15.161:6789/0 conn(0x7fd2600cf9a0 legacy=0x7fd26015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd25f7fe640 1 -- 172.21.15.161:0/4229788133 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600b2130 con 0x7fd26015e3b0 2023-11-24T08:00:37.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.927+0000 7fd25e7fc640 1 -- 172.21.15.161:0/4229788133 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938758620 0 0) 0x7fd2600b1ee0 con 0x7fd2600cf9a0 2023-11-24T08:00:37.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.928+0000 7fd25f7fe640 1 --2- 172.21.15.161:0/4229788133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd26015e3b0 0x7fd260164de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd258009d90 tx=0x7fd25802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3609ce39a35dc3d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.928+0000 7fd25e7fc640 1 -- 172.21.15.161:0/4229788133 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25802cc60 con 0x7fd26015e3b0 2023-11-24T08:00:37.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.928+0000 7fd25e7fc640 1 -- 172.21.15.161:0/4229788133 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25802cdc0 con 0x7fd26015e3b0 2023-11-24T08:00:37.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.928+0000 7fd25e7fc640 1 -- 172.21.15.161:0/4229788133 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258034660 con 0x7fd26015e3b0 2023-11-24T08:00:37.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 -- 172.21.15.161:0/4229788133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd26015e3b0 msgr2=0x7fd260164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 --2- 172.21.15.161:0/4229788133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd26015e3b0 0x7fd260164de0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd258009d90 tx=0x7fd25802beb0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 -- 172.21.15.161:0/4229788133 shutdown_connections 2023-11-24T08:00:37.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 --2- 172.21.15.161:0/4229788133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd26015e3b0 0x7fd260164de0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 -- 172.21.15.161:0/4229788133 >> 172.21.15.161:0/4229788133 conn(0x7fd26006a800 msgr2=0x7fd26006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:37.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 -- 172.21.15.161:0/4229788133 shutdown_connections 2023-11-24T08:00:37.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.929+0000 7fd265a1c640 1 -- 172.21.15.161:0/4229788133 wait complete. 2023-11-24T08:00:37.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.930+0000 7fd265a1c640 1 Processor -- start 2023-11-24T08:00:37.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 -- start start 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 0x7fd260163bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd260143ae0 0x7fd26013e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd26015e3b0 0x7fd26013eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26014c130 con 0x7fd2600cf9a0 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26014bbc0 con 0x7fd260143ae0 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.931+0000 7fd265a1c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd260164220 con 0x7fd26015e3b0 2023-11-24T08:00:37.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 0x7fd260163bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 0x7fd260163bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56930/0 (socket says 172.21.15.161:56930) 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 -- 172.21.15.161:0/15785046 learned_addr learned my addr 172.21.15.161:0/15785046 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd257fff640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd260143ae0 0x7fd26013e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 -- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd26015e3b0 msgr2=0x7fd26013eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd26015e3b0 0x7fd26013eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 -- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd260143ae0 msgr2=0x7fd26013e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd260143ae0 0x7fd26013e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 -- 172.21.15.161:0/15785046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258009a70 con 0x7fd2600cf9a0 2023-11-24T08:00:37.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25effd640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 0x7fd260163bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd25000c430 tx=0x7fd25000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.932+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250011790 con 0x7fd2600cf9a0 2023-11-24T08:00:37.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.933+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2500118f0 con 0x7fd2600cf9a0 2023-11-24T08:00:37.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.933+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260164500 con 0x7fd2600cf9a0 2023-11-24T08:00:37.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.933+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250011ce0 con 0x7fd2600cf9a0 2023-11-24T08:00:37.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.933+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260164ac0 con 0x7fd2600cf9a0 2023-11-24T08:00:37.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.934+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2600675d0 con 0x7fd2600cf9a0 2023-11-24T08:00:37.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.935+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd25001c460 con 0x7fd2600cf9a0 2023-11-24T08:00:37.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.936+0000 7fd25cff9640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd24006ae40 0x7fd24006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:37.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.936+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd250089610 con 0x7fd2600cf9a0 2023-11-24T08:00:37.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.936+0000 7fd257fff640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd24006ae40 0x7fd24006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:37.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.937+0000 7fd257fff640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd24006ae40 0x7fd24006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd248007fd0 tx=0x7fd248009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:37.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:37.940+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd250054620 con 0x7fd2600cf9a0 2023-11-24T08:00:38.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.132+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd260140370 con 0x7fd2600cf9a0 2023-11-24T08:00:38.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.132+0000 7fd25cff9640 1 -- 172.21.15.161:0/15785046 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fd25005e030 con 0x7fd2600cf9a0 2023-11-24T08:00:38.135 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:38.135 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:38.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd24006ae40 msgr2=0x7fd24006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd24006ae40 0x7fd24006d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd248007fd0 tx=0x7fd248009040 comp rx=0 tx=0).stop 2023-11-24T08:00:38.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 msgr2=0x7fd260163bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 0x7fd260163bd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd25000c430 tx=0x7fd25000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 shutdown_connections 2023-11-24T08:00:38.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd24006ae40 0x7fd24006d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd26015e3b0 0x7fd26013eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd260143ae0 0x7fd26013e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 --2- 172.21.15.161:0/15785046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd2600cf9a0 0x7fd260163bd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 >> 172.21.15.161:0/15785046 conn(0x7fd26006a800 msgr2=0x7fd2600cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:38.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.135+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 shutdown_connections 2023-11-24T08:00:38.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.136+0000 7fd265a1c640 1 -- 172.21.15.161:0/15785046 wait complete. 2023-11-24T08:00:38.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:00:38.157 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:00:38.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.371+0000 7ff427bb7640 1 Processor -- start 2023-11-24T08:00:38.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.372+0000 7ff427bb7640 1 -- start start 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.373+0000 7ff427bb7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff42013df80 0x7ff42015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.373+0000 7ff427bb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 0x7ff4200cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.373+0000 7ff427bb7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42006c470 con 0x7ff42015f9c0 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.373+0000 7ff427bb7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42006c750 con 0x7ff42013df80 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.373+0000 7ff427bb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006ca30 con 0x7ff42013e360 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff426154640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff42015f9c0 0x7ff4201408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40108/0 (socket says 172.21.15.161:40108) 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff426154640 1 -- 172.21.15.161:0/1287103303 learned_addr learned my addr 172.21.15.161:0/1287103303 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff425953640 1 --2- 172.21.15.161:0/1287103303 >> v2:172.21.15.175:3300/0 conn(0x7ff42013df80 0x7ff42015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff425152640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 0x7ff4200cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984440952 0 0) 0x7ff42006c470 con 0x7ff42015f9c0 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff410003520 con 0x7ff42015f9c0 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.374+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197384470 0 0) 0x7ff410003520 con 0x7ff42015f9c0 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 msgr2=0x7ff4200cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 0x7ff4200cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 >> v2:172.21.15.175:3300/0 conn(0x7ff42013df80 msgr2=0x7ff42015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 --2- 172.21.15.161:0/1287103303 >> v2:172.21.15.175:3300/0 conn(0x7ff42013df80 0x7ff42015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42006cd10 con 0x7ff42015f9c0 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7ff418001670 con 0x7ff42015f9c0 2023-11-24T08:00:38.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 >> v1:172.21.15.161:6789/0 conn(0x7ff42015f9c0 legacy=0x7ff4201408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 0x7ff410003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410003ef0 0x7ff4100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff410004d00 0x7ff410005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006c750 con 0x7ff410004d00 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006ca30 con 0x7ff410003ef0 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41000b980 con 0x7ff42013e360 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff426154640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff410004d00 0x7ff410005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff425953640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 0x7ff410003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff425152640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410003ef0 0x7ff4100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff426154640 1 -- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 msgr2=0x7ff410003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff426154640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff42013e360 0x7ff410003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff426154640 1 -- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410003ef0 msgr2=0x7ff4100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff426154640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410003ef0 0x7ff4100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff426154640 1 -- 172.21.15.161:0/1287103303 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410003520 con 0x7ff410004d00 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.375+0000 7ff425152640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410003ef0 0x7ff4100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.376+0000 7ff426154640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff410004d00 0x7ff410005180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c290 tx=0x7ff4100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d7b0e28fde5736 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418005ad0 con 0x7ff410004d00 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418005c30 con 0x7ff410004d00 2023-11-24T08:00:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff424951640 1 -- 172.21.15.161:0/1287103303 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41802c8c0 con 0x7ff410004d00 2023-11-24T08:00:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff427bb7640 1 -- 172.21.15.161:0/1287103303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff410004d00 msgr2=0x7ff410005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff427bb7640 1 --2- 172.21.15.161:0/1287103303 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff410004d00 0x7ff410005180 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff41800c290 tx=0x7ff4100057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff426154640 1 -- 172.21.15.161:0/1287103303 reap_dead start 2023-11-24T08:00:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff427bb7640 1 -- 172.21.15.161:0/1287103303 shutdown_connections 2023-11-24T08:00:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff427bb7640 1 -- 172.21.15.161:0/1287103303 >> 172.21.15.161:0/1287103303 conn(0x7ff42006a800 msgr2=0x7ff42006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff427bb7640 1 -- 172.21.15.161:0/1287103303 shutdown_connections 2023-11-24T08:00:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.377+0000 7ff427bb7640 1 -- 172.21.15.161:0/1287103303 wait complete. 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.379+0000 7ff427bb7640 1 Processor -- start 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.379+0000 7ff427bb7640 1 -- start start 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.380+0000 7ff427bb7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d00 0x7ff42013c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.380+0000 7ff427bb7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 0x7ff420150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.380+0000 7ff427bb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4201f60d0 0x7ff4201f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.380+0000 7ff427bb7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42014ecd0 con 0x7ff4201535b0 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.380+0000 7ff427bb7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4201f6a90 con 0x7ff410004d00 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.380+0000 7ff427bb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42014ff10 con 0x7ff4201f60d0 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 0x7ff420150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 0x7ff420150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56950/0 (socket says 172.21.15.161:56950) 2023-11-24T08:00:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 -- 172.21.15.161:0/442384118 learned_addr learned my addr 172.21.15.161:0/442384118 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425953640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d00 0x7ff42013c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff426154640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4201f60d0 0x7ff4201f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 -- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4201f60d0 msgr2=0x7ff4201f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4201f60d0 0x7ff4201f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 -- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d00 msgr2=0x7ff42013c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d00 0x7ff42013c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 -- 172.21.15.161:0/442384118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420153120 con 0x7ff4201535b0 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425953640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d00 0x7ff42013c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff425152640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 0x7ff420150610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0108c0 tx=0x7ff40c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.381+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c00eb00 con 0x7ff4201535b0 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.382+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40c00ec60 con 0x7ff4201535b0 2023-11-24T08:00:38.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.382+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40c01c400 con 0x7ff4201535b0 2023-11-24T08:00:38.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.382+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42014f950 con 0x7ff4201535b0 2023-11-24T08:00:38.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.382+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff420152db0 con 0x7ff4201535b0 2023-11-24T08:00:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.383+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4201532b0 con 0x7ff4201535b0 2023-11-24T08:00:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.384+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff40c01c560 con 0x7ff4201535b0 2023-11-24T08:00:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.385+0000 7ff41e7fc640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff40406ae40 0x7ff40406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.385+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff40c089af0 con 0x7ff4201535b0 2023-11-24T08:00:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.385+0000 7ff425953640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff40406ae40 0x7ff40406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.386+0000 7ff425953640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff40406ae40 0x7ff40406d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff414007440 tx=0x7ff41400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:38.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.389+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff40c054c50 con 0x7ff4201535b0 2023-11-24T08:00:38.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:00:38.528 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:00:38.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.581+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4200675d0 con 0x7ff4201535b0 2023-11-24T08:00:38.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.582+0000 7ff41e7fc640 1 -- 172.21.15.161:0/442384118 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff40c058270 con 0x7ff4201535b0 2023-11-24T08:00:38.583 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:00:38.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff40406ae40 msgr2=0x7ff40406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff40406ae40 0x7ff40406d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff414007440 tx=0x7ff41400b040 comp rx=0 tx=0).stop 2023-11-24T08:00:38.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 msgr2=0x7ff420150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 0x7ff420150610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0108c0 tx=0x7ff40c010d80 comp rx=0 tx=0).stop 2023-11-24T08:00:38.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 shutdown_connections 2023-11-24T08:00:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff40406ae40 0x7ff40406d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4201f60d0 0x7ff4201f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4201535b0 0x7ff420150610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 --2- 172.21.15.161:0/442384118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d00 0x7ff42013c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 >> 172.21.15.161:0/442384118 conn(0x7ff42006a800 msgr2=0x7ff4201547c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:38.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 shutdown_connections 2023-11-24T08:00:38.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.584+0000 7ff427bb7640 1 -- 172.21.15.161:0/442384118 wait complete. 2023-11-24T08:00:38.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:00:38.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.807+0000 7f0fc641c640 1 Processor -- start 2023-11-24T08:00:38.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.807+0000 7f0fc641c640 1 -- start start 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.808+0000 7f0fc641c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0fc015da10 0x7f0fc0072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fc641c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc00b3730 con 0x7f0fc0150760 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fc641c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc0071190 con 0x7f0fc00b2bd0 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fc641c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc0071470 con 0x7f0fc015da10 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0fc0150760 0x7f0fc015d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40120/0 (socket says 172.21.15.161:40120) 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbffff640 1 -- 172.21.15.161:0/1821425165 learned_addr learned my addr 172.21.15.161:0/1821425165 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:38.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084366195 0 0) 0x7f0fc00b3730 con 0x7f0fc0150760 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fac003520 con 0x7f0fc0150760 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/1821425165 >> v2:172.21.15.175:3300/0 conn(0x7f0fc015da10 0x7f0fc0072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90619311 0 0) 0x7f0fac003520 con 0x7f0fc0150760 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 >> v2:172.21.15.175:3300/0 conn(0x7f0fc015da10 msgr2=0x7f0fc0072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 --2- 172.21.15.161:0/1821425165 >> v2:172.21.15.175:3300/0 conn(0x7f0fc015da10 0x7f0fc0072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 >> v1:172.21.15.175:6789/0 conn(0x7f0fc00b2bd0 legacy=0x7f0fc00b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.809+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc0071750 con 0x7f0fc0150760 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0fb0001670 con 0x7f0fc0150760 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 >> v1:172.21.15.161:6789/0 conn(0x7f0fc0150760 legacy=0x7f0fc015d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fac0039c0 0x7f0fac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fac0047c0 0x7f0fac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0051d0 0x7f0fac00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc0071470 con 0x7f0fac0047c0 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac00e310 con 0x7f0fac0039c0 2023-11-24T08:00:38.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac00e4d0 con 0x7f0fac0051d0 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fac0047c0 0x7f0fac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbffff640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fac0039c0 0x7f0fac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fc49b9640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0051d0 0x7f0fac00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fb7fff640 1 -- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0051d0 msgr2=0x7f0fac00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0051d0 0x7f0fac00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fb7fff640 1 -- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fac0039c0 msgr2=0x7f0fac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fac0039c0 0x7f0fac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fb7fff640 1 -- 172.21.15.161:0/1821425165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac003520 con 0x7f0fac0047c0 2023-11-24T08:00:38.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fbffff640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fac0039c0 0x7f0fac003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:38.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fc49b9640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0051d0 0x7f0fac00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:38.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.810+0000 7f0fc49b9640 1 -- 172.21.15.161:0/1821425165 reap_dead start 2023-11-24T08:00:38.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fac0047c0 0x7f0fac004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ba00 tx=0x7f0fac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93eb3b18a13f01da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:38.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8033680 con 0x7f0fac0047c0 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa80337e0 con 0x7f0fac0047c0 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fbf7fe640 1 -- 172.21.15.161:0/1821425165 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8033b70 con 0x7f0fac0047c0 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fc641c640 1 -- 172.21.15.161:0/1821425165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fac0047c0 msgr2=0x7f0fac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fc641c640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fac0047c0 0x7f0fac004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ba00 tx=0x7f0fac0057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fc641c640 1 -- 172.21.15.161:0/1821425165 shutdown_connections 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fc641c640 1 --2- 172.21.15.161:0/1821425165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fac0047c0 0x7f0fac004c40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.812+0000 7f0fc641c640 1 -- 172.21.15.161:0/1821425165 >> 172.21.15.161:0/1821425165 conn(0x7f0fc006a800 msgr2=0x7f0fc006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.813+0000 7f0fc641c640 1 -- 172.21.15.161:0/1821425165 shutdown_connections 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.813+0000 7f0fc641c640 1 -- 172.21.15.161:0/1821425165 wait complete. 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.814+0000 7f0fc641c640 1 Processor -- start 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.814+0000 7f0fc641c640 1 -- start start 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.815+0000 7f0fc641c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0047c0 0x7f0fc014ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.815+0000 7f0fc641c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 0x7f0fc00c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.815+0000 7f0fc641c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc014e520 0x7f0fc00c6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.815+0000 7f0fc641c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00c5880 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.815+0000 7f0fc641c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00cad60 con 0x7f0fc014e520 2023-11-24T08:00:38.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.815+0000 7f0fc641c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc00c4960 con 0x7f0fac0047c0 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 0x7f0fc00c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 0x7f0fc00c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:56978/0 (socket says 172.21.15.161:56978) 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 -- 172.21.15.161:0/2309601598 learned_addr learned my addr 172.21.15.161:0/2309601598 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fbffff640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0047c0 0x7f0fc014ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 -- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0047c0 msgr2=0x7f0fc014ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fc49b9640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc014e520 0x7f0fc00c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0047c0 0x7f0fc014ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 -- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc014e520 msgr2=0x7f0fc00c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc014e520 0x7f0fc00c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 -- 172.21.15.161:0/2309601598 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc00c4c00 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fc49b9640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc014e520 0x7f0fc00c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.816+0000 7f0fb7fff640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 0x7f0fc00c4420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fa802be60 tx=0x7f0fa8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.817+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8004220 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.817+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8040070 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.817+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8003610 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.817+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc00c4ee0 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.817+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc00c54a0 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.818+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc00675d0 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.819+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fa8003770 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.820+0000 7f0fbd7fa640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006ae40 0x7f0fa006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:38.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.820+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fa80ab980 con 0x7f0fc00c5ca0 2023-11-24T08:00:38.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.820+0000 7f0fbffff640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006ae40 0x7f0fa006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:38.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.821+0000 7f0fbffff640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006ae40 0x7f0fa006d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001eb0 tx=0x7f0fb0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:38.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:38.824+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fa8076990 con 0x7f0fc00c5ca0 2023-11-24T08:00:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.013+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0fc00b0330 con 0x7f0fc00c5ca0 2023-11-24T08:00:39.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.014+0000 7f0fbd7fa640 1 -- 172.21.15.161:0/2309601598 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0fa8042020 con 0x7f0fc00c5ca0 2023-11-24T08:00:39.015 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:00:39.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.016+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006ae40 msgr2=0x7f0fa006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.016+0000 7f0fc641c640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006ae40 0x7f0fa006d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001eb0 tx=0x7f0fb0009040 comp rx=0 tx=0).stop 2023-11-24T08:00:39.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.016+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 msgr2=0x7f0fc00c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.016+0000 7f0fc641c640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 0x7f0fc00c4420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fa802be60 tx=0x7f0fa8004730 comp rx=0 tx=0).stop 2023-11-24T08:00:39.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 shutdown_connections 2023-11-24T08:00:39.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006ae40 0x7f0fa006d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fc014e520 0x7f0fc00c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fc00c5ca0 0x7f0fc00c4420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 --2- 172.21.15.161:0/2309601598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fac0047c0 0x7f0fc014ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 >> 172.21.15.161:0/2309601598 conn(0x7f0fc006a800 msgr2=0x7f0fc014f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:39.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 shutdown_connections 2023-11-24T08:00:39.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.017+0000 7f0fc641c640 1 -- 172.21.15.161:0/2309601598 wait complete. 2023-11-24T08:00:39.037 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:00:39.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.249+0000 7f305e4d3640 1 Processor -- start 2023-11-24T08:00:39.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.249+0000 7f305e4d3640 1 -- start start 2023-11-24T08:00:39.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.251+0000 7f305e4d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f305815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.251+0000 7f305e4d3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305806c470 con 0x7f30580cf9a0 2023-11-24T08:00:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.251+0000 7f305e4d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305806c750 con 0x7f305813e360 2023-11-24T08:00:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.251+0000 7f305e4d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305806ca30 con 0x7f305813df80 2023-11-24T08:00:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.251+0000 7f305ca70640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f30580cf9a0 0x7f30580cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40124/0 (socket says 172.21.15.161:40124) 2023-11-24T08:00:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.251+0000 7f305ca70640 1 -- 172.21.15.161:0/3809174189 learned_addr learned my addr 172.21.15.161:0/3809174189 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:39.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f3057fff640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f305815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680339104 0 0) 0x7f305806c470 con 0x7f30580cf9a0 2023-11-24T08:00:39.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3044003520 con 0x7f30580cf9a0 2023-11-24T08:00:39.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730256223 0 0) 0x7f3044003520 con 0x7f30580cf9a0 2023-11-24T08:00:39.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 msgr2=0x7f305815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:39.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f305815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 >> v1:172.21.15.175:6789/0 conn(0x7f305813e360 legacy=0x7f30580cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305806cd10 con 0x7f30580cf9a0 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f3050001670 con 0x7f30580cf9a0 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 >> v1:172.21.15.161:6789/0 conn(0x7f30580cf9a0 legacy=0x7f30580cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30440039a0 0x7f3044003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f30440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3044004d00 0x7f3044005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305806ca30 con 0x7f30440039a0 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304400ba30 con 0x7f3044004d00 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.252+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304400bbf0 con 0x7f305813df80 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f3057fff640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30440039a0 0x7f3044003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f3057fff640 1 -- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 msgr2=0x7f30440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f305ca70640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3044004d00 0x7f3044005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f304f7fe640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f30440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f3057fff640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f30440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f3057fff640 1 -- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3044004d00 msgr2=0x7f3044005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f3057fff640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3044004d00 0x7f3044005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f3057fff640 1 -- 172.21.15.161:0/3809174189 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044003520 con 0x7f30440039a0 2023-11-24T08:00:39.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f305ca70640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3044004d00 0x7f3044005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.253+0000 7f304f7fe640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813df80 0x7f30440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.254+0000 7f3057fff640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30440039a0 0x7f3044003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3048009f90 tx=0x7f30440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf547994c8e0518 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.254+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304802cbd0 con 0x7f30440039a0 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.254+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800f040 con 0x7f30440039a0 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.254+0000 7f30577fe640 1 -- 172.21.15.161:0/3809174189 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048034440 con 0x7f30440039a0 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305e4d3640 1 -- 172.21.15.161:0/3809174189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30440039a0 msgr2=0x7f3044003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305e4d3640 1 --2- 172.21.15.161:0/3809174189 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30440039a0 0x7f3044003dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3048009f90 tx=0x7f30440057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305ca70640 1 -- 172.21.15.161:0/3809174189 reap_dead start 2023-11-24T08:00:39.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305e4d3640 1 -- 172.21.15.161:0/3809174189 shutdown_connections 2023-11-24T08:00:39.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305e4d3640 1 -- 172.21.15.161:0/3809174189 >> 172.21.15.161:0/3809174189 conn(0x7f305806a800 msgr2=0x7f305806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:39.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305e4d3640 1 -- 172.21.15.161:0/3809174189 shutdown_connections 2023-11-24T08:00:39.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.255+0000 7f305e4d3640 1 -- 172.21.15.161:0/3809174189 wait complete. 2023-11-24T08:00:39.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.257+0000 7f305e4d3640 1 Processor -- start 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.257+0000 7f305e4d3640 1 -- start start 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305e4d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30440039a0 0x7f305813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305e4d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813d560 0x7f30581524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305e4d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 0x7f3058154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305e4d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305813d2a0 con 0x7f30581eedc0 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305e4d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3058152e40 con 0x7f30440039a0 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305e4d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b28b0 con 0x7f305813d560 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305ca70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 0x7f3058154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305ca70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 0x7f3058154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57002/0 (socket says 172.21.15.161:57002) 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.258+0000 7f305ca70640 1 -- 172.21.15.161:0/2907538475 learned_addr learned my addr 172.21.15.161:0/2907538475 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:39.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f3057fff640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30440039a0 0x7f305813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f304f7fe640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813d560 0x7f30581524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f305ca70640 1 -- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813d560 msgr2=0x7f30581524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f305ca70640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813d560 0x7f30581524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f305ca70640 1 -- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30440039a0 msgr2=0x7f305813cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f305ca70640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30440039a0 0x7f305813cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f305ca70640 1 -- 172.21.15.161:0/2907538475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580b2b90 con 0x7f30581eedc0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f305ca70640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 0x7f3058154570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30580cfea0 tx=0x7f305000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.259+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500072d0 con 0x7f30581eedc0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.260+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050007430 con 0x7f30581eedc0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.260+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30580b2e70 con 0x7f30581eedc0 2023-11-24T08:00:39.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.260+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500047e0 con 0x7f30581eedc0 2023-11-24T08:00:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.260+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3058152bf0 con 0x7f30581eedc0 2023-11-24T08:00:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.261+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580b2710 con 0x7f30581eedc0 2023-11-24T08:00:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.262+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3050004940 con 0x7f30581eedc0 2023-11-24T08:00:39.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.263+0000 7f30557fa640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303806ae40 0x7f303806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.263+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3050089380 con 0x7f30581eedc0 2023-11-24T08:00:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.264+0000 7f3057fff640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303806ae40 0x7f303806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.265+0000 7f3057fff640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303806ae40 0x7f303806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3048036000 tx=0x7f304802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:39.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.267+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30580b2710 con 0x7f30581eedc0 2023-11-24T08:00:39.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.461+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f30580b2710 con 0x7f30581eedc0 2023-11-24T08:00:39.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.462+0000 7f30557fa640 1 -- 172.21.15.161:0/2907538475 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f30580b2710 con 0x7f30581eedc0 2023-11-24T08:00:39.464 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:00:39.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303806ae40 msgr2=0x7f303806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303806ae40 0x7f303806d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3048036000 tx=0x7f304802e000 comp rx=0 tx=0).stop 2023-11-24T08:00:39.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 msgr2=0x7f3058154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 0x7f3058154570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f30580cfea0 tx=0x7f305000dc00 comp rx=0 tx=0).stop 2023-11-24T08:00:39.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 shutdown_connections 2023-11-24T08:00:39.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303806ae40 0x7f303806d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30581eedc0 0x7f3058154570 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305813d560 0x7f30581524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 --2- 172.21.15.161:0/2907538475 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30440039a0 0x7f305813cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.466+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 >> 172.21.15.161:0/2907538475 conn(0x7f305806a800 msgr2=0x7f305815c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:39.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.467+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 shutdown_connections 2023-11-24T08:00:39.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.467+0000 7f305e4d3640 1 -- 172.21.15.161:0/2907538475 wait complete. 2023-11-24T08:00:39.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:00:39.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.693+0000 7f1a1cf47640 1 Processor -- start 2023-11-24T08:00:39.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.693+0000 7f1a1cf47640 1 -- start start 2023-11-24T08:00:39.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a1cf47640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a18143c40 0x7f1a18071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a1cf47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180717d0 0x7f1a180cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a1cf47640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a18070e50 con 0x7f1a180cca40 2023-11-24T08:00:39.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a1cf47640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a180723c0 con 0x7f1a18143c40 2023-11-24T08:00:39.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a1cf47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180cce70 con 0x7f1a180717d0 2023-11-24T08:00:39.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a177fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a18143c40 0x7f1a18071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a177fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a18143c40 0x7f1a18071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57018/0 (socket says 172.21.15.161:57018) 2023-11-24T08:00:39.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a177fe640 1 -- 172.21.15.161:0/505364915 learned_addr learned my addr 172.21.15.161:0/505364915 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:39.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.695+0000 7f1a16ffd640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180717d0 0x7f1a180cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.696+0000 7f1a177fe640 1 -- 172.21.15.161:0/505364915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180717d0 msgr2=0x7f1a180cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:39.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.696+0000 7f1a177fe640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180717d0 0x7f1a180cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.696+0000 7f1a177fe640 1 -- 172.21.15.161:0/505364915 >> v1:172.21.15.175:6789/0 conn(0x7f1a180cca40 legacy=0x7f1a1815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:39.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.696+0000 7f1a177fe640 1 -- 172.21.15.161:0/505364915 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1806e170 con 0x7f1a18143c40 2023-11-24T08:00:39.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.696+0000 7f1a16ffd640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180717d0 0x7f1a180cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:39.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.697+0000 7f1a177fe640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18071290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009870 tx=0x7f1a0002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6635b9ed0a67a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:39.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.697+0000 7f1a167fc640 1 -- 172.21.15.161:0/505364915 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000317c0 con 0x7f1a18143c40 2023-11-24T08:00:39.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a167fc640 1 -- 172.21.15.161:0/505364915 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a00031920 con 0x7f1a18143c40 2023-11-24T08:00:39.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a167fc640 1 -- 172.21.15.161:0/505364915 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00031cb0 con 0x7f1a18143c40 2023-11-24T08:00:39.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 -- 172.21.15.161:0/505364915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 msgr2=0x7f1a18071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18071290 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009870 tx=0x7f1a0002b860 comp rx=0 tx=0).stop 2023-11-24T08:00:39.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 -- 172.21.15.161:0/505364915 shutdown_connections 2023-11-24T08:00:39.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180717d0 0x7f1a180cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/505364915 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18071290 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 -- 172.21.15.161:0/505364915 >> 172.21.15.161:0/505364915 conn(0x7f1a1806a800 msgr2=0x7f1a1806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:39.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 -- 172.21.15.161:0/505364915 shutdown_connections 2023-11-24T08:00:39.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.698+0000 7f1a1cf47640 1 -- 172.21.15.161:0/505364915 wait complete. 2023-11-24T08:00:39.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.701+0000 7f1a1cf47640 1 Processor -- start 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.701+0000 7f1a1cf47640 1 -- start start 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a1cf47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a180717d0 0x7f1a181f9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a1cf47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180cca40 0x7f1a18142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a1cf47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a1cf47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181f6cc0 con 0x7f1a18143c40 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a1cf47640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181f6f60 con 0x7f1a180717d0 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a1cf47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181f7240 con 0x7f1a180cca40 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57024/0 (socket says 172.21.15.161:57024) 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.702+0000 7f1a17fff640 1 -- 172.21.15.161:0/4109059509 learned_addr learned my addr 172.21.15.161:0/4109059509 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a16ffd640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180cca40 0x7f1a18142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a177fe640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a180717d0 0x7f1a181f9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a17fff640 1 -- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180cca40 msgr2=0x7f1a18142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a17fff640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180cca40 0x7f1a18142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a17fff640 1 -- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a180717d0 msgr2=0x7f1a181f9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a17fff640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a180717d0 0x7f1a181f9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a17fff640 1 -- 172.21.15.161:0/4109059509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000094d0 con 0x7f1a18143c40 2023-11-24T08:00:39.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a17fff640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18142140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c410 tx=0x7f1a1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10011790 con 0x7f1a18143c40 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100118f0 con 0x7f1a18143c40 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10011ce0 con 0x7f1a18143c40 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.703+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a181f7520 con 0x7f1a18143c40 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.704+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a181f9dd0 con 0x7f1a18143c40 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.705+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a181f7a40 con 0x7f1a18143c40 2023-11-24T08:00:39.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.706+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a1001c460 con 0x7f1a18143c40 2023-11-24T08:00:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.706+0000 7f1a0ffff640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19f806ae40 0x7f19f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.707+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a10089350 con 0x7f1a18143c40 2023-11-24T08:00:39.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.707+0000 7f1a177fe640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19f806ae40 0x7f19f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:39.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.708+0000 7f1a177fe640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19f806ae40 0x7f19f806d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a00036000 tx=0x7f1a0003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:39.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.712+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a181f7a40 con 0x7f1a18143c40 2023-11-24T08:00:39.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.939+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a181f7a40 con 0x7f1a18143c40 2023-11-24T08:00:39.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.940+0000 7f1a0ffff640 1 -- 172.21.15.161:0/4109059509 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f1a181f7a40 con 0x7f1a18143c40 2023-11-24T08:00:39.941 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:39.941 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:00:39.943 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:00:39.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19f806ae40 msgr2=0x7f19f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19f806ae40 0x7f19f806d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a00036000 tx=0x7f1a0003d040 comp rx=0 tx=0).stop 2023-11-24T08:00:39.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 msgr2=0x7f1a18142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:39.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18142140 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000c410 tx=0x7f1a1000c8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 shutdown_connections 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19f806ae40 0x7f19f806d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a18143c40 0x7f1a18142140 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a180cca40 0x7f1a18142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 --2- 172.21.15.161:0/4109059509 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a180717d0 0x7f1a181f9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 >> 172.21.15.161:0/4109059509 conn(0x7f1a1806a800 msgr2=0x7f1a18140290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 shutdown_connections 2023-11-24T08:00:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:39.943+0000 7f1a1cf47640 1 -- 172.21.15.161:0/4109059509 wait complete. 2023-11-24T08:00:39.963 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.174+0000 7f2e61b61640 1 Processor -- start 2023-11-24T08:00:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.174+0000 7f2e61b61640 1 -- start start 2023-11-24T08:00:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.175+0000 7f2e61b61640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e5c13e360 0x7f2e5c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.175+0000 7f2e61b61640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.175+0000 7f2e61b61640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e5c15c5f0 con 0x7f2e5c13df80 2023-11-24T08:00:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.175+0000 7f2e61b61640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e5c06c470 con 0x7f2e5c13e360 2023-11-24T08:00:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.175+0000 7f2e61b61640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c06c750 con 0x7f2e5c15f9c0 2023-11-24T08:00:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.176+0000 7f2e5affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e5c13e360 0x7f2e5c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.176+0000 7f2e5bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.176+0000 7f2e5affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e5c13e360 0x7f2e5c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:49210/0 (socket says 172.21.15.161:49210) 2023-11-24T08:00:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.176+0000 7f2e5affd640 1 -- 172.21.15.161:0/1099378336 learned_addr learned my addr 172.21.15.161:0/1099378336 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.177+0000 7f2e5affd640 1 -- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 msgr2=0x7f2e5c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.177+0000 7f2e5affd640 1 --2- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.177+0000 7f2e5affd640 1 -- 172.21.15.161:0/1099378336 >> v1:172.21.15.175:6789/0 conn(0x7f2e5c13df80 legacy=0x7f2e5c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.177+0000 7f2e5affd640 1 -- 172.21.15.161:0/1099378336 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e5c06ca30 con 0x7f2e5c13e360 2023-11-24T08:00:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.178+0000 7f2e5affd640 1 --2- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0cf290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009870 tx=0x7f2e4c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12700f462c3590cc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:40.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e5a7fc640 1 -- 172.21.15.161:0/1099378336 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c030840 con 0x7f2e5c13e360 2023-11-24T08:00:40.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e5a7fc640 1 -- 172.21.15.161:0/1099378336 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c0309a0 con 0x7f2e5c13e360 2023-11-24T08:00:40.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e5a7fc640 1 -- 172.21.15.161:0/1099378336 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c030d30 con 0x7f2e5c13e360 2023-11-24T08:00:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 -- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13e360 msgr2=0x7f2e5c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0cf290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009870 tx=0x7f2e4c02b980 comp rx=0 tx=0).stop 2023-11-24T08:00:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 -- 172.21.15.161:0/1099378336 shutdown_connections 2023-11-24T08:00:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1099378336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0cf290 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 -- 172.21.15.161:0/1099378336 >> 172.21.15.161:0/1099378336 conn(0x7f2e5c06a800 msgr2=0x7f2e5c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.179+0000 7f2e61b61640 1 -- 172.21.15.161:0/1099378336 shutdown_connections 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.180+0000 7f2e61b61640 1 -- 172.21.15.161:0/1099378336 wait complete. 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.181+0000 7f2e61b61640 1 Processor -- start 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.181+0000 7f2e61b61640 1 -- start start 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.182+0000 7f2e61b61640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13df80 0x7f2e5c14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.182+0000 7f2e61b61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.182+0000 7f2e61b61640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.182+0000 7f2e61b61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c14ac80 con 0x7f2e5c13e360 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.182+0000 7f2e61b61640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c1f1010 con 0x7f2e5c13df80 2023-11-24T08:00:40.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.182+0000 7f2e61b61640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5c14aef0 con 0x7f2e5c15f9c0 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57036/0 (socket says 172.21.15.161:57036) 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 -- 172.21.15.161:0/1118202330 learned_addr learned my addr 172.21.15.161:0/1118202330 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5b7fe640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13df80 0x7f2e5c14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5bfff640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 -- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 msgr2=0x7f2e5c0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0b37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 -- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13df80 msgr2=0x7f2e5c14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13df80 0x7f2e5c14f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 -- 172.21.15.161:0/1118202330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0094d0 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5b7fe640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13df80 0x7f2e5c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.183+0000 7f2e5affd640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0b3290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c000c00 tx=0x7f2e4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.184+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c039c90 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.184+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4c039df0 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.184+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c043640 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.184+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5c14b1d0 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.184+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5c130590 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.185+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e5c14b030 con 0x7f2e5c13e360 2023-11-24T08:00:40.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.186+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e4c0437a0 con 0x7f2e5c13e360 2023-11-24T08:00:40.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.187+0000 7f2e53fff640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e3c06ae40 0x7f2e3c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.187+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e4c03e070 con 0x7f2e5c13e360 2023-11-24T08:00:40.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.187+0000 7f2e5b7fe640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e3c06ae40 0x7f2e3c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.188+0000 7f2e5b7fe640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e3c06ae40 0x7f2e3c06d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000f60 tx=0x7f2e44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:40.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.191+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e5c14b030 con 0x7f2e5c13e360 2023-11-24T08:00:40.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.370+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e5c14b030 con 0x7f2e5c13e360 2023-11-24T08:00:40.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.372+0000 7f2e53fff640 1 -- 172.21.15.161:0/1118202330 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f2e5c14b030 con 0x7f2e5c13e360 2023-11-24T08:00:40.373 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:40.374 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e3c06ae40 msgr2=0x7f2e3c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e3c06ae40 0x7f2e3c06d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e44000f60 tx=0x7f2e44009040 comp rx=0 tx=0).stop 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 msgr2=0x7f2e5c0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0b3290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c000c00 tx=0x7f2e4c004730 comp rx=0 tx=0).stop 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 shutdown_connections 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e3c06ae40 0x7f2e3c06d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e5c15f9c0 0x7f2e5c0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e5c13e360 0x7f2e5c0b3290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 --2- 172.21.15.161:0/1118202330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e5c13df80 0x7f2e5c14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 >> 172.21.15.161:0/1118202330 conn(0x7f2e5c06a800 msgr2=0x7f2e5c15def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:40.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 shutdown_connections 2023-11-24T08:00:40.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.374+0000 7f2e61b61640 1 -- 172.21.15.161:0/1118202330 wait complete. 2023-11-24T08:00:40.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:00:40.395 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:00:40.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.602+0000 7fa092568640 1 Processor -- start 2023-11-24T08:00:40.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.602+0000 7fa092568640 1 -- start start 2023-11-24T08:00:40.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa092568640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa092568640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa08c13e360 0x7fa08c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa092568640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa08c15f9c0 0x7fa08c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa092568640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c06c470 con 0x7fa08c13e360 2023-11-24T08:00:40.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa092568640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c06c750 con 0x7fa08c15f9c0 2023-11-24T08:00:40.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa092568640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c06ca30 con 0x7fa08c13df80 2023-11-24T08:00:40.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa0837fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa08c13e360 0x7fa08c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa0837fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa08c13e360 0x7fa08c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57038/0 (socket says 172.21.15.161:57038) 2023-11-24T08:00:40.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.604+0000 7fa0837fe640 1 -- 172.21.15.161:0/3235200565 learned_addr learned my addr 172.21.15.161:0/3235200565 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:40.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa08bfff640 1 --2- 172.21.15.161:0/3235200565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa090b05640 1 --2- 172.21.15.161:0/3235200565 >> v2:172.21.15.175:3300/0 conn(0x7fa08c15f9c0 0x7fa08c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa0837fe640 1 -- 172.21.15.161:0/3235200565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 msgr2=0x7fa08c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa0837fe640 1 --2- 172.21.15.161:0/3235200565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa0837fe640 1 -- 172.21.15.161:0/3235200565 >> v2:172.21.15.175:3300/0 conn(0x7fa08c15f9c0 msgr2=0x7fa08c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa0837fe640 1 --2- 172.21.15.161:0/3235200565 >> v2:172.21.15.175:3300/0 conn(0x7fa08c15f9c0 0x7fa08c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa0837fe640 1 -- 172.21.15.161:0/3235200565 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c06cd10 con 0x7fa08c13e360 2023-11-24T08:00:40.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.605+0000 7fa090b05640 1 --2- 172.21.15.161:0/3235200565 >> v2:172.21.15.175:3300/0 conn(0x7fa08c15f9c0 0x7fa08c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:40.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.606+0000 7fa0837fe640 1 --2- 172.21.15.161:0/3235200565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0cf290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06e6d0 tx=0x7fa07402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a0a2a8d5ac3715 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:40.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.606+0000 7fa08b7fe640 1 -- 172.21.15.161:0/3235200565 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074031860 con 0x7fa08c13e360 2023-11-24T08:00:40.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.606+0000 7fa08b7fe640 1 -- 172.21.15.161:0/3235200565 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0740319c0 con 0x7fa08c13e360 2023-11-24T08:00:40.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.606+0000 7fa08b7fe640 1 -- 172.21.15.161:0/3235200565 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa074031d50 con 0x7fa08c13e360 2023-11-24T08:00:40.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 -- 172.21.15.161:0/3235200565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 msgr2=0x7fa08c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 --2- 172.21.15.161:0/3235200565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0cf290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa08c06e6d0 tx=0x7fa07402b900 comp rx=0 tx=0).stop 2023-11-24T08:00:40.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 -- 172.21.15.161:0/3235200565 shutdown_connections 2023-11-24T08:00:40.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 --2- 172.21.15.161:0/3235200565 >> v2:172.21.15.175:3300/0 conn(0x7fa08c15f9c0 0x7fa08c0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 --2- 172.21.15.161:0/3235200565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0cf290 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 --2- 172.21.15.161:0/3235200565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 -- 172.21.15.161:0/3235200565 >> 172.21.15.161:0/3235200565 conn(0x7fa08c06a800 msgr2=0x7fa08c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:40.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 -- 172.21.15.161:0/3235200565 shutdown_connections 2023-11-24T08:00:40.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.607+0000 7fa092568640 1 -- 172.21.15.161:0/3235200565 wait complete. 2023-11-24T08:00:40.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.609+0000 7fa092568640 1 Processor -- start 2023-11-24T08:00:40.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.609+0000 7fa092568640 1 -- start start 2023-11-24T08:00:40.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa092568640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa092568640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa092568640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa08c15f9c0 0x7fa08c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa092568640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0ac880 con 0x7fa08c13e360 2023-11-24T08:00:40.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa092568640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c154b90 con 0x7fa08c15f9c0 2023-11-24T08:00:40.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa092568640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c0ac500 con 0x7fa08c13df80 2023-11-24T08:00:40.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57054/0 (socket says 172.21.15.161:57054) 2023-11-24T08:00:40.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 -- 172.21.15.161:0/4232088973 learned_addr learned my addr 172.21.15.161:0/4232088973 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:40.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa08bfff640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa090b05640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa08c15f9c0 0x7fa08c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 -- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 msgr2=0x7fa08c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 -- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa08c15f9c0 msgr2=0x7fa08c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa08c15f9c0 0x7fa08c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa0837fe640 1 -- 172.21.15.161:0/4232088973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740094d0 con 0x7fa08c13e360 2023-11-24T08:00:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa08bfff640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.610+0000 7fa090b05640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa08c15f9c0 0x7fa08c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.611+0000 7fa0837fe640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0b1ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa074000c00 tx=0x7fa0740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.611+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07403ad30 con 0x7fa08c13e360 2023-11-24T08:00:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.611+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa074044400 con 0x7fa08c13e360 2023-11-24T08:00:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.611+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740447b0 con 0x7fa08c13e360 2023-11-24T08:00:40.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.611+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c0b25a0 con 0x7fa08c13e360 2023-11-24T08:00:40.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.611+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c0b2b60 con 0x7fa08c13e360 2023-11-24T08:00:40.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.613+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c0ac9c0 con 0x7fa08c13e360 2023-11-24T08:00:40.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.613+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa07404d430 con 0x7fa08c13e360 2023-11-24T08:00:40.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.614+0000 7fa0897fa640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa06c06ae40 0x7fa06c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:40.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.614+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0740abcf0 con 0x7fa08c13e360 2023-11-24T08:00:40.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.615+0000 7fa08bfff640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa06c06ae40 0x7fa06c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:40.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.616+0000 7fa08bfff640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa06c06ae40 0x7fa06c06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa07c006fd0 tx=0x7fa07c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.618+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa08c0ac9c0 con 0x7fa08c13e360 2023-11-24T08:00:40.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.795+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa08c0ac9c0 con 0x7fa08c13e360 2023-11-24T08:00:40.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.795+0000 7fa0897fa640 1 -- 172.21.15.161:0/4232088973 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa08c0ac9c0 con 0x7fa08c13e360 2023-11-24T08:00:40.797 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa06c06ae40 msgr2=0x7fa06c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa06c06ae40 0x7fa06c06d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa07c006fd0 tx=0x7fa07c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 msgr2=0x7fa08c0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0b1ca0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa074000c00 tx=0x7fa0740046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 shutdown_connections 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa06c06ae40 0x7fa06c06d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa08c15f9c0 0x7fa08c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa08c13e360 0x7fa08c0b1ca0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 --2- 172.21.15.161:0/4232088973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa08c13df80 0x7fa08c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 >> 172.21.15.161:0/4232088973 conn(0x7fa08c06a800 msgr2=0x7fa08c0af560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.798+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 shutdown_connections 2023-11-24T08:00:40.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:40.799+0000 7fa092568640 1 -- 172.21.15.161:0/4232088973 wait complete. 2023-11-24T08:00:40.817 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:00:41.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.022+0000 7f0fe52bb640 1 Processor -- start 2023-11-24T08:00:41.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.023+0000 7f0fe52bb640 1 -- start start 2023-11-24T08:00:41.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.024+0000 7f0fe52bb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0fe00adf20 0x7f0fe0070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.024+0000 7f0fe52bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fe0143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.024+0000 7f0fe52bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fe015f4e0 con 0x7f0fe015bf10 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.024+0000 7f0fe52bb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe015f970 con 0x7f0fe00adf20 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.024+0000 7f0fe52bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0071130 con 0x7f0fe00ccb50 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.024+0000 7f0fd7fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0fe015bf10 0x7f0fe00cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54758/0 (socket says 172.21.15.161:54758) 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fd7fff640 1 -- 172.21.15.161:0/3540143074 learned_addr learned my addr 172.21.15.161:0/3540143074 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdffff640 1 --2- 172.21.15.161:0/3540143074 >> v2:172.21.15.175:3300/0 conn(0x7f0fe00adf20 0x7f0fe0070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fe4aba640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fe0143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548336438 0 0) 0x7f0fe015f4e0 con 0x7f0fe015bf10 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fcc003520 con 0x7f0fe015bf10 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3212323418 0 0) 0x7f0fcc003520 con 0x7f0fe015bf10 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 msgr2=0x7f0fe0143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fe0143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 >> v2:172.21.15.175:3300/0 conn(0x7f0fe00adf20 msgr2=0x7f0fe0070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 --2- 172.21.15.161:0/3540143074 >> v2:172.21.15.175:3300/0 conn(0x7f0fe00adf20 0x7f0fe0070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe015c390 con 0x7f0fe015bf10 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0fc8001670 con 0x7f0fe015bf10 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 >> v1:172.21.15.161:6789/0 conn(0x7f0fe015bf10 legacy=0x7f0fe00cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fcc003970 0x7f0fcc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fcc0047c0 0x7f0fcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fcc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe015f970 con 0x7f0fcc003970 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0071130 con 0x7f0fcc0047c0 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.025+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc00b980 con 0x7f0fe00ccb50 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fdffff640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fcc003970 0x7f0fcc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fd7fff640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fcc0047c0 0x7f0fcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fe4aba640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fcc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fdffff640 1 -- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 msgr2=0x7f0fcc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fdffff640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fcc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fdffff640 1 -- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fcc0047c0 msgr2=0x7f0fcc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fdffff640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fcc0047c0 0x7f0fcc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fdffff640 1 -- 172.21.15.161:0/3540143074 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc003520 con 0x7f0fcc003970 2023-11-24T08:00:41.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.026+0000 7f0fe4aba640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fe00ccb50 0x7f0fcc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.027+0000 7f0fdffff640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fcc003970 0x7f0fcc003d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009af0 tx=0x7f0fcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fe7765caaacb51 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd002c710 con 0x7f0fcc003970 2023-11-24T08:00:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd002c870 con 0x7f0fcc003970 2023-11-24T08:00:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fdf7fe640 1 -- 172.21.15.161:0/3540143074 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd002cc00 con 0x7f0fcc003970 2023-11-24T08:00:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe52bb640 1 -- 172.21.15.161:0/3540143074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fcc003970 msgr2=0x7f0fcc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/3540143074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fcc003970 0x7f0fcc003d90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009af0 tx=0x7f0fcc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe4aba640 1 -- 172.21.15.161:0/3540143074 reap_dead start 2023-11-24T08:00:41.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe52bb640 1 -- 172.21.15.161:0/3540143074 shutdown_connections 2023-11-24T08:00:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe52bb640 1 -- 172.21.15.161:0/3540143074 >> 172.21.15.161:0/3540143074 conn(0x7f0fe006a7d0 msgr2=0x7f0fe006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe52bb640 1 -- 172.21.15.161:0/3540143074 shutdown_connections 2023-11-24T08:00:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.028+0000 7f0fe52bb640 1 -- 172.21.15.161:0/3540143074 wait complete. 2023-11-24T08:00:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.030+0000 7f0fe52bb640 1 Processor -- start 2023-11-24T08:00:41.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.030+0000 7f0fe52bb640 1 -- start start 2023-11-24T08:00:41.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fe52bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fcc003970 0x7f0fe013bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fe52bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 0x7f0fe013e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fe52bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fe013e9f0 0x7f0fe014c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fe52bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe013eea0 con 0x7f0fe00ace10 2023-11-24T08:00:41.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fe52bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0140cc0 con 0x7f0fe013e9f0 2023-11-24T08:00:41.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fe52bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0140140 con 0x7f0fcc003970 2023-11-24T08:00:41.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fd7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 0x7f0fe013e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fd7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 0x7f0fe013e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52236/0 (socket says 172.21.15.161:52236) 2023-11-24T08:00:41.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.031+0000 7f0fd7fff640 1 -- 172.21.15.161:0/2198731349 learned_addr learned my addr 172.21.15.161:0/2198731349 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:41.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fdffff640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fcc003970 0x7f0fe013bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fe4aba640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fe013e9f0 0x7f0fe014c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fd7fff640 1 -- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fcc003970 msgr2=0x7f0fe013bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fd7fff640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fcc003970 0x7f0fe013bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fd7fff640 1 -- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fe013e9f0 msgr2=0x7f0fe014c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fd7fff640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fe013e9f0 0x7f0fe014c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fd7fff640 1 -- 172.21.15.161:0/2198731349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0140420 con 0x7f0fe00ace10 2023-11-24T08:00:41.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fd7fff640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 0x7f0fe013e4b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8000c00 tx=0x7f0fc800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800c870 con 0x7f0fe00ace10 2023-11-24T08:00:41.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800c9f0 con 0x7f0fe00ace10 2023-11-24T08:00:41.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fe0140700 con 0x7f0fe00ace10 2023-11-24T08:00:41.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.032+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800cda0 con 0x7f0fe00ace10 2023-11-24T08:00:41.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.033+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe00ad270 con 0x7f0fe00ace10 2023-11-24T08:00:41.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.033+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0067450 con 0x7f0fe00ace10 2023-11-24T08:00:41.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.034+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0fc801d460 con 0x7f0fe00ace10 2023-11-24T08:00:41.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.035+0000 7f0fdd7fa640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fc006ae40 0x7f0fc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.035+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc8089660 con 0x7f0fe00ace10 2023-11-24T08:00:41.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.036+0000 7f0fdffff640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fc006ae40 0x7f0fc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.037+0000 7f0fdffff640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fc006ae40 0x7f0fc006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0036000 tx=0x7f0fd0030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.040+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fc8054670 con 0x7f0fe00ace10 2023-11-24T08:00:41.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.227+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0fe014a580 con 0x7f0fe00ace10 2023-11-24T08:00:41.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.228+0000 7f0fdd7fa640 1 -- 172.21.15.161:0/2198731349 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0fc8057c90 con 0x7f0fe00ace10 2023-11-24T08:00:41.230 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:00:41.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fc006ae40 msgr2=0x7f0fc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fc006ae40 0x7f0fc006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0036000 tx=0x7f0fd0030000 comp rx=0 tx=0).stop 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 msgr2=0x7f0fe013e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 0x7f0fe013e4b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8000c00 tx=0x7f0fc800ec80 comp rx=0 tx=0).stop 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 shutdown_connections 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fc006ae40 0x7f0fc006d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fe013e9f0 0x7f0fe014c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fe00ace10 0x7f0fe013e4b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 --2- 172.21.15.161:0/2198731349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fcc003970 0x7f0fe013bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.231+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 >> 172.21.15.161:0/2198731349 conn(0x7f0fe006a7d0 msgr2=0x7f0fe00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:41.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.232+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 shutdown_connections 2023-11-24T08:00:41.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.232+0000 7f0fe52bb640 1 -- 172.21.15.161:0/2198731349 wait complete. 2023-11-24T08:00:41.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:00:41.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.473+0000 7fdaff8b4640 1 Processor -- start 2023-11-24T08:00:41.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.474+0000 7fdaff8b4640 1 -- start start 2023-11-24T08:00:41.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.475+0000 7fdaff8b4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdaf80ae880 0x7fdaf8165e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.475+0000 7fdaff8b4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf8166380 con 0x7fdaf80c21f0 2023-11-24T08:00:41.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.475+0000 7fdaff8b4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80cbca0 con 0x7fdaf80ae4a0 2023-11-24T08:00:41.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.475+0000 7fdaff8b4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf806dc20 con 0x7fdaf80ae880 2023-11-24T08:00:41.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdafde51640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdaf80c21f0 0x7fdaf80cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54768/0 (socket says 172.21.15.161:54768) 2023-11-24T08:00:41.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdafde51640 1 -- 172.21.15.161:0/1736203838 learned_addr learned my addr 172.21.15.161:0/1736203838 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:41.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdafce4f640 1 --2- 172.21.15.161:0/1736203838 >> v2:172.21.15.175:3300/0 conn(0x7fdaf80ae880 0x7fdaf8165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382900510 0 0) 0x7fdaf0001490 con 0x7fdaf80c21f0 2023-11-24T08:00:41.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdae0003520 con 0x7fdaf80c21f0 2023-11-24T08:00:41.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757158968 0 0) 0x7fdae0003520 con 0x7fdaf80c21f0 2023-11-24T08:00:41.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 >> v2:172.21.15.175:3300/0 conn(0x7fdaf80ae880 msgr2=0x7fdaf8165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.476+0000 7fdaf7fff640 1 --2- 172.21.15.161:0/1736203838 >> v2:172.21.15.175:3300/0 conn(0x7fdaf80ae880 0x7fdaf8165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 >> v1:172.21.15.175:6789/0 conn(0x7fdaf80ae4a0 legacy=0x7fdaf80cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf806df00 con 0x7fdaf80c21f0 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fdaf0001b80 con 0x7fdaf80c21f0 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 >> v1:172.21.15.161:6789/0 conn(0x7fdaf80c21f0 legacy=0x7fdaf80cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae00039c0 0x7fdae0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae00047c0 0x7fdae0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdae000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf806dc20 con 0x7fdae0005180 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae000c080 con 0x7fdae00039c0 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae000c240 con 0x7fdae00047c0 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdafde51640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdae000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdafce4f640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae00047c0 0x7fdae0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.477+0000 7fdafd650640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae00039c0 0x7fdae0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.478+0000 7fdafde51640 1 -- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae00047c0 msgr2=0x7fdae0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.478+0000 7fdafde51640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae00047c0 0x7fdae0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.478+0000 7fdafde51640 1 -- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae00039c0 msgr2=0x7fdae0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.478+0000 7fdafde51640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae00039c0 0x7fdae0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.478+0000 7fdafde51640 1 -- 172.21.15.161:0/1736203838 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0003520 con 0x7fdae0005180 2023-11-24T08:00:41.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.479+0000 7fdafde51640 1 -- 172.21.15.161:0/1736203838 reap_dead start 2023-11-24T08:00:41.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.479+0000 7fdafde51640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdae000b980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000a740 tx=0x7fdae00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65614f4699b3ae1d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.479+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf00072d0 con 0x7fdae0005180 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.479+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf002f070 con 0x7fdae0005180 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.479+0000 7fdaf7fff640 1 -- 172.21.15.161:0/1736203838 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0007670 con 0x7fdae0005180 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1736203838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 msgr2=0x7fdae000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdae000b980 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdaf000a740 tx=0x7fdae00057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1736203838 shutdown_connections 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1736203838 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdae000b980 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1736203838 >> 172.21.15.161:0/1736203838 conn(0x7fdaf80b0d70 msgr2=0x7fdaf80b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1736203838 shutdown_connections 2023-11-24T08:00:41.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.480+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1736203838 wait complete. 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.482+0000 7fdaff8b4640 1 Processor -- start 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.482+0000 7fdaff8b4640 1 -- start start 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdaff8b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdaf815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdaff8b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaf815c930 0x7fdaf815c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdaff8b4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaf80b2bf0 0x7fdaf80b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdaff8b4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf81ec090 con 0x7fdae0005180 2023-11-24T08:00:41.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdaff8b4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80b1900 con 0x7fdaf80b2bf0 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdaff8b4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80b1b50 con 0x7fdaf815c930 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdafd650640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdaf815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdafd650640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdaf815ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52264/0 (socket says 172.21.15.161:52264) 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.483+0000 7fdafd650640 1 -- 172.21.15.161:0/1878213553 learned_addr learned my addr 172.21.15.161:0/1878213553 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafce4f640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaf815c930 0x7fdaf815c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafde51640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaf80b2bf0 0x7fdaf80b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafd650640 1 -- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaf815c930 msgr2=0x7fdaf815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafd650640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaf815c930 0x7fdaf815c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafd650640 1 -- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaf80b2bf0 msgr2=0x7fdaf80b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafd650640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaf80b2bf0 0x7fdaf80b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafd650640 1 -- 172.21.15.161:0/1878213553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80b1e30 con 0x7fdae0005180 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdafd650640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdaf815ce60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e4d0 tx=0x7fdae800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae80052e0 con 0x7fdae0005180 2023-11-24T08:00:41.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8005440 con 0x7fdae0005180 2023-11-24T08:00:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf80b2110 con 0x7fdae0005180 2023-11-24T08:00:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8003810 con 0x7fdae0005180 2023-11-24T08:00:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.484+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf80b26d0 con 0x7fdae0005180 2023-11-24T08:00:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.486+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf80b2890 con 0x7fdae0005180 2023-11-24T08:00:41.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.486+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdae8003970 con 0x7fdae0005180 2023-11-24T08:00:41.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.487+0000 7fdaf5ffb640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdae406ae70 0x7fdae406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.487+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdae8089320 con 0x7fdae0005180 2023-11-24T08:00:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.488+0000 7fdafce4f640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdae406ae70 0x7fdae406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.489+0000 7fdafce4f640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdae406ae70 0x7fdae406d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8066790 tx=0x7fdaec008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.492+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdae8054330 con 0x7fdae0005180 2023-11-24T08:00:41.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.683+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdaf80675d0 con 0x7fdae0005180 2023-11-24T08:00:41.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.684+0000 7fdaf5ffb640 1 -- 172.21.15.161:0/1878213553 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdae8057950 con 0x7fdae0005180 2023-11-24T08:00:41.685 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdae406ae70 msgr2=0x7fdae406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdae406ae70 0x7fdae406d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdaf8066790 tx=0x7fdaec008040 comp rx=0 tx=0).stop 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 msgr2=0x7fdaf815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdaf815ce60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdae800e4d0 tx=0x7fdae800e990 comp rx=0 tx=0).stop 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 shutdown_connections 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdae406ae70 0x7fdae406d330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaf80b2bf0 0x7fdaf80b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaf815c930 0x7fdaf815c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 --2- 172.21.15.161:0/1878213553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdae0005180 0x7fdaf815ce60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 >> 172.21.15.161:0/1878213553 conn(0x7fdaf80b0d70 msgr2=0x7fdaf80aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 shutdown_connections 2023-11-24T08:00:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.687+0000 7fdaff8b4640 1 -- 172.21.15.161:0/1878213553 wait complete. 2023-11-24T08:00:41.709 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:00:41.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.921+0000 7f1877e56640 1 Processor -- start 2023-11-24T08:00:41.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.921+0000 7f1877e56640 1 -- start start 2023-11-24T08:00:41.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.923+0000 7f1877e56640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f18700ae5a0 0x7f187015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.923+0000 7f1877e56640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1870070c40 con 0x7f18700b3ae0 2023-11-24T08:00:41.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.923+0000 7f1877e56640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187006c470 con 0x7f18700cf290 2023-11-24T08:00:41.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.923+0000 7f1877e56640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1870071450 con 0x7f18700ae5a0 2023-11-24T08:00:41.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f18753f1640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f18700b3ae0 0x7f187006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54774/0 (socket says 172.21.15.161:54774) 2023-11-24T08:00:41.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f18753f1640 1 -- 172.21.15.161:0/4255749165 learned_addr learned my addr 172.21.15.161:0/4255749165 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:41.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1875bf2640 1 --2- 172.21.15.161:0/4255749165 >> v2:172.21.15.175:3300/0 conn(0x7f18700ae5a0 0x7f187015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451963486 0 0) 0x7f1870070c40 con 0x7f18700b3ae0 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f185c003520 con 0x7f18700b3ae0 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1865149753 0 0) 0x7f185c003520 con 0x7f18700b3ae0 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 >> v2:172.21.15.175:3300/0 conn(0x7f18700ae5a0 msgr2=0x7f187015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 --2- 172.21.15.161:0/4255749165 >> v2:172.21.15.175:3300/0 conn(0x7f18700ae5a0 0x7f187015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 >> v1:172.21.15.175:6789/0 conn(0x7f18700cf290 legacy=0x7f18700b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187006c750 con 0x7f18700b3ae0 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f1860001670 con 0x7f18700b3ae0 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 >> v1:172.21.15.161:6789/0 conn(0x7f18700b3ae0 legacy=0x7f187006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f185c003970 0x7f185c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.924+0000 7f1874bf0640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c0047c0 0x7f185c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1874bf0640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c005180 0x7f185c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1870071450 con 0x7f185c003970 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c00c000 con 0x7f185c005180 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c00c1c0 con 0x7f185c0047c0 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1875bf2640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f185c003970 0x7f185c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1875bf2640 1 -- 172.21.15.161:0/4255749165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c0047c0 msgr2=0x7f185c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1875bf2640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c0047c0 0x7f185c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1875bf2640 1 -- 172.21.15.161:0/4255749165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c005180 msgr2=0x7f185c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1875bf2640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f185c005180 0x7f185c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f1875bf2640 1 -- 172.21.15.161:0/4255749165 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c003520 con 0x7f185c003970 2023-11-24T08:00:41.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.925+0000 7f18763f3640 1 -- 172.21.15.161:0/4255749165 reap_dead start 2023-11-24T08:00:41.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.926+0000 7f1875bf2640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f185c003970 0x7f185c003d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f186c009a90 tx=0x7f185c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47abeab930cfd497 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.926+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c02c6b0 con 0x7f185c003970 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.926+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186c02c810 con 0x7f185c003970 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.926+0000 7f1874bf0640 1 -- 172.21.15.161:0/4255749165 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186c02cba0 con 0x7f185c003970 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 -- 172.21.15.161:0/4255749165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f185c003970 msgr2=0x7f185c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f185c003970 0x7f185c003d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f186c009a90 tx=0x7f185c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 -- 172.21.15.161:0/4255749165 shutdown_connections 2023-11-24T08:00:41.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 --2- 172.21.15.161:0/4255749165 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f185c003970 0x7f185c003d70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 -- 172.21.15.161:0/4255749165 >> 172.21.15.161:0/4255749165 conn(0x7f187006a800 msgr2=0x7f187006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:41.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 -- 172.21.15.161:0/4255749165 shutdown_connections 2023-11-24T08:00:41.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.927+0000 7f1877e56640 1 -- 172.21.15.161:0/4255749165 wait complete. 2023-11-24T08:00:41.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.929+0000 7f1877e56640 1 Processor -- start 2023-11-24T08:00:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.929+0000 7f1877e56640 1 -- start start 2023-11-24T08:00:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f1877e56640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c003970 0x7f187015f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f1877e56640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 0x7f18701f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f1877e56640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1870150900 0x7f18701f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f1877e56640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18701f6240 con 0x7f1870150480 2023-11-24T08:00:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f1877e56640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18701f3150 con 0x7f1870150900 2023-11-24T08:00:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f1877e56640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18701f3430 con 0x7f185c003970 2023-11-24T08:00:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f18753f1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 0x7f18701f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f18753f1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 0x7f18701f25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52296/0 (socket says 172.21.15.161:52296) 2023-11-24T08:00:41.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.930+0000 7f18753f1640 1 -- 172.21.15.161:0/3627980530 learned_addr learned my addr 172.21.15.161:0/3627980530 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f1875bf2640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c003970 0x7f187015f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18763f3640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1870150900 0x7f18701f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18753f1640 1 -- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c003970 msgr2=0x7f187015f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18753f1640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c003970 0x7f187015f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18753f1640 1 -- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1870150900 msgr2=0x7f18701f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:41.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18753f1640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1870150900 0x7f18701f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:41.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18753f1640 1 -- 172.21.15.161:0/3627980530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18701f3710 con 0x7f1870150480 2023-11-24T08:00:41.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18753f1640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 0x7f18701f25c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f186000c710 tx=0x7f186000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18600074e0 con 0x7f1870150480 2023-11-24T08:00:41.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1860007660 con 0x7f1870150480 2023-11-24T08:00:41.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18701f39f0 con 0x7f1870150480 2023-11-24T08:00:41.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1860004a20 con 0x7f1870150480 2023-11-24T08:00:41.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.931+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18700b2400 con 0x7f1870150480 2023-11-24T08:00:41.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.933+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18700675d0 con 0x7f1870150480 2023-11-24T08:00:41.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.934+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1860004b80 con 0x7f1870150480 2023-11-24T08:00:41.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.935+0000 7f18667fc640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f185406ae40 0x7f185406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:41.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.935+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18600889d0 con 0x7f1870150480 2023-11-24T08:00:41.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.935+0000 7f1875bf2640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f185406ae40 0x7f185406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:41.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.936+0000 7f1875bf2640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f185406ae40 0x7f185406d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f186c009a90 tx=0x7f186c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:41.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:41.939+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1860053a80 con 0x7f1870150480 2023-11-24T08:00:42.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.171+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18700b21e0 con 0x7f1870150480 2023-11-24T08:00:42.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.172+0000 7f18667fc640 1 -- 172.21.15.161:0/3627980530 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f1860018090 con 0x7f1870150480 2023-11-24T08:00:42.174 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:42.174 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:00:42.175 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:00:42.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f185406ae40 msgr2=0x7f185406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f185406ae40 0x7f185406d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f186c009a90 tx=0x7f186c030000 comp rx=0 tx=0).stop 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 msgr2=0x7f18701f25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 0x7f18701f25c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f186000c710 tx=0x7f186000cbd0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 shutdown_connections 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f185406ae40 0x7f185406d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1870150900 0x7f18701f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1870150480 0x7f18701f25c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 --2- 172.21.15.161:0/3627980530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f185c003970 0x7f187015f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.175+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 >> 172.21.15.161:0/3627980530 conn(0x7f187006a800 msgr2=0x7f187015aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:42.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.176+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 shutdown_connections 2023-11-24T08:00:42.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.176+0000 7f1877e56640 1 -- 172.21.15.161:0/3627980530 wait complete. 2023-11-24T08:00:42.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:42.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.406+0000 7fc766d9e640 1 Processor -- start 2023-11-24T08:00:42.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.406+0000 7fc766d9e640 1 -- start start 2023-11-24T08:00:42.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc766d9e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc76009a170 0x7fc7600b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc766d9e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc76006c6b0 0x7fc7600cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc766d9e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76006cea0 con 0x7fc7600cd240 2023-11-24T08:00:42.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc766d9e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76006cbc0 con 0x7fc76006c6b0 2023-11-24T08:00:42.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc766d9e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76006f350 con 0x7fc76009a170 2023-11-24T08:00:42.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc764b3a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc7600cd240 0x7fc760099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54782/0 (socket says 172.21.15.161:54782) 2023-11-24T08:00:42.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc764b3a640 1 -- 172.21.15.161:0/4141903435 learned_addr learned my addr 172.21.15.161:0/4141903435 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:42.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.408+0000 7fc76533b640 1 --2- 172.21.15.161:0/4141903435 >> v2:172.21.15.161:3300/0 conn(0x7fc76006c6b0 0x7fc7600cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc75ffff640 1 --2- 172.21.15.161:0/4141903435 >> v2:172.21.15.175:3300/0 conn(0x7fc76009a170 0x7fc7600b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc75f7fe640 1 -- 172.21.15.161:0/4141903435 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503655994 0 0) 0x7fc76006cea0 con 0x7fc7600cd240 2023-11-24T08:00:42.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc75f7fe640 1 -- 172.21.15.161:0/4141903435 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc74c003520 con 0x7fc7600cd240 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc76533b640 1 -- 172.21.15.161:0/4141903435 >> v2:172.21.15.175:3300/0 conn(0x7fc76009a170 msgr2=0x7fc7600b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc76533b640 1 --2- 172.21.15.161:0/4141903435 >> v2:172.21.15.175:3300/0 conn(0x7fc76009a170 0x7fc7600b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc76533b640 1 -- 172.21.15.161:0/4141903435 >> v1:172.21.15.161:6789/0 conn(0x7fc7600cd240 legacy=0x7fc760099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.409+0000 7fc76533b640 1 -- 172.21.15.161:0/4141903435 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76006f630 con 0x7fc76006c6b0 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.410+0000 7fc76533b640 1 --2- 172.21.15.161:0/4141903435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76006c6b0 0x7fc7600cf640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc760071800 tx=0x7fc75802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4458fdfc4bb2ab8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.410+0000 7fc75f7fe640 1 -- 172.21.15.161:0/4141903435 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758031830 con 0x7fc76006c6b0 2023-11-24T08:00:42.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.410+0000 7fc75f7fe640 1 -- 172.21.15.161:0/4141903435 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758031990 con 0x7fc76006c6b0 2023-11-24T08:00:42.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.410+0000 7fc75f7fe640 1 -- 172.21.15.161:0/4141903435 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758031d20 con 0x7fc76006c6b0 2023-11-24T08:00:42.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 -- 172.21.15.161:0/4141903435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76006c6b0 msgr2=0x7fc7600cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 --2- 172.21.15.161:0/4141903435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76006c6b0 0x7fc7600cf640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc760071800 tx=0x7fc75802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 -- 172.21.15.161:0/4141903435 shutdown_connections 2023-11-24T08:00:42.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 --2- 172.21.15.161:0/4141903435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76006c6b0 0x7fc7600cf640 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 --2- 172.21.15.161:0/4141903435 >> v2:172.21.15.175:3300/0 conn(0x7fc76009a170 0x7fc7600b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 -- 172.21.15.161:0/4141903435 >> 172.21.15.161:0/4141903435 conn(0x7fc7600b2d00 msgr2=0x7fc7600b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:42.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 -- 172.21.15.161:0/4141903435 shutdown_connections 2023-11-24T08:00:42.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.411+0000 7fc766d9e640 1 -- 172.21.15.161:0/4141903435 wait complete. 2023-11-24T08:00:42.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.413+0000 7fc766d9e640 1 Processor -- start 2023-11-24T08:00:42.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.413+0000 7fc766d9e640 1 -- start start 2023-11-24T08:00:42.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc766d9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc76006c6b0 0x7fc760156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc766d9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 0x7fc7600b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc766d9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7600cd240 0x7fc7600b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc766d9e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600c6ac0 con 0x7fc76009a170 2023-11-24T08:00:42.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc766d9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600b4200 con 0x7fc76006c6b0 2023-11-24T08:00:42.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc766d9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7600b5fb0 con 0x7fc7600cd240 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 0x7fc7600b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc75ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 0x7fc7600b5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52318/0 (socket says 172.21.15.161:52318) 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.414+0000 7fc75ffff640 1 -- 172.21.15.161:0/3036981491 learned_addr learned my addr 172.21.15.161:0/3036981491 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc764b3a640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc76006c6b0 0x7fc760156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc76533b640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7600cd240 0x7fc7600b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75ffff640 1 -- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7600cd240 msgr2=0x7fc7600b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75ffff640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7600cd240 0x7fc7600b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75ffff640 1 -- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc76006c6b0 msgr2=0x7fc760156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75ffff640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc76006c6b0 0x7fc760156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75ffff640 1 -- 172.21.15.161:0/3036981491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc758009400 con 0x7fc76009a170 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75ffff640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 0x7fc7600b5440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc74800d800 tx=0x7fc74800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74800b6c0 con 0x7fc76009a170 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74800b820 con 0x7fc76009a170 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74800bbb0 con 0x7fc76009a170 2023-11-24T08:00:42.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7600b44a0 con 0x7fc76009a170 2023-11-24T08:00:42.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.415+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7600b4a60 con 0x7fc76009a170 2023-11-24T08:00:42.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.417+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7600675d0 con 0x7fc76009a170 2023-11-24T08:00:42.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.417+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc74800bd10 con 0x7fc76009a170 2023-11-24T08:00:42.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.418+0000 7fc75d7fa640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc74006ae40 0x7fc74006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.418+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc748089c50 con 0x7fc76009a170 2023-11-24T08:00:42.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.419+0000 7fc764b3a640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc74006ae40 0x7fc74006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.420+0000 7fc764b3a640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc74006ae40 0x7fc74006d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc750001560 tx=0x7fc750009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:42.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.423+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc748054c60 con 0x7fc76009a170 2023-11-24T08:00:42.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.615+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7600aff90 con 0x7fc76009a170 2023-11-24T08:00:42.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.617+0000 7fc75d7fa640 1 -- 172.21.15.161:0/3036981491 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fc748058280 con 0x7fc76009a170 2023-11-24T08:00:42.618 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:42.619 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.619+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc74006ae40 msgr2=0x7fc74006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.619+0000 7fc766d9e640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc74006ae40 0x7fc74006d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc750001560 tx=0x7fc750009040 comp rx=0 tx=0).stop 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.619+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 msgr2=0x7fc7600b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.619+0000 7fc766d9e640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 0x7fc7600b5440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc74800d800 tx=0x7fc74800dcc0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 shutdown_connections 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc74006ae40 0x7fc74006d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7600cd240 0x7fc7600b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc76009a170 0x7fc7600b5440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 --2- 172.21.15.161:0/3036981491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc76006c6b0 0x7fc760156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 >> 172.21.15.161:0/3036981491 conn(0x7fc7600b2d00 msgr2=0x7fc760099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 shutdown_connections 2023-11-24T08:00:42.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.620+0000 7fc766d9e640 1 -- 172.21.15.161:0/3036981491 wait complete. 2023-11-24T08:00:42.640 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:00:42.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.854+0000 7fd97b485640 1 Processor -- start 2023-11-24T08:00:42.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.854+0000 7fd97b485640 1 -- start start 2023-11-24T08:00:42.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd97b485640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9740cc500 0x7fd9740cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd97b485640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd974070e50 con 0x7fd97406d160 2023-11-24T08:00:42.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd97b485640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd974144020 con 0x7fd974143c40 2023-11-24T08:00:42.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd97b485640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740723c0 con 0x7fd9740cc500 2023-11-24T08:00:42.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd979c82640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9740cc500 0x7fd9740cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd97ac84640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd97406d160 0x7fd97406d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54784/0 (socket says 172.21.15.161:54784) 2023-11-24T08:00:42.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.856+0000 7fd97ac84640 1 -- 172.21.15.161:0/668729685 learned_addr learned my addr 172.21.15.161:0/668729685 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:42.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.857+0000 7fd979c82640 1 -- 172.21.15.161:0/668729685 >> v1:172.21.15.175:6789/0 conn(0x7fd974143c40 legacy=0x7fd974071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:42.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.857+0000 7fd979c82640 1 -- 172.21.15.161:0/668729685 >> v1:172.21.15.161:6789/0 conn(0x7fd97406d160 legacy=0x7fd97406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.857+0000 7fd979c82640 1 -- 172.21.15.161:0/668729685 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974071e00 con 0x7fd9740cc500 2023-11-24T08:00:42.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.858+0000 7fd979c82640 1 --2- 172.21.15.161:0/668729685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9740cc500 0x7fd9740cc990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd9680097a0 tx=0x7fd96802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4934c8672c0aefa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.858+0000 7fd979481640 1 -- 172.21.15.161:0/668729685 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968031830 con 0x7fd9740cc500 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.858+0000 7fd979481640 1 -- 172.21.15.161:0/668729685 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968031990 con 0x7fd9740cc500 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.858+0000 7fd979481640 1 -- 172.21.15.161:0/668729685 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968031d20 con 0x7fd9740cc500 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 -- 172.21.15.161:0/668729685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9740cc500 msgr2=0x7fd9740cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 --2- 172.21.15.161:0/668729685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9740cc500 0x7fd9740cc990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd9680097a0 tx=0x7fd96802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 -- 172.21.15.161:0/668729685 shutdown_connections 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 --2- 172.21.15.161:0/668729685 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9740cc500 0x7fd9740cc990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 -- 172.21.15.161:0/668729685 >> 172.21.15.161:0/668729685 conn(0x7fd97406a800 msgr2=0x7fd97406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:42.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 -- 172.21.15.161:0/668729685 shutdown_connections 2023-11-24T08:00:42.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.859+0000 7fd97b485640 1 -- 172.21.15.161:0/668729685 wait complete. 2023-11-24T08:00:42.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.861+0000 7fd97b485640 1 Processor -- start 2023-11-24T08:00:42.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.861+0000 7fd97b485640 1 -- start start 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.862+0000 7fd97b485640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 0x7fd9741424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.862+0000 7fd97b485640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9740cc500 0x7fd974157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.862+0000 7fd97b485640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd974143c40 0x7fd9741f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.862+0000 7fd97b485640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741592b0 con 0x7fd97406d160 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.862+0000 7fd97b485640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741586a0 con 0x7fd9740cc500 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.862+0000 7fd97b485640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd974158980 con 0x7fd974143c40 2023-11-24T08:00:42.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 0x7fd9741424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 0x7fd9741424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52336/0 (socket says 172.21.15.161:52336) 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 -- 172.21.15.161:0/3306598391 learned_addr learned my addr 172.21.15.161:0/3306598391 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd979c82640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9740cc500 0x7fd974157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 -- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd974143c40 msgr2=0x7fd9741f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd974143c40 0x7fd9741f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 -- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9740cc500 msgr2=0x7fd974157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9740cc500 0x7fd974157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:42.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 -- 172.21.15.161:0/3306598391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968009400 con 0x7fd97406d160 2023-11-24T08:00:42.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.863+0000 7fd97a483640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 0x7fd9741424f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd97000c450 tx=0x7fd97000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:42.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.864+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9700052d0 con 0x7fd97406d160 2023-11-24T08:00:42.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.864+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd970005430 con 0x7fd97406d160 2023-11-24T08:00:42.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.864+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970012870 con 0x7fd97406d160 2023-11-24T08:00:42.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.864+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974158c60 con 0x7fd97406d160 2023-11-24T08:00:42.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.864+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9740a8ff0 con 0x7fd97406d160 2023-11-24T08:00:42.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.865+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974144ac0 con 0x7fd97406d160 2023-11-24T08:00:42.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.866+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9700129d0 con 0x7fd97406d160 2023-11-24T08:00:42.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.867+0000 7fd966ffd640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd95806ae70 0x7fd95806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:42.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.867+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd970089110 con 0x7fd97406d160 2023-11-24T08:00:42.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.867+0000 7fd979c82640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd95806ae70 0x7fd95806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:42.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.868+0000 7fd979c82640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd95806ae70 0x7fd95806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd968036000 tx=0x7fd968008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:42.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:42.871+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9700541c0 con 0x7fd97406d160 2023-11-24T08:00:43.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.097+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd974067450 con 0x7fd97406d160 2023-11-24T08:00:43.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.098+0000 7fd966ffd640 1 -- 172.21.15.161:0/3306598391 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7fd9700577e0 con 0x7fd97406d160 2023-11-24T08:00:43.099 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:43.099 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:00:43.099 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:00:43.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd95806ae70 msgr2=0x7fd95806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd95806ae70 0x7fd95806d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd968036000 tx=0x7fd968008030 comp rx=0 tx=0).stop 2023-11-24T08:00:43.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 msgr2=0x7fd9741424f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 0x7fd9741424f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd97000c450 tx=0x7fd97000c910 comp rx=0 tx=0).stop 2023-11-24T08:00:43.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 shutdown_connections 2023-11-24T08:00:43.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd95806ae70 0x7fd95806d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd974143c40 0x7fd9741f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9740cc500 0x7fd974157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 --2- 172.21.15.161:0/3306598391 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd97406d160 0x7fd9741424f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.100+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 >> 172.21.15.161:0/3306598391 conn(0x7fd97406a800 msgr2=0x7fd974071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.101+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 shutdown_connections 2023-11-24T08:00:43.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.101+0000 7fd97b485640 1 -- 172.21.15.161:0/3306598391 wait complete. 2023-11-24T08:00:43.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:00:25.921462+0000', 'modified': '2023-11-24T08:00:29.255218+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6837/1099349504', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 1099349504}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 1099349504}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:00:43.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:00:43.523 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T08:00:43.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.749+0000 7fc83e2b4640 1 Processor -- start 2023-11-24T08:00:43.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.749+0000 7fc83e2b4640 1 -- start start 2023-11-24T08:00:43.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.750+0000 7fc83e2b4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc838143ae0 0x7fc8380cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc83e2b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83815e3b0 0x7fc8380702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc83e2b4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8380cfc30 con 0x7fc8380cf7d0 2023-11-24T08:00:43.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc83e2b4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8380b1ee0 con 0x7fc838143ae0 2023-11-24T08:00:43.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc83e2b4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380b2780 con 0x7fc83815e3b0 2023-11-24T08:00:43.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc837fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc838143ae0 0x7fc8380cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc83c851640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83815e3b0 0x7fc8380702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc837fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc838143ae0 0x7fc8380cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:42798/0 (socket says 172.21.15.161:42798) 2023-11-24T08:00:43.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.751+0000 7fc837fff640 1 -- 172.21.15.161:0/2553157441 learned_addr learned my addr 172.21.15.161:0/2553157441 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:43.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.752+0000 7fc837fff640 1 -- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83815e3b0 msgr2=0x7fc8380702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.752+0000 7fc837fff640 1 --2- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83815e3b0 0x7fc8380702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.752+0000 7fc837fff640 1 -- 172.21.15.161:0/2553157441 >> v1:172.21.15.175:6789/0 conn(0x7fc8380cf7d0 legacy=0x7fc83815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.752+0000 7fc836ffd640 1 -- 172.21.15.161:0/2553157441 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186270799 0 0) 0x7fc8380cfc30 con 0x7fc8380cf7d0 2023-11-24T08:00:43.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.752+0000 7fc837fff640 1 -- 172.21.15.161:0/2553157441 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83815e990 con 0x7fc838143ae0 2023-11-24T08:00:43.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.754+0000 7fc837fff640 1 --2- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc8380cf290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc82800bb10 tx=0x7fc82802e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32f5176825d3b3a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.754+0000 7fc836ffd640 1 -- 172.21.15.161:0/2553157441 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828036440 con 0x7fc838143ae0 2023-11-24T08:00:43.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.754+0000 7fc836ffd640 1 -- 172.21.15.161:0/2553157441 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280365a0 con 0x7fc838143ae0 2023-11-24T08:00:43.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.754+0000 7fc836ffd640 1 -- 172.21.15.161:0/2553157441 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828036930 con 0x7fc838143ae0 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.754+0000 7fc83e2b4640 1 -- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 msgr2=0x7fc8380cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.754+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc8380cf290 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc82800bb10 tx=0x7fc82802e150 comp rx=0 tx=0).stop 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.755+0000 7fc83e2b4640 1 -- 172.21.15.161:0/2553157441 shutdown_connections 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.755+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc83815e3b0 0x7fc8380702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.755+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/2553157441 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc8380cf290 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.755+0000 7fc83e2b4640 1 -- 172.21.15.161:0/2553157441 >> 172.21.15.161:0/2553157441 conn(0x7fc83806a800 msgr2=0x7fc83806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.755+0000 7fc83e2b4640 1 -- 172.21.15.161:0/2553157441 shutdown_connections 2023-11-24T08:00:43.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.755+0000 7fc83e2b4640 1 -- 172.21.15.161:0/2553157441 wait complete. 2023-11-24T08:00:43.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.756+0000 7fc83e2b4640 1 Processor -- start 2023-11-24T08:00:43.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.757+0000 7fc83e2b4640 1 -- start start 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.757+0000 7fc83e2b4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8380cf7d0 0x7fc838159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.757+0000 7fc83e2b4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc838140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83e2b4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 0x7fc8381409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83e2b4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380a8be0 con 0x7fc83815e3b0 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83e2b4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838159f40 con 0x7fc838143ae0 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83e2b4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380a99c0 con 0x7fc8380cf7d0 2023-11-24T08:00:43.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 0x7fc8381409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 0x7fc8381409a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52350/0 (socket says 172.21.15.161:52350) 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 -- 172.21.15.161:0/1094772127 learned_addr learned my addr 172.21.15.161:0/1094772127 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc8377fe640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc838140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc837fff640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8380cf7d0 0x7fc838159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 -- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8380cf7d0 msgr2=0x7fc838159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8380cf7d0 0x7fc838159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 -- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 msgr2=0x7fc838140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc838140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc83c851640 1 -- 172.21.15.161:0/1094772127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82800b770 con 0x7fc83815e3b0 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.758+0000 7fc837fff640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8380cf7d0 0x7fc838159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:43.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.759+0000 7fc83c851640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 0x7fc8381409a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc83000efc0 tx=0x7fc83000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.759+0000 7fc834ff9640 1 -- 172.21.15.161:0/1094772127 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830009ba0 con 0x7fc83815e3b0 2023-11-24T08:00:43.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.759+0000 7fc834ff9640 1 -- 172.21.15.161:0/1094772127 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000f040 con 0x7fc83815e3b0 2023-11-24T08:00:43.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.759+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380a9ca0 con 0x7fc83815e3b0 2023-11-24T08:00:43.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.759+0000 7fc834ff9640 1 -- 172.21.15.161:0/1094772127 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300146c0 con 0x7fc83815e3b0 2023-11-24T08:00:43.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.759+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380a8870 con 0x7fc83815e3b0 2023-11-24T08:00:43.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.761+0000 7fc834ff9640 1 -- 172.21.15.161:0/1094772127 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc830014820 con 0x7fc83815e3b0 2023-11-24T08:00:43.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.762+0000 7fc834ff9640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc82406ae70 0x7fc82406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.762+0000 7fc834ff9640 1 -- 172.21.15.161:0/1094772127 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc83008a3f0 con 0x7fc83815e3b0 2023-11-24T08:00:43.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.763+0000 7fc837fff640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc82406ae70 0x7fc82406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.763+0000 7fc840e49740 1 Processor -- start 2023-11-24T08:00:43.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.763+0000 7fc840e49740 1 -- start start 2023-11-24T08:00:43.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc837fff640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc82406ae70 0x7fc82406d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc828038000 tx=0x7fc828032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb38b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc840e49740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 0x55effb38a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38a5e0 0x55effb3ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc840e49740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb2e9880 con 0x55effb385ba0 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb2f8ae0 con 0x55effb38aea0 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55effb2f61d0 con 0x55effb38a5e0 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 0x55effb38a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 0x55effb38a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52366/0 (socket says 172.21.15.161:52366) 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc8377fe640 1 -- 172.21.15.161:0/286117477 learned_addr learned my addr 172.21.15.161:0/286117477 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.764+0000 7fc837fff640 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb38b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc8377fe640 1 -- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38a5e0 msgr2=0x55effb3ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc8377fe640 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38a5e0 0x55effb3ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc8377fe640 1 -- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 msgr2=0x55effb38b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc8377fe640 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb38b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc8377fe640 1 -- 172.21.15.161:0/286117477 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55effb2b9860 con 0x55effb385ba0 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc8377fe640 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 0x55effb38a0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0015f0 tx=0x7fc82c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=237945354f78c801 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc81dffb640 1 -- 172.21.15.161:0/286117477 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c001d00 con 0x55effb385ba0 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc81dffb640 1 -- 172.21.15.161:0/286117477 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c0052e0 con 0x55effb385ba0 2023-11-24T08:00:43.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.765+0000 7fc81dffb640 1 -- 172.21.15.161:0/286117477 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e940 con 0x55effb385ba0 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 -- 172.21.15.161:0/286117477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 msgr2=0x55effb38a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 0x55effb38a0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0015f0 tx=0x7fc82c001ab0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 -- 172.21.15.161:0/286117477 shutdown_connections 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38a5e0 0x55effb3ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb385ba0 0x55effb38a0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 --2- 172.21.15.161:0/286117477 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb38b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 -- 172.21.15.161:0/286117477 >> 172.21.15.161:0/286117477 conn(0x55effb34cc70 msgr2=0x55effb3d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 -- 172.21.15.161:0/286117477 shutdown_connections 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.766+0000 7fc840e49740 1 -- 172.21.15.161:0/286117477 wait complete. 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.767+0000 7fc840e49740 1 -- start start 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.767+0000 7fc840e49740 1 Processor -- start 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3d3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb3d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb2f1ac0 con 0x55effb38a5e0 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb28e2f0 con 0x55effb38aea0 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55effb2abc70 con 0x55effb385ba0 2023-11-24T08:00:43.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc840e49740 10 client.0 _ll_register_callbacks cb 0x55effb2b03b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52368/0 (socket says 172.21.15.161:52368) 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.768+0000 7fc8377fe640 1 -- 172.21.15.161:0/3995571733 learned_addr learned my addr 172.21.15.161:0/3995571733 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc837fff640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3d3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc83c851640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb3d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc8377fe640 1 -- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 msgr2=0x55effb3d3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc8377fe640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3d3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc8377fe640 1 -- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 msgr2=0x55effb3d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc8377fe640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb3d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc8377fe640 1 -- 172.21.15.161:0/3995571733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c00f040 con 0x55effb38a5e0 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc837fff640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc83c851640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb3d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc8377fe640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3cd180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc82c013000 tx=0x7fc82c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab67ba07a0537b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc816ffd640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc816ffd640 1 -- 172.21.15.161:0/3995571733 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c001d00 con 0x55effb38a5e0 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc816ffd640 1 -- 172.21.15.161:0/3995571733 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc82c00ed80 con 0x55effb38a5e0 2023-11-24T08:00:43.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55effb2eaaa0 con 0x55effb38a5e0 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.769+0000 7fc816ffd640 1 -- 172.21.15.161:0/3995571733 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc82c0035f0 con 0x55effb38a5e0 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 10 client.4587 fetch_fsmap learned FSMap version 8 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55effb2f0140 con 0x55effb38a5e0 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc816ffd640 1 -- 172.21.15.161:0/3995571733 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55effb2eaaa0 con 0x55effb38a5e0 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc816ffd640 1 -- 172.21.15.161:0/3995571733 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc82c003750 con 0x55effb38a5e0 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 10 client.4587 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 10 client.4587 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 20 client.4587 populate_metadata read hostname 'smithi161' 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3a2870 0x55effb3a0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 4 client.4587 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:00:43.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.770+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 --> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55effb2ea7c0 con 0x55effb3a2870 2023-11-24T08:00:43.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.771+0000 7fc837fff640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3a2870 0x55effb3a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.771+0000 7fc837fff640 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3a2870 0x55effb3a0390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00b54c00fa87773 server_cookie=955854cb5eef0a0f in_seq=0 out_seq=0 2023-11-24T08:00:43.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.771+0000 7fc816ffd640 10 client.4587 ms_handle_connect on v2:172.21.15.175:6836/1099349504 2023-11-24T08:00:43.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.773+0000 7fc816ffd640 1 -- 172.21.15.161:0/3995571733 <== mds.0 v2:172.21.15.175:6836/1099349504 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55effb2ea7c0 con 0x55effb3a2870 2023-11-24T08:00:43.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.773+0000 7fc816ffd640 10 client.4587 handle_command_reply: tid=0 2023-11-24T08:00:43.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 client.4587 shutdown 2023-11-24T08:00:43.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 msgr2=0x55effb3cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3cd180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc82c013000 tx=0x7fc82c000ed0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 shutdown_connections 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3a2870 0x55effb3a0390 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38aea0 0x55effb3d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3cd180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 --2- 172.21.15.161:0/3995571733 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3d3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc816ffd640 0 client.4587 ms_handle_reset on v2:172.21.15.175:6836/1099349504 2023-11-24T08:00:43.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 >> 172.21.15.161:0/3995571733 conn(0x55effb34cc70 msgr2=0x55effb384b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 shutdown_connections 2023-11-24T08:00:43.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 1 -- 172.21.15.161:0/3995571733 wait complete. 2023-11-24T08:00:43.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.774+0000 7fc840e49740 20 client.4587 trim_cache size 0 max 16384 2023-11-24T08:00:43.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.791+0000 7fc840e49740 1 Processor -- start 2023-11-24T08:00:43.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.791+0000 7fc840e49740 1 -- start start 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3a1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38a5e0 0x55effb3d7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc840e49740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 0x55effb3e3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc840e49740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb3d0740 con 0x55effb38aea0 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb054f20 con 0x55effb38a5e0 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55effb3f7280 con 0x55effb385ba0 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc83c851640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 0x55effb3e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc83c851640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 0x55effb3e3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52370/0 (socket says 172.21.15.161:52370) 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.792+0000 7fc83c851640 1 -- 172.21.15.161:0/3531345707 learned_addr learned my addr 172.21.15.161:0/3531345707 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc83c851640 1 -- 172.21.15.161:0/3531345707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 msgr2=0x55effb3a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc83c851640 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc83c851640 1 -- 172.21.15.161:0/3531345707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38a5e0 msgr2=0x55effb3d7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc83c851640 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38a5e0 0x55effb3d7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc83c851640 1 -- 172.21.15.161:0/3531345707 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55effb3ccbf0 con 0x55effb38aea0 2023-11-24T08:00:43.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc83c851640 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 0x55effb3e3170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc830060f20 tx=0x7fc830059910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227f131d7f8445b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc81e7fc640 1 -- 172.21.15.161:0/3531345707 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83006cea0 con 0x55effb38aea0 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc81e7fc640 1 -- 172.21.15.161:0/3531345707 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830061450 con 0x55effb38aea0 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.793+0000 7fc81e7fc640 1 -- 172.21.15.161:0/3531345707 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83008a0d0 con 0x55effb38aea0 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 -- 172.21.15.161:0/3531345707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 msgr2=0x55effb3e3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 0x55effb3e3170 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc830060f20 tx=0x7fc830059910 comp rx=0 tx=0).stop 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 -- 172.21.15.161:0/3531345707 shutdown_connections 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38aea0 0x55effb3e3170 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb38a5e0 0x55effb3d7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 --2- 172.21.15.161:0/3531345707 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb385ba0 0x55effb3a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 -- 172.21.15.161:0/3531345707 >> 172.21.15.161:0/3531345707 conn(0x55effb34cc70 msgr2=0x55effb3812a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 -- 172.21.15.161:0/3531345707 shutdown_connections 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.794+0000 7fc840e49740 1 -- 172.21.15.161:0/3531345707 wait complete. 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.795+0000 7fc840e49740 1 -- start start 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.795+0000 7fc840e49740 1 Processor -- start 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb385ba0 0x55effb43e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3f3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38aea0 0x55effb3f3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb3f6520 con 0x55effb38a5e0 2023-11-24T08:00:43.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55effb43eed0 con 0x55effb385ba0 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55effb3d1ac0 con 0x55effb38aea0 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc840e49740 10 client.0 _ll_register_callbacks cb 0x7fc82c017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52372/0 (socket says 172.21.15.161:52372) 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 -- 172.21.15.161:0/683564901 learned_addr learned my addr 172.21.15.161:0/683564901 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 -- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38aea0 msgr2=0x55effb3f3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38aea0 0x55effb3f3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc837fff640 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb385ba0 0x55effb43e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 -- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb385ba0 msgr2=0x55effb43e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb385ba0 0x55effb43e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.796+0000 7fc8377fe640 1 -- 172.21.15.161:0/683564901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380a8870 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc8377fe640 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3f3130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005000 tx=0x7fc82c001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81198c9b64958fc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc816ffd640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc816ffd640 1 -- 172.21.15.161:0/683564901 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00e9f0 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc816ffd640 1 -- 172.21.15.161:0/683564901 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc82c001d00 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc82c0052e0 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc816ffd640 1 -- 172.21.15.161:0/683564901 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc82c00e530 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 10 client.4593 fetch_fsmap learned FSMap version 8 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55effb28db80 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc816ffd640 1 -- 172.21.15.161:0/683564901 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c0052e0 con 0x55effb38a5e0 2023-11-24T08:00:43.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc816ffd640 1 -- 172.21.15.161:0/683564901 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc82c007030 con 0x55effb38a5e0 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 10 client.4593 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 10 client.4593 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 20 client.4593 populate_metadata read hostname 'smithi161' 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3f5410 0x55effb3f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 4 client.4593 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.797+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 --> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55effaff26c0 con 0x55effb3f5410 2023-11-24T08:00:43.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.798+0000 7fc837fff640 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3f5410 0x55effb3f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:43.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.799+0000 7fc837fff640 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3f5410 0x55effb3f57f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59080bba5a553555 server_cookie=21ac850703f1aedd in_seq=0 out_seq=0 2023-11-24T08:00:43.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.799+0000 7fc816ffd640 10 client.4593 ms_handle_connect on v2:172.21.15.175:6836/1099349504 2023-11-24T08:00:43.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.799+0000 7fc816ffd640 1 -- 172.21.15.161:0/683564901 <== mds.0 v2:172.21.15.175:6836/1099349504 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55effaff26c0 con 0x55effb3f5410 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.799+0000 7fc816ffd640 10 client.4593 handle_command_reply: tid=0 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.799+0000 7fc840e49740 1 client.4593 shutdown 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 msgr2=0x55effb3f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3f3130 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc82c005000 tx=0x7fc82c001080 comp rx=0 tx=0).stop 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 shutdown_connections 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:6836/1099349504,v1:172.21.15.175:6837/1099349504] conn(0x55effb3f5410 0x55effb3f57f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55effb38aea0 0x55effb3f3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55effb38a5e0 0x55effb3f3130 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 --2- 172.21.15.161:0/683564901 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55effb385ba0 0x55effb43e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc816ffd640 0 client.4593 ms_handle_reset on v2:172.21.15.175:6836/1099349504 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 >> 172.21.15.161:0/683564901 conn(0x55effb34cc70 msgr2=0x55effb39f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 shutdown_connections 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 1 -- 172.21.15.161:0/683564901 wait complete. 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc840e49740 20 client.4593 trim_cache size 0 max 16384 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "2e355083-a16f-42dd-a3ed-5276a3fda4f7", 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4285, 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2023-11-24T08:00:43.806 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2023-11-24T08:00:43.807 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 17.040157822000001, 2023-11-24T08:00:43.807 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 8, 2023-11-24T08:00:43.807 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 22, 2023-11-24T08:00:43.807 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 22, 2023-11-24T08:00:43.807 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 25.287961009 2023-11-24T08:00:43.807 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc82406ae70 msgr2=0x7fc82406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc82406ae70 0x7fc82406d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc828038000 tx=0x7fc828032000 comp rx=0 tx=0).stop 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 msgr2=0x7fc8381409a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.800+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 0x7fc8381409a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc83000efc0 tx=0x7fc83000c490 comp rx=0 tx=0).stop 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 shutdown_connections 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc82406ae70 0x7fc82406d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc83815e3b0 0x7fc8381409a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc838143ae0 0x7fc838140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 --2- 172.21.15.161:0/1094772127 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8380cf7d0 0x7fc838159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:43.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 >> 172.21.15.161:0/1094772127 conn(0x7fc83806a800 msgr2=0x7fc83806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:43.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 shutdown_connections 2023-11-24T08:00:43.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:43.801+0000 7fc83e2b4640 1 -- 172.21.15.161:0/1094772127 wait complete. 2023-11-24T08:00:43.819 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-24T08:00:43.842 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-24T08:00:43.843 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T08:00:43.843 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-24T08:00:43.843 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:00:43.843 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:43.843 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-24T08:00:43.843 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:00:43.843 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:43.843 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-24T08:00:43.844 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:00:43.844 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:43.844 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-24T08:00:43.844 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T08:00:43.844 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:43.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:43.844 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:00:43.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:43.908 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-11-24T08:00:44.008 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2023-11-24T08:00:44.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:00:44.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:44.012 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:00:44.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:44.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-11-24T08:00:44.171 INFO:teuthology.orchestra.run.smithi161.stderr:Cannot find device "ceph-brx" 2023-11-24T08:00:44.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:00:44.175 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-24T08:00:44.175 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:00:44.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.392+0000 7f6ed2c3d640 1 Processor -- start 2023-11-24T08:00:44.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.392+0000 7f6ed2c3d640 1 -- start start 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.394+0000 7f6ed2c3d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 0x7f6ecc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.394+0000 7f6ed2c3d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc06c470 con 0x7f6ecc13e360 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.394+0000 7f6ed2c3d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc06c750 con 0x7f6ecc0cf9a0 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.394+0000 7f6ed2c3d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc06ca30 con 0x7f6ecc13df80 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.394+0000 7f6ecbfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6ecc13e360 0x7f6ecc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54794/0 (socket says 172.21.15.161:54794) 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.394+0000 7f6ecbfff640 1 -- 172.21.15.161:0/3577643160 learned_addr learned my addr 172.21.15.161:0/3577643160 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:44.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 0x7f6ecc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808165075 0 0) 0x7f6ecc06c470 con 0x7f6ecc13e360 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb8003520 con 0x7f6ecc13e360 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4201175097 0 0) 0x7f6eb8003520 con 0x7f6ecc13e360 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 msgr2=0x7f6ecc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 0x7f6ecc15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 >> v1:172.21.15.175:6789/0 conn(0x7f6ecc0cf9a0 legacy=0x7f6ecc0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc06cd10 con 0x7f6ecc13e360 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6ebc0019f0 con 0x7f6ecc13e360 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 >> v1:172.21.15.161:6789/0 conn(0x7f6ecc13e360 legacy=0x7f6ecc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb80039a0 0x7f6eb8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80047c0 0x7f6eb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.395+0000 7f6ecb7fe640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 0x7f6eb8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc06ca30 con 0x7f6eb80039a0 2023-11-24T08:00:44.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb800bb10 con 0x7f6eb80047c0 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb800bcd0 con 0x7f6ecc13df80 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb80039a0 0x7f6eb8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ecbfff640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80047c0 0x7f6eb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ed09d9640 1 -- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 msgr2=0x7f6eb8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ecc13df80 0x7f6eb8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ed09d9640 1 -- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80047c0 msgr2=0x7f6eb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb80047c0 0x7f6eb8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.396+0000 7f6ed09d9640 1 -- 172.21.15.161:0/3577643160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8003520 con 0x7f6eb80039a0 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.397+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb80039a0 0x7f6eb8003dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400ba30 tx=0x7f6eb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ee9d913b9b59bc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.397+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4032680 con 0x7f6eb80039a0 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.397+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb40327e0 con 0x7f6eb80039a0 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.397+0000 7f6ecb7fe640 1 -- 172.21.15.161:0/3577643160 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4032b70 con 0x7f6eb80039a0 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/3577643160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb80039a0 msgr2=0x7f6eb8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/3577643160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb80039a0 0x7f6eb8003dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400ba30 tx=0x7f6eb80057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed11da640 1 -- 172.21.15.161:0/3577643160 reap_dead start 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/3577643160 shutdown_connections 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/3577643160 >> 172.21.15.161:0/3577643160 conn(0x7f6ecc06a800 msgr2=0x7f6ecc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/3577643160 shutdown_connections 2023-11-24T08:00:44.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.398+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/3577643160 wait complete. 2023-11-24T08:00:44.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.400+0000 7f6ed2c3d640 1 Processor -- start 2023-11-24T08:00:44.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.400+0000 7f6ed2c3d640 1 -- start start 2023-11-24T08:00:44.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ed2c3d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb80039a0 0x7f6ecc1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ed2c3d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 0x7f6ecc159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ed2c3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc070680 0x7f6ecc070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ed2c3d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc071c70 con 0x7f6ecc158d80 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ed2c3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc159740 con 0x7f6ecc070680 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ed2c3d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0b2270 con 0x7f6eb80039a0 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 0x7f6ecc159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ecbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 0x7f6ecc159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52384/0 (socket says 172.21.15.161:52384) 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.401+0000 7f6ecbfff640 1 -- 172.21.15.161:0/2298607776 learned_addr learned my addr 172.21.15.161:0/2298607776 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:44.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ecbfff640 1 -- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb80039a0 msgr2=0x7f6ecc1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ed11da640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc070680 0x7f6ecc070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ecbfff640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb80039a0 0x7f6ecc1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ecbfff640 1 -- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc070680 msgr2=0x7f6ecc070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ecbfff640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc070680 0x7f6ecc070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ecbfff640 1 -- 172.21.15.161:0/2298607776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0713d0 con 0x7f6ecc158d80 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ed11da640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc070680 0x7f6ecc070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ecbfff640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 0x7f6ecc159200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc002120 tx=0x7f6ebc00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc004d60 con 0x7f6ecc158d80 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00be80 con 0x7f6ecc158d80 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc0072d0 con 0x7f6ecc158d80 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0716b0 con 0x7f6ecc158d80 2023-11-24T08:00:44.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.402+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc151820 con 0x7f6ecc158d80 2023-11-24T08:00:44.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.404+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc0675d0 con 0x7f6ecc158d80 2023-11-24T08:00:44.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.405+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ebc007430 con 0x7f6ecc158d80 2023-11-24T08:00:44.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.405+0000 7f6ec97fa640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6eac06ae40 0x7f6eac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:44.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.406+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ebc089490 con 0x7f6ecc158d80 2023-11-24T08:00:44.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.406+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6eac06ae40 0x7f6eac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:44.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.407+0000 7f6ed09d9640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6eac06ae40 0x7f6eac06d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4037000 tx=0x7f6eb4032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:44.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.410+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ebc054680 con 0x7f6ecc158d80 2023-11-24T08:00:44.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.641+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ecc0b23b0 con 0x7f6ecc158d80 2023-11-24T08:00:44.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.642+0000 7f6ec97fa640 1 -- 172.21.15.161:0/2298607776 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6ebc019060 con 0x7f6ecc158d80 2023-11-24T08:00:44.643 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:00:44.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6eac06ae40 msgr2=0x7f6eac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6eac06ae40 0x7f6eac06d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4037000 tx=0x7f6eb4032000 comp rx=0 tx=0).stop 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 msgr2=0x7f6ecc159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 0x7f6ecc159200 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc002120 tx=0x7f6ebc00b4a0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 shutdown_connections 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6eac06ae40 0x7f6eac06d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ecc070680 0x7f6ecc070b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ecc158d80 0x7f6ecc159200 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 --2- 172.21.15.161:0/2298607776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb80039a0 0x7f6ecc1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:44.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.644+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 >> 172.21.15.161:0/2298607776 conn(0x7f6ecc06a800 msgr2=0x7f6ecc0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:44.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.645+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 shutdown_connections 2023-11-24T08:00:44.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:44.645+0000 7f6ed2c3d640 1 -- 172.21.15.161:0/2298607776 wait complete. 2023-11-24T08:00:44.663 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:00:44.664 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:00:44.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:44.665 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-24T08:00:44.718 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:44.718 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:44.718 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:44.718 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:44.718 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:44.718 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:44.719 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:00:44.720 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42358sec preferred_lft 42358sec 2023-11-24T08:00:44.720 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-24T08:00:44.720 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:44.720 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:00:44.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:44.720 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:44.720 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:44.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:00:44.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr flush dev ceph-brx 2023-11-24T08:00:44.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set ceph-brx up 2023-11-24T08:00:44.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:00:44.721 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:45.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:45.180 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:00:45.262 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-24T08:00:45.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:45.266 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-24T08:00:45.313 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-24T08:00:45.313 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:00:45.313 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:00:45.313 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:00:45.314 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:00:45.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:45.314 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:45.314 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:45.314 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:00:45.314 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:00:45.314 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:00:45.315 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:46.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:46.229 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:00:46.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:46.285 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-11-24T08:00:46.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:46.336 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:46.337 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:46.337 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:46.337 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T08:00:46.337 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:46.479 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T08:00:46.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:46.480 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:46.480 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:46.480 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T08:00:46.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:00:46.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T08:00:46.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T08:00:46.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T08:00:46.481 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:46.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:46.766 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:46.766 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:46.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-24T08:00:46.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:00:46.767 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:46.935 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T08:00:46.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:46.935 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:46.981 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:00:46.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:46.982 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:47.074 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:00:47.166 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:47.221 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:00:47.222 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:00:47.223 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:00:47.223 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:00:47.223 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:47.223 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:00:47.223 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:00:47.223 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:00:47.224 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:00:47.224 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:47.224 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:00:47.224 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:47.224 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:47.225 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:47.225 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:47.225 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:00:47.225 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:00:47.225 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:00:47.225 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:00:47.226 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:00:47.226 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:00:47.226 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:00:47.226 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:47.226 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:47.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:47.228 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:00:47.280 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:00:47.281 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T08:00:47.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:00:47.365 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:47.408 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:00:47.408 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:00:47.408 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:00:47.408 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:00:47.408 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:00:47.409 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:00:47.409 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:00:47.409 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:00:47.409 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:00:47.409 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:00:47.410 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:00:47.410 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:47.410 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:00:47.410 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:00:47.411 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:00:47.411 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:00:47.411 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:47.411 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:00:47.412 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:47.412 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:47.412 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:47.413 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:47.413 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:00:47.413 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:00:47.413 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:00:47.413 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:00:47.413 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:00:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:00:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:00:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:47.414 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:47.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:47.415 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:00:47.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:2023-11-24T08:00:47.489+0000 7f94f723c480 -1 init, newargv = 0x5612b0aed970 newargc=15 2023-11-24T08:00:47.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[96021]: starting ceph client 2023-11-24T08:00:47.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[96021]: starting fuse 2023-11-24T08:00:48.604 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:00:48.703 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:48.758 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:48.759 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:00:48.760 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:48.761 INFO:teuthology.orchestra.run.smithi161.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:48.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:48.762 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:00:48.812 INFO:teuthology.orchestra.run.smithi161.stdout:39 2023-11-24T08:00:48.812 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:00:48.812 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:00:48.812 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2023-11-24T08:00:48.812 DEBUG:teuthology.orchestra.run.smithi161:> import re 2023-11-24T08:00:48.812 DEBUG:teuthology.orchestra.run.smithi161:> import os 2023-11-24T08:00:48.812 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2023-11-24T08:00:48.813 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> return f 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.0")) 2023-11-24T08:00:48.814 DEBUG:teuthology.orchestra.run.smithi161:> ' 2023-11-24T08:00:48.985 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.0.96021.asok 2023-11-24T08:00:48.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:00:49.003 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96021.asok 2023-11-24T08:00:49.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:49.004 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96021.asok status 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "0", 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T08:00:49.233 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "96021", 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4605, 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2023-11-24T08:00:49.234 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2023-11-24T08:00:49.235 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2023-11-24T08:00:49.235 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 4605 2023-11-24T08:00:49.235 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:49.235 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:00:49.235 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:00:49.235 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:00:49.236 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3303512393 2023-11-24T08:00:49.236 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:00:49.236 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:49.236 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:00:49.236 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:00:49.236 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:00:49.237 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 3303512393 2023-11-24T08:00:49.237 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:49.237 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.4605 192.168.0.1:0/3303512393", 2023-11-24T08:00:49.237 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/3303512393", 2023-11-24T08:00:49.237 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2023-11-24T08:00:49.238 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 8, 2023-11-24T08:00:49.238 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 22, 2023-11-24T08:00:49.238 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:00:49.238 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2023-11-24T08:00:49.238 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2023-11-24T08:00:49.239 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:00:49.247 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:00:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.443+0000 7fdb5f7ce640 1 Processor -- start 2023-11-24T08:00:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.443+0000 7fdb5f7ce640 1 -- start start 2023-11-24T08:00:49.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.444+0000 7fdb5f7ce640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdb5813e360 0x7fdb580cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb5f7ce640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5815c5f0 con 0x7fdb5813df80 2023-11-24T08:00:49.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb5f7ce640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5806c470 con 0x7fdb5815f9c0 2023-11-24T08:00:49.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb5f7ce640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5806c750 con 0x7fdb5813e360 2023-11-24T08:00:49.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb5d56a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdb5813df80 0x7fdb5815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:54802/0 (socket says 172.21.15.161:54802) 2023-11-24T08:00:49.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb5d56a640 1 -- 172.21.15.161:0/3068589859 learned_addr learned my addr 172.21.15.161:0/3068589859 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:49.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb5cd69640 1 --2- 172.21.15.161:0/3068589859 >> v2:172.21.15.175:3300/0 conn(0x7fdb5813e360 0x7fdb580cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208491392 0 0) 0x7fdb5815c5f0 con 0x7fdb5813df80 2023-11-24T08:00:49.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.445+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb44003520 con 0x7fdb5813df80 2023-11-24T08:00:49.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3464197278 0 0) 0x7fdb44003520 con 0x7fdb5813df80 2023-11-24T08:00:49.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 >> v2:172.21.15.175:3300/0 conn(0x7fdb5813e360 msgr2=0x7fdb580cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:49.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 --2- 172.21.15.161:0/3068589859 >> v2:172.21.15.175:3300/0 conn(0x7fdb5813e360 0x7fdb580cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 >> v1:172.21.15.175:6789/0 conn(0x7fdb5815f9c0 legacy=0x7fdb580cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5806ca30 con 0x7fdb5813df80 2023-11-24T08:00:49.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fdb54001690 con 0x7fdb5813df80 2023-11-24T08:00:49.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 >> v1:172.21.15.161:6789/0 conn(0x7fdb5813df80 legacy=0x7fdb5815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb44003970 0x7fdb44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb440047c0 0x7fdb44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44005180 0x7fdb4400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5806c750 con 0x7fdb44003970 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400c020 con 0x7fdb440047c0 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4400c1e0 con 0x7fdb44005180 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb44003970 0x7fdb44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.446+0000 7fdb5cd69640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb440047c0 0x7fdb44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.447+0000 7fdb5d56a640 1 -- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44005180 msgr2=0x7fdb4400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.447+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44005180 0x7fdb4400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.447+0000 7fdb5d56a640 1 -- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb440047c0 msgr2=0x7fdb44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.447+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb440047c0 0x7fdb44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.447+0000 7fdb5d56a640 1 -- 172.21.15.161:0/3068589859 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44003520 con 0x7fdb44003970 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.447+0000 7fdb5dd6b640 1 -- 172.21.15.161:0/3068589859 reap_dead start 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb44003970 0x7fdb44003d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb5815c780 tx=0x7fdb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4e14b0812bc210 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:49.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54005ad0 con 0x7fdb44003970 2023-11-24T08:00:49.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54005c30 con 0x7fdb44003970 2023-11-24T08:00:49.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb4ffff640 1 -- 172.21.15.161:0/3068589859 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5402c890 con 0x7fdb44003970 2023-11-24T08:00:49.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3068589859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb44003970 msgr2=0x7fdb44003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb44003970 0x7fdb44003d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb5815c780 tx=0x7fdb440057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.448+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3068589859 shutdown_connections 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.449+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3068589859 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb44003970 0x7fdb44003d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.449+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3068589859 >> 172.21.15.161:0/3068589859 conn(0x7fdb5806a800 msgr2=0x7fdb5806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.449+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3068589859 shutdown_connections 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.449+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3068589859 wait complete. 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.450+0000 7fdb5f7ce640 1 Processor -- start 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.450+0000 7fdb5f7ce640 1 -- start start 2023-11-24T08:00:49.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.451+0000 7fdb5f7ce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44003970 0x7fdb580b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.451+0000 7fdb5f7ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb581530c0 0x7fdb5813bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.451+0000 7fdb5f7ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 0x7fdb581f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.451+0000 7fdb5f7ce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5813d180 con 0x7fdb5813c320 2023-11-24T08:00:49.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.451+0000 7fdb5f7ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5813c7a0 con 0x7fdb581530c0 2023-11-24T08:00:49.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.451+0000 7fdb5f7ce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5813a170 con 0x7fdb44003970 2023-11-24T08:00:49.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 0x7fdb581f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 0x7fdb581f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52392/0 (socket says 172.21.15.161:52392) 2023-11-24T08:00:49.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 -- 172.21.15.161:0/3779628663 learned_addr learned my addr 172.21.15.161:0/3779628663 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:49.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44003970 0x7fdb580b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5cd69640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb581530c0 0x7fdb5813bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 -- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44003970 msgr2=0x7fdb580b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44003970 0x7fdb580b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 -- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb581530c0 msgr2=0x7fdb5813bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb581530c0 0x7fdb5813bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.452+0000 7fdb5dd6b640 1 -- 172.21.15.161:0/3779628663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5813a450 con 0x7fdb5813c320 2023-11-24T08:00:49.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.453+0000 7fdb5dd6b640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 0x7fdb581f61c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb5806dea0 tx=0x7fdb5000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.453+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb50007070 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.453+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb500071f0 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.453+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5813a730 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.453+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb500075a0 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.453+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb5813acf0 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.454+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5813af10 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.455+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb50007700 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.456+0000 7fdb4dffb640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdb3c06ae70 0x7fdb3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.457+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb50088a20 con 0x7fdb5813c320 2023-11-24T08:00:49.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.457+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdb3c06ae70 0x7fdb3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:49.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.459+0000 7fdb5d56a640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdb3c06ae70 0x7fdb3c06d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdb54034000 tx=0x7fdb54009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:49.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.461+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb50053a30 con 0x7fdb5813c320 2023-11-24T08:00:49.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.693+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdb580675d0 con 0x7fdb5813c320 2023-11-24T08:00:49.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.694+0000 7fdb4dffb640 1 -- 172.21.15.161:0/3779628663 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdb50017070 con 0x7fdb5813c320 2023-11-24T08:00:49.695 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdb3c06ae70 msgr2=0x7fdb3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdb3c06ae70 0x7fdb3c06d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdb54034000 tx=0x7fdb54009030 comp rx=0 tx=0).stop 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 msgr2=0x7fdb581f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 0x7fdb581f61c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdb5806dea0 tx=0x7fdb5000c960 comp rx=0 tx=0).stop 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 shutdown_connections 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdb3c06ae70 0x7fdb3c06d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdb5813c320 0x7fdb581f61c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb581530c0 0x7fdb5813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 --2- 172.21.15.161:0/3779628663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb44003970 0x7fdb580b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.696+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 >> 172.21.15.161:0/3779628663 conn(0x7fdb5806a800 msgr2=0x7fdb5815e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.697+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 shutdown_connections 2023-11-24T08:00:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:49.697+0000 7fdb5f7ce640 1 -- 172.21.15.161:0/3779628663 wait complete. 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:00:49.715 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:00:49.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:49.716 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-24T08:00:49.762 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:49.762 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:49.762 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:49.762 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:49.762 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:49.762 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-24T08:00:49.763 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:49.764 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:49.764 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:00:49.764 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:49.764 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:00:49.764 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42353sec preferred_lft 42353sec 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8039:e9ff:fe5c:58ac/64 scope link 2023-11-24T08:00:49.765 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:49.766 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:00:49.766 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:49.766 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::f4:2aff:fe75:db23/64 scope link 2023-11-24T08:00:49.766 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:49.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:49.767 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:00:49.849 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-24T08:00:49.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:49.853 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-24T08:00:49.902 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-24T08:00:49.902 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:00:49.903 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:00:49.903 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:00:49.903 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:00:49.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:49.903 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:49.903 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:49.903 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:00:49.903 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:00:49.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:00:49.904 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:50.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.065 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:00:50.110 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:00:50.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.112 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list-id 2023-11-24T08:00:50.205 INFO:teuthology.orchestra.run.smithi161.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T08:00:50.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.206 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:50.206 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:50.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:00:50.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T08:00:50.207 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:50.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:00:50.410 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 82:20:42:dc:3c:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:00:50.411 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.412 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8020:42ff:fedc:3cb2/64 scope link 2023-11-24T08:00:50.412 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T08:00:50.488 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 82:20:42:dc:3c:b2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8020:42ff:fedc:3cb2/64 scope link 2023-11-24T08:00:50.489 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:50.492 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T08:00:50.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T08:00:50.492 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T08:00:50.493 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:50.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:50.726 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:00:50.726 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:00:50.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.1 up 2023-11-24T08:00:50.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:00:50.727 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:00:50.876 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-24T08:00:50.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:50.877 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:50.921 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T08:00:50.922 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:50.922 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:51.017 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:00:51.105 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:51.163 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:00:51.164 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:00:51.165 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:00:51.166 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:00:51.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:51.168 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:00:51.219 INFO:teuthology.orchestra.run.smithi161.stdout:39 2023-11-24T08:00:51.219 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-11-24T08:00:51.220 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-24T08:00:51.224 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:00:51.299 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:51.341 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:00:51.342 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:51.343 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:00:51.345 INFO:teuthology.orchestra.run.smithi161.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:51.345 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:00:51.345 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:00:51.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:51.346 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:00:51.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi161.stderr:2023-11-24T08:00:51.404+0000 7f06d3838480 -1 init, newargv = 0x5561b5a16b80 newargc=15 2023-11-24T08:00:51.405 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi161.stderr:ceph-fuse[96595]: starting ceph client 2023-11-24T08:00:51.415 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi161.stderr:ceph-fuse[96595]: starting fuse 2023-11-24T08:00:51.431 INFO:teuthology.orchestra.run.smithi161.stdout:39 2023-11-24T08:00:51.431 INFO:teuthology.orchestra.run.smithi161.stdout:42 2023-11-24T08:00:51.431 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-11-24T08:00:51.432 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:00:51.432 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2023-11-24T08:00:51.432 DEBUG:teuthology.orchestra.run.smithi161:> import re 2023-11-24T08:00:51.432 DEBUG:teuthology.orchestra.run.smithi161:> import os 2023-11-24T08:00:51.433 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2023-11-24T08:00:51.433 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:51.433 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2023-11-24T08:00:51.433 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-24T08:00:51.434 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2023-11-24T08:00:51.434 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-24T08:00:51.434 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:51.434 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2023-11-24T08:00:51.434 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2023-11-24T08:00:51.435 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2023-11-24T08:00:51.435 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2023-11-24T08:00:51.435 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:51.436 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2023-11-24T08:00:51.436 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:00:51.436 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:00:51.436 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:00:51.437 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2023-11-24T08:00:51.437 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2023-11-24T08:00:51.437 DEBUG:teuthology.orchestra.run.smithi161:> return f 2023-11-24T08:00:51.437 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:00:51.437 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:00:51.438 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.2")) 2023-11-24T08:00:51.438 DEBUG:teuthology.orchestra.run.smithi161:> ' 2023-11-24T08:00:51.631 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.2.96595.asok 2023-11-24T08:00:51.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:00:51.648 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.96595.asok 2023-11-24T08:00:51.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:51.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.96595.asok status 2023-11-24T08:00:51.886 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:00:51.886 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2023-11-24T08:00:51.886 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:00:51.886 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:00:51.886 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "2", 2023-11-24T08:00:51.886 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "96595", 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 4614, 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 4614 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:51.887 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1827573149 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1827573149 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:00:51.888 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.4614 192.168.0.2:0/1827573149", 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.2:0/1827573149", 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 8, 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 22, 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2023-11-24T08:00:51.889 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:00:51.903 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:00:52.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.119+0000 7fc2fadc9640 1 Processor -- start 2023-11-24T08:00:52.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.119+0000 7fc2fadc9640 1 -- start start 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.120+0000 7fc2fadc9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2f40cf9a0 0x7fc2f415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.120+0000 7fc2fadc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2f40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2fadc9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f40b1ee0 con 0x7fc2f4143ae0 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2fadc9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f40b2780 con 0x7fc2f40cf9a0 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2fadc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f415e990 con 0x7fc2f415e1e0 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2f8b65640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc2f4143ae0 0x7fc2f40cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60868/0 (socket says 172.21.15.161:60868) 2023-11-24T08:00:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2f8b65640 1 -- 172.21.15.161:0/990847198 learned_addr learned my addr 172.21.15.161:0/990847198 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2f9366640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2f40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2f3fff640 1 --2- 172.21.15.161:0/990847198 >> v2:172.21.15.175:3300/0 conn(0x7fc2f40cf9a0 0x7fc2f415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111111548 0 0) 0x7fc2f40b1ee0 con 0x7fc2f4143ae0 2023-11-24T08:00:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.121+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e4005730 con 0x7fc2f4143ae0 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2954652529 0 0) 0x7fc2e4005730 con 0x7fc2f4143ae0 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 msgr2=0x7fc2f40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2f40702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 >> v2:172.21.15.175:3300/0 conn(0x7fc2f40cf9a0 msgr2=0x7fc2f415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 --2- 172.21.15.161:0/990847198 >> v2:172.21.15.175:3300/0 conn(0x7fc2f40cf9a0 0x7fc2f415dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f40b2130 con 0x7fc2f4143ae0 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc2e8001670 con 0x7fc2f4143ae0 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 >> v1:172.21.15.161:6789/0 conn(0x7fc2f4143ae0 legacy=0x7fc2f40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e4005b80 0x7fc2e4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2e40069d0 0x7fc2e4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2e4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f40b2780 con 0x7fc2e40069d0 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f415e990 con 0x7fc2e4005b80 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e400db90 con 0x7fc2f415e1e0 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f3fff640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2e40069d0 0x7fc2e4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.122+0000 7fc2f8b65640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e4005b80 0x7fc2e4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f9366640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2e4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f3fff640 1 -- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 msgr2=0x7fc2e4007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f3fff640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2e4007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f3fff640 1 -- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e4005b80 msgr2=0x7fc2e4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f3fff640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e4005b80 0x7fc2e4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f3fff640 1 -- 172.21.15.161:0/990847198 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4005730 con 0x7fc2e40069d0 2023-11-24T08:00:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f9366640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f415e1e0 0x7fc2e4007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.123+0000 7fc2f8b65640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e4005b80 0x7fc2e4005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:52.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.124+0000 7fc2f3fff640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2e40069d0 0x7fc2e4006e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009ac0 tx=0x7fc2e4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a4777468acd8c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:52.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.124+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e002c6f0 con 0x7fc2e40069d0 2023-11-24T08:00:52.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.124+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e002c850 con 0x7fc2e40069d0 2023-11-24T08:00:52.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.124+0000 7fc2f37fe640 1 -- 172.21.15.161:0/990847198 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e002cbe0 con 0x7fc2e40069d0 2023-11-24T08:00:52.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2fadc9640 1 -- 172.21.15.161:0/990847198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2e40069d0 msgr2=0x7fc2e4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:52.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/990847198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2e40069d0 0x7fc2e4006e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009ac0 tx=0x7fc2e4007a00 comp rx=0 tx=0).stop 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2f9366640 1 -- 172.21.15.161:0/990847198 reap_dead start 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2fadc9640 1 -- 172.21.15.161:0/990847198 shutdown_connections 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2fadc9640 1 -- 172.21.15.161:0/990847198 >> 172.21.15.161:0/990847198 conn(0x7fc2f406a800 msgr2=0x7fc2f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2fadc9640 1 -- 172.21.15.161:0/990847198 shutdown_connections 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.125+0000 7fc2fadc9640 1 -- 172.21.15.161:0/990847198 wait complete. 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.127+0000 7fc2fadc9640 1 Processor -- start 2023-11-24T08:00:52.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.127+0000 7fc2fadc9640 1 -- start start 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2fadc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e40069d0 0x7fc2f40cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2fadc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f41f1cf0 0x7fc2f40ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2fadc9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 0x7fc2f415c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2fadc9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41f2200 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2fadc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41f24e0 con 0x7fc2e40069d0 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2fadc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41f27c0 con 0x7fc2f41f1cf0 2023-11-24T08:00:52.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 0x7fc2f415c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 0x7fc2f415c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39842/0 (socket says 172.21.15.161:39842) 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 -- 172.21.15.161:0/1004950825 learned_addr learned my addr 172.21.15.161:0/1004950825 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f3fff640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f41f1cf0 0x7fc2f40ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f8b65640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e40069d0 0x7fc2f40cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 -- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f41f1cf0 msgr2=0x7fc2f40ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f41f1cf0 0x7fc2f40ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 -- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e40069d0 msgr2=0x7fc2f40cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e40069d0 0x7fc2f40cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.128+0000 7fc2f9366640 1 -- 172.21.15.161:0/1004950825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f41f2aa0 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.129+0000 7fc2f9366640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 0x7fc2f415c770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4071f10 tx=0x7fc2ec00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.129+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec017400 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.129+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec011040 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.129+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f4158a10 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.129+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec017780 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.129+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f40ae680 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.130+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4067000 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.131+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2ec0203b0 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.132+0000 7fc2f17fa640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc2d806ae40 0x7fc2d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:52.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.132+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2ec089810 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.133+0000 7fc2f8b65640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc2d806ae40 0x7fc2d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:52.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.134+0000 7fc2f8b65640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc2d806ae40 0x7fc2d806d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000f60 tx=0x7fc2e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:52.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.137+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2ec054950 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.365+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc2f4158c00 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.366+0000 7fc2f17fa640 1 -- 172.21.15.161:0/1004950825 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc2ec01c060 con 0x7fc2f40cd1f0 2023-11-24T08:00:52.367 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.368+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc2d806ae40 msgr2=0x7fc2d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.368+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc2d806ae40 0x7fc2d806d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8000f60 tx=0x7fc2e8009040 comp rx=0 tx=0).stop 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.368+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 msgr2=0x7fc2f415c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.368+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 0x7fc2f415c770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4071f10 tx=0x7fc2ec00f4a0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 shutdown_connections 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc2d806ae40 0x7fc2d806d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc2f40cd1f0 0x7fc2f415c770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2f41f1cf0 0x7fc2f40ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 --2- 172.21.15.161:0/1004950825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2e40069d0 0x7fc2f40cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:52.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 >> 172.21.15.161:0/1004950825 conn(0x7fc2f406a800 msgr2=0x7fc2f406cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:52.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 shutdown_connections 2023-11-24T08:00:52.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:52.369+0000 7fc2fadc9640 1 -- 172.21.15.161:0/1004950825 wait complete. 2023-11-24T08:00:52.389 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:00:52.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:00:52.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-24T08:00:52.390 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:00:52.390 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:52.390 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:00:52.390 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:00:52.390 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:00:52.390 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:00:52.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:52.390 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-24T08:00:52.451 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-24T08:00:52.452 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:52.453 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:00:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42356sec preferred_lft 42356sec 2023-11-24T08:00:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-24T08:00:52.454 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:52.455 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T08:00:52.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:52.455 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:52.455 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:52.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2023-11-24T08:00:52.455 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2023-11-24T08:00:52.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2023-11-24T08:00:52.456 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T08:00:52.456 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:52.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:52.918 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:00:53.001 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-24T08:00:53.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:53.004 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-24T08:00:53.061 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-24T08:00:53.062 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:00:53.062 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:00:53.062 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:00:53.062 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:00:53.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:53.063 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:53.063 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:53.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:00:53.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:00:53.064 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:00:53.065 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:53.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:53.805 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:00:53.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:53.864 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-11-24T08:00:53.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:53.918 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:53.918 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:53.918 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:53.918 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T08:00:53.918 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:54.061 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T08:00:54.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:54.061 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:54.061 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:54.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T08:00:54.061 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T08:00:54.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T08:00:54.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T08:00:54.062 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T08:00:54.062 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:54.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:54.384 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:54.384 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:54.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-11-24T08:00:54.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T08:00:54.384 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:54.546 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T08:00:54.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:54.547 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:54.594 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:00:54.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:54.595 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:54.640 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:00:54.779 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:54.832 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:00:54.832 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:00:54.832 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:00:54.832 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:00:54.832 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:54.833 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:00:54.834 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:54.835 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:54.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:54.836 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:00:54.885 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:00:54.885 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T08:00:54.890 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:00:54.975 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:55.019 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:00:55.019 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:00:55.019 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:00:55.019 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:00:55.020 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:00:55.021 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:00:55.022 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:55.022 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:55.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:55.023 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:00:55.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2023-11-24T08:00:55.086+0000 7f4d92c46480 -1 init, newargv = 0x559f52bd1b50 newargc=15 2023-11-24T08:00:55.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[93947]: starting ceph client 2023-11-24T08:00:55.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[93947]: starting fuse 2023-11-24T08:00:55.109 INFO:teuthology.orchestra.run.smithi175.stdout:39 2023-11-24T08:00:55.110 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:00:55.110 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:00:55.110 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-24T08:00:55.110 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-24T08:00:55.110 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-24T08:00:55.110 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-24T08:00:55.110 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:00:55.111 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2023-11-24T08:00:55.112 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-24T08:00:55.311 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.93947.asok 2023-11-24T08:00:55.315 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:00:55.328 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.93947.asok 2023-11-24T08:00:55.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:55.328 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.93947.asok status 2023-11-24T08:00:55.574 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T08:00:55.575 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "93947", 2023-11-24T08:00:55.576 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-24T08:00:55.576 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:55.576 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-24T08:00:55.576 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-24T08:00:55.576 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4579, 2023-11-24T08:00:55.577 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-24T08:00:55.577 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-24T08:00:55.577 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-24T08:00:55.577 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4579 2023-11-24T08:00:55.577 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:55.577 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:00:55.578 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:00:55.578 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:00:55.578 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2132304990 2023-11-24T08:00:55.578 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-24T08:00:55.578 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:55.578 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2132304990 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4579 192.168.0.1:0/2132304990", 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/2132304990", 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-24T08:00:55.579 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 8, 2023-11-24T08:00:55.580 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 22, 2023-11-24T08:00:55.580 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:00:55.580 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-24T08:00:55.580 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-24T08:00:55.580 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-24T08:00:55.590 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:00:55.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.810+0000 7f9357acf640 1 Processor -- start 2023-11-24T08:00:55.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.810+0000 7f9357acf640 1 -- start start 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f9357acf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f935013df80 0x7f935015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f9357acf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f935013e360 0x7f93500cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f9357acf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935006c470 con 0x7f935015f9c0 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f9357acf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935006c750 con 0x7f935013df80 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f9357acf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935006ca30 con 0x7f935013e360 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f935586b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f935013df80 0x7f935015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f935606c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f935015f9c0 0x7f93501408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60884/0 (socket says 172.21.15.161:60884) 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.812+0000 7f935606c640 1 -- 172.21.15.161:0/3344033320 learned_addr learned my addr 172.21.15.161:0/3344033320 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:55.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.813+0000 7f935506a640 1 --2- 172.21.15.161:0/3344033320 >> v2:172.21.15.175:3300/0 conn(0x7f935013e360 0x7f93500cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.813+0000 7f935586b640 1 -- 172.21.15.161:0/3344033320 >> v2:172.21.15.175:3300/0 conn(0x7f935013e360 msgr2=0x7f93500cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.813+0000 7f935586b640 1 --2- 172.21.15.161:0/3344033320 >> v2:172.21.15.175:3300/0 conn(0x7f935013e360 0x7f93500cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.813+0000 7f935586b640 1 -- 172.21.15.161:0/3344033320 >> v1:172.21.15.161:6789/0 conn(0x7f935015f9c0 legacy=0x7f93501408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.813+0000 7f935586b640 1 -- 172.21.15.161:0/3344033320 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935006cd10 con 0x7f935013df80 2023-11-24T08:00:55.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.813+0000 7f9354869640 1 -- 172.21.15.161:0/3344033320 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796703287 0 0) 0x7f935006c470 con 0x7f935015f9c0 2023-11-24T08:00:55.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.814+0000 7f935586b640 1 --2- 172.21.15.161:0/3344033320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013df80 0x7f935015bee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f935006ded0 tx=0x7f934c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae5ad7e2e2f0108 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:55.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.814+0000 7f9354869640 1 -- 172.21.15.161:0/3344033320 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c031830 con 0x7f935013df80 2023-11-24T08:00:55.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.814+0000 7f9354869640 1 -- 172.21.15.161:0/3344033320 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c031990 con 0x7f935013df80 2023-11-24T08:00:55.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.814+0000 7f9354869640 1 -- 172.21.15.161:0/3344033320 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c031d20 con 0x7f935013df80 2023-11-24T08:00:55.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 -- 172.21.15.161:0/3344033320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013df80 msgr2=0x7f935015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:55.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 --2- 172.21.15.161:0/3344033320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013df80 0x7f935015bee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f935006ded0 tx=0x7f934c02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:00:55.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 -- 172.21.15.161:0/3344033320 shutdown_connections 2023-11-24T08:00:55.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 --2- 172.21.15.161:0/3344033320 >> v2:172.21.15.175:3300/0 conn(0x7f935013e360 0x7f93500cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:55.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 --2- 172.21.15.161:0/3344033320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013df80 0x7f935015bee0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:55.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 -- 172.21.15.161:0/3344033320 >> 172.21.15.161:0/3344033320 conn(0x7f935006a800 msgr2=0x7f935006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:55.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 -- 172.21.15.161:0/3344033320 shutdown_connections 2023-11-24T08:00:55.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.815+0000 7f9357acf640 1 -- 172.21.15.161:0/3344033320 wait complete. 2023-11-24T08:00:55.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.817+0000 7f9357acf640 1 Processor -- start 2023-11-24T08:00:55.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.817+0000 7f9357acf640 1 -- start start 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f9357acf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f935013df80 0x7f935014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f9357acf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 0x7f9350131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f9357acf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f935015f9c0 0x7f935012f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f9357acf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350132660 con 0x7f935013e360 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f9357acf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501f3010 con 0x7f935013df80 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f9357acf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935014cd10 con 0x7f935015f9c0 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f935506a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 0x7f9350131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f935506a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 0x7f9350131670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39864/0 (socket says 172.21.15.161:39864) 2023-11-24T08:00:55.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f935506a640 1 -- 172.21.15.161:0/2458190330 learned_addr learned my addr 172.21.15.161:0/2458190330 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:55.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f935506a640 1 -- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f935015f9c0 msgr2=0x7f935012f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:55.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f935506a640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f935015f9c0 0x7f935012f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:55.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.818+0000 7f935506a640 1 -- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f935013df80 msgr2=0x7f935014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:55.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f935506a640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f935013df80 0x7f935014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:55.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f935506a640 1 -- 172.21.15.161:0/2458190330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009400 con 0x7f935013e360 2023-11-24T08:00:55.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f935506a640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 0x7f9350131670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f934000d800 tx=0x7f934000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:55.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340018070 con 0x7f935013e360 2023-11-24T08:00:55.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340004020 con 0x7f935013e360 2023-11-24T08:00:55.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93400041b0 con 0x7f935013e360 2023-11-24T08:00:55.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935014b2c0 con 0x7f935013e360 2023-11-24T08:00:55.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.819+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935014c760 con 0x7f935013e360 2023-11-24T08:00:55.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.821+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93500675d0 con 0x7f935013e360 2023-11-24T08:00:55.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.821+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9340004310 con 0x7f935013e360 2023-11-24T08:00:55.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.822+0000 7f93467fc640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f933406ae40 0x7f933406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:55.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.822+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93400893e0 con 0x7f935013e360 2023-11-24T08:00:55.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.823+0000 7f935586b640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f933406ae40 0x7f933406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:55.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.824+0000 7f935586b640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f933406ae40 0x7f933406d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f934c036000 tx=0x7f934c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:55.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:55.827+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93400543f0 con 0x7f935013e360 2023-11-24T08:00:56.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.055+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f935014ce50 con 0x7f935013e360 2023-11-24T08:00:56.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.055+0000 7f93467fc640 1 -- 172.21.15.161:0/2458190330 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9340057a10 con 0x7f935013e360 2023-11-24T08:00:56.057 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f933406ae40 msgr2=0x7f933406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f933406ae40 0x7f933406d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f934c036000 tx=0x7f934c030000 comp rx=0 tx=0).stop 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 msgr2=0x7f9350131670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 0x7f9350131670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f934000d800 tx=0x7f934000dcc0 comp rx=0 tx=0).stop 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 shutdown_connections 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f933406ae40 0x7f933406d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f935015f9c0 0x7f935012f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f935013e360 0x7f9350131670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 --2- 172.21.15.161:0/2458190330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f935013df80 0x7f935014ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:56.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 >> 172.21.15.161:0/2458190330 conn(0x7f935006a800 msgr2=0x7f935015e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:56.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 shutdown_connections 2023-11-24T08:00:56.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:56.058+0000 7f9357acf640 1 -- 172.21.15.161:0/2458190330 wait complete. 2023-11-24T08:00:56.077 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:00:56.077 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:00:56.077 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-24T08:00:56.077 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T08:00:56.078 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:56.078 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:00:56.078 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:00:56.078 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:00:56.078 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:00:56.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.078 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-24T08:00:56.140 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:56.140 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:56.140 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:56.140 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.140 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:56.140 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42352sec preferred_lft 42352sec 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-24T08:00:56.141 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::aca0:d6ff:fe4f:fbed/64 scope link 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::3004:f3ff:fea7:6a6b/64 scope link 2023-11-24T08:00:56.142 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.143 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:00:56.234 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-24T08:00:56.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.238 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-24T08:00:56.291 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-24T08:00:56.292 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:00:56.292 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:00:56.292 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:00:56.292 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:00:56.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.294 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:56.294 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:56.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:00:56.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:00:56.294 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:00:56.294 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:56.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.476 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:00:56.527 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:00:56.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.528 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2023-11-24T08:00:56.580 INFO:teuthology.orchestra.run.smithi175.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T08:00:56.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.581 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:56.581 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:56.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:00:56.582 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T08:00:56.582 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:56.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.724 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:00:56.815 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 66:20:b1:3c:65:27 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.816 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::6420:b1ff:fe3c:6527/64 scope link 2023-11-24T08:00:56.817 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.820 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T08:00:56.916 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:00:56.916 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:00:56.916 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:00:56.916 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.916 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:00:56.916 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.917 INFO:teuthology.orchestra.run.smithi175.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:00:56.917 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 66:20:b1:3c:65:27 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T08:00:56.917 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T08:00:56.917 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.917 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::6420:b1ff:fe3c:6527/64 scope link 2023-11-24T08:00:56.917 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:00:56.921 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T08:00:56.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:56.921 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:56.921 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:56.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T08:00:56.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T08:00:56.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T08:00:56.921 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T08:00:56.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T08:00:56.922 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:57.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:57.182 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:00:57.182 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:00:57.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.1 up 2023-11-24T08:00:57.182 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T08:00:57.183 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:00:57.347 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-24T08:00:57.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:57.347 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:57.393 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T08:00:57.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:00:57.394 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:57.440 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:00:57.572 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:00:57.622 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:57.623 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:00:57.624 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:00:57.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:57.626 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:00:57.680 INFO:teuthology.orchestra.run.smithi175.stdout:39 2023-11-24T08:00:57.681 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-11-24T08:00:57.681 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-24T08:00:57.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:00:57.774 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:00:57.816 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:00:57.817 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:00:57.818 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:00:57.819 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:00:57.819 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:57.819 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:00:57.819 INFO:teuthology.orchestra.run.smithi175.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:57.819 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:00:57.819 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:00:57.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:57.820 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:00:57.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:2023-11-24T08:00:57.874+0000 7f4430a40480 -1 init, newargv = 0x55d38ab5b6c0 newargc=15 2023-11-24T08:00:57.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[94399]: starting ceph client 2023-11-24T08:00:57.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi175.stderr:ceph-fuse[94399]: starting fuse 2023-11-24T08:00:57.907 INFO:teuthology.orchestra.run.smithi175.stdout:39 2023-11-24T08:00:57.907 INFO:teuthology.orchestra.run.smithi175.stdout:42 2023-11-24T08:00:57.907 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-11-24T08:00:57.907 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:00:57.907 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-24T08:00:57.907 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-24T08:00:57.907 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-24T08:00:57.908 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.3")) 2023-11-24T08:00:57.909 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-24T08:00:58.113 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.3.94399.asok 2023-11-24T08:00:58.117 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:00:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:00:58.130 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94399.asok 2023-11-24T08:00:58.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.131 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94399.asok status 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "3", 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "94399", 2023-11-24T08:00:58.369 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4451, 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4451 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:00:58.370 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2939871255 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.2:0", 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2939871255 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4451 192.168.0.2:0/2939871255", 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.2:0/2939871255", 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-24T08:00:58.371 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 8, 2023-11-24T08:00:58.372 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 22, 2023-11-24T08:00:58.372 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:00:58.372 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-24T08:00:58.372 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-24T08:00:58.372 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-24T08:00:58.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.384 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2023-11-24T08:00:58.384 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:58.448 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2023-11-24T08:00:58.448 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:58.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:00:58.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.551 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2023-11-24T08:00:58.551 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:58.610 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2023-11-24T08:00:58.611 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:58.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T08:00:58.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.713 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-24T08:00:58.713 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:58.778 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-24T08:00:58.779 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:58.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.779 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:00:58.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.872 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-24T08:00:58.872 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:58.927 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-24T08:00:58.927 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:58.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:00:58.928 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T08:00:59.024 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T08:00:59.041 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:00:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.261+0000 7f6b2bbc9640 1 Processor -- start 2023-11-24T08:00:59.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.261+0000 7f6b2bbc9640 1 -- start start 2023-11-24T08:00:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b2bbc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 0x7f6b2415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b2bbc9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6b240cf9a0 0x7f6b240cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b2bbc9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2406c470 con 0x7f6b2413e360 2023-11-24T08:00:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b2bbc9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2406c750 con 0x7f6b240cf9a0 2023-11-24T08:00:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b2bbc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2406ca30 con 0x7f6b2413df80 2023-11-24T08:00:59.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b29164640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6b2413e360 0x7f6b240cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60886/0 (socket says 172.21.15.161:60886) 2023-11-24T08:00:59.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b29164640 1 -- 172.21.15.161:0/2773313755 learned_addr learned my addr 172.21.15.161:0/2773313755 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:00:59.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b29965640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 0x7f6b2415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.263+0000 7f6b2a166640 1 --2- 172.21.15.161:0/2773313755 >> v2:172.21.15.175:3300/0 conn(0x7f6b240cf9a0 0x7f6b240cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 679898993 0 0) 0x7f6b2406c470 con 0x7f6b2413e360 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b10003520 con 0x7f6b2413e360 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720284659 0 0) 0x7f6b10003520 con 0x7f6b2413e360 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 msgr2=0x7f6b2415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 0x7f6b2415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 >> v2:172.21.15.175:3300/0 conn(0x7f6b240cf9a0 msgr2=0x7f6b240cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 --2- 172.21.15.161:0/2773313755 >> v2:172.21.15.175:3300/0 conn(0x7f6b240cf9a0 0x7f6b240cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2406cd10 con 0x7f6b2413e360 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6b14001670 con 0x7f6b2413e360 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 >> v1:172.21.15.161:6789/0 conn(0x7f6b2413e360 legacy=0x7f6b240cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b10003970 0x7f6b10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 0x7f6b100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10004d00 0x7f6b10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2406c750 con 0x7f6b10003970 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2406ca30 con 0x7f6b10004d00 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1000b980 con 0x7f6b2413df80 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.264+0000 7f6b29965640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b10003970 0x7f6b10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.265+0000 7f6b29965640 1 -- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 msgr2=0x7f6b100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.265+0000 7f6b29965640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2413df80 0x7f6b100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.265+0000 7f6b29965640 1 -- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10004d00 msgr2=0x7f6b10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.265+0000 7f6b29965640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10004d00 0x7f6b10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.265+0000 7f6b29965640 1 -- 172.21.15.161:0/2773313755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b10003520 con 0x7f6b10003970 2023-11-24T08:00:59.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.266+0000 7f6b29965640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b10003970 0x7f6b10003d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009ac0 tx=0x7f6b100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0278a0e2716da85 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.266+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2002c710 con 0x7f6b10003970 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.266+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2002c870 con 0x7f6b10003970 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.266+0000 7f6b28963640 1 -- 172.21.15.161:0/2773313755 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2002cc00 con 0x7f6b10003970 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/2773313755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b10003970 msgr2=0x7f6b10003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/2773313755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b10003970 0x7f6b10003d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6b20009ac0 tx=0x7f6b100057f0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2a166640 1 -- 172.21.15.161:0/2773313755 reap_dead start 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/2773313755 shutdown_connections 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/2773313755 >> 172.21.15.161:0/2773313755 conn(0x7f6b2406a800 msgr2=0x7f6b2406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/2773313755 shutdown_connections 2023-11-24T08:00:59.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.267+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/2773313755 wait complete. 2023-11-24T08:00:59.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.269+0000 7f6b2bbc9640 1 Processor -- start 2023-11-24T08:00:59.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.269+0000 7f6b2bbc9640 1 -- start start 2023-11-24T08:00:59.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2bbc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10003970 0x7f6b240a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2bbc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b24155dc0 0x7f6b24156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2bbc9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 0x7f6b241f4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2bbc9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241f4a50 con 0x7f6b241f4090 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2bbc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b241555a0 con 0x7f6b10003970 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2bbc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b24154990 con 0x7f6b24155dc0 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2a166640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 0x7f6b241f4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2a166640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 0x7f6b241f4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39888/0 (socket says 172.21.15.161:39888) 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b2a166640 1 -- 172.21.15.161:0/130164600 learned_addr learned my addr 172.21.15.161:0/130164600 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.270+0000 7f6b29965640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10003970 0x7f6b240a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b29164640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b24155dc0 0x7f6b24156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2a166640 1 -- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b24155dc0 msgr2=0x7f6b24156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2a166640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b24155dc0 0x7f6b24156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2a166640 1 -- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10003970 msgr2=0x7f6b240a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2a166640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10003970 0x7f6b240a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2a166640 1 -- 172.21.15.161:0/130164600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b24154c70 con 0x7f6b241f4090 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2a166640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 0x7f6b241f4510 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b2415b6b0 tx=0x7f6b1c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c010040 con 0x7f6b241f4090 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c00bab0 con 0x7f6b241f4090 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b24154f50 con 0x7f6b241f4090 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c00be40 con 0x7f6b241f4090 2023-11-24T08:00:59.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.271+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b241f4e90 con 0x7f6b241f4090 2023-11-24T08:00:59.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.273+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b240675d0 con 0x7f6b241f4090 2023-11-24T08:00:59.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.274+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b1c01f460 con 0x7f6b241f4090 2023-11-24T08:00:59.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.274+0000 7f6b1a7fc640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b0806ae70 0x7f6b0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.274+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b1c089a50 con 0x7f6b241f4090 2023-11-24T08:00:59.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.275+0000 7f6b29965640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b0806ae70 0x7f6b0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.276+0000 7f6b29965640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b0806ae70 0x7f6b0806d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b20036000 tx=0x7f6b20030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:59.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.279+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b1c0584f0 con 0x7f6b241f4090 2023-11-24T08:00:59.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.470+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b2415beb0 con 0x7f6b241f4090 2023-11-24T08:00:59.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.472+0000 7f6b1a7fc640 1 -- 172.21.15.161:0/130164600 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f6b1c058080 con 0x7f6b241f4090 2023-11-24T08:00:59.474 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:00:59.475 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:00:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.474+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b0806ae70 msgr2=0x7f6b0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.474+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b0806ae70 0x7f6b0806d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b20036000 tx=0x7f6b20030000 comp rx=0 tx=0).stop 2023-11-24T08:00:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.474+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 msgr2=0x7f6b241f4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.474+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 0x7f6b241f4510 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6b2415b6b0 tx=0x7f6b1c00b480 comp rx=0 tx=0).stop 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 shutdown_connections 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b0806ae70 0x7f6b0806d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b241f4090 0x7f6b241f4510 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b24155dc0 0x7f6b24156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 --2- 172.21.15.161:0/130164600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b10003970 0x7f6b240a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 >> 172.21.15.161:0/130164600 conn(0x7f6b2406a800 msgr2=0x7f6b240b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:59.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 shutdown_connections 2023-11-24T08:00:59.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.475+0000 7f6b2bbc9640 1 -- 172.21.15.161:0/130164600 wait complete. 2023-11-24T08:00:59.495 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:00:59.496 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:00:59.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.703+0000 7fdaa0848640 1 Processor -- start 2023-11-24T08:00:59.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.703+0000 7fdaa0848640 1 -- start start 2023-11-24T08:00:59.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fdaa0848640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda9c0d3910 0x7fda9c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fdaa0848640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda9c160e10 0x7fda9c0d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fdaa0848640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0d4160 con 0x7fda9c0cfcf0 2023-11-24T08:00:59.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fdaa0848640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0ceff0 con 0x7fda9c0d3910 2023-11-24T08:00:59.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fdaa0848640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c0cf410 con 0x7fda9c160e10 2023-11-24T08:00:59.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fda99d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda9c0d3910 0x7fda9c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fda99d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fda9c0d3910 0x7fda9c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39896/0 (socket says 172.21.15.161:39896) 2023-11-24T08:00:59.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.705+0000 7fda99d9b640 1 -- 172.21.15.161:0/1035680167 learned_addr learned my addr 172.21.15.161:0/1035680167 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:59.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.706+0000 7fda99d9b640 1 -- 172.21.15.161:0/1035680167 >> v2:172.21.15.175:3300/0 conn(0x7fda9c160e10 msgr2=0x7fda9c0d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:59.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.706+0000 7fda99d9b640 1 --2- 172.21.15.161:0/1035680167 >> v2:172.21.15.175:3300/0 conn(0x7fda9c160e10 0x7fda9c0d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.706+0000 7fda99d9b640 1 -- 172.21.15.161:0/1035680167 >> v1:172.21.15.175:6789/0 conn(0x7fda9c0cfcf0 legacy=0x7fda9c160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:00:59.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.706+0000 7fda99d9b640 1 -- 172.21.15.161:0/1035680167 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0b2420 con 0x7fda9c0d3910 2023-11-24T08:00:59.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.707+0000 7fda99d9b640 1 --2- 172.21.15.161:0/1035680167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0d1100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0cd850 tx=0x7fda9002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee364707220ce381 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:59.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.707+0000 7fda9959a640 1 -- 172.21.15.161:0/1035680167 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900317e0 con 0x7fda9c0d3910 2023-11-24T08:00:59.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.707+0000 7fda9959a640 1 -- 172.21.15.161:0/1035680167 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda90031940 con 0x7fda9c0d3910 2023-11-24T08:00:59.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.707+0000 7fda9959a640 1 -- 172.21.15.161:0/1035680167 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90031cd0 con 0x7fda9c0d3910 2023-11-24T08:00:59.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 -- 172.21.15.161:0/1035680167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 msgr2=0x7fda9c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 --2- 172.21.15.161:0/1035680167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0d1100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fda9c0cd850 tx=0x7fda9002b880 comp rx=0 tx=0).stop 2023-11-24T08:00:59.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 -- 172.21.15.161:0/1035680167 shutdown_connections 2023-11-24T08:00:59.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 --2- 172.21.15.161:0/1035680167 >> v2:172.21.15.175:3300/0 conn(0x7fda9c160e10 0x7fda9c0d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 --2- 172.21.15.161:0/1035680167 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0d1100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 -- 172.21.15.161:0/1035680167 >> 172.21.15.161:0/1035680167 conn(0x7fda9c09c530 msgr2=0x7fda9c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:59.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 -- 172.21.15.161:0/1035680167 shutdown_connections 2023-11-24T08:00:59.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.708+0000 7fdaa0848640 1 -- 172.21.15.161:0/1035680167 wait complete. 2023-11-24T08:00:59.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.710+0000 7fdaa0848640 1 Processor -- start 2023-11-24T08:00:59.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.710+0000 7fdaa0848640 1 -- start start 2023-11-24T08:00:59.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fdaa0848640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda9c0cfcf0 0x7fda9c1f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fdaa0848640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fdaa0848640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda9c160e10 0x7fda9c1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fdaa0848640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c158fa0 con 0x7fda9c0d3910 2023-11-24T08:00:59.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fdaa0848640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0cbd60 con 0x7fda9c0cfcf0 2023-11-24T08:00:59.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fdaa0848640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0b6530 con 0x7fda9c160e10 2023-11-24T08:00:59.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fda99d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fda99d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39904/0 (socket says 172.21.15.161:39904) 2023-11-24T08:00:59.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.711+0000 7fda99d9b640 1 -- 172.21.15.161:0/2073142663 learned_addr learned my addr 172.21.15.161:0/2073142663 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:00:59.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda9ad9d640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda9c160e10 0x7fda9c1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda9a59c640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda9c0cfcf0 0x7fda9c1f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda99d9b640 1 -- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda9c160e10 msgr2=0x7fda9c1f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda99d9b640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda9c160e10 0x7fda9c1f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda99d9b640 1 -- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda9c0cfcf0 msgr2=0x7fda9c1f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda99d9b640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda9c0cfcf0 0x7fda9c1f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda99d9b640 1 -- 172.21.15.161:0/2073142663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda900094d0 con 0x7fda9c0d3910 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda9ad9d640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda9c160e10 0x7fda9c1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda9a59c640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda9c0cfcf0 0x7fda9c1f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda99d9b640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0cc0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fda900097f0 tx=0x7fda900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90032880 con 0x7fda9c0d3910 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda900329e0 con 0x7fda9c0d3910 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda90032d70 con 0x7fda9c0d3910 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.712+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c0b6810 con 0x7fda9c0d3910 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.713+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1f3120 con 0x7fda9c0d3910 2023-11-24T08:00:59.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.714+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c1f3310 con 0x7fda9c0d3910 2023-11-24T08:00:59.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.715+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda9004d3f0 con 0x7fda9c0d3910 2023-11-24T08:00:59.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.715+0000 7fda8affd640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fda7c06ae40 0x7fda7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:00:59.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.716+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda900ab520 con 0x7fda9c0d3910 2023-11-24T08:00:59.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.716+0000 7fda9a59c640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fda7c06ae40 0x7fda7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:00:59.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.717+0000 7fda9a59c640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fda7c06ae40 0x7fda7c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00a810 tx=0x7fda8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:00:59.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.721+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda90076680 con 0x7fda9c0d3910 2023-11-24T08:00:59.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.897+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fda9c0675d0 con 0x7fda9c0d3910 2023-11-24T08:00:59.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.897+0000 7fda8affd640 1 -- 172.21.15.161:0/2073142663 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fda90079ca0 con 0x7fda9c0d3910 2023-11-24T08:00:59.900 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:00:59.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fda7c06ae40 msgr2=0x7fda7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fda7c06ae40 0x7fda7c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00a810 tx=0x7fda8c008040 comp rx=0 tx=0).stop 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 msgr2=0x7fda9c0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0cc0e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fda900097f0 tx=0x7fda900046c0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 shutdown_connections 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fda7c06ae40 0x7fda7c06d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda9c160e10 0x7fda9c1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fda9c0d3910 0x7fda9c0cc0e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 --2- 172.21.15.161:0/2073142663 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda9c0cfcf0 0x7fda9c1f2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:00:59.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 >> 172.21.15.161:0/2073142663 conn(0x7fda9c09c530 msgr2=0x7fda9c0b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:00:59.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 shutdown_connections 2023-11-24T08:00:59.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:00:59.900+0000 7fdaa0848640 1 -- 172.21.15.161:0/2073142663 wait complete. 2023-11-24T08:00:59.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:00.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.118+0000 7f0b3ff1d640 1 Processor -- start 2023-11-24T08:01:00.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.118+0000 7f0b3ff1d640 1 -- start start 2023-11-24T08:01:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.120+0000 7f0b3ff1d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b380cf9a0 0x7f0b38166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.120+0000 7f0b3ff1d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3815c5f0 con 0x7f0b3813e360 2023-11-24T08:01:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.120+0000 7f0b3ff1d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3806c470 con 0x7f0b3813df80 2023-11-24T08:01:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.120+0000 7f0b3ff1d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3806c750 con 0x7f0b380cf9a0 2023-11-24T08:01:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.120+0000 7f0b3d4b8640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0b3813e360 0x7f0b380cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60902/0 (socket says 172.21.15.161:60902) 2023-11-24T08:01:00.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.120+0000 7f0b3d4b8640 1 -- 172.21.15.161:0/2224192324 learned_addr learned my addr 172.21.15.161:0/2224192324 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/2224192324 >> v2:172.21.15.175:3300/0 conn(0x7f0b380cf9a0 0x7f0b38166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224493646 0 0) 0x7f0b3815c5f0 con 0x7f0b3813e360 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b20003520 con 0x7f0b3813e360 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1722377223 0 0) 0x7f0b20003520 con 0x7f0b3813e360 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 >> v2:172.21.15.175:3300/0 conn(0x7f0b380cf9a0 msgr2=0x7f0b38166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 --2- 172.21.15.161:0/2224192324 >> v2:172.21.15.175:3300/0 conn(0x7f0b380cf9a0 0x7f0b38166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 >> v1:172.21.15.175:6789/0 conn(0x7f0b3813df80 legacy=0x7f0b3815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3806ca30 con 0x7f0b3813e360 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0b2c001670 con 0x7f0b3813e360 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 >> v1:172.21.15.161:6789/0 conn(0x7f0b3813e360 legacy=0x7f0b380cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b200039c0 0x7f0b20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b200047c0 0x7f0b20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b20005180 0x7f0b2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3806c750 con 0x7f0b20005180 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2000c080 con 0x7f0b200039c0 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.121+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2000c240 con 0x7f0b200047c0 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b20005180 0x7f0b2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3d4b8640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b200047c0 0x7f0b20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b200047c0 msgr2=0x7f0b20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b200047c0 0x7f0b20004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b200039c0 msgr2=0x7f0b20003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b200039c0 0x7f0b20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.122+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/2224192324 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b20003520 con 0x7f0b20005180 2023-11-24T08:01:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.123+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/2224192324 reap_dead start 2023-11-24T08:01:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.123+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b20005180 0x7f0b2000b980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009a90 tx=0x7f0b200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f37840d6e9f7613 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.123+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30004020 con 0x7f0b20005180 2023-11-24T08:01:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.123+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b30004180 con 0x7f0b20005180 2023-11-24T08:01:00.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.123+0000 7f0b3ccb7640 1 -- 172.21.15.161:0/2224192324 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3002c6b0 con 0x7f0b20005180 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/2224192324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b20005180 msgr2=0x7f0b2000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b20005180 0x7f0b2000b980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009a90 tx=0x7f0b200057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/2224192324 shutdown_connections 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/2224192324 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b20005180 0x7f0b2000b980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/2224192324 >> 172.21.15.161:0/2224192324 conn(0x7f0b3806a800 msgr2=0x7f0b3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/2224192324 shutdown_connections 2023-11-24T08:01:00.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.124+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/2224192324 wait complete. 2023-11-24T08:01:00.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.126+0000 7f0b3ff1d640 1 Processor -- start 2023-11-24T08:01:00.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.126+0000 7f0b3ff1d640 1 -- start start 2023-11-24T08:01:00.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3ff1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b20005180 0x7f0b380addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3ff1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b381f6130 0x7f0b380afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3ff1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 0x7f0b380b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3ff1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b38132ba0 con 0x7f0b381f6590 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3ff1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b380a90f0 con 0x7f0b381f6130 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3ff1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b381f7100 con 0x7f0b20005180 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 0x7f0b380b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 0x7f0b380b03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39918/0 (socket says 172.21.15.161:39918) 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/570500305 learned_addr learned my addr 172.21.15.161:0/570500305 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3dcb9640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b20005180 0x7f0b380addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b20005180 msgr2=0x7f0b380addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b20005180 0x7f0b380addb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b381f6130 msgr2=0x7f0b380afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b381f6130 0x7f0b380afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.127+0000 7f0b3e4ba640 1 -- 172.21.15.161:0/570500305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b380ae2f0 con 0x7f0b381f6590 2023-11-24T08:01:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.128+0000 7f0b3e4ba640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 0x7f0b380b03d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009b80 tx=0x7f0b30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.128+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30039070 con 0x7f0b381f6590 2023-11-24T08:01:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.128+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3000f0c0 con 0x7f0b381f6590 2023-11-24T08:01:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.128+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b30003830 con 0x7f0b381f6590 2023-11-24T08:01:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.128+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b381f6b40 con 0x7f0b381f6590 2023-11-24T08:01:00.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.128+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b381327c0 con 0x7f0b381f6590 2023-11-24T08:01:00.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.129+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b38132ce0 con 0x7f0b381f6590 2023-11-24T08:01:00.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.130+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b30003990 con 0x7f0b381f6590 2023-11-24T08:01:00.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.131+0000 7f0b367fc640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2406ae70 0x7f0b2406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.132+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b300a9bb0 con 0x7f0b381f6590 2023-11-24T08:01:00.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.132+0000 7f0b3dcb9640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2406ae70 0x7f0b2406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.133+0000 7f0b3dcb9640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2406ae70 0x7f0b2406d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b28001ce0 tx=0x7f0b28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.136+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b38132ce0 con 0x7f0b381f6590 2023-11-24T08:01:00.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.312+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b38132ce0 con 0x7f0b381f6590 2023-11-24T08:01:00.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.313+0000 7f0b367fc640 1 -- 172.21.15.161:0/570500305 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b38132ce0 con 0x7f0b381f6590 2023-11-24T08:01:00.318 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:00.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2406ae70 msgr2=0x7f0b2406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2406ae70 0x7f0b2406d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0b28001ce0 tx=0x7f0b28009040 comp rx=0 tx=0).stop 2023-11-24T08:01:00.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 msgr2=0x7f0b380b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 0x7f0b380b03d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b30009b80 tx=0x7f0b30004730 comp rx=0 tx=0).stop 2023-11-24T08:01:00.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 shutdown_connections 2023-11-24T08:01:00.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b2406ae70 0x7f0b2406d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b381f6590 0x7f0b380b03d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b381f6130 0x7f0b380afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 --2- 172.21.15.161:0/570500305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b20005180 0x7f0b380addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 >> 172.21.15.161:0/570500305 conn(0x7f0b3806a800 msgr2=0x7f0b3806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:00.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 shutdown_connections 2023-11-24T08:01:00.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.315+0000 7f0b3ff1d640 1 -- 172.21.15.161:0/570500305 wait complete. 2023-11-24T08:01:00.335 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:00.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.543+0000 7fc8e050f640 1 Processor -- start 2023-11-24T08:01:00.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.543+0000 7fc8e050f640 1 -- start start 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8e050f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8d80cf9a0 0x7fc8d815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8e050f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8d815e1e0 0x7fc8d80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8e050f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d80b1ee0 con 0x7fc8d8143ae0 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8e050f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d80b2780 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8e050f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d815e990 con 0x7fc8d815e1e0 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8d80cf9a0 0x7fc8d815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8d80cf9a0 0x7fc8d815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39926/0 (socket says 172.21.15.161:39926) 2023-11-24T08:01:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 -- 172.21.15.161:0/1111284741 learned_addr learned my addr 172.21.15.161:0/1111284741 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 -- 172.21.15.161:0/1111284741 >> v2:172.21.15.175:3300/0 conn(0x7fc8d815e1e0 msgr2=0x7fc8d80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 --2- 172.21.15.161:0/1111284741 >> v2:172.21.15.175:3300/0 conn(0x7fc8d815e1e0 0x7fc8d80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 -- 172.21.15.161:0/1111284741 >> v1:172.21.15.161:6789/0 conn(0x7fc8d8143ae0 legacy=0x7fc8d80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8ddaaa640 1 -- 172.21.15.161:0/1111284741 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d80b2130 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.545+0000 7fc8dd2a9640 1 -- 172.21.15.161:0/1111284741 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911654145 0 0) 0x7fc8d80b1ee0 con 0x7fc8d8143ae0 2023-11-24T08:01:00.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.547+0000 7fc8ddaaa640 1 --2- 172.21.15.161:0/1111284741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815dca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80ae9d0 tx=0x7fc8c802e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c664eed0ff6b7f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.547+0000 7fc8dd2a9640 1 -- 172.21.15.161:0/1111284741 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8036440 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.547+0000 7fc8dd2a9640 1 -- 172.21.15.161:0/1111284741 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c80365a0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.547+0000 7fc8dd2a9640 1 -- 172.21.15.161:0/1111284741 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8036930 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.547+0000 7fc8e050f640 1 -- 172.21.15.161:0/1111284741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 msgr2=0x7fc8d815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.547+0000 7fc8e050f640 1 --2- 172.21.15.161:0/1111284741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815dca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80ae9d0 tx=0x7fc8c802e170 comp rx=0 tx=0).stop 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.548+0000 7fc8e050f640 1 -- 172.21.15.161:0/1111284741 shutdown_connections 2023-11-24T08:01:00.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.548+0000 7fc8e050f640 1 --2- 172.21.15.161:0/1111284741 >> v2:172.21.15.175:3300/0 conn(0x7fc8d815e1e0 0x7fc8d80702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.548+0000 7fc8e050f640 1 --2- 172.21.15.161:0/1111284741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815dca0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.548+0000 7fc8e050f640 1 -- 172.21.15.161:0/1111284741 >> 172.21.15.161:0/1111284741 conn(0x7fc8d806a800 msgr2=0x7fc8d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.548+0000 7fc8e050f640 1 -- 172.21.15.161:0/1111284741 shutdown_connections 2023-11-24T08:01:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.548+0000 7fc8e050f640 1 -- 172.21.15.161:0/1111284741 wait complete. 2023-11-24T08:01:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.549+0000 7fc8e050f640 1 Processor -- start 2023-11-24T08:01:00.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.550+0000 7fc8e050f640 1 -- start start 2023-11-24T08:01:00.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.550+0000 7fc8e050f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8e050f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d8143ae0 0x7fc8d81f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8e050f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d815e1e0 0x7fc8d806c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8e050f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80afc90 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8e050f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80aebf0 con 0x7fc8d815e1e0 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8e050f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d80aeed0 con 0x7fc8d8143ae0 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39928/0 (socket says 172.21.15.161:39928) 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 -- 172.21.15.161:0/3139772508 learned_addr learned my addr 172.21.15.161:0/3139772508 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 -- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d8143ae0 msgr2=0x7fc8d81f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8ddaaa640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d8143ae0 0x7fc8d81f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d8143ae0 0x7fc8d81f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 -- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d815e1e0 msgr2=0x7fc8d806c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d815e1e0 0x7fc8d806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.551+0000 7fc8de2ab640 1 -- 172.21.15.161:0/3139772508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c800b770 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.552+0000 7fc8de2ab640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815aca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c4b0 tx=0x7fc8d400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.552+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4005480 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.552+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d40035f0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.552+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d40039e0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.552+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d80af1b0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.552+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d80af770 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.553+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d80af960 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.554+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8d4003b40 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.555+0000 7fc8ceffd640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8bc06ae40 0x7fc8bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.556+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8d4088ca0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.556+0000 7fc8ddaaa640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8bc06ae40 0x7fc8bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.557+0000 7fc8ddaaa640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8bc06ae40 0x7fc8bc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8038000 tx=0x7fc8c8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.560+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8d4053cb0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.755+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8d80675d0 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.756+0000 7fc8ceffd640 1 -- 172.21.15.161:0/3139772508 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8d4017070 con 0x7fc8d80cf9a0 2023-11-24T08:01:00.758 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:00.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8bc06ae40 msgr2=0x7fc8bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8bc06ae40 0x7fc8bc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8038000 tx=0x7fc8c8008040 comp rx=0 tx=0).stop 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 msgr2=0x7fc8d815aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815aca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400c4b0 tx=0x7fc8d400c970 comp rx=0 tx=0).stop 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 shutdown_connections 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8bc06ae40 0x7fc8bc06d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8d815e1e0 0x7fc8d806c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8d8143ae0 0x7fc8d81f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 --2- 172.21.15.161:0/3139772508 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8d80cf9a0 0x7fc8d815aca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.758+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 >> 172.21.15.161:0/3139772508 conn(0x7fc8d806a800 msgr2=0x7fc8d8140ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:00.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.759+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 shutdown_connections 2023-11-24T08:01:00.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.759+0000 7fc8e050f640 1 -- 172.21.15.161:0/3139772508 wait complete. 2023-11-24T08:01:00.778 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:00.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.979+0000 7f9b6b59e640 1 Processor -- start 2023-11-24T08:01:00.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.980+0000 7f9b6b59e640 1 -- start start 2023-11-24T08:01:00.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b6c160920 0x7f9b6c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cfea0 0x7f9b6c161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6b59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6c0d0a10 con 0x7f9b6c0cf9f0 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b6c0d0330 con 0x7f9b6c160920 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0d1f50 con 0x7f9b6c0cfea0 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6a59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b6c160920 0x7f9b6c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b69d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9b6c0cf9f0 0x7f9b6c161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47668/0 (socket says 172.21.15.161:47668) 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b6a59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b6c160920 0x7f9b6c0b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54898/0 (socket says 172.21.15.161:54898) 2023-11-24T08:01:00.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.981+0000 7f9b69d9b640 1 -- 172.21.15.161:0/3410065358 learned_addr learned my addr 172.21.15.161:0/3410065358 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:00.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.982+0000 7f9b6ad9d640 1 --2- 172.21.15.161:0/3410065358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cfea0 0x7f9b6c161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.982+0000 7f9b6a59c640 1 -- 172.21.15.161:0/3410065358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cfea0 msgr2=0x7f9b6c161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.982+0000 7f9b6a59c640 1 --2- 172.21.15.161:0/3410065358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cfea0 0x7f9b6c161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.982+0000 7f9b6a59c640 1 -- 172.21.15.161:0/3410065358 >> v1:172.21.15.161:6789/0 conn(0x7f9b6c0cf9f0 legacy=0x7f9b6c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.982+0000 7f9b6a59c640 1 -- 172.21.15.161:0/3410065358 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b6c0cf080 con 0x7f9b6c160920 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.982+0000 7f9b6959a640 1 -- 172.21.15.161:0/3410065358 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805864346 0 0) 0x7f9b6c0d0a10 con 0x7f9b6c0cf9f0 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.983+0000 7f9b6a59c640 1 --2- 172.21.15.161:0/3410065358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b3f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b540097a0 tx=0x7f9b5402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f28a84553dfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.983+0000 7f9b6959a640 1 -- 172.21.15.161:0/3410065358 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5402d040 con 0x7f9b6c160920 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.983+0000 7f9b6959a640 1 -- 172.21.15.161:0/3410065358 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b54031810 con 0x7f9b6c160920 2023-11-24T08:01:00.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.983+0000 7f9b6959a640 1 -- 172.21.15.161:0/3410065358 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54031ba0 con 0x7f9b6c160920 2023-11-24T08:01:00.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 -- 172.21.15.161:0/3410065358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 msgr2=0x7f9b6c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/3410065358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b3f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9b540097a0 tx=0x7f9b5402b8b0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 -- 172.21.15.161:0/3410065358 shutdown_connections 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/3410065358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cfea0 0x7f9b6c161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/3410065358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b3f30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 -- 172.21.15.161:0/3410065358 >> 172.21.15.161:0/3410065358 conn(0x7f9b6c0d3090 msgr2=0x7f9b6c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 -- 172.21.15.161:0/3410065358 shutdown_connections 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.984+0000 7f9b6b59e640 1 -- 172.21.15.161:0/3410065358 wait complete. 2023-11-24T08:01:00.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.986+0000 7f9b6b59e640 1 Processor -- start 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.986+0000 7f9b6b59e640 1 -- start start 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cf9f0 0x7f9b6c151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b6c0cfea0 0x7f9b6c0cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c151ac0 con 0x7f9b6c160920 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0b6070 con 0x7f9b6c0cfea0 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6c0b6350 con 0x7f9b6c0cf9f0 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54912/0 (socket says 172.21.15.161:54912) 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.987+0000 7f9b6ad9d640 1 -- 172.21.15.161:0/533594022 learned_addr learned my addr 172.21.15.161:0/533594022 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6a59c640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cf9f0 0x7f9b6c151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6ad9d640 1 -- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cf9f0 msgr2=0x7f9b6c151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6ad9d640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cf9f0 0x7f9b6c151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6ad9d640 1 -- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b6c0cfea0 msgr2=0x7f9b6c0cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b69d9b640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b6c0cfea0 0x7f9b6c0cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6ad9d640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b6c0cfea0 0x7f9b6c0cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6ad9d640 1 -- 172.21.15.161:0/533594022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009400 con 0x7f9b6c160920 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b69d9b640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b6c0cfea0 0x7f9b6c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:00.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6ad9d640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b7110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b64007e40 tx=0x7f9b6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b64014620 con 0x7f9b6c160920 2023-11-24T08:01:00.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6400ee90 con 0x7f9b6c160920 2023-11-24T08:01:00.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640149e0 con 0x7f9b6c160920 2023-11-24T08:01:00.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6c0b6630 con 0x7f9b6c160920 2023-11-24T08:01:00.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.988+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6c0b6bf0 con 0x7f9b6c160920 2023-11-24T08:01:00.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.990+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6c0b6e10 con 0x7f9b6c160920 2023-11-24T08:01:00.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.990+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b64014b40 con 0x7f9b6c160920 2023-11-24T08:01:00.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.991+0000 7f9b62ffd640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b4c06ae40 0x7f9b4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:00.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.991+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b6408a180 con 0x7f9b6c160920 2023-11-24T08:01:00.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.992+0000 7f9b6a59c640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b4c06ae40 0x7f9b4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:00.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.993+0000 7f9b6a59c640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b4c06ae40 0x7f9b4c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b54036000 tx=0x7f9b5403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:00.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:00.995+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b64055100 con 0x7f9b6c160920 2023-11-24T08:01:01.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.191+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b6c067450 con 0x7f9b6c160920 2023-11-24T08:01:01.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.193+0000 7f9b62ffd640 1 -- 172.21.15.161:0/533594022 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f9b64058720 con 0x7f9b6c160920 2023-11-24T08:01:01.196 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:01.196 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:01.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b4c06ae40 msgr2=0x7f9b4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b4c06ae40 0x7f9b4c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b54036000 tx=0x7f9b5403c040 comp rx=0 tx=0).stop 2023-11-24T08:01:01.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 msgr2=0x7f9b6c0b7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b7110 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9b64007e40 tx=0x7f9b6400e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 shutdown_connections 2023-11-24T08:01:01.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b4c06ae40 0x7f9b4c06d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b6c160920 0x7f9b6c0b7110 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b6c0cfea0 0x7f9b6c0cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 --2- 172.21.15.161:0/533594022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b6c0cf9f0 0x7f9b6c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 >> 172.21.15.161:0/533594022 conn(0x7f9b6c0d3090 msgr2=0x7f9b6c15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:01.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 shutdown_connections 2023-11-24T08:01:01.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.196+0000 7f9b6b59e640 1 -- 172.21.15.161:0/533594022 wait complete. 2023-11-24T08:01:01.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:01.217 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.428+0000 7ffb6bf41640 1 Processor -- start 2023-11-24T08:01:01.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.428+0000 7ffb6bf41640 1 -- start start 2023-11-24T08:01:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.430+0000 7ffb6bf41640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb6415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.430+0000 7ffb6bf41640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffb6413e360 0x7ffb640cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.430+0000 7ffb6bf41640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6406c470 con 0x7ffb6415f9c0 2023-11-24T08:01:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.430+0000 7ffb6bf41640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6406c750 con 0x7ffb6413e360 2023-11-24T08:01:01.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.430+0000 7ffb6bf41640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6406ca30 con 0x7ffb6413df80 2023-11-24T08:01:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.431+0000 7ffb69cdd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb6415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.431+0000 7ffb694dc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffb6413e360 0x7ffb640cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.431+0000 7ffb69cdd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb6415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:57728/0 (socket says 172.21.15.161:57728) 2023-11-24T08:01:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.431+0000 7ffb6a4de640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ffb6415f9c0 0x7ffb641408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:36156/0 (socket says 172.21.15.161:36156) 2023-11-24T08:01:01.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.431+0000 7ffb69cdd640 1 -- 172.21.15.161:0/2656180138 learned_addr learned my addr 172.21.15.161:0/2656180138 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.432+0000 7ffb69cdd640 1 -- 172.21.15.161:0/2656180138 >> v2:172.21.15.175:3300/0 conn(0x7ffb6413e360 msgr2=0x7ffb640cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.432+0000 7ffb69cdd640 1 --2- 172.21.15.161:0/2656180138 >> v2:172.21.15.175:3300/0 conn(0x7ffb6413e360 0x7ffb640cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.432+0000 7ffb69cdd640 1 -- 172.21.15.161:0/2656180138 >> v1:172.21.15.175:6789/0 conn(0x7ffb6415f9c0 legacy=0x7ffb641408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.432+0000 7ffb69cdd640 1 -- 172.21.15.161:0/2656180138 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6406cd10 con 0x7ffb6413df80 2023-11-24T08:01:01.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.432+0000 7ffb694dc640 1 --2- 172.21.15.161:0/2656180138 >> v2:172.21.15.175:3300/0 conn(0x7ffb6413e360 0x7ffb640cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:01:01.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.433+0000 7ffb69cdd640 1 --2- 172.21.15.161:0/2656180138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb6415bee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009e50 tx=0x7ffb6002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ecca7f7a11cd6ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb68cdb640 1 -- 172.21.15.161:0/2656180138 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6002caf0 con 0x7ffb6413df80 2023-11-24T08:01:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb68cdb640 1 -- 172.21.15.161:0/2656180138 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6002cc50 con 0x7ffb6413df80 2023-11-24T08:01:01.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb68cdb640 1 -- 172.21.15.161:0/2656180138 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600343f0 con 0x7ffb6413df80 2023-11-24T08:01:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 -- 172.21.15.161:0/2656180138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 msgr2=0x7ffb6415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/2656180138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb6415bee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb60009e50 tx=0x7ffb6002bf50 comp rx=0 tx=0).stop 2023-11-24T08:01:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 -- 172.21.15.161:0/2656180138 shutdown_connections 2023-11-24T08:01:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/2656180138 >> v2:172.21.15.175:3300/0 conn(0x7ffb6413e360 0x7ffb640cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/2656180138 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb6415bee0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 -- 172.21.15.161:0/2656180138 >> 172.21.15.161:0/2656180138 conn(0x7ffb6406a800 msgr2=0x7ffb6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 -- 172.21.15.161:0/2656180138 shutdown_connections 2023-11-24T08:01:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.434+0000 7ffb6bf41640 1 -- 172.21.15.161:0/2656180138 wait complete. 2023-11-24T08:01:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.436+0000 7ffb6bf41640 1 Processor -- start 2023-11-24T08:01:01.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.436+0000 7ffb6bf41640 1 -- start start 2023-11-24T08:01:01.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6bf41640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb641f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6bf41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb6413e360 0x7ffb640b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6bf41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 0x7ffb640a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6bf41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64151d80 con 0x7ffb6415f9c0 2023-11-24T08:01:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6bf41640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64152060 con 0x7ffb6413e360 2023-11-24T08:01:01.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6bf41640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64152340 con 0x7ffb6413df80 2023-11-24T08:01:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.437+0000 7ffb6a4de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 0x7ffb640a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 0x7ffb640a8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54928/0 (socket says 172.21.15.161:54928) 2023-11-24T08:01:01.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 -- 172.21.15.161:0/3586038440 learned_addr learned my addr 172.21.15.161:0/3586038440 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:01.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb69cdd640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb641f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 -- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 msgr2=0x7ffb641f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb641f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 -- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb6413e360 msgr2=0x7ffb640b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb694dc640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb6413e360 0x7ffb640b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb6413e360 0x7ffb640b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 -- 172.21.15.161:0/3586038440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009400 con 0x7ffb6415f9c0 2023-11-24T08:01:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.438+0000 7ffb6a4de640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 0x7ffb640a8e20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00c400 tx=0x7ffb5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.439+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0074e0 con 0x7ffb6415f9c0 2023-11-24T08:01:01.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.439+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c007640 con 0x7ffb6415f9c0 2023-11-24T08:01:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.439+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0049e0 con 0x7ffb6415f9c0 2023-11-24T08:01:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.439+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb60009b30 con 0x7ffb6415f9c0 2023-11-24T08:01:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.439+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb64152900 con 0x7ffb6415f9c0 2023-11-24T08:01:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.440+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb640675d0 con 0x7ffb6415f9c0 2023-11-24T08:01:01.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.441+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffb5c004b40 con 0x7ffb6415f9c0 2023-11-24T08:01:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.442+0000 7ffb5a7fc640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffb4806ae40 0x7ffb4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.442+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb5c089070 con 0x7ffb6415f9c0 2023-11-24T08:01:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.442+0000 7ffb69cdd640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffb4806ae40 0x7ffb4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.443+0000 7ffb69cdd640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffb4806ae40 0x7ffb4806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb60035000 tx=0x7ffb60030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:01.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.446+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffb5c0540a0 con 0x7ffb6415f9c0 2023-11-24T08:01:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.639+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb640702c0 con 0x7ffb6415f9c0 2023-11-24T08:01:01.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.640+0000 7ffb5a7fc640 1 -- 172.21.15.161:0/3586038440 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb5c0576c0 con 0x7ffb6415f9c0 2023-11-24T08:01:01.642 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:01.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffb4806ae40 msgr2=0x7ffb4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffb4806ae40 0x7ffb4806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffb60035000 tx=0x7ffb60030000 comp rx=0 tx=0).stop 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 msgr2=0x7ffb640a8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 0x7ffb640a8e20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00c400 tx=0x7ffb5c00c8c0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 shutdown_connections 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffb4806ae40 0x7ffb4806d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffb6415f9c0 0x7ffb640a8e20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb6413e360 0x7ffb640b0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 --2- 172.21.15.161:0/3586038440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb6413df80 0x7ffb641f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 >> 172.21.15.161:0/3586038440 conn(0x7ffb6406a800 msgr2=0x7ffb64070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 shutdown_connections 2023-11-24T08:01:01.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.643+0000 7ffb6bf41640 1 -- 172.21.15.161:0/3586038440 wait complete. 2023-11-24T08:01:01.665 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:01.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.879+0000 7f141ede2640 1 Processor -- start 2023-11-24T08:01:01.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.880+0000 7f141ede2640 1 -- start start 2023-11-24T08:01:01.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.881+0000 7f141ede2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f14180d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.881+0000 7f141ede2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14180b41e0 0x7f14180cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.881+0000 7f141ede2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14180d0320 con 0x7f14180cf9a0 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.881+0000 7f141ede2640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14180b2730 con 0x7f14180b41e0 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.881+0000 7f141ede2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14180d1ec0 con 0x7f141815d4b0 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.881+0000 7f141e5e1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14180b41e0 0x7f14180cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141e5e1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14180b41e0 0x7f14180cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54932/0 (socket says 172.21.15.161:54932) 2023-11-24T08:01:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141e5e1640 1 -- 172.21.15.161:0/2533990154 learned_addr learned my addr 172.21.15.161:0/2533990154 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:01.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141dde0640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f14180d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141e5e1640 1 -- 172.21.15.161:0/2533990154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 msgr2=0x7f14180d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141e5e1640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f14180d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141e5e1640 1 -- 172.21.15.161:0/2533990154 >> v1:172.21.15.175:6789/0 conn(0x7f14180cf9a0 legacy=0x7f14180cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141e5e1640 1 -- 172.21.15.161:0/2533990154 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180b29d0 con 0x7f14180b41e0 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.882+0000 7f141dde0640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f14180d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.883+0000 7f141e5e1640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14180cfde0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14100098a0 tx=0x7f141002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84848a0e212bf78 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.883+0000 7f141cdde640 1 -- 172.21.15.161:0/2533990154 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410031640 con 0x7f14180b41e0 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141cdde640 1 -- 172.21.15.161:0/2533990154 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14100317a0 con 0x7f14180b41e0 2023-11-24T08:01:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141cdde640 1 -- 172.21.15.161:0/2533990154 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410031b30 con 0x7f14180b41e0 2023-11-24T08:01:01.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 -- 172.21.15.161:0/2533990154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 msgr2=0x7f14180cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14180cfde0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f14100098a0 tx=0x7f141002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 -- 172.21.15.161:0/2533990154 shutdown_connections 2023-11-24T08:01:01.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14180cfde0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 --2- 172.21.15.161:0/2533990154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f14180d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 -- 172.21.15.161:0/2533990154 >> 172.21.15.161:0/2533990154 conn(0x7f14180d3000 msgr2=0x7f14180d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:01.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 -- 172.21.15.161:0/2533990154 shutdown_connections 2023-11-24T08:01:01.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.884+0000 7f141ede2640 1 -- 172.21.15.161:0/2533990154 wait complete. 2023-11-24T08:01:01.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.886+0000 7f141ede2640 1 Processor -- start 2023-11-24T08:01:01.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.886+0000 7f141ede2640 1 -- start start 2023-11-24T08:01:01.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141ede2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14181f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141ede2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14180cf9a0 0x7f1418152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141ede2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f141806ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141ede2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1418152940 con 0x7f14180b41e0 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141ede2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14180b7db0 con 0x7f14180cf9a0 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141ede2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14180b8090 con 0x7f141815d4b0 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141dde0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14181f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141dde0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14181f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54942/0 (socket says 172.21.15.161:54942) 2023-11-24T08:01:01.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.887+0000 7f141dde0640 1 -- 172.21.15.161:0/469396844 learned_addr learned my addr 172.21.15.161:0/469396844 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141dde0640 1 -- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 msgr2=0x7f141806ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141dde0640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f141806ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141dde0640 1 -- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14180cf9a0 msgr2=0x7f1418152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141dde0640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14180cf9a0 0x7f1418152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141dde0640 1 -- 172.21.15.161:0/469396844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100094d0 con 0x7f14180b41e0 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141dde0640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14181f2ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f140800ce00 tx=0x7f140800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140800f890 con 0x7f14180b41e0 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140800f9f0 con 0x7f14180b41e0 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141815da10 con 0x7f14180b41e0 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.888+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140800fdc0 con 0x7f14180b41e0 2023-11-24T08:01:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.889+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14180b8650 con 0x7f14180b41e0 2023-11-24T08:01:01.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.890+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1418067450 con 0x7f14180b41e0 2023-11-24T08:01:01.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.891+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f140800b040 con 0x7f14180b41e0 2023-11-24T08:01:01.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.892+0000 7f14167fc640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f140406ae40 0x7f140406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:01.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.892+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1408089f70 con 0x7f14180b41e0 2023-11-24T08:01:01.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.893+0000 7f141d5df640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f140406ae40 0x7f140406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:01.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.894+0000 7f141d5df640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f140406ae40 0x7f140406d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f141815c0d0 tx=0x7f140c0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:01.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:01.897+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14080bce90 con 0x7f14180b41e0 2023-11-24T08:01:02.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.089+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f141808d100 con 0x7f14180b41e0 2023-11-24T08:01:02.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.089+0000 7f14167fc640 1 -- 172.21.15.161:0/469396844 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1408055160 con 0x7f14180b41e0 2023-11-24T08:01:02.092 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:02.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f140406ae40 msgr2=0x7f140406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f140406ae40 0x7f140406d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f141815c0d0 tx=0x7f140c0079b0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 msgr2=0x7f14181f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14181f2ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f140800ce00 tx=0x7f140800a650 comp rx=0 tx=0).stop 2023-11-24T08:01:02.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 shutdown_connections 2023-11-24T08:01:02.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f140406ae40 0x7f140406d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f141815d4b0 0x7f141806ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14180cf9a0 0x7f1418152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 --2- 172.21.15.161:0/469396844 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14180b41e0 0x7f14181f2ef0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.092+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 >> 172.21.15.161:0/469396844 conn(0x7f14180d3000 msgr2=0x7f141806ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:02.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.093+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 shutdown_connections 2023-11-24T08:01:02.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.093+0000 7f141ede2640 1 -- 172.21.15.161:0/469396844 wait complete. 2023-11-24T08:01:02.113 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:02.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.326+0000 7f4aca49f640 1 Processor -- start 2023-11-24T08:01:02.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.326+0000 7f4aca49f640 1 -- start start 2023-11-24T08:01:02.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.327+0000 7f4aca49f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4ac40adf20 0x7f4ac4070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4aca49f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ccb50 0x7f4ac4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4aca49f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac415f4e0 con 0x7f4ac415bf10 2023-11-24T08:01:02.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4aca49f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac415f970 con 0x7f4ac40adf20 2023-11-24T08:01:02.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4aca49f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac4071130 con 0x7f4ac40ccb50 2023-11-24T08:01:02.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4ac949d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4ac40adf20 0x7f4ac4070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4ac949d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4ac40adf20 0x7f4ac4070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54958/0 (socket says 172.21.15.161:54958) 2023-11-24T08:01:02.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4ac949d640 1 -- 172.21.15.161:0/1734144448 learned_addr learned my addr 172.21.15.161:0/1734144448 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:02.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.328+0000 7f4ac9c9e640 1 --2- 172.21.15.161:0/1734144448 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ccb50 0x7f4ac4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.329+0000 7f4ac949d640 1 -- 172.21.15.161:0/1734144448 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ccb50 msgr2=0x7f4ac4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:02.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.329+0000 7f4ac949d640 1 --2- 172.21.15.161:0/1734144448 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ccb50 0x7f4ac4143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.329+0000 7f4ac949d640 1 -- 172.21.15.161:0/1734144448 >> v1:172.21.15.175:6789/0 conn(0x7f4ac415bf10 legacy=0x7f4ac40cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.329+0000 7f4ac949d640 1 -- 172.21.15.161:0/1734144448 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac415c390 con 0x7f4ac40adf20 2023-11-24T08:01:02.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.329+0000 7f4ac9c9e640 1 --2- 172.21.15.161:0/1734144448 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ccb50 0x7f4ac4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:02.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.330+0000 7f4ac949d640 1 --2- 172.21.15.161:0/1734144448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40adf20 0x7f4ac4070a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ac406ff20 tx=0x7f4ac002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8552aff1d9f1c49b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:02.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.330+0000 7f4abbfff640 1 -- 172.21.15.161:0/1734144448 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0031870 con 0x7f4ac40adf20 2023-11-24T08:01:02.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4abbfff640 1 -- 172.21.15.161:0/1734144448 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac00319d0 con 0x7f4ac40adf20 2023-11-24T08:01:02.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4abbfff640 1 -- 172.21.15.161:0/1734144448 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0031d60 con 0x7f4ac40adf20 2023-11-24T08:01:02.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 -- 172.21.15.161:0/1734144448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40adf20 msgr2=0x7f4ac4070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 --2- 172.21.15.161:0/1734144448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40adf20 0x7f4ac4070a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4ac406ff20 tx=0x7f4ac002b910 comp rx=0 tx=0).stop 2023-11-24T08:01:02.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 -- 172.21.15.161:0/1734144448 shutdown_connections 2023-11-24T08:01:02.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 --2- 172.21.15.161:0/1734144448 >> v2:172.21.15.175:3300/0 conn(0x7f4ac40ccb50 0x7f4ac4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 --2- 172.21.15.161:0/1734144448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40adf20 0x7f4ac4070a30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 -- 172.21.15.161:0/1734144448 >> 172.21.15.161:0/1734144448 conn(0x7f4ac406a7d0 msgr2=0x7f4ac406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:02.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 -- 172.21.15.161:0/1734144448 shutdown_connections 2023-11-24T08:01:02.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.331+0000 7f4aca49f640 1 -- 172.21.15.161:0/1734144448 wait complete. 2023-11-24T08:01:02.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.334+0000 7f4aca49f640 1 Processor -- start 2023-11-24T08:01:02.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.334+0000 7f4aca49f640 1 -- start start 2023-11-24T08:01:02.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4aca49f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40adf20 0x7f4ac413a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4aca49f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 0x7f4ac40c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4aca49f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415bf10 0x7f4ac40c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4aca49f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40c5300 con 0x7f4ac40ccb50 2023-11-24T08:01:02.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4aca49f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40c55e0 con 0x7f4ac415bf10 2023-11-24T08:01:02.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4aca49f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac40c58c0 con 0x7f4ac40adf20 2023-11-24T08:01:02.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4ac8c9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 0x7f4ac40c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.335+0000 7f4ac8c9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 0x7f4ac40c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54964/0 (socket says 172.21.15.161:54964) 2023-11-24T08:01:02.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 -- 172.21.15.161:0/63754954 learned_addr learned my addr 172.21.15.161:0/63754954 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:02.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac949d640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40adf20 0x7f4ac413a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 -- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40adf20 msgr2=0x7f4ac413a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40adf20 0x7f4ac413a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac9c9e640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415bf10 0x7f4ac40c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 -- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415bf10 msgr2=0x7f4ac40c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415bf10 0x7f4ac40c73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 -- 172.21.15.161:0/63754954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00094d0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ac8c9c640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 0x7f4ac40c6ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c3c0 tx=0x7f4ab400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.336+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab40052d0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.337+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab4005450 con 0x7f4ac40ccb50 2023-11-24T08:01:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.337+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4007260 con 0x7f4ac40ccb50 2023-11-24T08:01:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.337+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac40c5ba0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.337+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac413a8a0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.338+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac40c60c0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.339+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ab40073c0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.340+0000 7f4ab9ffb640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4aa806ae40 0x7f4aa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.340+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ab4088920 con 0x7f4ac40ccb50 2023-11-24T08:01:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.341+0000 7f4ac949d640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4aa806ae40 0x7f4aa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.342+0000 7f4ac949d640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4aa806ae40 0x7f4aa806d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0036000 tx=0x7f4ac003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.345+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ac40c60c0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.532+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ac40c60c0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.533+0000 7f4ab9ffb640 1 -- 172.21.15.161:0/63754954 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ac40c60c0 con 0x7f4ac40ccb50 2023-11-24T08:01:02.536 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:02.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4aa806ae40 msgr2=0x7f4aa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4aa806ae40 0x7f4aa806d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0036000 tx=0x7f4ac003c040 comp rx=0 tx=0).stop 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 msgr2=0x7f4ac40c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 0x7f4ac40c6ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400c3c0 tx=0x7f4ab400c880 comp rx=0 tx=0).stop 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 shutdown_connections 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4aa806ae40 0x7f4aa806d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415bf10 0x7f4ac40c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ac40ccb50 0x7f4ac40c6ea0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 --2- 172.21.15.161:0/63754954 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac40adf20 0x7f4ac413a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 >> 172.21.15.161:0/63754954 conn(0x7f4ac406a7d0 msgr2=0x7f4ac406abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:02.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.536+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 shutdown_connections 2023-11-24T08:01:02.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.537+0000 7f4aca49f640 1 -- 172.21.15.161:0/63754954 wait complete. 2023-11-24T08:01:02.559 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:02.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.768+0000 7f6ebb8c9640 1 Processor -- start 2023-11-24T08:01:02.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.768+0000 7f6ebb8c9640 1 -- start start 2023-11-24T08:01:02.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.769+0000 7f6ebb8c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6eb413df80 0x7f6eb415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6ebb8c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6eb40cf9a0 0x7f6eb40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6ebb8c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb406c470 con 0x7f6eb413e360 2023-11-24T08:01:02.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6ebb8c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb406c750 con 0x7f6eb40cf9a0 2023-11-24T08:01:02.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6ebb8c9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb406ca30 con 0x7f6eb413df80 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6eb40cf9a0 0x7f6eb40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6eb40cf9a0 0x7f6eb40cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54968/0 (socket says 172.21.15.161:54968) 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 -- 172.21.15.161:0/521556090 learned_addr learned my addr 172.21.15.161:0/521556090 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9665640 1 --2- 172.21.15.161:0/521556090 >> v2:172.21.15.175:3300/0 conn(0x7f6eb413df80 0x7f6eb415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 -- 172.21.15.161:0/521556090 >> v2:172.21.15.175:3300/0 conn(0x7f6eb413df80 msgr2=0x7f6eb415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 --2- 172.21.15.161:0/521556090 >> v2:172.21.15.175:3300/0 conn(0x7f6eb413df80 0x7f6eb415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 -- 172.21.15.161:0/521556090 >> v1:172.21.15.175:6789/0 conn(0x7f6eb413e360 legacy=0x7f6eb40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:02.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.770+0000 7f6eb9e66640 1 -- 172.21.15.161:0/521556090 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb406cd10 con 0x7f6eb40cf9a0 2023-11-24T08:01:02.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.772+0000 7f6eb9e66640 1 --2- 172.21.15.161:0/521556090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb40cf9a0 0x7f6eb40cd840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4072770 tx=0x7f6eac02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b3ef18035fc13f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:02.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.772+0000 7f6eabfff640 1 -- 172.21.15.161:0/521556090 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac02ca80 con 0x7f6eb40cf9a0 2023-11-24T08:01:02.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.772+0000 7f6eabfff640 1 -- 172.21.15.161:0/521556090 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac02cbe0 con 0x7f6eb40cf9a0 2023-11-24T08:01:02.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.772+0000 7f6eabfff640 1 -- 172.21.15.161:0/521556090 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac0343f0 con 0x7f6eb40cf9a0 2023-11-24T08:01:02.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.772+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/521556090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb40cf9a0 msgr2=0x7f6eb40cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.772+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/521556090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb40cf9a0 0x7f6eb40cd840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4072770 tx=0x7f6eac02bee0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.773+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/521556090 shutdown_connections 2023-11-24T08:01:02.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.773+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/521556090 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb40cf9a0 0x7f6eb40cd840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.773+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/521556090 >> v2:172.21.15.175:3300/0 conn(0x7f6eb413df80 0x7f6eb415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.773+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/521556090 >> 172.21.15.161:0/521556090 conn(0x7f6eb406a800 msgr2=0x7f6eb406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.773+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/521556090 shutdown_connections 2023-11-24T08:01:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.773+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/521556090 wait complete. 2023-11-24T08:01:02.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.774+0000 7f6ebb8c9640 1 Processor -- start 2023-11-24T08:01:02.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.775+0000 7f6ebb8c9640 1 -- start start 2023-11-24T08:01:02.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.775+0000 7f6ebb8c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb40cf9a0 0x7f6eb414f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.775+0000 7f6ebb8c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb413df80 0x7f6eb413d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6ebb8c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 0x7f6eb4157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6ebb8c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb414f570 con 0x7f6eb413e360 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6ebb8c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4153440 con 0x7f6eb413df80 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6ebb8c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4152550 con 0x7f6eb40cf9a0 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 0x7f6eb4157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 0x7f6eb4157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54972/0 (socket says 172.21.15.161:54972) 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 -- 172.21.15.161:0/4114623994 learned_addr learned my addr 172.21.15.161:0/4114623994 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 -- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb40cf9a0 msgr2=0x7f6eb414f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb40cf9a0 0x7f6eb414f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 -- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb413df80 msgr2=0x7f6eb413d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb413df80 0x7f6eb413d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 -- 172.21.15.161:0/4114623994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac009b30 con 0x7f6eb413e360 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.776+0000 7f6eb9e66640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 0x7f6eb4157e40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6eac036040 tx=0x7f6eac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.777+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac009510 con 0x7f6eb413e360 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.777+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac03e450 con 0x7f6eb413e360 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.777+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4152830 con 0x7f6eb413e360 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.777+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac03e800 con 0x7f6eb413e360 2023-11-24T08:01:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.777+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4152df0 con 0x7f6eb413e360 2023-11-24T08:01:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.778+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40675d0 con 0x7f6eb413e360 2023-11-24T08:01:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.779+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6eac02cd50 con 0x7f6eb413e360 2023-11-24T08:01:02.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.780+0000 7f6ea9ffb640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6e9806ae70 0x7f6e9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:02.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.780+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6eac0ac1c0 con 0x7f6eb413e360 2023-11-24T08:01:02.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.780+0000 7f6eb9665640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6e9806ae70 0x7f6e9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:02.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.782+0000 7f6eb9665640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6e9806ae70 0x7f6e9806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0006fd0 tx=0x7f6eb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:02.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.784+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6eac077310 con 0x7f6eb413e360 2023-11-24T08:01:02.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.974+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6eb41535b0 con 0x7f6eb413e360 2023-11-24T08:01:02.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.976+0000 7f6ea9ffb640 1 -- 172.21.15.161:0/4114623994 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f6eac07a930 con 0x7f6eb413e360 2023-11-24T08:01:02.979 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:02.979 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:02.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6e9806ae70 msgr2=0x7f6e9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6e9806ae70 0x7f6e9806d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0006fd0 tx=0x7f6eb0008040 comp rx=0 tx=0).stop 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 msgr2=0x7f6eb4157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 0x7f6eb4157e40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6eac036040 tx=0x7f6eac004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 shutdown_connections 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6e9806ae70 0x7f6e9806d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6eb413e360 0x7f6eb4157e40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6eb413df80 0x7f6eb413d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 --2- 172.21.15.161:0/4114623994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6eb40cf9a0 0x7f6eb414f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 >> 172.21.15.161:0/4114623994 conn(0x7f6eb406a800 msgr2=0x7f6eb40b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 shutdown_connections 2023-11-24T08:01:02.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:02.979+0000 7f6ebb8c9640 1 -- 172.21.15.161:0/4114623994 wait complete. 2023-11-24T08:01:03.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:03.001 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:03.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.209+0000 7f5390932640 1 Processor -- start 2023-11-24T08:01:03.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.209+0000 7f5390932640 1 -- start start 2023-11-24T08:01:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.210+0000 7f5390932640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c13cf10 0x7f538c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f5390932640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f538c0cddf0 0x7f538c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f5390932640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f538c0ce440 con 0x7f538c13fae0 2023-11-24T08:01:03.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f5390932640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f538c13ff60 con 0x7f538c0cddf0 2023-11-24T08:01:03.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f5390932640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c0ce720 con 0x7f538c13cf10 2023-11-24T08:01:03.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f538c0cddf0 0x7f538c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f538c0cddf0 0x7f538c0b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54980/0 (socket says 172.21.15.161:54980) 2023-11-24T08:01:03.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 -- 172.21.15.161:0/3309998152 learned_addr learned my addr 172.21.15.161:0/3309998152 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:03.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538ad9d640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c13cf10 0x7f538c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 -- 172.21.15.161:0/3309998152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c13cf10 msgr2=0x7f538c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:03.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c13cf10 0x7f538c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 -- 172.21.15.161:0/3309998152 >> v1:172.21.15.175:6789/0 conn(0x7f538c13fae0 legacy=0x7f538c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:03.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538b59e640 1 -- 172.21.15.161:0/3309998152 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0cea00 con 0x7f538c0cddf0 2023-11-24T08:01:03.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.211+0000 7f538ad9d640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c13cf10 0x7f538c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.212+0000 7f538b59e640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c0cddf0 0x7f538c0b2590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5384009e50 tx=0x7f538402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf2333b3a3db2c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.213+0000 7f5389d9b640 1 -- 172.21.15.161:0/3309998152 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538402ca80 con 0x7f538c0cddf0 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.213+0000 7f5389d9b640 1 -- 172.21.15.161:0/3309998152 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538402cbe0 con 0x7f538c0cddf0 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.213+0000 7f5389d9b640 1 -- 172.21.15.161:0/3309998152 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53840343f0 con 0x7f538c0cddf0 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.213+0000 7f5390932640 1 -- 172.21.15.161:0/3309998152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c0cddf0 msgr2=0x7f538c0b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.213+0000 7f5390932640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c0cddf0 0x7f538c0b2590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5384009e50 tx=0x7f538402bee0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.214+0000 7f5390932640 1 -- 172.21.15.161:0/3309998152 shutdown_connections 2023-11-24T08:01:03.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.214+0000 7f5390932640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c0cddf0 0x7f538c0b2590 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.214+0000 7f5390932640 1 --2- 172.21.15.161:0/3309998152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c13cf10 0x7f538c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.214+0000 7f5390932640 1 -- 172.21.15.161:0/3309998152 >> 172.21.15.161:0/3309998152 conn(0x7f538c06a7d0 msgr2=0x7f538c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:03.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.214+0000 7f5390932640 1 -- 172.21.15.161:0/3309998152 shutdown_connections 2023-11-24T08:01:03.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.214+0000 7f5390932640 1 -- 172.21.15.161:0/3309998152 wait complete. 2023-11-24T08:01:03.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.215+0000 7f5390932640 1 Processor -- start 2023-11-24T08:01:03.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.215+0000 7f5390932640 1 -- start start 2023-11-24T08:01:03.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.216+0000 7f5390932640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c0cddf0 0x7f538c1f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.216+0000 7f5390932640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538c13cf10 0x7f538c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.216+0000 7f5390932640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 0x7f538c137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.216+0000 7f5390932640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c15b600 con 0x7f538c13fae0 2023-11-24T08:01:03.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.216+0000 7f5390932640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f538c15b8e0 con 0x7f538c13cf10 2023-11-24T08:01:03.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.216+0000 7f5390932640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f538c15bbc0 con 0x7f538c0cddf0 2023-11-24T08:01:03.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 0x7f538c137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 0x7f538c137fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54996/0 (socket says 172.21.15.161:54996) 2023-11-24T08:01:03.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 -- 172.21.15.161:0/1755970133 learned_addr learned my addr 172.21.15.161:0/1755970133 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:03.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 -- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c0cddf0 msgr2=0x7f538c1f24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538ad9d640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c0cddf0 0x7f538c1f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538a59c640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538c13cf10 0x7f538c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c0cddf0 0x7f538c1f24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 -- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538c13cf10 msgr2=0x7f538c071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538c13cf10 0x7f538c071f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538b59e640 1 -- 172.21.15.161:0/1755970133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5384009b30 con 0x7f538c13fae0 2023-11-24T08:01:03.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.217+0000 7f538ad9d640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c0cddf0 0x7f538c1f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.218+0000 7f538b59e640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 0x7f538c137fd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5384009e50 tx=0x7f5384004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.218+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384009510 con 0x7f538c13fae0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.218+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538403e450 con 0x7f538c13fae0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.218+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538403e800 con 0x7f538c13fae0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.218+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f538c15bea0 con 0x7f538c13fae0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.218+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f538c159ed0 con 0x7f538c13fae0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.219+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f538c067450 con 0x7f538c13fae0 2023-11-24T08:01:03.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.220+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f538402cd50 con 0x7f538c13fae0 2023-11-24T08:01:03.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.221+0000 7f53737fe640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f537806ae40 0x7f537806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.222+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53840ac260 con 0x7f538c13fae0 2023-11-24T08:01:03.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.222+0000 7f538ad9d640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f537806ae40 0x7f537806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.223+0000 7f538ad9d640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f537806ae40 0x7f537806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f537c006fd0 tx=0x7f537c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:03.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.226+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5384077320 con 0x7f538c13fae0 2023-11-24T08:01:03.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.415+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f538c15b740 con 0x7f538c13fae0 2023-11-24T08:01:03.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.416+0000 7f53737fe640 1 -- 172.21.15.161:0/1755970133 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f538c15b740 con 0x7f538c13fae0 2023-11-24T08:01:03.418 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f537806ae40 msgr2=0x7f537806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f537806ae40 0x7f537806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f537c006fd0 tx=0x7f537c008040 comp rx=0 tx=0).stop 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 msgr2=0x7f538c137fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 0x7f538c137fd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5384009e50 tx=0x7f5384004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 shutdown_connections 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f537806ae40 0x7f537806d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f538c13fae0 0x7f538c137fd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f538c13cf10 0x7f538c071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 --2- 172.21.15.161:0/1755970133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f538c0cddf0 0x7f538c1f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.419+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 >> 172.21.15.161:0/1755970133 conn(0x7f538c06a7d0 msgr2=0x7f538c15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:03.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.420+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 shutdown_connections 2023-11-24T08:01:03.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.420+0000 7f5390932640 1 -- 172.21.15.161:0/1755970133 wait complete. 2023-11-24T08:01:03.441 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:03.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.645+0000 7f3063000640 1 Processor -- start 2023-11-24T08:01:03.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.646+0000 7f3063000640 1 -- start start 2023-11-24T08:01:03.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.647+0000 7f3063000640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f305c15c300 0x7f305c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.647+0000 7f3063000640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c0c6060 con 0x7f305c0b34e0 2023-11-24T08:01:03.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.647+0000 7f3063000640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305c0cf710 con 0x7f305c159040 2023-11-24T08:01:03.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.647+0000 7f3063000640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305c0c62d0 con 0x7f305c15c300 2023-11-24T08:01:03.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f306159d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f305c0b34e0 0x7f305c0d0b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47674/0 (socket says 172.21.15.161:47674) 2023-11-24T08:01:03.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f306159d640 1 -- 172.21.15.161:0/3014698692 learned_addr learned my addr 172.21.15.161:0/3014698692 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204126984 0 0) 0x7f305c0c6060 con 0x7f305c0b34e0 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3048003520 con 0x7f305c0b34e0 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305bfff640 1 --2- 172.21.15.161:0/3014698692 >> v2:172.21.15.175:3300/0 conn(0x7f305c15c300 0x7f305c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1074579341 0 0) 0x7f3048003520 con 0x7f305c0b34e0 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 >> v2:172.21.15.175:3300/0 conn(0x7f305c15c300 msgr2=0x7f305c15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 --2- 172.21.15.161:0/3014698692 >> v2:172.21.15.175:3300/0 conn(0x7f305c15c300 0x7f305c15f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 >> v1:172.21.15.175:6789/0 conn(0x7f305c159040 legacy=0x7f305c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0c65b0 con 0x7f305c0b34e0 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f3054001670 con 0x7f305c0b34e0 2023-11-24T08:01:03.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305bfff640 1 --2- 172.21.15.161:0/3014698692 >> v2:172.21.15.175:3300/0 conn(0x7f305c15c300 0x7f305c15f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.648+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 >> v1:172.21.15.161:6789/0 conn(0x7f305c0b34e0 legacy=0x7f305c0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305b7fe640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480039c0 0x7f3048003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305b7fe640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30480047c0 0x7f3048004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305b7fe640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048005380 0x7f304800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0c62d0 con 0x7f30480047c0 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304800c1f0 con 0x7f3048005380 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304800c3b0 con 0x7f30480039c0 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305bfff640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30480047c0 0x7f3048004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f306159d640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048005380 0x7f304800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f3060d9c640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480039c0 0x7f3048003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305bfff640 1 -- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480039c0 msgr2=0x7f3048003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305bfff640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480039c0 0x7f3048003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305bfff640 1 -- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048005380 msgr2=0x7f304800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305bfff640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3048005380 0x7f304800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f305bfff640 1 -- 172.21.15.161:0/3014698692 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3048003520 con 0x7f30480047c0 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f306159d640 1 -- 172.21.15.161:0/3014698692 reap_dead start 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.649+0000 7f3060d9c640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30480039c0 0x7f3048003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f305bfff640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30480047c0 0x7f3048004c40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c490 tx=0x7f30480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87aa43e5582e41c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c0335f0 con 0x7f30480047c0 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c033750 con 0x7f30480047c0 2023-11-24T08:01:03.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f305b7fe640 1 -- 172.21.15.161:0/3014698692 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c033b00 con 0x7f30480047c0 2023-11-24T08:01:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f3063000640 1 -- 172.21.15.161:0/3014698692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30480047c0 msgr2=0x7f3048004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f3063000640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30480047c0 0x7f3048004c40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f304c00c490 tx=0x7f30480057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f3063000640 1 -- 172.21.15.161:0/3014698692 shutdown_connections 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f3063000640 1 --2- 172.21.15.161:0/3014698692 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30480047c0 0x7f3048004c40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f3063000640 1 -- 172.21.15.161:0/3014698692 >> 172.21.15.161:0/3014698692 conn(0x7f305c066690 msgr2=0x7f305c06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.651+0000 7f3063000640 1 -- 172.21.15.161:0/3014698692 shutdown_connections 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.652+0000 7f3063000640 1 -- 172.21.15.161:0/3014698692 wait complete. 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.653+0000 7f3063000640 1 Processor -- start 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.653+0000 7f3063000640 1 -- start start 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.654+0000 7f3063000640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30480047c0 0x7f305c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.654+0000 7f3063000640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 0x7f305c06c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.654+0000 7f3063000640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c06c8d0 0x7f305c06cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.654+0000 7f3063000640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c1480f0 con 0x7f305c147c90 2023-11-24T08:01:03.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.654+0000 7f3063000640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c06bd00 con 0x7f30480047c0 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.654+0000 7f3063000640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305c0b2650 con 0x7f305c06c8d0 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 0x7f305c06c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 0x7f305c06c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55018/0 (socket says 172.21.15.161:55018) 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 -- 172.21.15.161:0/478436321 learned_addr learned my addr 172.21.15.161:0/478436321 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f306159d640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c06c8d0 0x7f305c06cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f3060d9c640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30480047c0 0x7f305c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 -- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c06c8d0 msgr2=0x7f305c06cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c06c8d0 0x7f305c06cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 -- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30480047c0 msgr2=0x7f305c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30480047c0 0x7f305c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f305bfff640 1 -- 172.21.15.161:0/478436321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305c0c8cc0 con 0x7f305c147c90 2023-11-24T08:01:03.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.655+0000 7f3060d9c640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30480047c0 0x7f305c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:03.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.656+0000 7f305bfff640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 0x7f305c06c390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f304c035040 tx=0x7f304c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.656+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c045410 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.656+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304c045570 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.656+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304c045920 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.656+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c0c8fa0 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.656+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c0c9560 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.657+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f305c074a50 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.658+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f304c03c3f0 con 0x7f305c147c90 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.659+0000 7f30597fa640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303c06add0 0x7f303c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:03.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.659+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f304c030050 con 0x7f305c147c90 2023-11-24T08:01:03.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.659+0000 7f3060d9c640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303c06add0 0x7f303c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:03.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.660+0000 7f3060d9c640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303c06add0 0x7f303c06d290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f305c0695b0 tx=0x7f3044009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:03.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.663+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f304c077140 con 0x7f305c147c90 2023-11-24T08:01:03.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.856+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f305c0c96f0 con 0x7f305c147c90 2023-11-24T08:01:03.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.856+0000 7f30597fa640 1 -- 172.21.15.161:0/478436321 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f304c04a0a0 con 0x7f305c147c90 2023-11-24T08:01:03.859 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:03.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303c06add0 msgr2=0x7f303c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303c06add0 0x7f303c06d290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f305c0695b0 tx=0x7f3044009040 comp rx=0 tx=0).stop 2023-11-24T08:01:03.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 msgr2=0x7f305c06c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:03.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 0x7f305c06c390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f304c035040 tx=0x7f304c004ab0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 shutdown_connections 2023-11-24T08:01:03.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303c06add0 0x7f303c06d290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305c06c8d0 0x7f305c06cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305c147c90 0x7f305c06c390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.859+0000 7f3063000640 1 --2- 172.21.15.161:0/478436321 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30480047c0 0x7f305c0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:03.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.860+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 >> 172.21.15.161:0/478436321 conn(0x7f305c066690 msgr2=0x7f305c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:03.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.860+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 shutdown_connections 2023-11-24T08:01:03.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:03.860+0000 7f3063000640 1 -- 172.21.15.161:0/478436321 wait complete. 2023-11-24T08:01:03.879 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:04.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.092+0000 7f2bcab8a640 1 Processor -- start 2023-11-24T08:01:04.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.092+0000 7f2bcab8a640 1 -- start start 2023-11-24T08:01:04.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.093+0000 7f2bcab8a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2bc4143ae0 0x7f2bc40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.093+0000 7f2bcab8a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40cfc30 con 0x7f2bc40cf7d0 2023-11-24T08:01:04.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.093+0000 7f2bcab8a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40b1ee0 con 0x7f2bc415e3b0 2023-11-24T08:01:04.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.093+0000 7f2bcab8a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40b2780 con 0x7f2bc4143ae0 2023-11-24T08:01:04.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2bc40cf7d0 0x7f2bc415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47690/0 (socket says 172.21.15.161:47690) 2023-11-24T08:01:04.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc3fff640 1 -- 172.21.15.161:0/252557573 learned_addr learned my addr 172.21.15.161:0/252557573 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:04.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc8926640 1 --2- 172.21.15.161:0/252557573 >> v2:172.21.15.161:3300/0 conn(0x7f2bc4143ae0 0x7f2bc40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc8926640 1 -- 172.21.15.161:0/252557573 >> v1:172.21.15.175:6789/0 conn(0x7f2bc415e3b0 legacy=0x7f2bc40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:04.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc8926640 1 -- 172.21.15.161:0/252557573 >> v1:172.21.15.161:6789/0 conn(0x7f2bc40cf7d0 legacy=0x7f2bc415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc8926640 1 -- 172.21.15.161:0/252557573 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc415e990 con 0x7f2bc4143ae0 2023-11-24T08:01:04.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.094+0000 7f2bc37fe640 1 -- 172.21.15.161:0/252557573 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447113713 0 0) 0x7f2bc40cfc30 con 0x7f2bc40cf7d0 2023-11-24T08:01:04.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.095+0000 7f2bc8926640 1 --2- 172.21.15.161:0/252557573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cf290 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80097a0 tx=0x7f2bb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41bc774a71c014b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:04.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bc37fe640 1 -- 172.21.15.161:0/252557573 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8031830 con 0x7f2bc4143ae0 2023-11-24T08:01:04.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bc37fe640 1 -- 172.21.15.161:0/252557573 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb8031990 con 0x7f2bc4143ae0 2023-11-24T08:01:04.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bc37fe640 1 -- 172.21.15.161:0/252557573 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8031d20 con 0x7f2bc4143ae0 2023-11-24T08:01:04.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bcab8a640 1 -- 172.21.15.161:0/252557573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 msgr2=0x7f2bc40cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/252557573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cf290 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2bb80097a0 tx=0x7f2bb802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bcab8a640 1 -- 172.21.15.161:0/252557573 shutdown_connections 2023-11-24T08:01:04.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/252557573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cf290 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bcab8a640 1 -- 172.21.15.161:0/252557573 >> 172.21.15.161:0/252557573 conn(0x7f2bc406a800 msgr2=0x7f2bc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:04.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.096+0000 7f2bcab8a640 1 -- 172.21.15.161:0/252557573 shutdown_connections 2023-11-24T08:01:04.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.097+0000 7f2bcab8a640 1 -- 172.21.15.161:0/252557573 wait complete. 2023-11-24T08:01:04.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.098+0000 7f2bcab8a640 1 Processor -- start 2023-11-24T08:01:04.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.098+0000 7f2bcab8a640 1 -- start start 2023-11-24T08:01:04.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bcab8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc40cf7d0 0x7f2bc413cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bcab8a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bcab8a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc415e3b0 0x7f2bc413db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bcab8a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40ceb40 con 0x7f2bc4143ae0 2023-11-24T08:01:04.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bcab8a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40ce370 con 0x7f2bc415e3b0 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bcab8a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc413d6a0 con 0x7f2bc40cf7d0 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.099+0000 7f2bc3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55036/0 (socket says 172.21.15.161:55036) 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 -- 172.21.15.161:0/1416967957 learned_addr learned my addr 172.21.15.161:0/1416967957 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 -- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc40cf7d0 msgr2=0x7f2bc413cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc40cf7d0 0x7f2bc413cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 -- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc415e3b0 msgr2=0x7f2bc413db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc415e3b0 0x7f2bc413db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 -- 172.21.15.161:0/1416967957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb8009400 con 0x7f2bc4143ae0 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc3fff640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cde30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c4d0 tx=0x7f2bb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:04.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00074e0 con 0x7f2bc4143ae0 2023-11-24T08:01:04.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb0007660 con 0x7f2bc4143ae0 2023-11-24T08:01:04.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0004a20 con 0x7f2bc4143ae0 2023-11-24T08:01:04.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.100+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc40ce580 con 0x7f2bc4143ae0 2023-11-24T08:01:04.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.101+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc413d330 con 0x7f2bc4143ae0 2023-11-24T08:01:04.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.102+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc413d190 con 0x7f2bc4143ae0 2023-11-24T08:01:04.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.102+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2bb0004b80 con 0x7f2bc4143ae0 2023-11-24T08:01:04.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.103+0000 7f2bc17fa640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ba806ae40 0x7f2ba806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.104+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bb0088770 con 0x7f2bc4143ae0 2023-11-24T08:01:04.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.104+0000 7f2bc8926640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ba806ae40 0x7f2ba806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.105+0000 7f2bc8926640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ba806ae40 0x7f2ba806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8036000 tx=0x7f2bb8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:04.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.108+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2bc413d190 con 0x7f2bc4143ae0 2023-11-24T08:01:04.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.299+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2bc413d190 con 0x7f2bc4143ae0 2023-11-24T08:01:04.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.300+0000 7f2bc17fa640 1 -- 172.21.15.161:0/1416967957 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2bc413d190 con 0x7f2bc4143ae0 2023-11-24T08:01:04.302 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:04.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.302+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ba806ae40 msgr2=0x7f2ba806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.302+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ba806ae40 0x7f2ba806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2bb8036000 tx=0x7f2bb8030000 comp rx=0 tx=0).stop 2023-11-24T08:01:04.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.302+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 msgr2=0x7f2bc40cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cde30 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2bb000c4d0 tx=0x7f2bb000c990 comp rx=0 tx=0).stop 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 shutdown_connections 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ba806ae40 0x7f2ba806d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bc415e3b0 0x7f2bc413db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2bc4143ae0 0x7f2bc40cde30 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 --2- 172.21.15.161:0/1416967957 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bc40cf7d0 0x7f2bc413cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 >> 172.21.15.161:0/1416967957 conn(0x7f2bc406a800 msgr2=0x7f2bc4142cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 shutdown_connections 2023-11-24T08:01:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.303+0000 7f2bcab8a640 1 -- 172.21.15.161:0/1416967957 wait complete. 2023-11-24T08:01:04.322 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:04.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.534+0000 7f19fcf33640 1 Processor -- start 2023-11-24T08:01:04.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.534+0000 7f19fcf33640 1 -- start start 2023-11-24T08:01:04.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.536+0000 7f19fcf33640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19f80ae5a0 0x7f19f815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.536+0000 7f19fcf33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 0x7f19f806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.536+0000 7f19fcf33640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f8070c40 con 0x7f19f806d120 2023-11-24T08:01:04.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.536+0000 7f19fcf33640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f8071450 con 0x7f19f80ae5a0 2023-11-24T08:01:04.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.536+0000 7f19fcf33640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f806c470 con 0x7f19f80b3ae0 2023-11-24T08:01:04.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.537+0000 7f19edd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 0x7f19f806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.537+0000 7f19edd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 0x7f19f806cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:57816/0 (socket says 172.21.15.161:57816) 2023-11-24T08:01:04.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.537+0000 7f19edd9b640 1 -- 172.21.15.161:0/3945058328 learned_addr learned my addr 172.21.15.161:0/3945058328 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:04.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.537+0000 7f19f659c640 1 --2- 172.21.15.161:0/3945058328 >> v2:172.21.15.175:3300/0 conn(0x7f19f80ae5a0 0x7f19f815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.538+0000 7f19edd9b640 1 -- 172.21.15.161:0/3945058328 >> v2:172.21.15.175:3300/0 conn(0x7f19f80ae5a0 msgr2=0x7f19f815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:04.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.538+0000 7f19edd9b640 1 --2- 172.21.15.161:0/3945058328 >> v2:172.21.15.175:3300/0 conn(0x7f19f80ae5a0 0x7f19f815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.538+0000 7f19edd9b640 1 -- 172.21.15.161:0/3945058328 >> v1:172.21.15.175:6789/0 conn(0x7f19f806d120 legacy=0x7f19f80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.538+0000 7f19edd9b640 1 -- 172.21.15.161:0/3945058328 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f806c750 con 0x7f19f80b3ae0 2023-11-24T08:01:04.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.538+0000 7f19f5d9b640 1 -- 172.21.15.161:0/3945058328 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483887141 0 0) 0x7f19f8070c40 con 0x7f19f806d120 2023-11-24T08:01:04.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.539+0000 7f19edd9b640 1 --2- 172.21.15.161:0/3945058328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 0x7f19f806cbe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009870 tx=0x7f19e002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c042cca3c20f06d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:04.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.540+0000 7f19f5d9b640 1 -- 172.21.15.161:0/3945058328 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0030840 con 0x7f19f80b3ae0 2023-11-24T08:01:04.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.540+0000 7f19f5d9b640 1 -- 172.21.15.161:0/3945058328 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00309a0 con 0x7f19f80b3ae0 2023-11-24T08:01:04.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.540+0000 7f19f5d9b640 1 -- 172.21.15.161:0/3945058328 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0030d30 con 0x7f19f80b3ae0 2023-11-24T08:01:04.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.540+0000 7f19fcf33640 1 -- 172.21.15.161:0/3945058328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 msgr2=0x7f19f806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.540+0000 7f19fcf33640 1 --2- 172.21.15.161:0/3945058328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 0x7f19f806cbe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009870 tx=0x7f19e002b980 comp rx=0 tx=0).stop 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.541+0000 7f19fcf33640 1 -- 172.21.15.161:0/3945058328 shutdown_connections 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.541+0000 7f19fcf33640 1 --2- 172.21.15.161:0/3945058328 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80b3ae0 0x7f19f806cbe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.541+0000 7f19fcf33640 1 --2- 172.21.15.161:0/3945058328 >> v2:172.21.15.175:3300/0 conn(0x7f19f80ae5a0 0x7f19f815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.541+0000 7f19fcf33640 1 -- 172.21.15.161:0/3945058328 >> 172.21.15.161:0/3945058328 conn(0x7f19f806a800 msgr2=0x7f19f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.541+0000 7f19fcf33640 1 -- 172.21.15.161:0/3945058328 shutdown_connections 2023-11-24T08:01:04.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.541+0000 7f19fcf33640 1 -- 172.21.15.161:0/3945058328 wait complete. 2023-11-24T08:01:04.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.543+0000 7f19fcf33640 1 Processor -- start 2023-11-24T08:01:04.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.543+0000 7f19fcf33640 1 -- start start 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19fcf33640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 0x7f19f8155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19fcf33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80ae5a0 0x7f19f8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19fcf33640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f80b3ae0 0x7f19f80b24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19fcf33640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8158710 con 0x7f19f806d120 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19fcf33640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8158280 con 0x7f19f80b3ae0 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19fcf33640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f8157670 con 0x7f19f80ae5a0 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19f659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 0x7f19f8155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19f659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 0x7f19f8155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55038/0 (socket says 172.21.15.161:55038) 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.544+0000 7f19f659c640 1 -- 172.21.15.161:0/2113591599 learned_addr learned my addr 172.21.15.161:0/2113591599 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:04.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19edd9b640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80ae5a0 0x7f19f8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19f659c640 1 -- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80ae5a0 msgr2=0x7f19f8156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19f659c640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80ae5a0 0x7f19f8156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19f659c640 1 -- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f80b3ae0 msgr2=0x7f19f80b24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19f659c640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f80b3ae0 0x7f19f80b24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19f659c640 1 -- 172.21.15.161:0/2113591599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00094d0 con 0x7f19f806d120 2023-11-24T08:01:04.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19edd9b640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80ae5a0 0x7f19f8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:04.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19f659c640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 0x7f19f8155ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19e800e9b0 tx=0x7f19e800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:04.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8009670 con 0x7f19f806d120 2023-11-24T08:01:04.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e800c9a0 con 0x7f19f806d120 2023-11-24T08:01:04.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e800cd50 con 0x7f19f806d120 2023-11-24T08:01:04.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f8157950 con 0x7f19f806d120 2023-11-24T08:01:04.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.545+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f8157f10 con 0x7f19f806d120 2023-11-24T08:01:04.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.546+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f80675d0 con 0x7f19f806d120 2023-11-24T08:01:04.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.547+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f19e8013470 con 0x7f19f806d120 2023-11-24T08:01:04.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.548+0000 7f19ef7fe640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19d806ae70 0x7f19d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.548+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e80897b0 con 0x7f19f806d120 2023-11-24T08:01:04.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.549+0000 7f19edd9b640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19d806ae70 0x7f19d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.550+0000 7f19edd9b640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19d806ae70 0x7f19d806d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19e0036000 tx=0x7f19e003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:04.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.553+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19e80548f0 con 0x7f19f806d120 2023-11-24T08:01:04.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.747+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f815e4a0 con 0x7f19f806d120 2023-11-24T08:01:04.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.750+0000 7f19ef7fe640 1 -- 172.21.15.161:0/2113591599 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f19e8057f10 con 0x7f19f806d120 2023-11-24T08:01:04.753 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:04.753 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":22,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:00:27.748290+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:04.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19d806ae70 msgr2=0x7f19d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19d806ae70 0x7f19d806d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19e0036000 tx=0x7f19e003b040 comp rx=0 tx=0).stop 2023-11-24T08:01:04.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 msgr2=0x7f19f8155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:04.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 0x7f19f8155ce0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f19e800e9b0 tx=0x7f19e800ee70 comp rx=0 tx=0).stop 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 shutdown_connections 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19d806ae70 0x7f19d806d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f80b3ae0 0x7f19f80b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f80ae5a0 0x7f19f8156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 --2- 172.21.15.161:0/2113591599 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f806d120 0x7f19f8155ce0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 >> 172.21.15.161:0/2113591599 conn(0x7f19f806a800 msgr2=0x7f19f80acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 shutdown_connections 2023-11-24T08:01:04.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.753+0000 7f19fcf33640 1 -- 172.21.15.161:0/2113591599 wait complete. 2023-11-24T08:01:04.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:04.775 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:04.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.994+0000 7ff5afe15640 1 Processor -- start 2023-11-24T08:01:04.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.994+0000 7ff5afe15640 1 -- start start 2023-11-24T08:01:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5afe15640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff5a814b2c0 0x7ff5a80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5afe15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a8070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5afe15640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a80cfbf0 con 0x7ff5a8070ea0 2023-11-24T08:01:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5afe15640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a814b6a0 con 0x7ff5a814b2c0 2023-11-24T08:01:04.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5afe15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8071690 con 0x7ff5a80cf7d0 2023-11-24T08:01:04.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5adbb1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff5a814b2c0 0x7ff5a80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:04.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5ae3b2640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff5a8070ea0 0x7ff5a80b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47696/0 (socket says 172.21.15.161:47696) 2023-11-24T08:01:05.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.996+0000 7ff5ae3b2640 1 -- 172.21.15.161:0/1830624365 learned_addr learned my addr 172.21.15.161:0/1830624365 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:05.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.997+0000 7ff5ad3b0640 1 --2- 172.21.15.161:0/1830624365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a8070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.997+0000 7ff5adbb1640 1 -- 172.21.15.161:0/1830624365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 msgr2=0x7ff5a8070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.997+0000 7ff5adbb1640 1 --2- 172.21.15.161:0/1830624365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a8070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.997+0000 7ff5adbb1640 1 -- 172.21.15.161:0/1830624365 >> v1:172.21.15.161:6789/0 conn(0x7ff5a8070ea0 legacy=0x7ff5a80b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.997+0000 7ff5adbb1640 1 -- 172.21.15.161:0/1830624365 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8071970 con 0x7ff5a814b2c0 2023-11-24T08:01:05.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.998+0000 7ff5adbb1640 1 --2- 172.21.15.161:0/1830624365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a814b2c0 0x7ff5a80cf290 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40097a0 tx=0x7ff5a402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0ea7240fc51312 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.998+0000 7ff5acbaf640 1 -- 172.21.15.161:0/1830624365 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a402d040 con 0x7ff5a814b2c0 2023-11-24T08:01:05.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.998+0000 7ff5acbaf640 1 -- 172.21.15.161:0/1830624365 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a4031810 con 0x7ff5a814b2c0 2023-11-24T08:01:05.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.998+0000 7ff5acbaf640 1 -- 172.21.15.161:0/1830624365 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4031ba0 con 0x7ff5a814b2c0 2023-11-24T08:01:05.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 -- 172.21.15.161:0/1830624365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a814b2c0 msgr2=0x7ff5a80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 --2- 172.21.15.161:0/1830624365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a814b2c0 0x7ff5a80cf290 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40097a0 tx=0x7ff5a402b8b0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 -- 172.21.15.161:0/1830624365 shutdown_connections 2023-11-24T08:01:05.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 --2- 172.21.15.161:0/1830624365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a8070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 --2- 172.21.15.161:0/1830624365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a814b2c0 0x7ff5a80cf290 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 -- 172.21.15.161:0/1830624365 >> 172.21.15.161:0/1830624365 conn(0x7ff5a806a800 msgr2=0x7ff5a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:05.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 -- 172.21.15.161:0/1830624365 shutdown_connections 2023-11-24T08:01:05.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:04.999+0000 7ff5afe15640 1 -- 172.21.15.161:0/1830624365 wait complete. 2023-11-24T08:01:05.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.001+0000 7ff5afe15640 1 Processor -- start 2023-11-24T08:01:05.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.001+0000 7ff5afe15640 1 -- start start 2023-11-24T08:01:05.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5afe15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 0x7ff5a815e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5afe15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a81463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5afe15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a814b2c0 0x7ff5a81437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5afe15640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8161ff0 con 0x7ff5a8070ea0 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5afe15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a81622b0 con 0x7ff5a814b2c0 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5afe15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a8162590 con 0x7ff5a80cf7d0 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5adbb1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 0x7ff5a815e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5adbb1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 0x7ff5a815e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55060/0 (socket says 172.21.15.161:55060) 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.002+0000 7ff5adbb1640 1 -- 172.21.15.161:0/2863573257 learned_addr learned my addr 172.21.15.161:0/2863573257 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5ae3b2640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a814b2c0 0x7ff5a81437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5ad3b0640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a81463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5adbb1640 1 -- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 msgr2=0x7ff5a81463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5adbb1640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a81463e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5adbb1640 1 -- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a814b2c0 msgr2=0x7ff5a81437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5adbb1640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a814b2c0 0x7ff5a81437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5adbb1640 1 -- 172.21.15.161:0/2863573257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009400 con 0x7ff5a8070ea0 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5ae3b2640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a814b2c0 0x7ff5a81437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5adbb1640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 0x7ff5a815e510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c00 tx=0x7ff5a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a403ad60 con 0x7ff5a8070ea0 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40443f0 con 0x7ff5a8070ea0 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a8162870 con 0x7ff5a8070ea0 2023-11-24T08:01:05.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.003+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40447a0 con 0x7ff5a8070ea0 2023-11-24T08:01:05.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.004+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a8163c20 con 0x7ff5a8070ea0 2023-11-24T08:01:05.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.005+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a80675d0 con 0x7ff5a8070ea0 2023-11-24T08:01:05.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.005+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5a404d450 con 0x7ff5a8070ea0 2023-11-24T08:01:05.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.006+0000 7ff59e7fc640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58c06ae40 0x7ff58c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.007+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5a40ab7d0 con 0x7ff5a8070ea0 2023-11-24T08:01:05.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.007+0000 7ff5ad3b0640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58c06ae40 0x7ff58c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.008+0000 7ff5ad3b0640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58c06ae40 0x7ff58c06d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80cf5b0 tx=0x7ff598008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.011+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5a4076910 con 0x7ff5a8070ea0 2023-11-24T08:01:05.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.204+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff5a8164240 con 0x7ff5a8070ea0 2023-11-24T08:01:05.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.205+0000 7ff59e7fc640 1 -- 172.21.15.161:0/2863573257 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff5a40350a0 con 0x7ff5a8070ea0 2023-11-24T08:01:05.207 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:05.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58c06ae40 msgr2=0x7ff58c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58c06ae40 0x7ff58c06d300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff5a80cf5b0 tx=0x7ff598008040 comp rx=0 tx=0).stop 2023-11-24T08:01:05.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 msgr2=0x7ff5a815e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 0x7ff5a815e510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c00 tx=0x7ff5a40046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 shutdown_connections 2023-11-24T08:01:05.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58c06ae40 0x7ff58c06d300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a814b2c0 0x7ff5a81437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a80cf7d0 0x7ff5a81463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 --2- 172.21.15.161:0/2863573257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a8070ea0 0x7ff5a815e510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.208+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 >> 172.21.15.161:0/2863573257 conn(0x7ff5a806a800 msgr2=0x7ff5a80b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:05.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.209+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 shutdown_connections 2023-11-24T08:01:05.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.209+0000 7ff5afe15640 1 -- 172.21.15.161:0/2863573257 wait complete. 2023-11-24T08:01:05.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:05.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.450+0000 7fbc3a2ad640 1 Processor -- start 2023-11-24T08:01:05.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.450+0000 7fbc3a2ad640 1 -- start start 2023-11-24T08:01:05.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.451+0000 7fbc3a2ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc340ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.451+0000 7fbc3a2ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc340d0de0 con 0x7fbc340b2a00 2023-11-24T08:01:05.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.451+0000 7fbc3a2ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc340d10c0 con 0x7fbc34160f80 2023-11-24T08:01:05.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.451+0000 7fbc3a2ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340d13a0 con 0x7fbc340ce8f0 2023-11-24T08:01:05.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.452+0000 7fbc3884a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbc340b2a00 0x7fbc340b2e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47700/0 (socket says 172.21.15.161:47700) 2023-11-24T08:01:05.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.452+0000 7fbc3884a640 1 -- 172.21.15.161:0/2994076965 learned_addr learned my addr 172.21.15.161:0/2994076965 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:05.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.452+0000 7fbc337fe640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc340ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.452+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002904074 0 0) 0x7fbc340d0de0 con 0x7fbc340b2a00 2023-11-24T08:01:05.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.452+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc20003520 con 0x7fbc340b2a00 2023-11-24T08:01:05.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399077836 0 0) 0x7fbc20003520 con 0x7fbc340b2a00 2023-11-24T08:01:05.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 msgr2=0x7fbc340ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc340ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 >> v1:172.21.15.175:6789/0 conn(0x7fbc34160f80 legacy=0x7fbc34161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340d1680 con 0x7fbc340b2a00 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fbc2c001670 con 0x7fbc340b2a00 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 >> v1:172.21.15.161:6789/0 conn(0x7fbc340b2a00 legacy=0x7fbc340b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc200039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc20004d00 0x7fbc20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340d13a0 con 0x7fbc20003ee0 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2000b9e0 con 0x7fbc20004d00 2023-11-24T08:01:05.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2000bba0 con 0x7fbc340ce8f0 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc337fe640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc3884a640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc20004d00 0x7fbc20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.453+0000 7fbc33fff640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc200039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc337fe640 1 -- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 msgr2=0x7fbc200039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc337fe640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc200039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc337fe640 1 -- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc20004d00 msgr2=0x7fbc20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc337fe640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc20004d00 0x7fbc20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc337fe640 1 -- 172.21.15.161:0/2994076965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc20003520 con 0x7fbc20003ee0 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc3884a640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc20004d00 0x7fbc20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.454+0000 7fbc33fff640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340ce8f0 0x7fbc200039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:05.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.455+0000 7fbc337fe640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc200047c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009ac0 tx=0x7fbc200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5553563fcf3b0c9f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.455+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c02c600 con 0x7fbc20003ee0 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.455+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c02c760 con 0x7fbc20003ee0 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.455+0000 7fbc32ffd640 1 -- 172.21.15.161:0/2994076965 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c02caf0 con 0x7fbc20003ee0 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.455+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/2994076965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 msgr2=0x7fbc200047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.455+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/2994076965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc200047c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009ac0 tx=0x7fbc200057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.456+0000 7fbc3884a640 1 -- 172.21.15.161:0/2994076965 reap_dead start 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.456+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/2994076965 shutdown_connections 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.456+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/2994076965 >> 172.21.15.161:0/2994076965 conn(0x7fbc3409c550 msgr2=0x7fbc340d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.456+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/2994076965 shutdown_connections 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.456+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/2994076965 wait complete. 2023-11-24T08:01:05.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.457+0000 7fbc3a2ad640 1 Processor -- start 2023-11-24T08:01:05.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.458+0000 7fbc3a2ad640 1 -- start start 2023-11-24T08:01:05.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.458+0000 7fbc3a2ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc341552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.458+0000 7fbc3a2ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc340c6d40 0x7fbc3415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc3a2ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340c82c0 0x7fbc340b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc3a2ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc34155830 con 0x7fbc20003ee0 2023-11-24T08:01:05.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc3a2ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c7240 con 0x7fbc340c6d40 2023-11-24T08:01:05.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc3a2ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc340c7520 con 0x7fbc340c82c0 2023-11-24T08:01:05.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc341552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc341552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55064/0 (socket says 172.21.15.161:55064) 2023-11-24T08:01:05.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 -- 172.21.15.161:0/1383323853 learned_addr learned my addr 172.21.15.161:0/1383323853 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:05.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc337fe640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc340c6d40 0x7fbc3415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc3884a640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340c82c0 0x7fbc340b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 -- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340c82c0 msgr2=0x7fbc340b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340c82c0 0x7fbc340b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 -- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc340c6d40 msgr2=0x7fbc3415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc340c6d40 0x7fbc3415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.459+0000 7fbc33fff640 1 -- 172.21.15.161:0/1383323853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc340c7800 con 0x7fbc20003ee0 2023-11-24T08:01:05.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.460+0000 7fbc33fff640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc341552f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400db60 tx=0x7fbc2400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.460+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24017070 con 0x7fbc20003ee0 2023-11-24T08:01:05.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.460+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2400de60 con 0x7fbc20003ee0 2023-11-24T08:01:05.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.460+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2400bdf0 con 0x7fbc20003ee0 2023-11-24T08:01:05.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.460+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc340c7ae0 con 0x7fbc20003ee0 2023-11-24T08:01:05.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.460+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3415c290 con 0x7fbc20003ee0 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.461+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc340675d0 con 0x7fbc20003ee0 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.462+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc24006b50 con 0x7fbc20003ee0 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.463+0000 7fbc30ff9640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc1406ae40 0x7fbc1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.463+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc24089330 con 0x7fbc20003ee0 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.463+0000 7fbc337fe640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc1406ae40 0x7fbc1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.464+0000 7fbc337fe640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc1406ae40 0x7fbc1406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c036000 tx=0x7fbc1c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.467+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc240543e0 con 0x7fbc20003ee0 2023-11-24T08:01:05.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.668+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbc340d3920 con 0x7fbc20003ee0 2023-11-24T08:01:05.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.669+0000 7fbc30ff9640 1 -- 172.21.15.161:0/1383323853 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbc24057a00 con 0x7fbc20003ee0 2023-11-24T08:01:05.671 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.671+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc1406ae40 msgr2=0x7fbc1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.671+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc1406ae40 0x7fbc1406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c036000 tx=0x7fbc1c030000 comp rx=0 tx=0).stop 2023-11-24T08:01:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.671+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 msgr2=0x7fbc341552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.671+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc341552f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400db60 tx=0x7fbc2400b4a0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.671+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 shutdown_connections 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.671+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc1406ae40 0x7fbc1406d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.672+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc340c82c0 0x7fbc340b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.672+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc340c6d40 0x7fbc3415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.672+0000 7fbc3a2ad640 1 --2- 172.21.15.161:0/1383323853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc20003ee0 0x7fbc341552f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.672+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 >> 172.21.15.161:0/1383323853 conn(0x7fbc3409c550 msgr2=0x7fbc340b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.672+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 shutdown_connections 2023-11-24T08:01:05.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.672+0000 7fbc3a2ad640 1 -- 172.21.15.161:0/1383323853 wait complete. 2023-11-24T08:01:05.691 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.894+0000 7f79fad41640 1 Processor -- start 2023-11-24T08:01:05.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.895+0000 7f79fad41640 1 -- start start 2023-11-24T08:01:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.896+0000 7f79fad41640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 0x7f79f40d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.896+0000 7f79fad41640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40d4160 con 0x7f79f40d3910 2023-11-24T08:01:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.896+0000 7f79fad41640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f40b2420 con 0x7f79f40cfcf0 2023-11-24T08:01:05.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.896+0000 7f79fad41640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40ceff0 con 0x7f79f4160e10 2023-11-24T08:01:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.896+0000 7f79f3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f79f40d3910 0x7f79f40d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47712/0 (socket says 172.21.15.161:47712) 2023-11-24T08:01:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.896+0000 7f79f3fff640 1 -- 172.21.15.161:0/1210202215 learned_addr learned my addr 172.21.15.161:0/1210202215 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f92de640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 0x7f79f40d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557319095 0 0) 0x7f79f40d4160 con 0x7f79f40d3910 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79e0003520 con 0x7f79f40d3910 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262660242 0 0) 0x7f79f40b2420 con 0x7f79f40cfcf0 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f40d4160 con 0x7f79f40cfcf0 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155470266 0 0) 0x7f79e0003520 con 0x7f79f40d3910 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 msgr2=0x7f79f40d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 0x7f79f40d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 >> v1:172.21.15.175:6789/0 conn(0x7f79f40cfcf0 legacy=0x7f79f4160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40b2140 con 0x7f79f40d3910 2023-11-24T08:01:05.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f79dc001670 con 0x7f79f40d3910 2023-11-24T08:01:05.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 >> v1:172.21.15.161:6789/0 conn(0x7f79f40d3910 legacy=0x7f79f40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 0x7f79e0003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.897+0000 7f79f37fe640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e00040e0 0x7f79e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f37fe640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40ceff0 con 0x7f79e0004d00 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e000bb40 con 0x7f79e00040e0 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e000bd00 con 0x7f79f4160e10 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f92de640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f8add640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 0x7f79e0003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f3fff640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e00040e0 0x7f79e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f92de640 1 -- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 msgr2=0x7f79e0003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f92de640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f4160e10 0x7f79e0003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f92de640 1 -- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e00040e0 msgr2=0x7f79e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f92de640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79e00040e0 0x7f79e00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.898+0000 7f79f92de640 1 -- 172.21.15.161:0/1210202215 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e0003520 con 0x7f79e0004d00 2023-11-24T08:01:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.899+0000 7f79f92de640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79e0005180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009a90 tx=0x7f79e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918d05733c900ebb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec02c680 con 0x7f79e0004d00 2023-11-24T08:01:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec02c7e0 con 0x7f79e0004d00 2023-11-24T08:01:05.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79f37fe640 1 -- 172.21.15.161:0/1210202215 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec02cb90 con 0x7f79e0004d00 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79fad41640 1 -- 172.21.15.161:0/1210202215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 msgr2=0x7f79e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79fad41640 1 --2- 172.21.15.161:0/1210202215 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79e0005180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009a90 tx=0x7f79e00057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79f92de640 1 -- 172.21.15.161:0/1210202215 reap_dead start 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79fad41640 1 -- 172.21.15.161:0/1210202215 shutdown_connections 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79fad41640 1 -- 172.21.15.161:0/1210202215 >> 172.21.15.161:0/1210202215 conn(0x7f79f409c530 msgr2=0x7f79f40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79fad41640 1 -- 172.21.15.161:0/1210202215 shutdown_connections 2023-11-24T08:01:05.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.900+0000 7f79fad41640 1 -- 172.21.15.161:0/1210202215 wait complete. 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.902+0000 7f79fad41640 1 Processor -- start 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.902+0000 7f79fad41640 1 -- start start 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79fad41640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79f40b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79fad41640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f40ca2d0 0x7f79f40b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79fad41640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f40b2fa0 0x7f79f40c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79fad41640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c8920 con 0x7f79e0004d00 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79fad41640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c7a30 con 0x7f79f40ca2d0 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79fad41640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f40c7d10 con 0x7f79f40b2fa0 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79f8add640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79f40b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79f8add640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79f40b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55082/0 (socket says 172.21.15.161:55082) 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.903+0000 7f79f8add640 1 -- 172.21.15.161:0/2260411108 learned_addr learned my addr 172.21.15.161:0/2260411108 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f92de640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f40b2fa0 0x7f79f40c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f3fff640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f40ca2d0 0x7f79f40b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f8add640 1 -- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f40b2fa0 msgr2=0x7f79f40c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f8add640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f40b2fa0 0x7f79f40c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f8add640 1 -- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f40ca2d0 msgr2=0x7f79f40b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f8add640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f40ca2d0 0x7f79f40b2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f8add640 1 -- 172.21.15.161:0/2260411108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f40c7ff0 con 0x7f79e0004d00 2023-11-24T08:01:05.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f8add640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79f40b6ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79e400eb20 tx=0x7f79e40020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4003b80 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4003ce0 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400c9c0 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.904+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f40c82d0 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.905+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f40b6ff0 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.906+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f40b71b0 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.907+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79e400cb20 con 0x7f79e0004d00 2023-11-24T08:01:05.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.907+0000 7f79f17fa640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79d406ae70 0x7f79d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:05.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.908+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f79e4089a30 con 0x7f79e0004d00 2023-11-24T08:01:05.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.908+0000 7f79f3fff640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79d406ae70 0x7f79d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:05.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.909+0000 7f79f3fff640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79d406ae70 0x7f79d406d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0017a0 tx=0x7f79dc001470 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:05.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:05.912+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79e40549d0 con 0x7f79e0004d00 2023-11-24T08:01:06.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.107+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79f40675d0 con 0x7f79e0004d00 2023-11-24T08:01:06.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.108+0000 7f79f17fa640 1 -- 172.21.15.161:0/2260411108 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79e4057ff0 con 0x7f79e0004d00 2023-11-24T08:01:06.110 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.110+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79d406ae70 msgr2=0x7f79d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.110+0000 7f79fad41640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79d406ae70 0x7f79d406d330 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0017a0 tx=0x7f79dc001470 comp rx=0 tx=0).stop 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 msgr2=0x7f79f40b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79f40b6ab0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f79e400eb20 tx=0x7f79e40020d0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 shutdown_connections 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79d406ae70 0x7f79d406d330 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f79f40b2fa0 0x7f79f40c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79f40ca2d0 0x7f79f40b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 --2- 172.21.15.161:0/2260411108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79e0004d00 0x7f79f40b6ab0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 >> 172.21.15.161:0/2260411108 conn(0x7f79f409c530 msgr2=0x7f79f40d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:06.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 shutdown_connections 2023-11-24T08:01:06.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.111+0000 7f79fad41640 1 -- 172.21.15.161:0/2260411108 wait complete. 2023-11-24T08:01:06.193 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2023-11-24T08:01:06.193 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:01:06.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:06.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.410+0000 7ffabdf16640 1 Processor -- start 2023-11-24T08:01:06.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.410+0000 7ffabdf16640 1 -- start start 2023-11-24T08:01:06.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.412+0000 7ffabdf16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab80cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.412+0000 7ffabdf16640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffab806d160 0x7ffab806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.412+0000 7ffabdf16640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab8070e50 con 0x7ffab8143c40 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.412+0000 7ffabdf16640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80723c0 con 0x7ffab806d160 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.412+0000 7ffabdf16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8144020 con 0x7ffab80cc500 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab80cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab80cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:57900/0 (socket says 172.21.15.161:57900) 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffabd715640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffab806d160 0x7ffab806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffabcf14640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ffab8143c40 0x7ffab8071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:36238/0 (socket says 172.21.15.161:36238) 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffab7fff640 1 -- 172.21.15.161:0/2558352402 learned_addr learned my addr 172.21.15.161:0/2558352402 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffab7fff640 1 -- 172.21.15.161:0/2558352402 >> v2:172.21.15.175:3300/0 conn(0x7ffab806d160 msgr2=0x7ffab806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffab7fff640 1 --2- 172.21.15.161:0/2558352402 >> v2:172.21.15.175:3300/0 conn(0x7ffab806d160 0x7ffab806d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.413+0000 7ffab7fff640 1 -- 172.21.15.161:0/2558352402 >> v1:172.21.15.175:6789/0 conn(0x7ffab8143c40 legacy=0x7ffab8071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.414+0000 7ffab7fff640 1 -- 172.21.15.161:0/2558352402 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80ccea0 con 0x7ffab80cc500 2023-11-24T08:01:06.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.414+0000 7ffabd715640 1 --2- 172.21.15.161:0/2558352402 >> v2:172.21.15.175:3300/0 conn(0x7ffab806d160 0x7ffab806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.415+0000 7ffab7fff640 1 --2- 172.21.15.161:0/2558352402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab80cc960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009870 tx=0x7ffaa802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=504700bf89e98ecc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.415+0000 7ffab77fe640 1 -- 172.21.15.161:0/2558352402 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8031640 con 0x7ffab80cc500 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.415+0000 7ffab77fe640 1 -- 172.21.15.161:0/2558352402 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa80317a0 con 0x7ffab80cc500 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.415+0000 7ffab77fe640 1 -- 172.21.15.161:0/2558352402 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8031b30 con 0x7ffab80cc500 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 -- 172.21.15.161:0/2558352402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 msgr2=0x7ffab80cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 --2- 172.21.15.161:0/2558352402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab80cc960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009870 tx=0x7ffaa802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 -- 172.21.15.161:0/2558352402 shutdown_connections 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 --2- 172.21.15.161:0/2558352402 >> v2:172.21.15.175:3300/0 conn(0x7ffab806d160 0x7ffab806d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 --2- 172.21.15.161:0/2558352402 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab80cc960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 -- 172.21.15.161:0/2558352402 >> 172.21.15.161:0/2558352402 conn(0x7ffab806a800 msgr2=0x7ffab806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 -- 172.21.15.161:0/2558352402 shutdown_connections 2023-11-24T08:01:06.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.416+0000 7ffabdf16640 1 -- 172.21.15.161:0/2558352402 wait complete. 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.418+0000 7ffabdf16640 1 Processor -- start 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.418+0000 7ffabdf16640 1 -- start start 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabdf16640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 0x7ffab815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabdf16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab81f3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabdf16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffab8143c40 0x7ffab81f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabdf16640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815ae30 con 0x7ffab806d160 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabdf16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ad330 con 0x7ffab8143c40 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabdf16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80b07f0 con 0x7ffab80cc500 2023-11-24T08:01:06.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabcf14640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 0x7ffab815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabcf14640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 0x7ffab815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55088/0 (socket says 172.21.15.161:55088) 2023-11-24T08:01:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabcf14640 1 -- 172.21.15.161:0/3677372298 learned_addr learned my addr 172.21.15.161:0/3677372298 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffab7fff640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab81f3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabd715640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffab8143c40 0x7ffab81f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.420+0000 7ffabcf14640 1 -- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 msgr2=0x7ffab81f3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabcf14640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab81f3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabcf14640 1 -- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffab8143c40 msgr2=0x7ffab81f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabcf14640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffab8143c40 0x7ffab81f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabcf14640 1 -- 172.21.15.161:0/3677372298 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0009a70 con 0x7ffab806d160 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabd715640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffab8143c40 0x7ffab81f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabcf14640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 0x7ffab815a8f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c3e0 tx=0x7ffaac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0074e0 con 0x7ffab806d160 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac007640 con 0x7ffab806d160 2023-11-24T08:01:06.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0049e0 con 0x7ffab806d160 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa80094d0 con 0x7ffab806d160 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.421+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab80acce0 con 0x7ffab806d160 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.423+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab80cdf30 con 0x7ffab806d160 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.424+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffaac004b40 con 0x7ffab806d160 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.424+0000 7ffab57fa640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffaa406ae40 0x7ffaa406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.425+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ffaac089090 con 0x7ffab806d160 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.425+0000 7ffab7fff640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffaa406ae40 0x7ffaa406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.426+0000 7ffab7fff640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffaa406ae40 0x7ffaa406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8036000 tx=0x7ffaa803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:06.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.429+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffaac0540b0 con 0x7ffab806d160 2023-11-24T08:01:06.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.634+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffab8067450 con 0x7ffab806d160 2023-11-24T08:01:06.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.637+0000 7ffab57fa640 1 -- 172.21.15.161:0/3677372298 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7ffaac0576d0 con 0x7ffab806d160 2023-11-24T08:01:06.639 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:06.639 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:06.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffaa406ae40 msgr2=0x7ffaa406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffaa406ae40 0x7ffaa406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8036000 tx=0x7ffaa803c040 comp rx=0 tx=0).stop 2023-11-24T08:01:06.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 msgr2=0x7ffab815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 0x7ffab815a8f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ffaac00c3e0 tx=0x7ffaac00c8a0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 shutdown_connections 2023-11-24T08:01:06.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffaa406ae40 0x7ffaa406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffab8143c40 0x7ffab81f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.639+0000 7ffabdf16640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffab80cc500 0x7ffab81f3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.640+0000 7ffabdf16640 1 --2- 172.21.15.161:0/3677372298 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffab806d160 0x7ffab815a8f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.640+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 >> 172.21.15.161:0/3677372298 conn(0x7ffab806a800 msgr2=0x7ffab8071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:06.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.640+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 shutdown_connections 2023-11-24T08:01:06.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.640+0000 7ffabdf16640 1 -- 172.21.15.161:0/3677372298 wait complete. 2023-11-24T08:01:06.659 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:06.660 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:06.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.869+0000 7ff462b5a640 1 Processor -- start 2023-11-24T08:01:06.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.869+0000 7ff462b5a640 1 -- start start 2023-11-24T08:01:06.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.870+0000 7ff462b5a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff45c0ae5a0 0x7ff45c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.870+0000 7ff462b5a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff45c0cf290 0x7ff45c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.870+0000 7ff462b5a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45c070c40 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.870+0000 7ff462b5a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c071450 con 0x7ff45c0ae5a0 2023-11-24T08:01:06.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff462b5a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff45c0cfc60 con 0x7ff45c0cf290 2023-11-24T08:01:06.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff4608f6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff45c0ae5a0 0x7ff45c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff45bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff45c0b3ae0 0x7ff45c06cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47718/0 (socket says 172.21.15.161:47718) 2023-11-24T08:01:06.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff45bfff640 1 -- 172.21.15.161:0/742933580 learned_addr learned my addr 172.21.15.161:0/742933580 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:06.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff4608f6640 1 -- 172.21.15.161:0/742933580 >> v2:172.21.15.175:3300/0 conn(0x7ff45c0cf290 msgr2=0x7ff45c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:06.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff4608f6640 1 --2- 172.21.15.161:0/742933580 >> v2:172.21.15.175:3300/0 conn(0x7ff45c0cf290 0x7ff45c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff4608f6640 1 -- 172.21.15.161:0/742933580 >> v1:172.21.15.161:6789/0 conn(0x7ff45c0b3ae0 legacy=0x7ff45c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff4608f6640 1 -- 172.21.15.161:0/742933580 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c06c470 con 0x7ff45c0ae5a0 2023-11-24T08:01:06.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.871+0000 7ff45b7fe640 1 -- 172.21.15.161:0/742933580 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483998668 0 0) 0x7ff45c070c40 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.872+0000 7ff4608f6640 1 --2- 172.21.15.161:0/742933580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c15e430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0b3f70 tx=0x7ff45002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a821b545d983b03d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:06.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff45b7fe640 1 -- 172.21.15.161:0/742933580 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450030610 con 0x7ff45c0ae5a0 2023-11-24T08:01:06.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff45b7fe640 1 -- 172.21.15.161:0/742933580 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff450030770 con 0x7ff45c0ae5a0 2023-11-24T08:01:06.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff45b7fe640 1 -- 172.21.15.161:0/742933580 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff450030b00 con 0x7ff45c0ae5a0 2023-11-24T08:01:06.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 -- 172.21.15.161:0/742933580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0ae5a0 msgr2=0x7ff45c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 --2- 172.21.15.161:0/742933580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c15e430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff45c0b3f70 tx=0x7ff45002b960 comp rx=0 tx=0).stop 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 -- 172.21.15.161:0/742933580 shutdown_connections 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 --2- 172.21.15.161:0/742933580 >> v2:172.21.15.175:3300/0 conn(0x7ff45c0cf290 0x7ff45c0cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 --2- 172.21.15.161:0/742933580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c15e430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 -- 172.21.15.161:0/742933580 >> 172.21.15.161:0/742933580 conn(0x7ff45c06a800 msgr2=0x7ff45c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 -- 172.21.15.161:0/742933580 shutdown_connections 2023-11-24T08:01:06.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.873+0000 7ff462b5a640 1 -- 172.21.15.161:0/742933580 wait complete. 2023-11-24T08:01:06.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.875+0000 7ff462b5a640 1 Processor -- start 2023-11-24T08:01:06.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.875+0000 7ff462b5a640 1 -- start start 2023-11-24T08:01:06.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff462b5a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff462b5a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 0x7ff45c14d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff462b5a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff45c0cf290 0x7ff45c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff462b5a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c14c810 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff462b5a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c15c7e0 con 0x7ff45c0ae5a0 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff462b5a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c15cac0 con 0x7ff45c0cf290 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 0x7ff45c14d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 0x7ff45c14d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55096/0 (socket says 172.21.15.161:55096) 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 -- 172.21.15.161:0/3332416942 learned_addr learned my addr 172.21.15.161:0/3332416942 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff4608f6640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 -- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff45c0cf290 msgr2=0x7ff45c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff45c0cf290 0x7ff45c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 -- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45c0ae5a0 msgr2=0x7ff45c1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c1503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.876+0000 7ff45bfff640 1 -- 172.21.15.161:0/3332416942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009400 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.877+0000 7ff45bfff640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 0x7ff45c14d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c4d0 tx=0x7ff44800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.877+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4480074e0 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.877+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff448007660 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.877+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448004a20 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.877+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c15cda0 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.877+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c15d360 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.878+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c0675d0 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.879+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff448004b80 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.880+0000 7ff4597fa640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff44006ae40 0x7ff44006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:06.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.880+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff448088830 con 0x7ff45c0b3ae0 2023-11-24T08:01:06.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.881+0000 7ff4608f6640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff44006ae40 0x7ff44006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:06.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.882+0000 7ff4608f6640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff44006ae40 0x7ff44006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff450036000 tx=0x7ff45003b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:06.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:06.885+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff448053850 con 0x7ff45c0b3ae0 2023-11-24T08:01:07.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.074+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff45c06b3f0 con 0x7ff45c0b3ae0 2023-11-24T08:01:07.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.075+0000 7ff4597fa640 1 -- 172.21.15.161:0/3332416942 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4480180a0 con 0x7ff45c0b3ae0 2023-11-24T08:01:07.077 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:07.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff44006ae40 msgr2=0x7ff44006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff44006ae40 0x7ff44006d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff450036000 tx=0x7ff45003b040 comp rx=0 tx=0).stop 2023-11-24T08:01:07.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 msgr2=0x7ff45c14d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 0x7ff45c14d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c4d0 tx=0x7ff44800c990 comp rx=0 tx=0).stop 2023-11-24T08:01:07.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 shutdown_connections 2023-11-24T08:01:07.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff44006ae40 0x7ff44006d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff45c0cf290 0x7ff45c14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff45c0b3ae0 0x7ff45c14d390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 --2- 172.21.15.161:0/3332416942 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff45c0ae5a0 0x7ff45c1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.077+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 >> 172.21.15.161:0/3332416942 conn(0x7ff45c06a800 msgr2=0x7ff45c14fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:07.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.078+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 shutdown_connections 2023-11-24T08:01:07.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.078+0000 7ff462b5a640 1 -- 172.21.15.161:0/3332416942 wait complete. 2023-11-24T08:01:07.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:07.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.313+0000 7fb81759e640 1 Processor -- start 2023-11-24T08:01:07.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.313+0000 7fb81759e640 1 -- start start 2023-11-24T08:01:07.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.314+0000 7fb81759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8180cfde0 0x7fb8180b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.314+0000 7fb81759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180d1c60 con 0x7fb8180cf9a0 2023-11-24T08:01:07.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.314+0000 7fb81759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8180b2730 con 0x7fb81815d4b0 2023-11-24T08:01:07.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.314+0000 7fb81759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8180d1ec0 con 0x7fb8180cfde0 2023-11-24T08:01:07.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb80dd9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb8180cf9a0 0x7fb8180b31d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47726/0 (socket says 172.21.15.161:47726) 2023-11-24T08:01:07.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb80dd9b640 1 -- 172.21.15.161:0/2595254011 learned_addr learned my addr 172.21.15.161:0/2595254011 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:07.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb816d9d640 1 --2- 172.21.15.161:0/2595254011 >> v2:172.21.15.161:3300/0 conn(0x7fb8180cfde0 0x7fb8180b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb815d9b640 1 -- 172.21.15.161:0/2595254011 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317871213 0 0) 0x7fb8180d1c60 con 0x7fb8180cf9a0 2023-11-24T08:01:07.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb815d9b640 1 -- 172.21.15.161:0/2595254011 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7f8003520 con 0x7fb8180cf9a0 2023-11-24T08:01:07.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb816d9d640 1 -- 172.21.15.161:0/2595254011 >> v1:172.21.15.175:6789/0 conn(0x7fb81815d4b0 legacy=0x7fb8180d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb816d9d640 1 -- 172.21.15.161:0/2595254011 >> v1:172.21.15.161:6789/0 conn(0x7fb8180cf9a0 legacy=0x7fb8180b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.315+0000 7fb816d9d640 1 -- 172.21.15.161:0/2595254011 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180b29d0 con 0x7fb8180cfde0 2023-11-24T08:01:07.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.316+0000 7fb816d9d640 1 --2- 172.21.15.161:0/2595254011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb8180b38e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d90 tx=0x7fb81002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeb7d02c90e1cea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:07.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb815d9b640 1 -- 172.21.15.161:0/2595254011 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81002cd00 con 0x7fb8180cfde0 2023-11-24T08:01:07.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb815d9b640 1 -- 172.21.15.161:0/2595254011 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81002ce60 con 0x7fb8180cfde0 2023-11-24T08:01:07.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb815d9b640 1 -- 172.21.15.161:0/2595254011 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb810034660 con 0x7fb8180cfde0 2023-11-24T08:01:07.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb81759e640 1 -- 172.21.15.161:0/2595254011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 msgr2=0x7fb8180b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb81759e640 1 --2- 172.21.15.161:0/2595254011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb8180b38e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb810009d90 tx=0x7fb81002bf50 comp rx=0 tx=0).stop 2023-11-24T08:01:07.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb81759e640 1 -- 172.21.15.161:0/2595254011 shutdown_connections 2023-11-24T08:01:07.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb81759e640 1 --2- 172.21.15.161:0/2595254011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb8180b38e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb81759e640 1 -- 172.21.15.161:0/2595254011 >> 172.21.15.161:0/2595254011 conn(0x7fb8180d3000 msgr2=0x7fb8180d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:07.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.317+0000 7fb81759e640 1 -- 172.21.15.161:0/2595254011 shutdown_connections 2023-11-24T08:01:07.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.318+0000 7fb81759e640 1 -- 172.21.15.161:0/2595254011 wait complete. 2023-11-24T08:01:07.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.319+0000 7fb81759e640 1 Processor -- start 2023-11-24T08:01:07.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.319+0000 7fb81759e640 1 -- start start 2023-11-24T08:01:07.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.320+0000 7fb81759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8180cf9a0 0x7fb8181f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.320+0000 7fb81759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb81809eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.320+0000 7fb81759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb81815d4b0 0x7fb81809f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.320+0000 7fb81759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180cafd0 con 0x7fb8180cfde0 2023-11-24T08:01:07.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.320+0000 7fb81759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180cb2b0 con 0x7fb8180cf9a0 2023-11-24T08:01:07.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.320+0000 7fb81759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8180cb590 con 0x7fb81815d4b0 2023-11-24T08:01:07.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb81809eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb81809eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55110/0 (socket says 172.21.15.161:55110) 2023-11-24T08:01:07.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 -- 172.21.15.161:0/2067772962 learned_addr learned my addr 172.21.15.161:0/2067772962 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:07.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb816d9d640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb81815d4b0 0x7fb81809f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb81659c640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8180cf9a0 0x7fb8181f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 -- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb81815d4b0 msgr2=0x7fb81809f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb81815d4b0 0x7fb81809f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 -- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8180cf9a0 msgr2=0x7fb8181f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8180cf9a0 0x7fb8181f5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 -- 172.21.15.161:0/2067772962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810009a70 con 0x7fb8180cfde0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.321+0000 7fb80dd9b640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb81809eed0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb80000c500 tx=0x7fb80000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.322+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800005ce0 con 0x7fb8180cfde0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.322+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb800005e40 con 0x7fb8180cfde0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.322+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800007330 con 0x7fb8180cfde0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.322+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8180cb870 con 0x7fb8180cfde0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.322+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8181f6140 con 0x7fb8180cfde0 2023-11-24T08:01:07.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.323+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8180cbd90 con 0x7fb8180cfde0 2023-11-24T08:01:07.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.324+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb800007490 con 0x7fb8180cfde0 2023-11-24T08:01:07.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.325+0000 7fb80f7fe640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb7fc06ae70 0x7fb7fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.325+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb800088c40 con 0x7fb8180cfde0 2023-11-24T08:01:07.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.325+0000 7fb81659c640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb7fc06ae70 0x7fb7fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.326+0000 7fb81659c640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb7fc06ae70 0x7fb7fc06d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb81806c490 tx=0x7fb808009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:07.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.329+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8180cbd90 con 0x7fb8180cfde0 2023-11-24T08:01:07.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.520+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8180cbd90 con 0x7fb8180cfde0 2023-11-24T08:01:07.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.521+0000 7fb80f7fe640 1 -- 172.21.15.161:0/2067772962 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8180cbd90 con 0x7fb8180cfde0 2023-11-24T08:01:07.523 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:07.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.523+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb7fc06ae70 msgr2=0x7fb7fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.523+0000 7fb81759e640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb7fc06ae70 0x7fb7fc06d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb81806c490 tx=0x7fb808009040 comp rx=0 tx=0).stop 2023-11-24T08:01:07.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.523+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 msgr2=0x7fb81809eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.523+0000 7fb81759e640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb81809eed0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb80000c500 tx=0x7fb80000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.523+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 shutdown_connections 2023-11-24T08:01:07.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb7fc06ae70 0x7fb7fc06d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb81815d4b0 0x7fb81809f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8180cfde0 0x7fb81809eed0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 --2- 172.21.15.161:0/2067772962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8180cf9a0 0x7fb8181f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 >> 172.21.15.161:0/2067772962 conn(0x7fb8180d3000 msgr2=0x7fb8180cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:07.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 shutdown_connections 2023-11-24T08:01:07.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.524+0000 7fb81759e640 1 -- 172.21.15.161:0/2067772962 wait complete. 2023-11-24T08:01:07.544 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.760+0000 7f4803490640 1 Processor -- start 2023-11-24T08:01:07.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.760+0000 7f4803490640 1 -- start start 2023-11-24T08:01:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f4803490640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f47fc0cf9a0 0x7f47fc070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f4803490640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc071690 con 0x7f47fc14b2c0 2023-11-24T08:01:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f4803490640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47fc071970 con 0x7f47fc070ea0 2023-11-24T08:01:07.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f4803490640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47fc14b6a0 con 0x7f47fc0cf9a0 2023-11-24T08:01:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f480122c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f47fc14b2c0 0x7f47fc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47738/0 (socket says 172.21.15.161:47738) 2023-11-24T08:01:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f480122c640 1 -- 172.21.15.161:0/1233672448 learned_addr learned my addr 172.21.15.161:0/1233672448 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.762+0000 7f4800a2b640 1 --2- 172.21.15.161:0/1233672448 >> v2:172.21.15.161:3300/0 conn(0x7f47fc0cf9a0 0x7f47fc070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.763+0000 7f4800a2b640 1 -- 172.21.15.161:0/1233672448 >> v1:172.21.15.175:6789/0 conn(0x7f47fc070ea0 legacy=0x7f47fc0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:07.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.763+0000 7f4800a2b640 1 -- 172.21.15.161:0/1233672448 >> v1:172.21.15.161:6789/0 conn(0x7f47fc14b2c0 legacy=0x7f47fc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.763+0000 7f4800a2b640 1 -- 172.21.15.161:0/1233672448 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc071c50 con 0x7f47fc0cf9a0 2023-11-24T08:01:07.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.763+0000 7f47effff640 1 -- 172.21.15.161:0/1233672448 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690687663 0 0) 0x7f47fc071690 con 0x7f47fc14b2c0 2023-11-24T08:01:07.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.764+0000 7f4800a2b640 1 --2- 172.21.15.161:0/1233672448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc070960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47f00097a0 tx=0x7f47f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db1b6ede5fc0117 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:07.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.764+0000 7f47effff640 1 -- 172.21.15.161:0/1233672448 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0031830 con 0x7f47fc0cf9a0 2023-11-24T08:01:07.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.764+0000 7f47effff640 1 -- 172.21.15.161:0/1233672448 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0031990 con 0x7f47fc0cf9a0 2023-11-24T08:01:07.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.764+0000 7f47effff640 1 -- 172.21.15.161:0/1233672448 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0031d20 con 0x7f47fc0cf9a0 2023-11-24T08:01:07.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 -- 172.21.15.161:0/1233672448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc0cf9a0 msgr2=0x7f47fc070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 --2- 172.21.15.161:0/1233672448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc070960 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f47f00097a0 tx=0x7f47f002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 -- 172.21.15.161:0/1233672448 shutdown_connections 2023-11-24T08:01:07.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 --2- 172.21.15.161:0/1233672448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc070960 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 -- 172.21.15.161:0/1233672448 >> 172.21.15.161:0/1233672448 conn(0x7f47fc06a800 msgr2=0x7f47fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:07.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 -- 172.21.15.161:0/1233672448 shutdown_connections 2023-11-24T08:01:07.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.765+0000 7f4803490640 1 -- 172.21.15.161:0/1233672448 wait complete. 2023-11-24T08:01:07.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.767+0000 7f4803490640 1 Processor -- start 2023-11-24T08:01:07.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.767+0000 7f4803490640 1 -- start start 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4803490640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 0x7f47fc15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4803490640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4803490640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc14b2c0 0x7f47fc142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4803490640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc162fb0 con 0x7f47fc070ea0 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4803490640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc149430 con 0x7f47fc0cf9a0 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4803490640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc148b90 con 0x7f47fc14b2c0 2023-11-24T08:01:07.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f480122c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 0x7f47fc15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f480122c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 0x7f47fc15f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55134/0 (socket says 172.21.15.161:55134) 2023-11-24T08:01:07.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f480122c640 1 -- 172.21.15.161:0/2764583283 learned_addr learned my addr 172.21.15.161:0/2764583283 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4800a2b640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.768+0000 7f4801a2d640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc14b2c0 0x7f47fc142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f480122c640 1 -- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc14b2c0 msgr2=0x7f47fc142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f480122c640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc14b2c0 0x7f47fc142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f480122c640 1 -- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0cf9a0 msgr2=0x7f47fc146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f480122c640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f480122c640 1 -- 172.21.15.161:0/2764583283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009400 con 0x7f47fc070ea0 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f4801a2d640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc14b2c0 0x7f47fc142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f480122c640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 0x7f47fc15f420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47f800c430 tx=0x7f47f800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80074e0 con 0x7f47fc070ea0 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f8007660 con 0x7f47fc070ea0 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8004a20 con 0x7f47fc070ea0 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc148e70 con 0x7f47fc070ea0 2023-11-24T08:01:07.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.769+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc1634a0 con 0x7f47fc070ea0 2023-11-24T08:01:07.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.770+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47fc0af5a0 con 0x7f47fc070ea0 2023-11-24T08:01:07.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.771+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47f8004b80 con 0x7f47fc070ea0 2023-11-24T08:01:07.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.772+0000 7f47edffb640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f47e006ae40 0x7f47e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:07.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.772+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f47f8089430 con 0x7f47fc070ea0 2023-11-24T08:01:07.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.773+0000 7f4800a2b640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f47e006ae40 0x7f47e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:07.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.774+0000 7f4800a2b640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f47e006ae40 0x7f47e006d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f47f0036000 tx=0x7f47f003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:07.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.777+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47f80544f0 con 0x7f47fc070ea0 2023-11-24T08:01:07.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.965+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47fc0675d0 con 0x7f47fc070ea0 2023-11-24T08:01:07.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.966+0000 7f47edffb640 1 -- 172.21.15.161:0/2764583283 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47f8057b10 con 0x7f47fc070ea0 2023-11-24T08:01:07.969 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:07.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f47e006ae40 msgr2=0x7f47e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f47e006ae40 0x7f47e006d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f47f0036000 tx=0x7f47f003c040 comp rx=0 tx=0).stop 2023-11-24T08:01:07.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 msgr2=0x7f47fc15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 0x7f47fc15f420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f47f800c430 tx=0x7f47f800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 shutdown_connections 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f47e006ae40 0x7f47e006d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f47fc14b2c0 0x7f47fc142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f47fc0cf9a0 0x7f47fc146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 --2- 172.21.15.161:0/2764583283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f47fc070ea0 0x7f47fc15f420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 >> 172.21.15.161:0/2764583283 conn(0x7f47fc06a800 msgr2=0x7f47fc0ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:07.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 shutdown_connections 2023-11-24T08:01:07.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:07.969+0000 7f4803490640 1 -- 172.21.15.161:0/2764583283 wait complete. 2023-11-24T08:01:07.991 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:01:08.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.185+0000 7fd5c09ff640 1 Processor -- start 2023-11-24T08:01:08.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.185+0000 7fd5c09ff640 1 -- start start 2023-11-24T08:01:08.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5c09ff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd5bc15afb0 0x7fd5bc13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5c09ff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5bc13ff30 con 0x7fd5bc13cfa0 2023-11-24T08:01:08.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5c09ff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5bc0cdc40 con 0x7fd5bc13fae0 2023-11-24T08:01:08.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5c09ff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5bc0cdec0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5b3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd5bc15afb0 0x7fd5bc13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5b3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd5bc15afb0 0x7fd5bc13f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55142/0 (socket says 172.21.15.161:55142) 2023-11-24T08:01:08.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5b3fff640 1 -- 172.21.15.161:0/4032835384 learned_addr learned my addr 172.21.15.161:0/4032835384 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:08.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5b3fff640 1 -- 172.21.15.161:0/4032835384 >> v1:172.21.15.175:6789/0 conn(0x7fd5bc13fae0 legacy=0x7fd5bc0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:08.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5b3fff640 1 -- 172.21.15.161:0/4032835384 >> v1:172.21.15.161:6789/0 conn(0x7fd5bc13cfa0 legacy=0x7fd5bc0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.187+0000 7fd5b3fff640 1 -- 172.21.15.161:0/4032835384 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0ce1a0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.189+0000 7fd5b3fff640 1 --2- 172.21.15.161:0/4032835384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13f5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009870 tx=0x7fd5a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b466c402bc04f81b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:08.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.189+0000 7fd5baffd640 1 -- 172.21.15.161:0/4032835384 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4031870 con 0x7fd5bc15afb0 2023-11-24T08:01:08.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.189+0000 7fd5baffd640 1 -- 172.21.15.161:0/4032835384 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a40319d0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.189+0000 7fd5baffd640 1 -- 172.21.15.161:0/4032835384 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4031d60 con 0x7fd5bc15afb0 2023-11-24T08:01:08.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 -- 172.21.15.161:0/4032835384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 msgr2=0x7fd5bc13f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/4032835384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13f5a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009870 tx=0x7fd5a402b910 comp rx=0 tx=0).stop 2023-11-24T08:01:08.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 -- 172.21.15.161:0/4032835384 shutdown_connections 2023-11-24T08:01:08.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/4032835384 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13f5a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 -- 172.21.15.161:0/4032835384 >> 172.21.15.161:0/4032835384 conn(0x7fd5bc06a800 msgr2=0x7fd5bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 -- 172.21.15.161:0/4032835384 shutdown_connections 2023-11-24T08:01:08.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.190+0000 7fd5c09ff640 1 -- 172.21.15.161:0/4032835384 wait complete. 2023-11-24T08:01:08.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.192+0000 7fd5c09ff640 1 Processor -- start 2023-11-24T08:01:08.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.192+0000 7fd5c09ff640 1 -- start start 2023-11-24T08:01:08.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5c09ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5bc13cfa0 0x7fd5bc0ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5c09ff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5bc13fae0 0x7fd5bc155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5c09ff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5c09ff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc1f3ff0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5c09ff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc156490 con 0x7fd5bc13cfa0 2023-11-24T08:01:08.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5c09ff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc1f39a0 con 0x7fd5bc13fae0 2023-11-24T08:01:08.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55144/0 (socket says 172.21.15.161:55144) 2023-11-24T08:01:08.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 -- 172.21.15.161:0/2953202354 learned_addr learned my addr 172.21.15.161:0/2953202354 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:08.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5b3fff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5bc13fae0 0x7fd5bc155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bb7fe640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5bc13cfa0 0x7fd5bc0ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 -- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5bc13fae0 msgr2=0x7fd5bc155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5bc13fae0 0x7fd5bc155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 -- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5bc13cfa0 msgr2=0x7fd5bc0ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5bc13cfa0 0x7fd5bc0ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.193+0000 7fd5bbfff640 1 -- 172.21.15.161:0/2953202354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a40094d0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.194+0000 7fd5bbfff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13b400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c780 tx=0x7fd5b400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:08.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.194+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4004b60 con 0x7fd5bc15afb0 2023-11-24T08:01:08.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.194+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b400ce90 con 0x7fd5bc15afb0 2023-11-24T08:01:08.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.194+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400a850 con 0x7fd5bc15afb0 2023-11-24T08:01:08.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.194+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc1f3c80 con 0x7fd5bc15afb0 2023-11-24T08:01:08.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.194+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc0adda0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.196+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc067450 con 0x7fd5bc15afb0 2023-11-24T08:01:08.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.196+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5b400a9b0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.197+0000 7fd5b8ff9640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd59c06ae40 0x7fd59c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.197+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd5b4089850 con 0x7fd5bc15afb0 2023-11-24T08:01:08.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.198+0000 7fd5bb7fe640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd59c06ae40 0x7fd59c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.199+0000 7fd5bb7fe640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd59c06ae40 0x7fd59c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc071df0 tx=0x7fd5ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:08.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.202+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5b4054880 con 0x7fd5bc15afb0 2023-11-24T08:01:08.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.463+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fd5bc0cbff0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.640+0000 7fd5b8ff9640 1 -- 172.21.15.161:0/2953202354 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd5b4057ea0 con 0x7fd5bc15afb0 2023-11-24T08:01:08.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.643+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd59c06ae40 msgr2=0x7fd59c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.643+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd59c06ae40 0x7fd59c06d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc071df0 tx=0x7fd5ac009040 comp rx=0 tx=0).stop 2023-11-24T08:01:08.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.643+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 msgr2=0x7fd5bc13b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.643+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13b400 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400c780 tx=0x7fd5b400cc40 comp rx=0 tx=0).stop 2023-11-24T08:01:08.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 shutdown_connections 2023-11-24T08:01:08.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd59c06ae40 0x7fd59c06d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd5bc15afb0 0x7fd5bc13b400 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5bc13fae0 0x7fd5bc155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 --2- 172.21.15.161:0/2953202354 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5bc13cfa0 0x7fd5bc0ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 >> 172.21.15.161:0/2953202354 conn(0x7fd5bc06a800 msgr2=0x7fd5bc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:08.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 shutdown_connections 2023-11-24T08:01:08.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.644+0000 7fd5c09ff640 1 -- 172.21.15.161:0/2953202354 wait complete. 2023-11-24T08:01:08.665 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:01:08.667 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:01:08.715 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:01:08.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.912+0000 7f9ba1abb640 1 Processor -- start 2023-11-24T08:01:08.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.912+0000 7f9ba1abb640 1 -- start start 2023-11-24T08:01:08.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.914+0000 7f9ba1abb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b9c15b140 0x7f9b9c0abee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.914+0000 7f9ba1abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c15ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.914+0000 7f9ba1abb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b9c0ac7a0 con 0x7f9b9c15c400 2023-11-24T08:01:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.914+0000 7f9ba1abb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9c0ad6e0 con 0x7f9b9c15b140 2023-11-24T08:01:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.914+0000 7f9ba1abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c0ac4c0 con 0x7f9b9c072250 2023-11-24T08:01:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.914+0000 7f9b9b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b9c15b140 0x7f9b9c0abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b9c15b140 0x7f9b9c0abee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55156/0 (socket says 172.21.15.161:55156) 2023-11-24T08:01:08.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9b7fe640 1 -- 172.21.15.161:0/2092300012 learned_addr learned my addr 172.21.15.161:0/2092300012 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9bfff640 1 --2- 172.21.15.161:0/2092300012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c15ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9b7fe640 1 -- 172.21.15.161:0/2092300012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 msgr2=0x7f9b9c15ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9b7fe640 1 --2- 172.21.15.161:0/2092300012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c15ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9b7fe640 1 -- 172.21.15.161:0/2092300012 >> v1:172.21.15.175:6789/0 conn(0x7f9b9c15c400 legacy=0x7f9b9c071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.915+0000 7f9b9b7fe640 1 -- 172.21.15.161:0/2092300012 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c15b920 con 0x7f9b9c15b140 2023-11-24T08:01:08.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.917+0000 7f9b9b7fe640 1 --2- 172.21.15.161:0/2092300012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c0abee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098a0 tx=0x7f9b8c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d017dd85dd4500ad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:08.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.917+0000 7f9b9a7fc640 1 -- 172.21.15.161:0/2092300012 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c030840 con 0x7f9b9c15b140 2023-11-24T08:01:08.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.917+0000 7f9b9a7fc640 1 -- 172.21.15.161:0/2092300012 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0309a0 con 0x7f9b9c15b140 2023-11-24T08:01:08.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.917+0000 7f9b9a7fc640 1 -- 172.21.15.161:0/2092300012 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c030d30 con 0x7f9b9c15b140 2023-11-24T08:01:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2092300012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 msgr2=0x7f9b9c0abee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2092300012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c0abee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098a0 tx=0x7f9b8c02b980 comp rx=0 tx=0).stop 2023-11-24T08:01:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2092300012 shutdown_connections 2023-11-24T08:01:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2092300012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c15ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2092300012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c0abee0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2092300012 >> 172.21.15.161:0/2092300012 conn(0x7f9b9c0b0c00 msgr2=0x7f9b9c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2092300012 shutdown_connections 2023-11-24T08:01:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.918+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2092300012 wait complete. 2023-11-24T08:01:08.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.920+0000 7f9ba1abb640 1 Processor -- start 2023-11-24T08:01:08.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.920+0000 7f9ba1abb640 1 -- start start 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9ba1abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9ba1abb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c09b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9ba1abb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b9c15c400 0x7f9b9c070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9ba1abb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c151b90 con 0x7f9b9c15b140 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9ba1abb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c150dc0 con 0x7f9b9c15c400 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9ba1abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9c09bb90 con 0x7f9b9c072250 2023-11-24T08:01:08.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c09b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c09b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55170/0 (socket says 172.21.15.161:55170) 2023-11-24T08:01:08.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 -- 172.21.15.161:0/2496020152 learned_addr learned my addr 172.21.15.161:0/2496020152 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9b7fe640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 -- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 msgr2=0x7f9b9c151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9bfff640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b9c15c400 0x7f9b9c070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 -- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b9c15c400 msgr2=0x7f9b9c070920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b9c15c400 0x7f9b9c070920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.921+0000 7f9b9affd640 1 -- 172.21.15.161:0/2496020152 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c0094d0 con 0x7f9b9c15b140 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9b9b7fe640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:08.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9b9affd640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c09b4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c3c0 tx=0x7f9b9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b900052d0 con 0x7f9b9c15b140 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b90005450 con 0x7f9b9c15b140 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b90007260 con 0x7f9b9c15b140 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9c1511f0 con 0x7f9b9c15b140 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.922+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9c1517b0 con 0x7f9b9c15b140 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.923+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9c151cd0 con 0x7f9b9c15b140 2023-11-24T08:01:08.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.924+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b900073c0 con 0x7f9b9c15b140 2023-11-24T08:01:08.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.925+0000 7f9b83fff640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b8806ae40 0x7f9b8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:08.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.925+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9b90088ad0 con 0x7f9b9c15b140 2023-11-24T08:01:08.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.926+0000 7f9b9b7fe640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b8806ae40 0x7f9b8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:08.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.927+0000 7f9b9b7fe640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b8806ae40 0x7f9b8806d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c036000 tx=0x7f9b8c03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:08.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:08.930+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b9c151cd0 con 0x7f9b9c15b140 2023-11-24T08:01:09.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.119+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9b9c151cd0 con 0x7f9b9c15b140 2023-11-24T08:01:09.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.125+0000 7f9b83fff640 1 -- 172.21.15.161:0/2496020152 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b9c151cd0 con 0x7f9b9c15b140 2023-11-24T08:01:09.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b8806ae40 msgr2=0x7f9b8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b8806ae40 0x7f9b8806d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c036000 tx=0x7f9b8c03b040 comp rx=0 tx=0).stop 2023-11-24T08:01:09.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 msgr2=0x7f9b9c09b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c09b4b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9b9000c3c0 tx=0x7f9b9000c880 comp rx=0 tx=0).stop 2023-11-24T08:01:09.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 shutdown_connections 2023-11-24T08:01:09.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9b8806ae40 0x7f9b8806d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b9c15c400 0x7f9b9c070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b9c15b140 0x7f9b9c09b4b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 --2- 172.21.15.161:0/2496020152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b9c072250 0x7f9b9c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 >> 172.21.15.161:0/2496020152 conn(0x7f9b9c0b0c00 msgr2=0x7f9b9c0aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 shutdown_connections 2023-11-24T08:01:09.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.128+0000 7f9ba1abb640 1 -- 172.21.15.161:0/2496020152 wait complete. 2023-11-24T08:01:09.149 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:01:09.149 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:01:09.267 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:01:09.387 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:01:09.387 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:09.388 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:09.448 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:09.449 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:09.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:09.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.711+0000 7f0f9e03d640 1 Processor -- start 2023-11-24T08:01:09.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.712+0000 7f0f9e03d640 1 -- start start 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.713+0000 7f0f9e03d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813e360 0x7f0f980cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.713+0000 7f0f9e03d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f9815f9c0 0x7f0f980cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.713+0000 7f0f9e03d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9815c5f0 con 0x7f0f9813df80 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.713+0000 7f0f9e03d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9806c470 con 0x7f0f9815f9c0 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.713+0000 7f0f9e03d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9806c750 con 0x7f0f9813e360 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f97fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0f9815f9c0 0x7f0f980cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f977fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0f9813df80 0x7f0f9815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47750/0 (socket says 172.21.15.161:47750) 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f977fe640 1 -- 172.21.15.161:0/957151011 learned_addr learned my addr 172.21.15.161:0/957151011 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:09.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f8ffff640 1 --2- 172.21.15.161:0/957151011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813e360 0x7f0f980cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f96ffd640 1 -- 172.21.15.161:0/957151011 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544415761 0 0) 0x7f0f9815c5f0 con 0x7f0f9813df80 2023-11-24T08:01:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f96ffd640 1 -- 172.21.15.161:0/957151011 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f84003520 con 0x7f0f9813df80 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f97fff640 1 -- 172.21.15.161:0/957151011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813e360 msgr2=0x7f0f980cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f97fff640 1 --2- 172.21.15.161:0/957151011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813e360 0x7f0f980cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f97fff640 1 -- 172.21.15.161:0/957151011 >> v1:172.21.15.161:6789/0 conn(0x7f0f9813df80 legacy=0x7f0f9815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.714+0000 7f0f97fff640 1 -- 172.21.15.161:0/957151011 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9806ca30 con 0x7f0f9815f9c0 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.715+0000 7f0f97fff640 1 --2- 172.21.15.161:0/957151011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f980cf7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009d90 tx=0x7f0f9002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dad3af0b968550 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f96ffd640 1 -- 172.21.15.161:0/957151011 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9002cc50 con 0x7f0f9815f9c0 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f96ffd640 1 -- 172.21.15.161:0/957151011 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9002cdb0 con 0x7f0f9815f9c0 2023-11-24T08:01:09.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f96ffd640 1 -- 172.21.15.161:0/957151011 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90034660 con 0x7f0f9815f9c0 2023-11-24T08:01:09.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 -- 172.21.15.161:0/957151011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 msgr2=0x7f0f980cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/957151011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f980cf7d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009d90 tx=0x7f0f9002bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 -- 172.21.15.161:0/957151011 shutdown_connections 2023-11-24T08:01:09.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/957151011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f980cf7d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/957151011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813e360 0x7f0f980cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 -- 172.21.15.161:0/957151011 >> 172.21.15.161:0/957151011 conn(0x7f0f9806a800 msgr2=0x7f0f9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 -- 172.21.15.161:0/957151011 shutdown_connections 2023-11-24T08:01:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.716+0000 7f0f9e03d640 1 -- 172.21.15.161:0/957151011 wait complete. 2023-11-24T08:01:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.718+0000 7f0f9e03d640 1 Processor -- start 2023-11-24T08:01:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.718+0000 7f0f9e03d640 1 -- start start 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f9e03d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813df80 0x7f0f980adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f9e03d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9813e360 0x7f0f9815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f9e03d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f9815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f9e03d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f981f1c90 con 0x7f0f9815f9c0 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f9e03d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f981f0cc0 con 0x7f0f9813e360 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f9e03d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f981f0ed0 con 0x7f0f9813df80 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.719+0000 7f0f97fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f9815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f9815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55184/0 (socket says 172.21.15.161:55184) 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 -- 172.21.15.161:0/983533487 learned_addr learned my addr 172.21.15.161:0/983533487 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f977fe640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813df80 0x7f0f980adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f8ffff640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9813e360 0x7f0f9815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 -- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813df80 msgr2=0x7f0f980adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813df80 0x7f0f980adef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 -- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9813e360 msgr2=0x7f0f9815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9813e360 0x7f0f9815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 -- 172.21.15.161:0/983533487 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90009a70 con 0x7f0f9815f9c0 2023-11-24T08:01:09.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f977fe640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813df80 0x7f0f980adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:09.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.720+0000 7f0f97fff640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f9815cd90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009d90 tx=0x7f0f90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:09.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.721+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90040650 con 0x7f0f9815f9c0 2023-11-24T08:01:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.721+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f900407b0 con 0x7f0f9815f9c0 2023-11-24T08:01:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.721+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90040b60 con 0x7f0f9815f9c0 2023-11-24T08:01:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.721+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f981f11b0 con 0x7f0f9815f9c0 2023-11-24T08:01:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.721+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f981f1770 con 0x7f0f9815f9c0 2023-11-24T08:01:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.722+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f981f1960 con 0x7f0f9815f9c0 2023-11-24T08:01:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.723+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f90040cc0 con 0x7f0f9815f9c0 2023-11-24T08:01:09.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.724+0000 7f0f94ff9640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0f7806ae40 0x7f0f7806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:09.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.724+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0f900ac390 con 0x7f0f9815f9c0 2023-11-24T08:01:09.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.724+0000 7f0f977fe640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0f7806ae40 0x7f0f7806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.725+0000 7f0f977fe640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0f7806ae40 0x7f0f7806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f880011e0 tx=0x7f0f88009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:09.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.729+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f900773c0 con 0x7f0f9815f9c0 2023-11-24T08:01:09.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.924+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f980675d0 con 0x7f0f9815f9c0 2023-11-24T08:01:09.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.926+0000 7f0f94ff9640 1 -- 172.21.15.161:0/983533487 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f0f90009450 con 0x7f0f9815f9c0 2023-11-24T08:01:09.928 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:09.929 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.928+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0f7806ae40 msgr2=0x7f0f7806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.928+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0f7806ae40 0x7f0f7806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0f880011e0 tx=0x7f0f88009040 comp rx=0 tx=0).stop 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.928+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 msgr2=0x7f0f9815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.928+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f9815cd90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0f90009d90 tx=0x7f0f90004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 shutdown_connections 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0f7806ae40 0x7f0f7806d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9815f9c0 0x7f0f9815cd90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9813e360 0x7f0f9815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 --2- 172.21.15.161:0/983533487 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f9813df80 0x7f0f980adef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 >> 172.21.15.161:0/983533487 conn(0x7f0f9806a800 msgr2=0x7f0f9815d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 shutdown_connections 2023-11-24T08:01:09.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:09.929+0000 7f0f9e03d640 1 -- 172.21.15.161:0/983533487 wait complete. 2023-11-24T08:01:09.951 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:09.951 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:10.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.164+0000 7f1bc891d640 1 Processor -- start 2023-11-24T08:01:10.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.164+0000 7f1bc891d640 1 -- start start 2023-11-24T08:01:10.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.165+0000 7f1bc891d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bc4143ae0 0x7f1bc40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.165+0000 7f1bc891d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40cfc30 con 0x7f1bc415e3b0 2023-11-24T08:01:10.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.165+0000 7f1bc891d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40b1ee0 con 0x7f1bc40cf7d0 2023-11-24T08:01:10.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.165+0000 7f1bc891d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40b2780 con 0x7f1bc4143ae0 2023-11-24T08:01:10.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.166+0000 7f1bc2d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1bc415e3b0 0x7f1bc40702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47754/0 (socket says 172.21.15.161:47754) 2023-11-24T08:01:10.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.166+0000 7f1bc2d9d640 1 -- 172.21.15.161:0/526817305 learned_addr learned my addr 172.21.15.161:0/526817305 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:10.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.166+0000 7f1bc259c640 1 --2- 172.21.15.161:0/526817305 >> v2:172.21.15.175:3300/0 conn(0x7f1bc4143ae0 0x7f1bc40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.166+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692656278 0 0) 0x7f1bc40cfc30 con 0x7f1bc415e3b0 2023-11-24T08:01:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.166+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb0003520 con 0x7f1bc415e3b0 2023-11-24T08:01:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532155919 0 0) 0x7f1bc40b1ee0 con 0x7f1bc40cf7d0 2023-11-24T08:01:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc40cfc30 con 0x7f1bc40cf7d0 2023-11-24T08:01:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1523197954 0 0) 0x7f1bb0003520 con 0x7f1bc415e3b0 2023-11-24T08:01:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 >> v2:172.21.15.175:3300/0 conn(0x7f1bc4143ae0 msgr2=0x7f1bc40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 --2- 172.21.15.161:0/526817305 >> v2:172.21.15.175:3300/0 conn(0x7f1bc4143ae0 0x7f1bc40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 >> v1:172.21.15.175:6789/0 conn(0x7f1bc40cf7d0 legacy=0x7f1bc415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc415e990 con 0x7f1bc415e3b0 2023-11-24T08:01:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f1bbc0019f0 con 0x7f1bc415e3b0 2023-11-24T08:01:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 >> v1:172.21.15.161:6789/0 conn(0x7f1bc415e3b0 legacy=0x7f1bc40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb0003b50 0x7f1bb0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb00047c0 0x7f1bb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bb0005180 0x7f1bb000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40b2780 con 0x7f1bb0005180 2023-11-24T08:01:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb000e260 con 0x7f1bb0003b50 2023-11-24T08:01:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb000e420 con 0x7f1bb00047c0 2023-11-24T08:01:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc2d9d640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bb0005180 0x7f1bb000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.167+0000 7f1bc259c640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb0003b50 0x7f1bb0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bbbfff640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb00047c0 0x7f1bb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bc2d9d640 1 -- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb00047c0 msgr2=0x7f1bb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bc2d9d640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb00047c0 0x7f1bb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bc2d9d640 1 -- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb0003b50 msgr2=0x7f1bb0003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bc2d9d640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb0003b50 0x7f1bb0003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bc2d9d640 1 -- 172.21.15.161:0/526817305 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb0003520 con 0x7f1bb0005180 2023-11-24T08:01:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.168+0000 7f1bc259c640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bb0003b50 0x7f1bb0003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.169+0000 7f1bc2d9d640 1 -- 172.21.15.161:0/526817305 reap_dead start 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.169+0000 7f1bc2d9d640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bb0005180 0x7f1bb000db90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00a710 tx=0x7f1bb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682f273ebeb806ad server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.169+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc034630 con 0x7f1bb0005180 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.169+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc02f070 con 0x7f1bb0005180 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.169+0000 7f1bc1d9b640 1 -- 172.21.15.161:0/526817305 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc034a10 con 0x7f1bb0005180 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 -- 172.21.15.161:0/526817305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bb0005180 msgr2=0x7f1bb000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bb0005180 0x7f1bb000db90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00a710 tx=0x7f1bb00057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 -- 172.21.15.161:0/526817305 shutdown_connections 2023-11-24T08:01:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 --2- 172.21.15.161:0/526817305 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bb0005180 0x7f1bb000db90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 -- 172.21.15.161:0/526817305 >> 172.21.15.161:0/526817305 conn(0x7f1bc406a800 msgr2=0x7f1bc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 -- 172.21.15.161:0/526817305 shutdown_connections 2023-11-24T08:01:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.170+0000 7f1bc891d640 1 -- 172.21.15.161:0/526817305 wait complete. 2023-11-24T08:01:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.171+0000 7f1bc891d640 1 Processor -- start 2023-11-24T08:01:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.172+0000 7f1bc891d640 1 -- start start 2023-11-24T08:01:10.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc891d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb0005180 0x7f1bc40aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc891d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 0x7f1bc413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc891d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc40b0bc0 0x7f1bc40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc891d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40b1590 con 0x7f1bc413f9a0 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc891d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc413f6b0 con 0x7f1bc40b0bc0 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc891d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40a8880 con 0x7f1bb0005180 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 0x7f1bc413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 0x7f1bc413f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55198/0 (socket says 172.21.15.161:55198) 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 -- 172.21.15.161:0/4136892892 learned_addr learned my addr 172.21.15.161:0/4136892892 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc259c640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb0005180 0x7f1bc40aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bc2d9d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc40b0bc0 0x7f1bc40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 -- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb0005180 msgr2=0x7f1bc40aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb0005180 0x7f1bc40aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 -- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc40b0bc0 msgr2=0x7f1bc40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc40b0bc0 0x7f1bc40b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.173+0000 7f1bbbfff640 1 -- 172.21.15.161:0/4136892892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40a8b40 con 0x7f1bc413f9a0 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.174+0000 7f1bbbfff640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 0x7f1bc413f170 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e7b0 tx=0x7f1bac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.174+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0050d0 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.174+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac005230 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.174+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00c6c0 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.174+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc40a8e20 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.174+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc40a93e0 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.175+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc40675d0 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.176+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bac00c820 con 0x7f1bc413f9a0 2023-11-24T08:01:10.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.178+0000 7f1bbaffd640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1ba406ae40 0x7f1ba406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.178+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1bac0895c0 con 0x7f1bc413f9a0 2023-11-24T08:01:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.178+0000 7f1bc259c640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1ba406ae40 0x7f1ba406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.179+0000 7f1bc259c640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1ba406ae40 0x7f1ba406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009990 tx=0x7f1bb4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:10.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.183+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1bac054610 con 0x7f1bc413f9a0 2023-11-24T08:01:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.374+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bc40a95a0 con 0x7f1bc413f9a0 2023-11-24T08:01:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.375+0000 7f1bbaffd640 1 -- 172.21.15.161:0/4136892892 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bac057c30 con 0x7f1bc413f9a0 2023-11-24T08:01:10.378 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1ba406ae40 msgr2=0x7f1ba406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1ba406ae40 0x7f1ba406d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009990 tx=0x7f1bb4008040 comp rx=0 tx=0).stop 2023-11-24T08:01:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 msgr2=0x7f1bc413f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 0x7f1bc413f170 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e7b0 tx=0x7f1bac00ec70 comp rx=0 tx=0).stop 2023-11-24T08:01:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 shutdown_connections 2023-11-24T08:01:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1ba406ae40 0x7f1ba406d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bc40b0bc0 0x7f1bc40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1bc413f9a0 0x7f1bc413f170 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 --2- 172.21.15.161:0/4136892892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bb0005180 0x7f1bc40aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 >> 172.21.15.161:0/4136892892 conn(0x7f1bc406a800 msgr2=0x7f1bc40ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 shutdown_connections 2023-11-24T08:01:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.378+0000 7f1bc891d640 1 -- 172.21.15.161:0/4136892892 wait complete. 2023-11-24T08:01:10.400 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.619+0000 7f163674c640 1 Processor -- start 2023-11-24T08:01:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.619+0000 7f163674c640 1 -- start start 2023-11-24T08:01:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.621+0000 7f163674c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.621+0000 7f163674c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f163013e360 0x7f16300cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.621+0000 7f163674c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163006c470 con 0x7f163015f9c0 2023-11-24T08:01:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.621+0000 7f163674c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163006c750 con 0x7f163013e360 2023-11-24T08:01:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.621+0000 7f163674c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163006ca30 con 0x7f163013df80 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.622+0000 7f162f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f163013e360 0x7f16300cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.622+0000 7f1634ce9640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f163015f9c0 0x7f16301408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:36292/0 (socket says 172.21.15.161:36292) 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.622+0000 7f1634ce9640 1 -- 172.21.15.161:0/3211275335 learned_addr learned my addr 172.21.15.161:0/3211275335 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.622+0000 7f162ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162effd640 1 -- 172.21.15.161:0/3211275335 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406049424 0 0) 0x7f163006c470 con 0x7f163015f9c0 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162effd640 1 -- 172.21.15.161:0/3211275335 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f161c003520 con 0x7f163015f9c0 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162f7fe640 1 -- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 msgr2=0x7f163015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162f7fe640 1 --2- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162f7fe640 1 -- 172.21.15.161:0/3211275335 >> v1:172.21.15.175:6789/0 conn(0x7f163015f9c0 legacy=0x7f16301408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162f7fe640 1 -- 172.21.15.161:0/3211275335 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163006cd10 con 0x7f163013e360 2023-11-24T08:01:10.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.623+0000 7f162ffff640 1 --2- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:01:10.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.624+0000 7f162f7fe640 1 --2- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f16300cf290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16180097a0 tx=0x7f161802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2941b9708f196ba server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.624+0000 7f162effd640 1 -- 172.21.15.161:0/3211275335 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161802d040 con 0x7f163013e360 2023-11-24T08:01:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.624+0000 7f162effd640 1 -- 172.21.15.161:0/3211275335 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618031810 con 0x7f163013e360 2023-11-24T08:01:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.624+0000 7f162effd640 1 -- 172.21.15.161:0/3211275335 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1618031b80 con 0x7f163013e360 2023-11-24T08:01:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 -- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 msgr2=0x7f16300cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 --2- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f16300cf290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16180097a0 tx=0x7f161802b8b0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 -- 172.21.15.161:0/3211275335 shutdown_connections 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 --2- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f16300cf290 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 --2- 172.21.15.161:0/3211275335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 -- 172.21.15.161:0/3211275335 >> 172.21.15.161:0/3211275335 conn(0x7f163006a800 msgr2=0x7f163006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 -- 172.21.15.161:0/3211275335 shutdown_connections 2023-11-24T08:01:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.625+0000 7f163674c640 1 -- 172.21.15.161:0/3211275335 wait complete. 2023-11-24T08:01:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.627+0000 7f163674c640 1 Processor -- start 2023-11-24T08:01:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.627+0000 7f163674c640 1 -- start start 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f163674c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163013d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f163674c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f163014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f163674c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 0x7f163014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f163674c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1630151120 con 0x7f163015f9c0 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f163674c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16301505e0 con 0x7f163013e360 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f163674c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1630150880 con 0x7f163013df80 2023-11-24T08:01:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f1634ce9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 0x7f163014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f1634ce9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 0x7f163014be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:55202/0 (socket says 172.21.15.161:55202) 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f1634ce9640 1 -- 172.21.15.161:0/3719986655 learned_addr learned my addr 172.21.15.161:0/3719986655 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.628+0000 7f162f7fe640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f163014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f162ffff640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163013d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f1634ce9640 1 -- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 msgr2=0x7f163013d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f1634ce9640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163013d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f1634ce9640 1 -- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 msgr2=0x7f163014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f1634ce9640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f163014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f1634ce9640 1 -- 172.21.15.161:0/3719986655 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1620009400 con 0x7f163015f9c0 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f162ffff640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163013d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f1634ce9640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 0x7f163014be20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f162800cb40 tx=0x7f162800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162800aca0 con 0x7f163015f9c0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162800ae00 con 0x7f163015f9c0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.629+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618009400 con 0x7f163015f9c0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.630+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628012620 con 0x7f163015f9c0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.630+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16301f0f40 con 0x7f163015f9c0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.631+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16300af2d0 con 0x7f163015f9c0 2023-11-24T08:01:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.632+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1628007070 con 0x7f163015f9c0 2023-11-24T08:01:10.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.633+0000 7f162cff9640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f161006ae40 0x7f161006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:10.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.633+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f16280895a0 con 0x7f163015f9c0 2023-11-24T08:01:10.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.633+0000 7f162ffff640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f161006ae40 0x7f161006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:10.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.635+0000 7f162ffff640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f161006ae40 0x7f161006d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1620009c80 tx=0x7f1620008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.637+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1628054710 con 0x7f163015f9c0 2023-11-24T08:01:10.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.828+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1630150c70 con 0x7f163015f9c0 2023-11-24T08:01:10.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.829+0000 7f162cff9640 1 -- 172.21.15.161:0/3719986655 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1628057d30 con 0x7f163015f9c0 2023-11-24T08:01:10.831 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:10.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f161006ae40 msgr2=0x7f161006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f161006ae40 0x7f161006d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1620009c80 tx=0x7f1620008040 comp rx=0 tx=0).stop 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 msgr2=0x7f163014be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 0x7f163014be20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f162800cb40 tx=0x7f162800a060 comp rx=0 tx=0).stop 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 shutdown_connections 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f161006ae40 0x7f161006d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f163015f9c0 0x7f163014be20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f163013e360 0x7f163014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 --2- 172.21.15.161:0/3719986655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f163013df80 0x7f163013d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:10.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 >> 172.21.15.161:0/3719986655 conn(0x7f163006a800 msgr2=0x7f163015caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:10.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 shutdown_connections 2023-11-24T08:01:10.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:10.832+0000 7f163674c640 1 -- 172.21.15.161:0/3719986655 wait complete. 2023-11-24T08:01:10.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.070+0000 7f68d1431640 1 Processor -- start 2023-11-24T08:01:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.070+0000 7f68d1431640 1 -- start start 2023-11-24T08:01:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68d1431640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68cc143ae0 0x7f68cc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68d1431640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68cc0cf7d0 0x7f68cc15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68d1431640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68cc0cfc30 con 0x7f68cc15e1e0 2023-11-24T08:01:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68d1431640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0b1ee0 con 0x7f68cc143ae0 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68d1431640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68cc0b2780 con 0x7f68cc0cf7d0 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68caffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68cc143ae0 0x7f68cc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68caffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68cc143ae0 0x7f68cc0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52636/0 (socket says 172.21.15.161:52636) 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.072+0000 7f68caffd640 1 -- 172.21.15.161:0/1679194732 learned_addr learned my addr 172.21.15.161:0/1679194732 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.073+0000 7f68c3fff640 1 --2- 172.21.15.161:0/1679194732 >> v2:172.21.15.175:3300/0 conn(0x7f68cc0cf7d0 0x7f68cc15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.073+0000 7f68caffd640 1 -- 172.21.15.161:0/1679194732 >> v2:172.21.15.175:3300/0 conn(0x7f68cc0cf7d0 msgr2=0x7f68cc15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.073+0000 7f68caffd640 1 --2- 172.21.15.161:0/1679194732 >> v2:172.21.15.175:3300/0 conn(0x7f68cc0cf7d0 0x7f68cc15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.073+0000 7f68caffd640 1 -- 172.21.15.161:0/1679194732 >> v1:172.21.15.175:6789/0 conn(0x7f68cc15e1e0 legacy=0x7f68cc15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.073+0000 7f68caffd640 1 -- 172.21.15.161:0/1679194732 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68cc15e990 con 0x7f68cc143ae0 2023-11-24T08:01:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.074+0000 7f68caffd640 1 --2- 172.21.15.161:0/1679194732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0cf290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0cb830 tx=0x7f68bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f436e128b067e3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.074+0000 7f68ca7fc640 1 -- 172.21.15.161:0/1679194732 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc031870 con 0x7f68cc143ae0 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.074+0000 7f68ca7fc640 1 -- 172.21.15.161:0/1679194732 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc0319d0 con 0x7f68cc143ae0 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.074+0000 7f68ca7fc640 1 -- 172.21.15.161:0/1679194732 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc031d60 con 0x7f68cc143ae0 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 -- 172.21.15.161:0/1679194732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 msgr2=0x7f68cc0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 --2- 172.21.15.161:0/1679194732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0cf290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f68cc0cb830 tx=0x7f68bc02b910 comp rx=0 tx=0).stop 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 -- 172.21.15.161:0/1679194732 shutdown_connections 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 --2- 172.21.15.161:0/1679194732 >> v2:172.21.15.175:3300/0 conn(0x7f68cc0cf7d0 0x7f68cc15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 --2- 172.21.15.161:0/1679194732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0cf290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 -- 172.21.15.161:0/1679194732 >> 172.21.15.161:0/1679194732 conn(0x7f68cc06a800 msgr2=0x7f68cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 -- 172.21.15.161:0/1679194732 shutdown_connections 2023-11-24T08:01:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.075+0000 7f68d1431640 1 -- 172.21.15.161:0/1679194732 wait complete. 2023-11-24T08:01:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.077+0000 7f68d1431640 1 Processor -- start 2023-11-24T08:01:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.077+0000 7f68d1431640 1 -- start start 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68d1431640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68cc0cf7d0 0x7f68cc0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68d1431640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68d1431640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68cc15e1e0 0x7f68cc13e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68d1431640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0afa60 con 0x7f68cc143ae0 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68d1431640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc0aef60 con 0x7f68cc15e1e0 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68d1431640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68cc13eeb0 con 0x7f68cc0cf7d0 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68c3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52642/0 (socket says 172.21.15.161:52642) 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.078+0000 7f68c3fff640 1 -- 172.21.15.161:0/4225024923 learned_addr learned my addr 172.21.15.161:0/4225024923 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68caffd640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68cc0cf7d0 0x7f68cc0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c3fff640 1 -- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68cc0cf7d0 msgr2=0x7f68cc0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c3fff640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68cc0cf7d0 0x7f68cc0b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c3fff640 1 -- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68cc15e1e0 msgr2=0x7f68cc13e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c3fff640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68cc15e1e0 0x7f68cc13e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c3fff640 1 -- 172.21.15.161:0/4225024923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0094d0 con 0x7f68cc143ae0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c3fff640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0aea20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f68b400d620 tx=0x7f68b400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400b620 con 0x7f68cc143ae0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b400b780 con 0x7f68cc143ae0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.079+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68cc0af1c0 con 0x7f68cc143ae0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.080+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400bb10 con 0x7f68cc143ae0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.080+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68cc0af780 con 0x7f68cc143ae0 2023-11-24T08:01:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.081+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68cc0b2bf0 con 0x7f68cc143ae0 2023-11-24T08:01:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.082+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68b400bc70 con 0x7f68cc143ae0 2023-11-24T08:01:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.082+0000 7f68c37fe640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68ac06ae40 0x7f68ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.083+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f68b4089b40 con 0x7f68cc143ae0 2023-11-24T08:01:11.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.083+0000 7f68caffd640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68ac06ae40 0x7f68ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.084+0000 7f68caffd640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68ac06ae40 0x7f68ac06d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f68bc036000 tx=0x7f68bc03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:11.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.087+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68cc0b2bf0 con 0x7f68cc143ae0 2023-11-24T08:01:11.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.280+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68cc0b2bf0 con 0x7f68cc143ae0 2023-11-24T08:01:11.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.281+0000 7f68c37fe640 1 -- 172.21.15.161:0/4225024923 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68cc0b2bf0 con 0x7f68cc143ae0 2023-11-24T08:01:11.283 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68ac06ae40 msgr2=0x7f68ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68ac06ae40 0x7f68ac06d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f68bc036000 tx=0x7f68bc03c040 comp rx=0 tx=0).stop 2023-11-24T08:01:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 msgr2=0x7f68cc0aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0aea20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f68b400d620 tx=0x7f68b400dae0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 shutdown_connections 2023-11-24T08:01:11.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68ac06ae40 0x7f68ac06d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68cc15e1e0 0x7f68cc13e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68cc143ae0 0x7f68cc0aea20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 --2- 172.21.15.161:0/4225024923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68cc0cf7d0 0x7f68cc0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 >> 172.21.15.161:0/4225024923 conn(0x7f68cc06a800 msgr2=0x7f68cc15c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:11.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.283+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 shutdown_connections 2023-11-24T08:01:11.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.284+0000 7f68d1431640 1 -- 172.21.15.161:0/4225024923 wait complete. 2023-11-24T08:01:11.305 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:11.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.510+0000 7fa93eac9640 1 Processor -- start 2023-11-24T08:01:11.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.510+0000 7fa93eac9640 1 -- start start 2023-11-24T08:01:11.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.511+0000 7fa93eac9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa9380cd170 0x7fa938071070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.511+0000 7fa93eac9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa938071690 con 0x7fa93814b2c0 2023-11-24T08:01:11.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa93eac9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa938071970 con 0x7fa9380cf9a0 2023-11-24T08:01:11.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa93eac9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93814b6a0 con 0x7fa9380cd170 2023-11-24T08:01:11.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa93c865640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa93814b2c0 0x7fa9380cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47404/0 (socket says 172.21.15.161:47404) 2023-11-24T08:01:11.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa93c865640 1 -- 172.21.15.161:0/1329605766 learned_addr learned my addr 172.21.15.161:0/1329605766 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:11.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa93d066640 1 --2- 172.21.15.161:0/1329605766 >> v2:172.21.15.161:3300/0 conn(0x7fa9380cd170 0x7fa938071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa9377fe640 1 -- 172.21.15.161:0/1329605766 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611295341 0 0) 0x7fa938071690 con 0x7fa93814b2c0 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.512+0000 7fa9377fe640 1 -- 172.21.15.161:0/1329605766 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa928003520 con 0x7fa93814b2c0 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.513+0000 7fa93d066640 1 -- 172.21.15.161:0/1329605766 >> v1:172.21.15.175:6789/0 conn(0x7fa9380cf9a0 legacy=0x7fa938070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.513+0000 7fa93d066640 1 -- 172.21.15.161:0/1329605766 >> v1:172.21.15.161:6789/0 conn(0x7fa93814b2c0 legacy=0x7fa9380cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.513+0000 7fa93d066640 1 -- 172.21.15.161:0/1329605766 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa938071c50 con 0x7fa9380cd170 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.514+0000 7fa93d066640 1 --2- 172.21.15.161:0/1329605766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9380cd170 0x7fa938071070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa93002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8273e5bd041270fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:11.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.514+0000 7fa9377fe640 1 -- 172.21.15.161:0/1329605766 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93002cd00 con 0x7fa9380cd170 2023-11-24T08:01:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.514+0000 7fa9377fe640 1 -- 172.21.15.161:0/1329605766 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93002ce60 con 0x7fa9380cd170 2023-11-24T08:01:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.514+0000 7fa9377fe640 1 -- 172.21.15.161:0/1329605766 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930034660 con 0x7fa9380cd170 2023-11-24T08:01:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 -- 172.21.15.161:0/1329605766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9380cd170 msgr2=0x7fa938071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 --2- 172.21.15.161:0/1329605766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9380cd170 0x7fa938071070 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa93002bf50 comp rx=0 tx=0).stop 2023-11-24T08:01:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 -- 172.21.15.161:0/1329605766 shutdown_connections 2023-11-24T08:01:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 --2- 172.21.15.161:0/1329605766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa9380cd170 0x7fa938071070 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 -- 172.21.15.161:0/1329605766 >> 172.21.15.161:0/1329605766 conn(0x7fa93806a800 msgr2=0x7fa93806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 -- 172.21.15.161:0/1329605766 shutdown_connections 2023-11-24T08:01:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.515+0000 7fa93eac9640 1 -- 172.21.15.161:0/1329605766 wait complete. 2023-11-24T08:01:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.516+0000 7fa93eac9640 1 Processor -- start 2023-11-24T08:01:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.517+0000 7fa93eac9640 1 -- start start 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.517+0000 7fa93eac9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9380cd170 0x7fa938160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93eac9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380cf9a0 0x7fa93813f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93eac9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 0x7fa9381647a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93eac9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938163700 con 0x7fa93814b2c0 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93eac9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9381639e0 con 0x7fa9380cf9a0 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93eac9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa938163cc0 con 0x7fa9380cd170 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 0x7fa9381647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 0x7fa9381647a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52668/0 (socket says 172.21.15.161:52668) 2023-11-24T08:01:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 -- 172.21.15.161:0/3649848845 learned_addr learned my addr 172.21.15.161:0/3649848845 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93c865640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9380cd170 0x7fa938160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 -- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9380cd170 msgr2=0x7fa938160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9380cd170 0x7fa938160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 -- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380cf9a0 msgr2=0x7fa93813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa937fff640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380cf9a0 0x7fa93813f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380cf9a0 0x7fa93813f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93d066640 1 -- 172.21.15.161:0/3649848845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930009a70 con 0x7fa93814b2c0 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.518+0000 7fa93c865640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9380cd170 0x7fa938160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.519+0000 7fa93d066640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 0x7fa9381647a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa930004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:11.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.519+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93003d600 con 0x7fa93814b2c0 2023-11-24T08:01:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.519+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93003d780 con 0x7fa93814b2c0 2023-11-24T08:01:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.519+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa938163fa0 con 0x7fa93814b2c0 2023-11-24T08:01:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.519+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93003db30 con 0x7fa93814b2c0 2023-11-24T08:01:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.519+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93813fb90 con 0x7fa93814b2c0 2023-11-24T08:01:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.520+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9381644c0 con 0x7fa93814b2c0 2023-11-24T08:01:11.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.521+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa93003b040 con 0x7fa93814b2c0 2023-11-24T08:01:11.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.522+0000 7fa9357fa640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa91c06ae70 0x7fa91c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:11.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.522+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa9300abcb0 con 0x7fa93814b2c0 2023-11-24T08:01:11.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.523+0000 7fa93c865640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa91c06ae70 0x7fa91c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:11.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.524+0000 7fa93c865640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa91c06ae70 0x7fa91c06d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0011e0 tx=0x7fa92c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:11.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.527+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9381644c0 con 0x7fa93814b2c0 2023-11-24T08:01:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.732+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa9381644c0 con 0x7fa93814b2c0 2023-11-24T08:01:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.732+0000 7fa9357fa640 1 -- 172.21.15.161:0/3649848845 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa9381644c0 con 0x7fa93814b2c0 2023-11-24T08:01:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa91c06ae70 msgr2=0x7fa91c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa91c06ae70 0x7fa91c06d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0011e0 tx=0x7fa92c009040 comp rx=0 tx=0).stop 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 msgr2=0x7fa9381647a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 0x7fa9381647a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa930009d90 tx=0x7fa930004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 shutdown_connections 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa91c06ae70 0x7fa91c06d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa93814b2c0 0x7fa9381647a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9380cf9a0 0x7fa93813f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 --2- 172.21.15.161:0/3649848845 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa9380cd170 0x7fa938160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 >> 172.21.15.161:0/3649848845 conn(0x7fa93806a800 msgr2=0x7fa938148a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 shutdown_connections 2023-11-24T08:01:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:11.735+0000 7fa93eac9640 1 -- 172.21.15.161:0/3649848845 wait complete. 2023-11-24T08:01:11.757 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:11.757 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:11.810 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:12.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.018+0000 7efee759e640 1 Processor -- start 2023-11-24T08:01:12.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.018+0000 7efee759e640 1 -- start start 2023-11-24T08:01:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.019+0000 7efee759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efee8146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.019+0000 7efee759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efee806c7c0 0x7efee80717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.019+0000 7efee759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee806cc20 con 0x7efee8071d30 2023-11-24T08:01:12.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.019+0000 7efee759e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee806cec0 con 0x7efee806c7c0 2023-11-24T08:01:12.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.019+0000 7efee759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee806d1a0 con 0x7efee8071410 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.020+0000 7efee6d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efee8071d30 0x7efee80b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47414/0 (socket says 172.21.15.161:47414) 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.020+0000 7efee6d9d640 1 -- 172.21.15.161:0/980349412 learned_addr learned my addr 172.21.15.161:0/980349412 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.020+0000 7efee659c640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efee8146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.020+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521358596 0 0) 0x7efee806cc20 con 0x7efee8071d30 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.020+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed4003520 con 0x7efee8071d30 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.020+0000 7efeddd9b640 1 --2- 172.21.15.161:0/980349412 >> v2:172.21.15.175:3300/0 conn(0x7efee806c7c0 0x7efee80717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979502740 0 0) 0x7efed4003520 con 0x7efee8071d30 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 msgr2=0x7efee8146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efee8146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 >> v2:172.21.15.175:3300/0 conn(0x7efee806c7c0 msgr2=0x7efee80717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 --2- 172.21.15.161:0/980349412 >> v2:172.21.15.175:3300/0 conn(0x7efee806c7c0 0x7efee80717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee806d480 con 0x7efee8071d30 2023-11-24T08:01:12.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7efee00019f0 con 0x7efee8071d30 2023-11-24T08:01:12.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 >> v1:172.21.15.161:6789/0 conn(0x7efee8071d30 legacy=0x7efee80b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4003970 0x7efed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efed40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efed4004d00 0x7efed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee806cec0 con 0x7efed4004d00 2023-11-24T08:01:12.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee806d1a0 con 0x7efed4003970 2023-11-24T08:01:12.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed400ba00 con 0x7efee8071410 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efeddd9b640 1 --2- 172.21.15.161:0/980349412 >> v2:172.21.15.175:3300/0 conn(0x7efee806c7c0 0x7efee80717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.021+0000 7efee6d9d640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efed4004d00 0x7efed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efeddd9b640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efed40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efee659c640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4003970 0x7efed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efee6d9d640 1 -- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 msgr2=0x7efed40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efee6d9d640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efed40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efee6d9d640 1 -- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4003970 msgr2=0x7efed4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efee6d9d640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4003970 0x7efed4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efee6d9d640 1 -- 172.21.15.161:0/980349412 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed4003520 con 0x7efed4004d00 2023-11-24T08:01:12.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.022+0000 7efeddd9b640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee8071410 0x7efed40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:12.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.023+0000 7efee6d9d640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efed4004d00 0x7efed4005180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efee000a760 tx=0x7efed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfb8796d71b4c48 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.023+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0034630 con 0x7efed4004d00 2023-11-24T08:01:12.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.023+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee002f070 con 0x7efed4004d00 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.023+0000 7efee5d9b640 1 -- 172.21.15.161:0/980349412 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee00349d0 con 0x7efed4004d00 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee759e640 1 -- 172.21.15.161:0/980349412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efed4004d00 msgr2=0x7efed4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee759e640 1 --2- 172.21.15.161:0/980349412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efed4004d00 0x7efed4005180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efee000a760 tx=0x7efed40057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee6d9d640 1 -- 172.21.15.161:0/980349412 reap_dead start 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee759e640 1 -- 172.21.15.161:0/980349412 shutdown_connections 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee759e640 1 -- 172.21.15.161:0/980349412 >> 172.21.15.161:0/980349412 conn(0x7efee806a800 msgr2=0x7efee806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee759e640 1 -- 172.21.15.161:0/980349412 shutdown_connections 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.024+0000 7efee759e640 1 -- 172.21.15.161:0/980349412 wait complete. 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.026+0000 7efee759e640 1 Processor -- start 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.026+0000 7efee759e640 1 -- start start 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4004d00 0x7efee80c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 0x7efee80cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee80ccc80 0x7efee813dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80ce0d0 con 0x7efee813f450 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80cd550 con 0x7efed4004d00 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80cd830 con 0x7efee80ccc80 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 0x7efee80cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 0x7efee80cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52684/0 (socket says 172.21.15.161:52684) 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 -- 172.21.15.161:0/8397544 learned_addr learned my addr 172.21.15.161:0/8397544 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee6d9d640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee80ccc80 0x7efee813dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 -- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee80ccc80 msgr2=0x7efee813dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee80ccc80 0x7efee813dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 -- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4004d00 msgr2=0x7efee80c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efee659c640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4004d00 0x7efee80c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4004d00 0x7efee80c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.027+0000 7efeddd9b640 1 -- 172.21.15.161:0/8397544 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80cdb10 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.028+0000 7efeddd9b640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 0x7efee80cc740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efed000f600 tx=0x7efed000fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.028+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0014890 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.028+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed000c030 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.028+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0014c30 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.028+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee80cddf0 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.028+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee813f8d0 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.029+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee8067450 con 0x7efee813f450 2023-11-24T08:01:12.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.030+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efed000d490 con 0x7efee813f450 2023-11-24T08:01:12.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.031+0000 7efedf7fe640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efec806ae70 0x7efec806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.031+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efed0089c30 con 0x7efee813f450 2023-11-24T08:01:12.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.032+0000 7efee659c640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efec806ae70 0x7efec806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.033+0000 7efee659c640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efec806ae70 0x7efec806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efed80098d0 tx=0x7efed8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.036+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efed0054bc0 con 0x7efee813f450 2023-11-24T08:01:12.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.226+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efee814cf50 con 0x7efee813f450 2023-11-24T08:01:12.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.229+0000 7efedf7fe640 1 -- 172.21.15.161:0/8397544 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7efed0022090 con 0x7efee813f450 2023-11-24T08:01:12.231 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:12.232 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:12.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efec806ae70 msgr2=0x7efec806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efec806ae70 0x7efec806d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efed80098d0 tx=0x7efed8008040 comp rx=0 tx=0).stop 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 msgr2=0x7efee80cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 0x7efee80cc740 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efed000f600 tx=0x7efed000fac0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 shutdown_connections 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efec806ae70 0x7efec806d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efee80ccc80 0x7efee813dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efee813f450 0x7efee80cc740 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 --2- 172.21.15.161:0/8397544 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efed4004d00 0x7efee80c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.231+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 >> 172.21.15.161:0/8397544 conn(0x7efee806a800 msgr2=0x7efee80af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.232+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 shutdown_connections 2023-11-24T08:01:12.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.232+0000 7efee759e640 1 -- 172.21.15.161:0/8397544 wait complete. 2023-11-24T08:01:12.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:12.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.473+0000 7fcdc57c9640 1 Processor -- start 2023-11-24T08:01:12.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.473+0000 7fcdc57c9640 1 -- start start 2023-11-24T08:01:12.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.474+0000 7fcdc57c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcdc013df80 0x7fcdc015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.474+0000 7fcdc57c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdc013e360 0x7fcdc00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.474+0000 7fcdc57c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc015f9c0 0x7fcdc00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.474+0000 7fcdc57c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc006c470 con 0x7fcdc013e360 2023-11-24T08:01:12.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.474+0000 7fcdc57c9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc006c750 con 0x7fcdc013df80 2023-11-24T08:01:12.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.474+0000 7fcdc57c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc006ca30 con 0x7fcdc015f9c0 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.475+0000 7fcdb7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdc013e360 0x7fcdc00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.475+0000 7fcdbeffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcdc013df80 0x7fcdc015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.475+0000 7fcdb7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcdc013e360 0x7fcdc00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52698/0 (socket says 172.21.15.161:52698) 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.475+0000 7fcdb7fff640 1 -- 172.21.15.161:0/1999382136 learned_addr learned my addr 172.21.15.161:0/1999382136 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.475+0000 7fcdbf7fe640 1 --2- 172.21.15.161:0/1999382136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc015f9c0 0x7fcdc00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.476+0000 7fcdb7fff640 1 -- 172.21.15.161:0/1999382136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc015f9c0 msgr2=0x7fcdc00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.476+0000 7fcdb7fff640 1 --2- 172.21.15.161:0/1999382136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc015f9c0 0x7fcdc00cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.476+0000 7fcdb7fff640 1 -- 172.21.15.161:0/1999382136 >> v2:172.21.15.175:3300/0 conn(0x7fcdc013df80 msgr2=0x7fcdc015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.476+0000 7fcdb7fff640 1 --2- 172.21.15.161:0/1999382136 >> v2:172.21.15.175:3300/0 conn(0x7fcdc013df80 0x7fcdc015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.476+0000 7fcdb7fff640 1 -- 172.21.15.161:0/1999382136 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc006cd10 con 0x7fcdc013e360 2023-11-24T08:01:12.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.477+0000 7fcdb7fff640 1 --2- 172.21.15.161:0/1999382136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc013e360 0x7fcdc00cf290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0072770 tx=0x7fcda802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4f8eec632516e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdbe7fc640 1 -- 172.21.15.161:0/1999382136 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8031870 con 0x7fcdc013e360 2023-11-24T08:01:12.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdbe7fc640 1 -- 172.21.15.161:0/1999382136 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda80319d0 con 0x7fcdc013e360 2023-11-24T08:01:12.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdbe7fc640 1 -- 172.21.15.161:0/1999382136 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8031d60 con 0x7fcdc013e360 2023-11-24T08:01:12.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 -- 172.21.15.161:0/1999382136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc013e360 msgr2=0x7fcdc00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/1999382136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc013e360 0x7fcdc00cf290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0072770 tx=0x7fcda802b910 comp rx=0 tx=0).stop 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 -- 172.21.15.161:0/1999382136 shutdown_connections 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/1999382136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc015f9c0 0x7fcdc00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/1999382136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc013e360 0x7fcdc00cf290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/1999382136 >> v2:172.21.15.175:3300/0 conn(0x7fcdc013df80 0x7fcdc015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 -- 172.21.15.161:0/1999382136 >> 172.21.15.161:0/1999382136 conn(0x7fcdc006a800 msgr2=0x7fcdc006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.478+0000 7fcdc57c9640 1 -- 172.21.15.161:0/1999382136 shutdown_connections 2023-11-24T08:01:12.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.479+0000 7fcdc57c9640 1 -- 172.21.15.161:0/1999382136 wait complete. 2023-11-24T08:01:12.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.480+0000 7fcdc57c9640 1 Processor -- start 2023-11-24T08:01:12.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.480+0000 7fcdc57c9640 1 -- start start 2023-11-24T08:01:12.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.481+0000 7fcdc57c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdc013df80 0x7fcdc015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.481+0000 7fcdc57c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc013e360 0x7fcdc00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.481+0000 7fcdc57c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 0x7fcdc00b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.481+0000 7fcdc57c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0154730 con 0x7fcdc015f9c0 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.481+0000 7fcdc57c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0153b20 con 0x7fcdc013df80 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.481+0000 7fcdc57c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0153e00 con 0x7fcdc013e360 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 0x7fcdc00b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 0x7fcdc00b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52706/0 (socket says 172.21.15.161:52706) 2023-11-24T08:01:12.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 -- 172.21.15.161:0/3584624136 learned_addr learned my addr 172.21.15.161:0/3584624136 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:12.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdb7fff640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc013e360 0x7fcdc00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbeffd640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdc013df80 0x7fcdc015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 -- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc013e360 msgr2=0x7fcdc00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc013e360 0x7fcdc00afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 -- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdc013df80 msgr2=0x7fcdc015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdc013df80 0x7fcdc015d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 -- 172.21.15.161:0/3584624136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80094d0 con 0x7fcdc015f9c0 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.482+0000 7fcdbf7fe640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 0x7fcdc00b0120 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8007e30 tx=0x7fcdb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.483+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8014620 con 0x7fcdc015f9c0 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.483+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb800ee90 con 0x7fcdc015f9c0 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.483+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb80149c0 con 0x7fcdc015f9c0 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.483+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc01540e0 con 0x7fcdc015f9c0 2023-11-24T08:01:12.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.483+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc015e690 con 0x7fcdc015f9c0 2023-11-24T08:01:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.484+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc01548a0 con 0x7fcdc015f9c0 2023-11-24T08:01:12.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.485+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdb8014b20 con 0x7fcdc015f9c0 2023-11-24T08:01:12.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.486+0000 7fcdb77fe640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcda006ae70 0x7fcda006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.486+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcdb8089f90 con 0x7fcdc015f9c0 2023-11-24T08:01:12.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.487+0000 7fcdbeffd640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcda006ae70 0x7fcda006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.488+0000 7fcdbeffd640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcda006ae70 0x7fcda006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009970 tx=0x7fcdb0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.491+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcdb80bce90 con 0x7fcdc015f9c0 2023-11-24T08:01:12.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.682+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdc00675d0 con 0x7fcdc015f9c0 2023-11-24T08:01:12.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.683+0000 7fcdb77fe640 1 -- 172.21.15.161:0/3584624136 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcdb8054fc0 con 0x7fcdc015f9c0 2023-11-24T08:01:12.685 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:12.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.685+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcda006ae70 msgr2=0x7fcda006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.685+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcda006ae70 0x7fcda006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0009970 tx=0x7fcdb0008040 comp rx=0 tx=0).stop 2023-11-24T08:01:12.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.685+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 msgr2=0x7fcdc00b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.685+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 0x7fcdc00b0120 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8007e30 tx=0x7fcdb800e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 shutdown_connections 2023-11-24T08:01:12.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcda006ae70 0x7fcda006d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcdc015f9c0 0x7fcdc00b0120 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcdc013e360 0x7fcdc00afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 --2- 172.21.15.161:0/3584624136 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcdc013df80 0x7fcdc015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 >> 172.21.15.161:0/3584624136 conn(0x7fcdc006a800 msgr2=0x7fcdc00cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 shutdown_connections 2023-11-24T08:01:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.686+0000 7fcdc57c9640 1 -- 172.21.15.161:0/3584624136 wait complete. 2023-11-24T08:01:12.707 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.926+0000 7f1527035640 1 Processor -- start 2023-11-24T08:01:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.926+0000 7f1527035640 1 -- start start 2023-11-24T08:01:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1527035640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15200b2e00 0x7f1520070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1527035640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f152006cb10 0x7f152006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1527035640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15200706a0 con 0x7f152006c730 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1527035640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15200b3290 con 0x7f152006cb10 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1527035640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200708d0 con 0x7f15200b2e00 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1526834640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f152006cb10 0x7f152006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1526033640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f152006c730 0x7f1520071970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47428/0 (socket says 172.21.15.161:47428) 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.928+0000 7f1526033640 1 -- 172.21.15.161:0/1879893601 learned_addr learned my addr 172.21.15.161:0/1879893601 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:12.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.929+0000 7f1525832640 1 --2- 172.21.15.161:0/1879893601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15200b2e00 0x7f1520070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.929+0000 7f1526834640 1 -- 172.21.15.161:0/1879893601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15200b2e00 msgr2=0x7f1520070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.929+0000 7f1526834640 1 --2- 172.21.15.161:0/1879893601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15200b2e00 0x7f1520070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.929+0000 7f1526834640 1 -- 172.21.15.161:0/1879893601 >> v1:172.21.15.161:6789/0 conn(0x7f152006c730 legacy=0x7f1520071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.929+0000 7f1525031640 1 -- 172.21.15.161:0/1879893601 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775053777 0 0) 0x7f15200706a0 con 0x7f152006c730 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.929+0000 7f1526834640 1 -- 172.21.15.161:0/1879893601 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1520070bb0 con 0x7f152006cb10 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.930+0000 7f1526834640 1 --2- 172.21.15.161:0/1879893601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f152006cfa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b441a6233300f6da server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.930+0000 7f1525031640 1 -- 172.21.15.161:0/1879893601 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151802cc50 con 0x7f152006cb10 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.930+0000 7f1525031640 1 -- 172.21.15.161:0/1879893601 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151802cdb0 con 0x7f152006cb10 2023-11-24T08:01:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.930+0000 7f1525031640 1 -- 172.21.15.161:0/1879893601 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518034660 con 0x7f152006cb10 2023-11-24T08:01:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 -- 172.21.15.161:0/1879893601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 msgr2=0x7f152006cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 --2- 172.21.15.161:0/1879893601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f152006cfa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1518009d90 tx=0x7f151802bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 -- 172.21.15.161:0/1879893601 shutdown_connections 2023-11-24T08:01:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 --2- 172.21.15.161:0/1879893601 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f152006cfa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 --2- 172.21.15.161:0/1879893601 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15200b2e00 0x7f1520070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 -- 172.21.15.161:0/1879893601 >> 172.21.15.161:0/1879893601 conn(0x7f152006a7d0 msgr2=0x7f152006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 -- 172.21.15.161:0/1879893601 shutdown_connections 2023-11-24T08:01:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.931+0000 7f1527035640 1 -- 172.21.15.161:0/1879893601 wait complete. 2023-11-24T08:01:12.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.934+0000 7f1527035640 1 Processor -- start 2023-11-24T08:01:12.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.934+0000 7f1527035640 1 -- start start 2023-11-24T08:01:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.935+0000 7f1527035640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152006c730 0x7f15201f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.935+0000 7f1527035640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f15201f9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.935+0000 7f1527035640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15200b2e00 0x7f15201e6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.935+0000 7f1527035640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520161040 con 0x7f152006cb10 2023-11-24T08:01:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.935+0000 7f1527035640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200ad210 con 0x7f15200b2e00 2023-11-24T08:01:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.935+0000 7f1527035640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15200ac600 con 0x7f152006c730 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f15201f9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f15201f9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52734/0 (socket says 172.21.15.161:52734) 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 -- 172.21.15.161:0/1164697002 learned_addr learned my addr 172.21.15.161:0/1164697002 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1526033640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152006c730 0x7f15201f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 -- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152006c730 msgr2=0x7f15201f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152006c730 0x7f15201f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 -- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15200b2e00 msgr2=0x7f15201e6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15200b2e00 0x7f15201e6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 -- 172.21.15.161:0/1164697002 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518009a70 con 0x7f152006cb10 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1526033640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152006c730 0x7f15201f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.936+0000 7f1525832640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f15201f9cb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f151400e9e0 tx=0x7f151400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.937+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514009670 con 0x7f152006cb10 2023-11-24T08:01:12.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.937+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151400c9d0 con 0x7f152006cb10 2023-11-24T08:01:12.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.937+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400cd80 con 0x7f152006cb10 2023-11-24T08:01:12.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.937+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15200ac8e0 con 0x7f152006cb10 2023-11-24T08:01:12.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.937+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15200acea0 con 0x7f152006cb10 2023-11-24T08:01:12.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.938+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15200ad3a0 con 0x7f152006cb10 2023-11-24T08:01:12.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.939+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1514013470 con 0x7f152006cb10 2023-11-24T08:01:12.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.940+0000 7f151effd640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:12.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.940+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f15140898b0 con 0x7f152006cb10 2023-11-24T08:01:12.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.941+0000 7f1526033640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:12.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.942+0000 7f1526033640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1510001030 tx=0x7f1510009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:12.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:12.945+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15140548d0 con 0x7f152006cb10 2023-11-24T08:01:13.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.135+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1520067450 con 0x7f152006cb10 2023-11-24T08:01:13.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.135+0000 7f151effd640 1 -- 172.21.15.161:0/1164697002 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1514057ef0 con 0x7f152006cb10 2023-11-24T08:01:13.139 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 msgr2=0x7f150c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1510001030 tx=0x7f1510009040 comp rx=0 tx=0).stop 2023-11-24T08:01:13.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 msgr2=0x7f15201f9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f15201f9cb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f151400e9e0 tx=0x7f151400eea0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 shutdown_connections 2023-11-24T08:01:13.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15200b2e00 0x7f15201e6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f152006cb10 0x7f15201f9cb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 --2- 172.21.15.161:0/1164697002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152006c730 0x7f15201f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 >> 172.21.15.161:0/1164697002 conn(0x7f152006a7d0 msgr2=0x7f15200b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:13.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 shutdown_connections 2023-11-24T08:01:13.145 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.138+0000 7f1527035640 1 -- 172.21.15.161:0/1164697002 wait complete. 2023-11-24T08:01:13.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.379+0000 7fd2223b0640 1 Processor -- start 2023-11-24T08:01:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.380+0000 7fd2223b0640 1 -- start start 2023-11-24T08:01:13.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.381+0000 7fd2223b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13df80 0x7fd21c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.381+0000 7fd2223b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd21c0cf9a0 0x7fd21c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.381+0000 7fd2223b0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21c06c470 con 0x7fd21c13e360 2023-11-24T08:01:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.381+0000 7fd2223b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21c06c750 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.381+0000 7fd2223b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c06ca30 con 0x7fd21c13df80 2023-11-24T08:01:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd22094d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd21c0cf9a0 0x7fd21c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd21b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd21c13e360 0x7fd21c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47438/0 (socket says 172.21.15.161:47438) 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd21b7fe640 1 -- 172.21.15.161:0/3884482181 learned_addr learned my addr 172.21.15.161:0/3884482181 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd21bfff640 1 --2- 172.21.15.161:0/3884482181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13df80 0x7fd21c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd22094d640 1 -- 172.21.15.161:0/3884482181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13df80 msgr2=0x7fd21c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd22094d640 1 --2- 172.21.15.161:0/3884482181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13df80 0x7fd21c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd22094d640 1 -- 172.21.15.161:0/3884482181 >> v1:172.21.15.161:6789/0 conn(0x7fd21c13e360 legacy=0x7fd21c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd21affd640 1 -- 172.21.15.161:0/3884482181 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307115791 0 0) 0x7fd21c06c470 con 0x7fd21c13e360 2023-11-24T08:01:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.382+0000 7fd22094d640 1 -- 172.21.15.161:0/3884482181 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c06cd10 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.383+0000 7fd22094d640 1 --2- 172.21.15.161:0/3884482181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c0cd840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9525ee6b87b90a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd21affd640 1 -- 172.21.15.161:0/3884482181 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214031830 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd21affd640 1 -- 172.21.15.161:0/3884482181 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214031990 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd21affd640 1 -- 172.21.15.161:0/3884482181 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214031d20 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 -- 172.21.15.161:0/3884482181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 msgr2=0x7fd21c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3884482181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c0cd840 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 -- 172.21.15.161:0/3884482181 shutdown_connections 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3884482181 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c0cd840 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3884482181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13df80 0x7fd21c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 -- 172.21.15.161:0/3884482181 >> 172.21.15.161:0/3884482181 conn(0x7fd21c06a800 msgr2=0x7fd21c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 -- 172.21.15.161:0/3884482181 shutdown_connections 2023-11-24T08:01:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.384+0000 7fd2223b0640 1 -- 172.21.15.161:0/3884482181 wait complete. 2023-11-24T08:01:13.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.386+0000 7fd2223b0640 1 Processor -- start 2023-11-24T08:01:13.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.386+0000 7fd2223b0640 1 -- start start 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd2223b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c14c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd2223b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd21c13df80 0x7fd21c0a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd2223b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13e360 0x7fd21c1f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd2223b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c1f73d0 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd2223b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c0a92b0 con 0x7fd21c13df80 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd2223b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21c14ba20 con 0x7fd21c13e360 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.387+0000 7fd21bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c14c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c14c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52748/0 (socket says 172.21.15.161:52748) 2023-11-24T08:01:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 -- 172.21.15.161:0/3438745270 learned_addr learned my addr 172.21.15.161:0/3438745270 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 -- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13e360 msgr2=0x7fd21c1f6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13e360 0x7fd21c1f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 -- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd21c13df80 msgr2=0x7fd21c0a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd21c13df80 0x7fd21c0a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 -- 172.21.15.161:0/3438745270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009400 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd21bfff640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c14c7e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd20c007ef0 tx=0x7fd20c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c014620 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c014780 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.388+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c014b10 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.389+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21c14bd00 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.389+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21c14c2c0 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.390+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c14c480 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.391+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd20c014c70 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.392+0000 7fd218ff9640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd1fc06ae40 0x7fd1fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.392+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd20c08a0c0 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.392+0000 7fd21b7fe640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd1fc06ae40 0x7fd1fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.393+0000 7fd21b7fe640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd1fc06ae40 0x7fd1fc06d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd204007fd0 tx=0x7fd204007920 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:13.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.396+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd20c0550e0 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.595+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd21c0675d0 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.596+0000 7fd218ff9640 1 -- 172.21.15.161:0/3438745270 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd20c058700 con 0x7fd21c0cf9a0 2023-11-24T08:01:13.599 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:13.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd1fc06ae40 msgr2=0x7fd1fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd1fc06ae40 0x7fd1fc06d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd204007fd0 tx=0x7fd204007920 comp rx=0 tx=0).stop 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 msgr2=0x7fd21c14c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c14c7e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd20c007ef0 tx=0x7fd20c00e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 shutdown_connections 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd1fc06ae40 0x7fd1fc06d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd21c13e360 0x7fd21c1f6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd21c13df80 0x7fd21c0a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 --2- 172.21.15.161:0/3438745270 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd21c0cf9a0 0x7fd21c14c7e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 >> 172.21.15.161:0/3438745270 conn(0x7fd21c06a800 msgr2=0x7fd21c0ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 shutdown_connections 2023-11-24T08:01:13.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.598+0000 7fd2223b0640 1 -- 172.21.15.161:0/3438745270 wait complete. 2023-11-24T08:01:13.620 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:13.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.834+0000 7f34cb74c640 1 Processor -- start 2023-11-24T08:01:13.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.835+0000 7f34cb74c640 1 -- start start 2023-11-24T08:01:13.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34cb74c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34c4157c30 0x7f34c40cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34cb74c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c41618f0 0x7f34c4070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34cb74c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c4071460 con 0x7f34c4071030 2023-11-24T08:01:13.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34cb74c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c415ea30 con 0x7f34c4157c30 2023-11-24T08:01:13.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34cb74c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c406d860 con 0x7f34c41618f0 2023-11-24T08:01:13.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34c94e8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34c4157c30 0x7f34c40cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34c94e8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34c4157c30 0x7f34c40cd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52762/0 (socket says 172.21.15.161:52762) 2023-11-24T08:01:13.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.836+0000 7f34c94e8640 1 -- 172.21.15.161:0/3694155033 learned_addr learned my addr 172.21.15.161:0/3694155033 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:13.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.837+0000 7f34c94e8640 1 -- 172.21.15.161:0/3694155033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c41618f0 msgr2=0x7f34c4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:13.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.837+0000 7f34c94e8640 1 --2- 172.21.15.161:0/3694155033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c41618f0 0x7f34c4070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.837+0000 7f34c94e8640 1 -- 172.21.15.161:0/3694155033 >> v1:172.21.15.175:6789/0 conn(0x7f34c4071030 legacy=0x7f34c406dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:13.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.837+0000 7f34c94e8640 1 -- 172.21.15.161:0/3694155033 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c415deb0 con 0x7f34c4157c30 2023-11-24T08:01:13.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.838+0000 7f34c94e8640 1 --2- 172.21.15.161:0/3694155033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4157c30 0x7f34c40cd600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f34c40723f0 tx=0x7f34c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f21e61eb8951c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:13.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.838+0000 7f34bbfff640 1 -- 172.21.15.161:0/3694155033 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0031830 con 0x7f34c4157c30 2023-11-24T08:01:13.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.838+0000 7f34bbfff640 1 -- 172.21.15.161:0/3694155033 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c0031990 con 0x7f34c4157c30 2023-11-24T08:01:13.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.838+0000 7f34bbfff640 1 -- 172.21.15.161:0/3694155033 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0031d20 con 0x7f34c4157c30 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 -- 172.21.15.161:0/3694155033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4157c30 msgr2=0x7f34c40cd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 --2- 172.21.15.161:0/3694155033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4157c30 0x7f34c40cd600 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f34c40723f0 tx=0x7f34c002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 -- 172.21.15.161:0/3694155033 shutdown_connections 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 --2- 172.21.15.161:0/3694155033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c41618f0 0x7f34c4070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 --2- 172.21.15.161:0/3694155033 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4157c30 0x7f34c40cd600 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 -- 172.21.15.161:0/3694155033 >> 172.21.15.161:0/3694155033 conn(0x7f34c40cf700 msgr2=0x7f34c40cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 -- 172.21.15.161:0/3694155033 shutdown_connections 2023-11-24T08:01:13.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.839+0000 7f34cb74c640 1 -- 172.21.15.161:0/3694155033 wait complete. 2023-11-24T08:01:13.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.841+0000 7f34cb74c640 1 Processor -- start 2023-11-24T08:01:13.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.841+0000 7f34cb74c640 1 -- start start 2023-11-24T08:01:13.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34cb74c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 0x7f34c41566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34cb74c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c4157c30 0x7f34c41587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34cb74c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34c41618f0 0x7f34c40b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34cb74c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c4156bf0 con 0x7f34c4071030 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34cb74c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c415c060 con 0x7f34c41618f0 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34cb74c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c415c340 con 0x7f34c4157c30 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 0x7f34c41566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 0x7f34c41566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52764/0 (socket says 172.21.15.161:52764) 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 -- 172.21.15.161:0/1892158025 learned_addr learned my addr 172.21.15.161:0/1892158025 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c8ce7640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c4157c30 0x7f34c41587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 -- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c4157c30 msgr2=0x7f34c41587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c4157c30 0x7f34c41587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 -- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34c41618f0 msgr2=0x7f34c40b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:13.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34c41618f0 0x7f34c40b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c94e8640 1 -- 172.21.15.161:0/1892158025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00094d0 con 0x7f34c4071030 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.842+0000 7f34c8ce7640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c4157c30 0x7f34c41587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.843+0000 7f34c94e8640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 0x7f34c41566b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f34c0000c00 tx=0x7f34c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.843+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c003aa60 con 0x7f34c4071030 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.843+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c003abc0 con 0x7f34c4071030 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.843+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c00443f0 con 0x7f34c4071030 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.843+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c415c620 con 0x7f34c4071030 2023-11-24T08:01:13.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.843+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c415cbe0 con 0x7f34c4071030 2023-11-24T08:01:13.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.845+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c415cdd0 con 0x7f34c4071030 2023-11-24T08:01:13.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.845+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34c0044550 con 0x7f34c4071030 2023-11-24T08:01:13.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.846+0000 7f34b9ffb640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f34a806aec0 0x7f34a806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:13.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.846+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f34c00ab870 con 0x7f34c4071030 2023-11-24T08:01:13.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.847+0000 7f34c8ce7640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f34a806aec0 0x7f34a806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:13.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.848+0000 7f34c8ce7640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f34a806aec0 0x7f34a806d380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34b4006fd0 tx=0x7f34b4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:13.851+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34c0076aa0 con 0x7f34c4071030 2023-11-24T08:01:14.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.055+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f34c40675d0 con 0x7f34c4071030 2023-11-24T08:01:14.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.056+0000 7f34b9ffb640 1 -- 172.21.15.161:0/1892158025 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f34c0035080 con 0x7f34c4071030 2023-11-24T08:01:14.058 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:14.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f34a806aec0 msgr2=0x7f34a806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f34a806aec0 0x7f34a806d380 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f34b4006fd0 tx=0x7f34b4008040 comp rx=0 tx=0).stop 2023-11-24T08:01:14.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 msgr2=0x7f34c41566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 0x7f34c41566b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f34c0000c00 tx=0x7f34c00046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 shutdown_connections 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f34a806aec0 0x7f34a806d380 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34c41618f0 0x7f34c40b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f34c4157c30 0x7f34c41587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 --2- 172.21.15.161:0/1892158025 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34c4071030 0x7f34c41566b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 >> 172.21.15.161:0/1892158025 conn(0x7f34c40cf700 msgr2=0x7f34c40b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 shutdown_connections 2023-11-24T08:01:14.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.058+0000 7f34cb74c640 1 -- 172.21.15.161:0/1892158025 wait complete. 2023-11-24T08:01:14.080 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2023-11-24T08:01:14.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:14.081 DEBUG:teuthology.orchestra.run.smithi161:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:14.177 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:14.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:01:14.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:14.177 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:01:14.242 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:01:14.242 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:14.302 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:01:14.303 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:14.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:14.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.576+0000 7ff40ffff640 1 Processor -- start 2023-11-24T08:01:14.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.576+0000 7ff40ffff640 1 -- start start 2023-11-24T08:01:14.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.578+0000 7ff40ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff410143c40 0x7ff410071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:14.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.578+0000 7ff40ffff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff4100ccc10 0x7ff41006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:14.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.578+0000 7ff40ffff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410070e50 con 0x7ff4100717d0 2023-11-24T08:01:14.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.578+0000 7ff40ffff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100723c0 con 0x7ff4100ccc10 2023-11-24T08:01:14.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.578+0000 7ff40ffff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff410144020 con 0x7ff410143c40 2023-11-24T08:01:14.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.578+0000 7ff40f7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff4100ccc10 0x7ff41006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:14.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40effd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff410143c40 0x7ff410071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:14.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40e7fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff4100717d0 0x7ff4100cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:48222/0 (socket says 172.21.15.161:48222) 2023-11-24T08:01:14.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40e7fc640 1 -- 172.21.15.161:0/2739909811 learned_addr learned my addr 172.21.15.161:0/2739909811 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:14.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40f7fe640 1 -- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff410143c40 msgr2=0x7ff410071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:14.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40f7fe640 1 --2- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff410143c40 0x7ff410071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40f7fe640 1 -- 172.21.15.161:0/2739909811 >> v1:172.21.15.175:6789/0 conn(0x7ff4100717d0 legacy=0x7ff4100cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.579+0000 7ff40f7fe640 1 -- 172.21.15.161:0/2739909811 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410071e00 con 0x7ff4100ccc10 2023-11-24T08:01:14.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.581+0000 7ff40f7fe640 1 --2- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4100ccc10 0x7ff41006d160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff408009d90 tx=0x7ff40802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bf0ec839ceab9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:14.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.581+0000 7ff40dffb640 1 -- 172.21.15.161:0/2739909811 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40802cbc0 con 0x7ff4100ccc10 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40dffb640 1 -- 172.21.15.161:0/2739909811 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40802cd20 con 0x7ff4100ccc10 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40dffb640 1 -- 172.21.15.161:0/2739909811 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408034660 con 0x7ff4100ccc10 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 -- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4100ccc10 msgr2=0x7ff41006d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 --2- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4100ccc10 0x7ff41006d160 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff408009d90 tx=0x7ff40802be10 comp rx=0 tx=0).stop 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 -- 172.21.15.161:0/2739909811 shutdown_connections 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 --2- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4100ccc10 0x7ff41006d160 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 --2- 172.21.15.161:0/2739909811 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff410143c40 0x7ff410071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 -- 172.21.15.161:0/2739909811 >> 172.21.15.161:0/2739909811 conn(0x7ff41006a800 msgr2=0x7ff41006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:14.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 -- 172.21.15.161:0/2739909811 shutdown_connections 2023-11-24T08:01:14.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.582+0000 7ff40ffff640 1 -- 172.21.15.161:0/2739909811 wait complete. 2023-11-24T08:01:14.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.585+0000 7ff40ffff640 1 Processor -- start 2023-11-24T08:01:14.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.585+0000 7ff40ffff640 1 -- start start 2023-11-24T08:01:14.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4100717d0 0x7ff4100b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:14.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 0x7ff4100b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40ffff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410143c40 0x7ff4100b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40ffff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100ae2b0 con 0x7ff4100ccc10 2023-11-24T08:01:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40ffff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100ad6a0 con 0x7ff410143c40 2023-11-24T08:01:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40ffff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100ad980 con 0x7ff4100717d0 2023-11-24T08:01:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 0x7ff4100b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:14.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40e7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 0x7ff4100b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52766/0 (socket says 172.21.15.161:52766) 2023-11-24T08:01:14.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.586+0000 7ff40e7fc640 1 -- 172.21.15.161:0/412118786 learned_addr learned my addr 172.21.15.161:0/412118786 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:14.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40f7fe640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410143c40 0x7ff4100b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:14.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40effd640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4100717d0 0x7ff4100b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:14.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40e7fc640 1 -- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4100717d0 msgr2=0x7ff4100b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40e7fc640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4100717d0 0x7ff4100b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40e7fc640 1 -- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410143c40 msgr2=0x7ff4100b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40e7fc640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410143c40 0x7ff4100b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40e7fc640 1 -- 172.21.15.161:0/412118786 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408009a70 con 0x7ff4100ccc10 2023-11-24T08:01:14.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40f7fe640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410143c40 0x7ff4100b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:14.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff40e7fc640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 0x7ff4100b2c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c4a0 tx=0x7ff40400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:14.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.587+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404005ce0 con 0x7ff4100ccc10 2023-11-24T08:01:14.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.588+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404005e40 con 0x7ff4100ccc10 2023-11-24T08:01:14.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.588+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4100adc60 con 0x7ff4100ccc10 2023-11-24T08:01:14.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.588+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404007270 con 0x7ff4100ccc10 2023-11-24T08:01:14.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.588+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41013c8c0 con 0x7ff4100ccc10 2023-11-24T08:01:14.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.589+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410067450 con 0x7ff4100ccc10 2023-11-24T08:01:14.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.590+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff404007490 con 0x7ff4100ccc10 2023-11-24T08:01:14.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.591+0000 7ff3f77fe640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff3fc06ae40 0x7ff3fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:14.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.591+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff404088ab0 con 0x7ff4100ccc10 2023-11-24T08:01:14.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.591+0000 7ff40effd640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff3fc06ae40 0x7ff3fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:14.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.593+0000 7ff40effd640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff3fc06ae40 0x7ff3fc06d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff400009a30 tx=0x7ff400008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:14.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.596+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff404053b80 con 0x7ff4100ccc10 2023-11-24T08:01:14.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.795+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4100b2430 con 0x7ff4100ccc10 2023-11-24T08:01:14.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.797+0000 7ff3f77fe640 1 -- 172.21.15.161:0/412118786 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7ff404017020 con 0x7ff4100ccc10 2023-11-24T08:01:14.799 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:14.799 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff3fc06ae40 msgr2=0x7ff3fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff3fc06ae40 0x7ff3fc06d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff400009a30 tx=0x7ff400008040 comp rx=0 tx=0).stop 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 msgr2=0x7ff4100b2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 0x7ff4100b2c10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff40400c4a0 tx=0x7ff40400c960 comp rx=0 tx=0).stop 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 shutdown_connections 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff3fc06ae40 0x7ff3fc06d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410143c40 0x7ff4100b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4100ccc10 0x7ff4100b2c10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 --2- 172.21.15.161:0/412118786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4100717d0 0x7ff4100b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.799+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 >> 172.21.15.161:0/412118786 conn(0x7ff41006a800 msgr2=0x7ff4100afe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:14.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.800+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 shutdown_connections 2023-11-24T08:01:14.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:14.800+0000 7ff40ffff640 1 -- 172.21.15.161:0/412118786 wait complete. 2023-11-24T08:01:14.819 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:14.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:15.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.027+0000 7f5e251c5640 1 Processor -- start 2023-11-24T08:01:15.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.028+0000 7f5e251c5640 1 -- start start 2023-11-24T08:01:15.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e251c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e200ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e251c5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5e200ced60 0x7f5e200d17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e251c5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e200d1d20 0x7f5e200cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e251c5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200d1390 con 0x7f5e200d1d20 2023-11-24T08:01:15.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e251c5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200d21b0 con 0x7f5e200ced60 2023-11-24T08:01:15.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e251c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200b3400 con 0x7f5e2015d610 2023-11-24T08:01:15.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.029+0000 7f5e1f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e200d1d20 0x7f5e200cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5e200d1d20 0x7f5e200cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52772/0 (socket says 172.21.15.161:52772) 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 -- 172.21.15.161:0/791156105 learned_addr learned my addr 172.21.15.161:0/791156105 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1ed9d640 1 --2- 172.21.15.161:0/791156105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e200ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1e59c640 1 --2- 172.21.15.161:0/791156105 >> v2:172.21.15.175:3300/0 conn(0x7f5e200ced60 0x7f5e200d17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 -- 172.21.15.161:0/791156105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 msgr2=0x7f5e200ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 --2- 172.21.15.161:0/791156105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e200ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 -- 172.21.15.161:0/791156105 >> v2:172.21.15.175:3300/0 conn(0x7f5e200ced60 msgr2=0x7f5e200d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 --2- 172.21.15.161:0/791156105 >> v2:172.21.15.175:3300/0 conn(0x7f5e200ced60 0x7f5e200d17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1f59e640 1 -- 172.21.15.161:0/791156105 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200b27f0 con 0x7f5e200d1d20 2023-11-24T08:01:15.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.030+0000 7f5e1e59c640 1 --2- 172.21.15.161:0/791156105 >> v2:172.21.15.175:3300/0 conn(0x7f5e200ced60 0x7f5e200d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:15.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.031+0000 7f5e1f59e640 1 --2- 172.21.15.161:0/791156105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e200cf830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5e2008d4e0 tx=0x7f5e1802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718340fefa350364 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.031+0000 7f5e1dd9b640 1 -- 172.21.15.161:0/791156105 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1802ca70 con 0x7f5e200d1d20 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.031+0000 7f5e1dd9b640 1 -- 172.21.15.161:0/791156105 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1802cbd0 con 0x7f5e200d1d20 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.031+0000 7f5e1dd9b640 1 -- 172.21.15.161:0/791156105 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e180343f0 con 0x7f5e200d1d20 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 -- 172.21.15.161:0/791156105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 msgr2=0x7f5e200cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 --2- 172.21.15.161:0/791156105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e200cf830 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5e2008d4e0 tx=0x7f5e1802bed0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 -- 172.21.15.161:0/791156105 shutdown_connections 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 --2- 172.21.15.161:0/791156105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e200cf830 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 --2- 172.21.15.161:0/791156105 >> v2:172.21.15.175:3300/0 conn(0x7f5e200ced60 0x7f5e200d17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 --2- 172.21.15.161:0/791156105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e200ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 -- 172.21.15.161:0/791156105 >> 172.21.15.161:0/791156105 conn(0x7f5e2009c540 msgr2=0x7f5e200d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:15.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 -- 172.21.15.161:0/791156105 shutdown_connections 2023-11-24T08:01:15.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.032+0000 7f5e251c5640 1 -- 172.21.15.161:0/791156105 wait complete. 2023-11-24T08:01:15.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.034+0000 7f5e251c5640 1 Processor -- start 2023-11-24T08:01:15.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.034+0000 7f5e251c5640 1 -- start start 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e251c5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e200ced60 0x7f5e201f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e251c5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e201603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e251c5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e201f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e251c5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e201f3fc0 con 0x7f5e200d1d20 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e251c5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2015dc50 con 0x7f5e200ced60 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e251c5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200b80a0 con 0x7f5e2015d610 2023-11-24T08:01:15.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e1e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e201603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e1e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e201603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52774/0 (socket says 172.21.15.161:52774) 2023-11-24T08:01:15.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e1e59c640 1 -- 172.21.15.161:0/2247595109 learned_addr learned my addr 172.21.15.161:0/2247595109 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.035+0000 7f5e1f59e640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e201f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1e59c640 1 -- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 msgr2=0x7f5e201f64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1ed9d640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e200ced60 0x7f5e201f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1e59c640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e201f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1e59c640 1 -- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e200ced60 msgr2=0x7f5e201f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1e59c640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e200ced60 0x7f5e201f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1e59c640 1 -- 172.21.15.161:0/2247595109 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18009b30 con 0x7f5e200d1d20 2023-11-24T08:01:15.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e1e59c640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e201603b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c7f0 tx=0x7f5e1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400cea0 con 0x7f5e200d1d20 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14007a30 con 0x7f5e200d1d20 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e200b8380 con 0x7f5e200d1d20 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14007dc0 con 0x7f5e200d1d20 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.036+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2015e180 con 0x7f5e200d1d20 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.037+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2015e3a0 con 0x7f5e200d1d20 2023-11-24T08:01:15.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.038+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e140113f0 con 0x7f5e200d1d20 2023-11-24T08:01:15.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.039+0000 7f5e077fe640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e0c06ae40 0x7f5e0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.039+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5e140897a0 con 0x7f5e200d1d20 2023-11-24T08:01:15.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.040+0000 7f5e1ed9d640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e0c06ae40 0x7f5e0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.041+0000 7f5e1ed9d640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e0c06ae40 0x7f5e0c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006fd0 tx=0x7f5e10008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.044+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e140547c0 con 0x7f5e200d1d20 2023-11-24T08:01:15.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.218+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e200675d0 con 0x7f5e200d1d20 2023-11-24T08:01:15.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.218+0000 7f5e077fe640 1 -- 172.21.15.161:0/2247595109 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e14057de0 con 0x7f5e200d1d20 2023-11-24T08:01:15.221 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:15.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e0c06ae40 msgr2=0x7f5e0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e0c06ae40 0x7f5e0c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006fd0 tx=0x7f5e10008040 comp rx=0 tx=0).stop 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 msgr2=0x7f5e201603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e201603b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400c7f0 tx=0x7f5e1400ccb0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 shutdown_connections 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e0c06ae40 0x7f5e0c06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e2015d610 0x7f5e201f64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e200d1d20 0x7f5e201603b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.221+0000 7f5e251c5640 1 --2- 172.21.15.161:0/2247595109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e200ced60 0x7f5e201f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.222+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 >> 172.21.15.161:0/2247595109 conn(0x7f5e2009c540 msgr2=0x7f5e2015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.222+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 shutdown_connections 2023-11-24T08:01:15.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.222+0000 7f5e251c5640 1 -- 172.21.15.161:0/2247595109 wait complete. 2023-11-24T08:01:15.242 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:15.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.447+0000 7f53e0690640 1 Processor -- start 2023-11-24T08:01:15.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.448+0000 7f53e0690640 1 -- start start 2023-11-24T08:01:15.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.449+0000 7f53e0690640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53d80cfcf0 0x7f53d8160700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.449+0000 7f53e0690640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80d4160 con 0x7f53d80d3910 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.449+0000 7f53e0690640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53d80b2420 con 0x7f53d80d00d0 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.449+0000 7f53e0690640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53d80ceff0 con 0x7f53d80cfcf0 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.449+0000 7f53de42c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f53d80cfcf0 0x7f53d8160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.450+0000 7f53ddc2b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f53d80d3910 0x7f53d80b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47440/0 (socket says 172.21.15.161:47440) 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.450+0000 7f53ddc2b640 1 -- 172.21.15.161:0/3959869952 learned_addr learned my addr 172.21.15.161:0/3959869952 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:15.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.450+0000 7f53dd42a640 1 -- 172.21.15.161:0/3959869952 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554003661 0 0) 0x7f53d80d4160 con 0x7f53d80d3910 2023-11-24T08:01:15.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.450+0000 7f53de42c640 1 -- 172.21.15.161:0/3959869952 >> v1:172.21.15.175:6789/0 conn(0x7f53d80d00d0 legacy=0x7f53d80b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:15.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.450+0000 7f53de42c640 1 -- 172.21.15.161:0/3959869952 >> v1:172.21.15.161:6789/0 conn(0x7f53d80d3910 legacy=0x7f53d80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.450+0000 7f53de42c640 1 -- 172.21.15.161:0/3959869952 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d80b2140 con 0x7f53d80cfcf0 2023-11-24T08:01:15.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.451+0000 7f53de42c640 1 --2- 172.21.15.161:0/3959869952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80cfcf0 0x7f53d8160700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009d90 tx=0x7f53cc02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac4b7c3a6ea3e05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.451+0000 7f53dd42a640 1 -- 172.21.15.161:0/3959869952 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02cbd0 con 0x7f53d80cfcf0 2023-11-24T08:01:15.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53dd42a640 1 -- 172.21.15.161:0/3959869952 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc02cd30 con 0x7f53d80cfcf0 2023-11-24T08:01:15.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53dd42a640 1 -- 172.21.15.161:0/3959869952 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02cea0 con 0x7f53d80cfcf0 2023-11-24T08:01:15.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 -- 172.21.15.161:0/3959869952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80cfcf0 msgr2=0x7f53d8160700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 --2- 172.21.15.161:0/3959869952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80cfcf0 0x7f53d8160700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009d90 tx=0x7f53cc02be20 comp rx=0 tx=0).stop 2023-11-24T08:01:15.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 -- 172.21.15.161:0/3959869952 shutdown_connections 2023-11-24T08:01:15.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 --2- 172.21.15.161:0/3959869952 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80cfcf0 0x7f53d8160700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 -- 172.21.15.161:0/3959869952 >> 172.21.15.161:0/3959869952 conn(0x7f53d809c530 msgr2=0x7f53d80d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:15.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 -- 172.21.15.161:0/3959869952 shutdown_connections 2023-11-24T08:01:15.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.452+0000 7f53e0690640 1 -- 172.21.15.161:0/3959869952 wait complete. 2023-11-24T08:01:15.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.454+0000 7f53e0690640 1 Processor -- start 2023-11-24T08:01:15.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.454+0000 7f53e0690640 1 -- start start 2023-11-24T08:01:15.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.455+0000 7f53e0690640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d80cfcf0 0x7f53d815e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.455+0000 7f53e0690640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d80d00d0 0x7f53d814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.455+0000 7f53e0690640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 0x7f53d814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.455+0000 7f53e0690640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80c8310 con 0x7f53d80d3910 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.455+0000 7f53e0690640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80c85f0 con 0x7f53d80cfcf0 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.455+0000 7f53e0690640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d80c88d0 con 0x7f53d80d00d0 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 0x7f53d814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 0x7f53d814fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52802/0 (socket says 172.21.15.161:52802) 2023-11-24T08:01:15.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 -- 172.21.15.161:0/4099480730 learned_addr learned my addr 172.21.15.161:0/4099480730 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53ddc2b640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d80d00d0 0x7f53d814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53de42c640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d80cfcf0 0x7f53d815e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 -- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d80d00d0 msgr2=0x7f53d814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d80d00d0 0x7f53d814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 -- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d80cfcf0 msgr2=0x7f53d815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d80cfcf0 0x7f53d815e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.456+0000 7f53dec2d640 1 -- 172.21.15.161:0/4099480730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc009a70 con 0x7f53d80d3910 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.457+0000 7f53dec2d640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 0x7f53d814fac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c3e0 tx=0x7f53d000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.457+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011790 con 0x7f53d80d3910 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.457+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d00118f0 con 0x7f53d80d3910 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.457+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0011ce0 con 0x7f53d80d3910 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.457+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d80c8bb0 con 0x7f53d80d3910 2023-11-24T08:01:15.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.457+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d815ebb0 con 0x7f53d80d3910 2023-11-24T08:01:15.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.459+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53d80cebf0 con 0x7f53d80d3910 2023-11-24T08:01:15.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.459+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53d001c460 con 0x7f53d80d3910 2023-11-24T08:01:15.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.461+0000 7f53d6ffd640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f53bc06ae40 0x7f53bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.461+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f53d0089340 con 0x7f53d80d3910 2023-11-24T08:01:15.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.461+0000 7f53de42c640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f53bc06ae40 0x7f53bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.463+0000 7f53de42c640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f53bc06ae40 0x7f53bc06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53cc036000 tx=0x7f53cc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.465+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53d80cebf0 con 0x7f53d80d3910 2023-11-24T08:01:15.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.656+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53d80cebf0 con 0x7f53d80d3910 2023-11-24T08:01:15.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.657+0000 7f53d6ffd640 1 -- 172.21.15.161:0/4099480730 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53d80cebf0 con 0x7f53d80d3910 2023-11-24T08:01:15.660 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:15.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f53bc06ae40 msgr2=0x7f53bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f53bc06ae40 0x7f53bc06d300 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f53cc036000 tx=0x7f53cc030000 comp rx=0 tx=0).stop 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 msgr2=0x7f53d814fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 0x7f53d814fac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f53d000c3e0 tx=0x7f53d000c8a0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 shutdown_connections 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f53bc06ae40 0x7f53bc06d300 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53d80d3910 0x7f53d814fac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53d80d00d0 0x7f53d814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 --2- 172.21.15.161:0/4099480730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53d80cfcf0 0x7f53d815e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 >> 172.21.15.161:0/4099480730 conn(0x7f53d809c530 msgr2=0x7f53d8155850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:15.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 shutdown_connections 2023-11-24T08:01:15.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.660+0000 7f53e0690640 1 -- 172.21.15.161:0/4099480730 wait complete. 2023-11-24T08:01:15.681 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:15.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.885+0000 7f124687c640 1 Processor -- start 2023-11-24T08:01:15.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.886+0000 7f124687c640 1 -- start start 2023-11-24T08:01:15.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f124687c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1240160f80 0x7f1240161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f124687c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f12400ce8f0 0x7f12400ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f124687c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12401618a0 con 0x7f12400cfbe0 2023-11-24T08:01:15.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f124687c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12400d0de0 con 0x7f12400ce8f0 2023-11-24T08:01:15.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f124687c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12400d10c0 con 0x7f1240160f80 2023-11-24T08:01:15.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f1237fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f12400ce8f0 0x7f12400ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f1237fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f12400ce8f0 0x7f12400ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52814/0 (socket says 172.21.15.161:52814) 2023-11-24T08:01:15.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.887+0000 7f1237fff640 1 -- 172.21.15.161:0/2914465052 learned_addr learned my addr 172.21.15.161:0/2914465052 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.888+0000 7f123ffff640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1240160f80 0x7f1240161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.888+0000 7f1237fff640 1 -- 172.21.15.161:0/2914465052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1240160f80 msgr2=0x7f1240161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.888+0000 7f1237fff640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1240160f80 0x7f1240161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.888+0000 7f1237fff640 1 -- 172.21.15.161:0/2914465052 >> v1:172.21.15.175:6789/0 conn(0x7f12400cfbe0 legacy=0x7f12400d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.888+0000 7f1237fff640 1 -- 172.21.15.161:0/2914465052 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12400d13a0 con 0x7f12400ce8f0 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.888+0000 7f123ffff640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1240160f80 0x7f1240161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:15.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.889+0000 7f1237fff640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12400ced50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f122802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f84a485fc9fd8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.889+0000 7f123f7fe640 1 -- 172.21.15.161:0/2914465052 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228031640 con 0x7f12400ce8f0 2023-11-24T08:01:15.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.889+0000 7f123f7fe640 1 -- 172.21.15.161:0/2914465052 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12280317a0 con 0x7f12400ce8f0 2023-11-24T08:01:15.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.889+0000 7f123f7fe640 1 -- 172.21.15.161:0/2914465052 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1228031b30 con 0x7f12400ce8f0 2023-11-24T08:01:15.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 -- 172.21.15.161:0/2914465052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 msgr2=0x7f12400ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12400ced50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1228009870 tx=0x7f122802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 -- 172.21.15.161:0/2914465052 shutdown_connections 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12400ced50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 --2- 172.21.15.161:0/2914465052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1240160f80 0x7f1240161360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 -- 172.21.15.161:0/2914465052 >> 172.21.15.161:0/2914465052 conn(0x7f124009c550 msgr2=0x7f12400d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 -- 172.21.15.161:0/2914465052 shutdown_connections 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.890+0000 7f124687c640 1 -- 172.21.15.161:0/2914465052 wait complete. 2023-11-24T08:01:15.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.892+0000 7f124687c640 1 Processor -- start 2023-11-24T08:01:15.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.892+0000 7f124687c640 1 -- start start 2023-11-24T08:01:15.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f124687c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12401565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f124687c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12400cfbe0 0x7f12400cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f124687c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1240160f80 0x7f12400cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f124687c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124015e2b0 con 0x7f12400ce8f0 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f124687c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124015d6c0 con 0x7f1240160f80 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f124687c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f124015d910 con 0x7f12400cfbe0 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12401565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12401565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52816/0 (socket says 172.21.15.161:52816) 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 -- 172.21.15.161:0/2541005142 learned_addr learned my addr 172.21.15.161:0/2541005142 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 -- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12400cfbe0 msgr2=0x7f12400cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12400cfbe0 0x7f12400cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 -- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1240160f80 msgr2=0x7f12400cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1240160f80 0x7f12400cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 -- 172.21.15.161:0/2541005142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280094d0 con 0x7f12400ce8f0 2023-11-24T08:01:15.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.893+0000 7f123ffff640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12401565c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f123000c820 tx=0x7f123000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.894+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230007a30 con 0x7f12400ce8f0 2023-11-24T08:01:15.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.894+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230007b90 con 0x7f12400ce8f0 2023-11-24T08:01:15.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.894+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123000ce70 con 0x7f12400ce8f0 2023-11-24T08:01:15.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.894+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124015dbf0 con 0x7f12400ce8f0 2023-11-24T08:01:15.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.894+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1240156b00 con 0x7f12400ce8f0 2023-11-24T08:01:15.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.895+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124015e3f0 con 0x7f12400ce8f0 2023-11-24T08:01:15.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.896+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f12300113f0 con 0x7f12400ce8f0 2023-11-24T08:01:15.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.897+0000 7f123d7fa640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae70 0x7f122006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:15.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.897+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1230089840 con 0x7f12400ce8f0 2023-11-24T08:01:15.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.898+0000 7f1237fff640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae70 0x7f122006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:15.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.899+0000 7f1237fff640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae70 0x7f122006d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1228036000 tx=0x7f1228030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:15.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:15.901+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f124015e3f0 con 0x7f12400ce8f0 2023-11-24T08:01:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.075+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f124015e3f0 con 0x7f12400ce8f0 2023-11-24T08:01:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.076+0000 7f123d7fa640 1 -- 172.21.15.161:0/2541005142 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f124015e3f0 con 0x7f12400ce8f0 2023-11-24T08:01:16.079 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:16.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae70 msgr2=0x7f122006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae70 0x7f122006d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1228036000 tx=0x7f1228030000 comp rx=0 tx=0).stop 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 msgr2=0x7f12401565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12401565c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f123000c820 tx=0x7f123000cc20 comp rx=0 tx=0).stop 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 shutdown_connections 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f122006ae70 0x7f122006d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1240160f80 0x7f12400cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f12400cfbe0 0x7f12400cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 --2- 172.21.15.161:0/2541005142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f12400ce8f0 0x7f12401565c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 >> 172.21.15.161:0/2541005142 conn(0x7f124009c550 msgr2=0x7f12400d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 shutdown_connections 2023-11-24T08:01:16.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.079+0000 7f124687c640 1 -- 172.21.15.161:0/2541005142 wait complete. 2023-11-24T08:01:16.099 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:16.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.303+0000 7ff0586d3640 1 Processor -- start 2023-11-24T08:01:16.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.303+0000 7ff0586d3640 1 -- start start 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.304+0000 7ff0586d3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff0500cf9a0 0x7ff05015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff0586d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff05015e1e0 0x7ff0500702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff0586d3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500b1ee0 con 0x7ff050143ae0 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff0586d3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500b2780 con 0x7ff0500cf9a0 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff0586d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05015e990 con 0x7ff05015e1e0 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff05646f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff050143ae0 0x7ff0500cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47444/0 (socket says 172.21.15.161:47444) 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff05646f640 1 -- 172.21.15.161:0/2674883096 learned_addr learned my addr 172.21.15.161:0/2674883096 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:16.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff055c6e640 1 --2- 172.21.15.161:0/2674883096 >> v2:172.21.15.161:3300/0 conn(0x7ff0500cf9a0 0x7ff05015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff056c70640 1 --2- 172.21.15.161:0/2674883096 >> v2:172.21.15.175:3300/0 conn(0x7ff05015e1e0 0x7ff0500702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff05546d640 1 -- 172.21.15.161:0/2674883096 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397610378 0 0) 0x7ff0500b1ee0 con 0x7ff050143ae0 2023-11-24T08:01:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff055c6e640 1 -- 172.21.15.161:0/2674883096 >> v2:172.21.15.175:3300/0 conn(0x7ff05015e1e0 msgr2=0x7ff0500702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff055c6e640 1 --2- 172.21.15.161:0/2674883096 >> v2:172.21.15.175:3300/0 conn(0x7ff05015e1e0 0x7ff0500702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff055c6e640 1 -- 172.21.15.161:0/2674883096 >> v1:172.21.15.161:6789/0 conn(0x7ff050143ae0 legacy=0x7ff0500cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.305+0000 7ff055c6e640 1 -- 172.21.15.161:0/2674883096 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500b2130 con 0x7ff0500cf9a0 2023-11-24T08:01:16.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff055c6e640 1 --2- 172.21.15.161:0/2674883096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500cf9a0 0x7ff05015dca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ae9d0 tx=0x7ff04002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c22b68ce5755775 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff05546d640 1 -- 172.21.15.161:0/2674883096 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040031830 con 0x7ff0500cf9a0 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff05546d640 1 -- 172.21.15.161:0/2674883096 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040031990 con 0x7ff0500cf9a0 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff05546d640 1 -- 172.21.15.161:0/2674883096 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040031d20 con 0x7ff0500cf9a0 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff0586d3640 1 -- 172.21.15.161:0/2674883096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500cf9a0 msgr2=0x7ff05015dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff0586d3640 1 --2- 172.21.15.161:0/2674883096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500cf9a0 0x7ff05015dca0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0500ae9d0 tx=0x7ff04002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff0586d3640 1 -- 172.21.15.161:0/2674883096 shutdown_connections 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff0586d3640 1 --2- 172.21.15.161:0/2674883096 >> v2:172.21.15.175:3300/0 conn(0x7ff05015e1e0 0x7ff0500702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff0586d3640 1 --2- 172.21.15.161:0/2674883096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0500cf9a0 0x7ff05015dca0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.307+0000 7ff0586d3640 1 -- 172.21.15.161:0/2674883096 >> 172.21.15.161:0/2674883096 conn(0x7ff05006a800 msgr2=0x7ff05006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.308+0000 7ff0586d3640 1 -- 172.21.15.161:0/2674883096 shutdown_connections 2023-11-24T08:01:16.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.308+0000 7ff0586d3640 1 -- 172.21.15.161:0/2674883096 wait complete. 2023-11-24T08:01:16.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.309+0000 7ff0586d3640 1 Processor -- start 2023-11-24T08:01:16.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.309+0000 7ff0586d3640 1 -- start start 2023-11-24T08:01:16.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.310+0000 7ff0586d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0500cf9a0 0x7ff0501f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.310+0000 7ff0586d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff050143ae0 0x7ff0500ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.310+0000 7ff0586d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 0x7ff0500b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.310+0000 7ff0586d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c4b70 con 0x7ff05015e1e0 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.310+0000 7ff0586d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0501f2960 con 0x7ff0500cf9a0 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.310+0000 7ff0586d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500c3ef0 con 0x7ff050143ae0 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 0x7ff0500b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 0x7ff0500b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52834/0 (socket says 172.21.15.161:52834) 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 -- 172.21.15.161:0/66732571 learned_addr learned my addr 172.21.15.161:0/66732571 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff05646f640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0500cf9a0 0x7ff0501f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 -- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff050143ae0 msgr2=0x7ff0500ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff050143ae0 0x7ff0500ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 -- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0500cf9a0 msgr2=0x7ff0501f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0500cf9a0 0x7ff0501f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 -- 172.21.15.161:0/66732571 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009400 con 0x7ff05015e1e0 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff056c70640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 0x7ff0500b0bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff048007e40 tx=0x7ff04800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048014620 con 0x7ff05015e1e0 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04800ee90 con 0x7ff05015e1e0 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500c41d0 con 0x7ff05015e1e0 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.311+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0480149e0 con 0x7ff05015e1e0 2023-11-24T08:01:16.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.312+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500c4790 con 0x7ff05015e1e0 2023-11-24T08:01:16.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.313+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0500c4cb0 con 0x7ff05015e1e0 2023-11-24T08:01:16.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.314+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff048014b40 con 0x7ff05015e1e0 2023-11-24T08:01:16.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.315+0000 7ff046ffd640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff03406ae40 0x7ff03406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.315+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff04808a100 con 0x7ff05015e1e0 2023-11-24T08:01:16.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.316+0000 7ff05646f640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff03406ae40 0x7ff03406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.317+0000 7ff05646f640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff03406ae40 0x7ff03406d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff04c007fd0 tx=0x7ff04c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:16.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.320+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0500c4cb0 con 0x7ff05015e1e0 2023-11-24T08:01:16.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.510+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff0500c4cb0 con 0x7ff05015e1e0 2023-11-24T08:01:16.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.511+0000 7ff046ffd640 1 -- 172.21.15.161:0/66732571 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff0500c4cb0 con 0x7ff05015e1e0 2023-11-24T08:01:16.513 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:16.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.513+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff03406ae40 msgr2=0x7ff03406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.513+0000 7ff0586d3640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff03406ae40 0x7ff03406d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff04c007fd0 tx=0x7ff04c009040 comp rx=0 tx=0).stop 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.513+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 msgr2=0x7ff0500b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.513+0000 7ff0586d3640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 0x7ff0500b0bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff048007e40 tx=0x7ff04800e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 shutdown_connections 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff03406ae40 0x7ff03406d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff05015e1e0 0x7ff0500b0bc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff050143ae0 0x7ff0500ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 --2- 172.21.15.161:0/66732571 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0500cf9a0 0x7ff0501f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 >> 172.21.15.161:0/66732571 conn(0x7ff05006a800 msgr2=0x7ff05006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 shutdown_connections 2023-11-24T08:01:16.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.514+0000 7ff0586d3640 1 -- 172.21.15.161:0/66732571 wait complete. 2023-11-24T08:01:16.534 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:01:16.534 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:16.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:16.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.813+0000 7f89f4190640 1 Processor -- start 2023-11-24T08:01:16.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.814+0000 7f89f4190640 1 -- start start 2023-11-24T08:01:16.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.815+0000 7f89f4190640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ec13e360 0x7f89ec0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.815+0000 7f89f4190640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f89ec15f9c0 0x7f89ec0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.815+0000 7f89f4190640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec15c5f0 con 0x7f89ec13df80 2023-11-24T08:01:16.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.815+0000 7f89f4190640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec06c470 con 0x7f89ec15f9c0 2023-11-24T08:01:16.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.815+0000 7f89f4190640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec06c750 con 0x7f89ec13e360 2023-11-24T08:01:16.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f1f2c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f89ec13df80 0x7f89ec15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47460/0 (socket says 172.21.15.161:47460) 2023-11-24T08:01:16.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f1f2c640 1 -- 172.21.15.161:0/1036332840 learned_addr learned my addr 172.21.15.161:0/1036332840 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:16.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f272d640 1 --2- 172.21.15.161:0/1036332840 >> v2:172.21.15.175:3300/0 conn(0x7f89ec15f9c0 0x7f89ec0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894348594 0 0) 0x7f89ec15c5f0 con 0x7f89ec13df80 2023-11-24T08:01:16.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d8003520 con 0x7f89ec13df80 2023-11-24T08:01:16.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f172b640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ec13e360 0x7f89ec0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 439722441 0 0) 0x7f89d8003520 con 0x7f89ec13df80 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ec13e360 msgr2=0x7f89ec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ec13e360 0x7f89ec0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 >> v2:172.21.15.175:3300/0 conn(0x7f89ec15f9c0 msgr2=0x7f89ec0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.816+0000 7f89f0f2a640 1 --2- 172.21.15.161:0/1036332840 >> v2:172.21.15.175:3300/0 conn(0x7f89ec15f9c0 0x7f89ec0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec06ca30 con 0x7f89ec13df80 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f89e8001670 con 0x7f89ec13df80 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 >> v1:172.21.15.161:6789/0 conn(0x7f89ec13df80 legacy=0x7f89ec15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d8003970 0x7f89d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80047c0 0x7f89d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d8005180 0x7f89d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec06c470 con 0x7f89d80047c0 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec06c750 con 0x7f89d8003970 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d800bef0 con 0x7f89d8005180 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89ec13e360 0x7f89ec0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:16.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80047c0 0x7f89d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f1f2c640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d8003970 0x7f89d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f272d640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d8005180 0x7f89d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 -- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d8005180 msgr2=0x7f89d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d8005180 0x7f89d800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 -- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d8003970 msgr2=0x7f89d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d8003970 0x7f89d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f172b640 1 -- 172.21.15.161:0/1036332840 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8003520 con 0x7f89d80047c0 2023-11-24T08:01:16.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.817+0000 7f89f1f2c640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89d8003970 0x7f89d8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:16.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f172b640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80047c0 0x7f89d8004c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f89dc006fd0 tx=0x7f89d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6786e19df272c41c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:16.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc034680 con 0x7f89d80047c0 2023-11-24T08:01:16.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc0347e0 con 0x7f89d80047c0 2023-11-24T08:01:16.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f0f2a640 1 -- 172.21.15.161:0/1036332840 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc034b70 con 0x7f89d80047c0 2023-11-24T08:01:16.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f4190640 1 -- 172.21.15.161:0/1036332840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80047c0 msgr2=0x7f89d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f4190640 1 --2- 172.21.15.161:0/1036332840 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89d80047c0 0x7f89d8004c40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f89dc006fd0 tx=0x7f89d80057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.819+0000 7f89f272d640 1 -- 172.21.15.161:0/1036332840 reap_dead start 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.820+0000 7f89f4190640 1 -- 172.21.15.161:0/1036332840 shutdown_connections 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.820+0000 7f89f4190640 1 -- 172.21.15.161:0/1036332840 >> 172.21.15.161:0/1036332840 conn(0x7f89ec06a800 msgr2=0x7f89ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.820+0000 7f89f4190640 1 -- 172.21.15.161:0/1036332840 shutdown_connections 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.820+0000 7f89f4190640 1 -- 172.21.15.161:0/1036332840 wait complete. 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.821+0000 7f89f4190640 1 Processor -- start 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.822+0000 7f89f4190640 1 -- start start 2023-11-24T08:01:16.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.822+0000 7f89f4190640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d80047c0 0x7f89ec153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f4190640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 0x7f89ec1f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f4190640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ec0b2f30 0x7f89ec0b33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f4190640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0ad210 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f4190640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec1f7750 con 0x7f89ec0b2f30 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f4190640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0b38f0 con 0x7f89d80047c0 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 0x7f89ec1f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 0x7f89ec1f67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52848/0 (socket says 172.21.15.161:52848) 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 -- 172.21.15.161:0/1484914529 learned_addr learned my addr 172.21.15.161:0/1484914529 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 -- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d80047c0 msgr2=0x7f89ec153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d80047c0 0x7f89ec153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 -- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ec0b2f30 msgr2=0x7f89ec0b33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f272d640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ec0b2f30 0x7f89ec0b33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ec0b2f30 0x7f89ec0b33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.823+0000 7f89f172b640 1 -- 172.21.15.161:0/1484914529 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0aa040 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.824+0000 7f89f172b640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 0x7f89ec1f67b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0097c0 tx=0x7f89dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:16.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.824+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc03d810 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.824+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc03d970 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.824+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc03dd20 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.824+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec13ddb0 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.824+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec1f7190 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.825+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec067000 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.826+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89dc03b040 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.827+0000 7f89e27fc640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f89d006ae40 0x7f89d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:16.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.827+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f89dc0aabb0 con 0x7f89ec0a9bc0 2023-11-24T08:01:16.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.828+0000 7f89f1f2c640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f89d006ae40 0x7f89d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:16.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.829+0000 7f89f1f2c640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f89d006ae40 0x7f89d006d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89e8000f60 tx=0x7f89e8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:16.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:16.832+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89dc075c80 con 0x7f89ec0a9bc0 2023-11-24T08:01:17.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.019+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89ec15c3f0 con 0x7f89ec0a9bc0 2023-11-24T08:01:17.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.022+0000 7f89e27fc640 1 -- 172.21.15.161:0/1484914529 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f89ec15c3f0 con 0x7f89ec0a9bc0 2023-11-24T08:01:17.024 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:17.025 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:17.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.024+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f89d006ae40 msgr2=0x7f89d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.024+0000 7f89f4190640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f89d006ae40 0x7f89d006d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f89e8000f60 tx=0x7f89e8009040 comp rx=0 tx=0).stop 2023-11-24T08:01:17.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.024+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 msgr2=0x7f89ec1f67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.024+0000 7f89f4190640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 0x7f89ec1f67b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0097c0 tx=0x7f89dc004730 comp rx=0 tx=0).stop 2023-11-24T08:01:17.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 shutdown_connections 2023-11-24T08:01:17.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f89d006ae40 0x7f89d006d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f89ec0b2f30 0x7f89ec0b33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89ec0a9bc0 0x7f89ec1f67b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 --2- 172.21.15.161:0/1484914529 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f89d80047c0 0x7f89ec153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 >> 172.21.15.161:0/1484914529 conn(0x7f89ec06a800 msgr2=0x7f89ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:17.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 shutdown_connections 2023-11-24T08:01:17.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.025+0000 7f89f4190640 1 -- 172.21.15.161:0/1484914529 wait complete. 2023-11-24T08:01:17.045 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:17.046 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:17.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.254+0000 7fab31a09640 1 Processor -- start 2023-11-24T08:01:17.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.254+0000 7fab31a09640 1 -- start start 2023-11-24T08:01:17.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.256+0000 7fab31a09640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab2c0cf9a0 0x7fab2c166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.256+0000 7fab31a09640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c15c5f0 con 0x7fab2c13df80 2023-11-24T08:01:17.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.256+0000 7fab31a09640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c06c470 con 0x7fab2c13e360 2023-11-24T08:01:17.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.256+0000 7fab31a09640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c06c750 con 0x7fab2c0cf9a0 2023-11-24T08:01:17.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.256+0000 7fab2affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fab2c13df80 0x7fab2c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47464/0 (socket says 172.21.15.161:47464) 2023-11-24T08:01:17.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.256+0000 7fab2affd640 1 -- 172.21.15.161:0/1961299820 learned_addr learned my addr 172.21.15.161:0/1961299820 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:17.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.257+0000 7fab2b7fe640 1 --2- 172.21.15.161:0/1961299820 >> v2:172.21.15.161:3300/0 conn(0x7fab2c0cf9a0 0x7fab2c166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.257+0000 7fab29ffb640 1 -- 172.21.15.161:0/1961299820 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2171556990 0 0) 0x7fab2c15c5f0 con 0x7fab2c13df80 2023-11-24T08:01:17.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.257+0000 7fab29ffb640 1 -- 172.21.15.161:0/1961299820 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab18003520 con 0x7fab2c13df80 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.257+0000 7fab2b7fe640 1 -- 172.21.15.161:0/1961299820 >> v1:172.21.15.175:6789/0 conn(0x7fab2c13e360 legacy=0x7fab2c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.257+0000 7fab2b7fe640 1 -- 172.21.15.161:0/1961299820 >> v1:172.21.15.161:6789/0 conn(0x7fab2c13df80 legacy=0x7fab2c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.257+0000 7fab2b7fe640 1 -- 172.21.15.161:0/1961299820 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c06ca30 con 0x7fab2c0cf9a0 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.258+0000 7fab2b7fe640 1 --2- 172.21.15.161:0/1961299820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c166030 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab240097a0 tx=0x7fab2402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b6764f274af175 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.258+0000 7fab29ffb640 1 -- 172.21.15.161:0/1961299820 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24030610 con 0x7fab2c0cf9a0 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.258+0000 7fab29ffb640 1 -- 172.21.15.161:0/1961299820 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab24030770 con 0x7fab2c0cf9a0 2023-11-24T08:01:17.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab29ffb640 1 -- 172.21.15.161:0/1961299820 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24030b00 con 0x7fab2c0cf9a0 2023-11-24T08:01:17.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 -- 172.21.15.161:0/1961299820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c0cf9a0 msgr2=0x7fab2c166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 --2- 172.21.15.161:0/1961299820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c166030 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab240097a0 tx=0x7fab2402b960 comp rx=0 tx=0).stop 2023-11-24T08:01:17.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 -- 172.21.15.161:0/1961299820 shutdown_connections 2023-11-24T08:01:17.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 --2- 172.21.15.161:0/1961299820 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c166030 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 -- 172.21.15.161:0/1961299820 >> 172.21.15.161:0/1961299820 conn(0x7fab2c06a800 msgr2=0x7fab2c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:17.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 -- 172.21.15.161:0/1961299820 shutdown_connections 2023-11-24T08:01:17.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.259+0000 7fab31a09640 1 -- 172.21.15.161:0/1961299820 wait complete. 2023-11-24T08:01:17.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.261+0000 7fab31a09640 1 Processor -- start 2023-11-24T08:01:17.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.261+0000 7fab31a09640 1 -- start start 2023-11-24T08:01:17.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab31a09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c130df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab31a09640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 0x7fab2c0aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab31a09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab2c13e360 0x7fab2c12f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab31a09640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c12fd50 con 0x7fab2c13df80 2023-11-24T08:01:17.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab31a09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c130030 con 0x7fab2c0cf9a0 2023-11-24T08:01:17.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab31a09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c130310 con 0x7fab2c13e360 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab2a7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 0x7fab2c0aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab2a7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 0x7fab2c0aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52866/0 (socket says 172.21.15.161:52866) 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.262+0000 7fab2a7fc640 1 -- 172.21.15.161:0/4034109766 learned_addr learned my addr 172.21.15.161:0/4034109766 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2affd640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c130df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2b7fe640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab2c13e360 0x7fab2c12f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2a7fc640 1 -- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab2c13e360 msgr2=0x7fab2c12f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2a7fc640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab2c13e360 0x7fab2c12f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2a7fc640 1 -- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab2c0cf9a0 msgr2=0x7fab2c130df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2a7fc640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c130df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2a7fc640 1 -- 172.21.15.161:0/4034109766 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab24009400 con 0x7fab2c13df80 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab2a7fc640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 0x7fab2c0aded0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c400 tx=0x7fab1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab140052d0 con 0x7fab2c13df80 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14005430 con 0x7fab2c13df80 2023-11-24T08:01:17.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14003830 con 0x7fab2c13df80 2023-11-24T08:01:17.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c1305f0 con 0x7fab2c13df80 2023-11-24T08:01:17.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.263+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c12f940 con 0x7fab2c13df80 2023-11-24T08:01:17.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.264+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c12fb00 con 0x7fab2c13df80 2023-11-24T08:01:17.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.265+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab14003990 con 0x7fab2c13df80 2023-11-24T08:01:17.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.266+0000 7fab23fff640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab0c06ae40 0x7fab0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.266+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fab14088cd0 con 0x7fab2c13df80 2023-11-24T08:01:17.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.267+0000 7fab2affd640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab0c06ae40 0x7fab0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.268+0000 7fab2affd640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab0c06ae40 0x7fab0c06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab1c001560 tx=0x7fab1c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:17.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.271+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab14053cf0 con 0x7fab2c13df80 2023-11-24T08:01:17.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.459+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab2c0675d0 con 0x7fab2c13df80 2023-11-24T08:01:17.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.460+0000 7fab23fff640 1 -- 172.21.15.161:0/4034109766 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab140170a0 con 0x7fab2c13df80 2023-11-24T08:01:17.463 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.463+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab0c06ae40 msgr2=0x7fab0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.463+0000 7fab31a09640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab0c06ae40 0x7fab0c06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fab1c001560 tx=0x7fab1c009040 comp rx=0 tx=0).stop 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.463+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 msgr2=0x7fab2c0aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.463+0000 7fab31a09640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 0x7fab2c0aded0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c400 tx=0x7fab1400c8c0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 shutdown_connections 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab0c06ae40 0x7fab0c06d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab2c13e360 0x7fab2c12f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab2c13df80 0x7fab2c0aded0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 --2- 172.21.15.161:0/4034109766 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab2c0cf9a0 0x7fab2c130df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 >> 172.21.15.161:0/4034109766 conn(0x7fab2c06a800 msgr2=0x7fab2c070680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:17.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 shutdown_connections 2023-11-24T08:01:17.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.464+0000 7fab31a09640 1 -- 172.21.15.161:0/4034109766 wait complete. 2023-11-24T08:01:17.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.691+0000 7f7c2f597640 1 Processor -- start 2023-11-24T08:01:17.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.692+0000 7f7c2f597640 1 -- start start 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2f597640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c280cd240 0x7f7c280b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2f597640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 0x7f7c28099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2f597640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2806cea0 con 0x7f7c28099fa0 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2f597640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2809a430 con 0x7f7c280cd240 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2f597640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2806cbc0 con 0x7f7c2806c6b0 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2db34640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7c28099fa0 0x7f7c2806b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47472/0 (socket says 172.21.15.161:47472) 2023-11-24T08:01:17.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2db34640 1 -- 172.21.15.161:0/2600547680 learned_addr learned my addr 172.21.15.161:0/2600547680 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 0x7f7c28099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c2d333640 1 --2- 172.21.15.161:0/2600547680 >> v2:172.21.15.175:3300/0 conn(0x7f7c280cd240 0x7f7c280b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.693+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169102030 0 0) 0x7f7c2806cea0 con 0x7f7c28099fa0 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c14003520 con 0x7f7c28099fa0 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3102859100 0 0) 0x7f7c14003520 con 0x7f7c28099fa0 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 msgr2=0x7f7c28099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 0x7f7c28099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 >> v2:172.21.15.175:3300/0 conn(0x7f7c280cd240 msgr2=0x7f7c280b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 --2- 172.21.15.161:0/2600547680 >> v2:172.21.15.175:3300/0 conn(0x7f7c280cd240 0x7f7c280b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2806f350 con 0x7f7c28099fa0 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f7c200019f0 con 0x7f7c28099fa0 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 >> v1:172.21.15.161:6789/0 conn(0x7f7c28099fa0 legacy=0x7f7c2806b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14003970 0x7f7c14003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c14004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 0x7f7c14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2809a430 con 0x7f7c140047c0 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2806cbc0 con 0x7f7c14003970 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1400b980 con 0x7f7c2806c6b0 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.694+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c14004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.695+0000 7f7c2d333640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14003970 0x7f7c14003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.695+0000 7f7c2cb32640 1 -- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 msgr2=0x7f7c14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.695+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c2806c6b0 0x7f7c14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.695+0000 7f7c2cb32640 1 -- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14003970 msgr2=0x7f7c14003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.695+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c14003970 0x7f7c14003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.695+0000 7f7c2cb32640 1 -- 172.21.15.161:0/2600547680 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c14003520 con 0x7f7c140047c0 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.696+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c14004c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009a90 tx=0x7f7c140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf6687a16b25947 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.696+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1802c6b0 con 0x7f7c140047c0 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.696+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1802c810 con 0x7f7c140047c0 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.696+0000 7f7c1ffff640 1 -- 172.21.15.161:0/2600547680 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1802cba0 con 0x7f7c140047c0 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2f597640 1 -- 172.21.15.161:0/2600547680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 msgr2=0x7f7c14004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2600547680 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c14004c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c18009a90 tx=0x7f7c140057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2db34640 1 -- 172.21.15.161:0/2600547680 reap_dead start 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2f597640 1 -- 172.21.15.161:0/2600547680 shutdown_connections 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2f597640 1 -- 172.21.15.161:0/2600547680 >> 172.21.15.161:0/2600547680 conn(0x7f7c280b2d00 msgr2=0x7f7c280b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2f597640 1 -- 172.21.15.161:0/2600547680 shutdown_connections 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.697+0000 7f7c2f597640 1 -- 172.21.15.161:0/2600547680 wait complete. 2023-11-24T08:01:17.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.699+0000 7f7c2f597640 1 Processor -- start 2023-11-24T08:01:17.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.699+0000 7f7c2f597640 1 -- start start 2023-11-24T08:01:17.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2f597640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c280b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2f597640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c28155660 0x7f7c280c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2f597640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c280c73f0 0x7f7c280c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2f597640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280cb200 con 0x7f7c140047c0 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2f597640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280c79c0 con 0x7f7c280c73f0 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2f597640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280ca5e0 con 0x7f7c28155660 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c280b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c280b5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52884/0 (socket says 172.21.15.161:52884) 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 -- 172.21.15.161:0/2306167548 learned_addr learned my addr 172.21.15.161:0/2306167548 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c28155660 0x7f7c280c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2db34640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c280c73f0 0x7f7c280c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 -- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c28155660 msgr2=0x7f7c280c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c28155660 0x7f7c280c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 -- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c280c73f0 msgr2=0x7f7c280c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c280c73f0 0x7f7c280c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.700+0000 7f7c2d333640 1 -- 172.21.15.161:0/2306167548 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280ca860 con 0x7f7c140047c0 2023-11-24T08:01:17.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.701+0000 7f7c2d333640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c280b5320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c24010910 tx=0x7f7c24010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:17.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.701+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24009690 con 0x7f7c140047c0 2023-11-24T08:01:17.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.701+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400ec20 con 0x7f7c140047c0 2023-11-24T08:01:17.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.701+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c280cab40 con 0x7f7c140047c0 2023-11-24T08:01:17.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.701+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2401c400 con 0x7f7c140047c0 2023-11-24T08:01:17.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.701+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280b5860 con 0x7f7c140047c0 2023-11-24T08:01:17.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.702+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c280675d0 con 0x7f7c140047c0 2023-11-24T08:01:17.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.703+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c2401c560 con 0x7f7c140047c0 2023-11-24T08:01:17.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.704+0000 7f7c1dffb640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c0c06ae70 0x7f7c0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:17.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.704+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7c24089c20 con 0x7f7c140047c0 2023-11-24T08:01:17.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.705+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c0c06ae70 0x7f7c0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:17.707 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.706+0000 7f7c2cb32640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c0c06ae70 0x7f7c0c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c18036000 tx=0x7f7c18030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:17.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.708+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c24054cf0 con 0x7f7c140047c0 2023-11-24T08:01:17.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.885+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c280d0a80 con 0x7f7c140047c0 2023-11-24T08:01:17.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.885+0000 7f7c1dffb640 1 -- 172.21.15.161:0/2306167548 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c24058310 con 0x7f7c140047c0 2023-11-24T08:01:17.887 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:17.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c0c06ae70 msgr2=0x7f7c0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c0c06ae70 0x7f7c0c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7c18036000 tx=0x7f7c18030000 comp rx=0 tx=0).stop 2023-11-24T08:01:17.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 msgr2=0x7f7c280b5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:17.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c280b5320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7c24010910 tx=0x7f7c24010dd0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 shutdown_connections 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c0c06ae70 0x7f7c0c06d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c280c73f0 0x7f7c280c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c28155660 0x7f7c280c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 --2- 172.21.15.161:0/2306167548 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c140047c0 0x7f7c280b5320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 >> 172.21.15.161:0/2306167548 conn(0x7f7c280b2d00 msgr2=0x7f7c280b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 shutdown_connections 2023-11-24T08:01:17.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:17.888+0000 7f7c2f597640 1 -- 172.21.15.161:0/2306167548 wait complete. 2023-11-24T08:01:17.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.122+0000 7fdd92168640 1 Processor -- start 2023-11-24T08:01:18.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.122+0000 7fdd92168640 1 -- start start 2023-11-24T08:01:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd92168640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 0x7fdd8c166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd92168640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c15c5f0 con 0x7fdd8c13df80 2023-11-24T08:01:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd92168640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8c06c470 con 0x7fdd8c13e360 2023-11-24T08:01:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd92168640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c06c750 con 0x7fdd8c0cf9a0 2023-11-24T08:01:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd8b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdd8c13df80 0x7fdd8c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47484/0 (socket says 172.21.15.161:47484) 2023-11-24T08:01:18.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd8b7fe640 1 -- 172.21.15.161:0/2437023265 learned_addr learned my addr 172.21.15.161:0/2437023265 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd8bfff640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 0x7fdd8c166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706415614 0 0) 0x7fdd8c15c5f0 con 0x7fdd8c13df80 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.124+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd78003520 con 0x7fdd8c13df80 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103116611 0 0) 0x7fdd78003520 con 0x7fdd8c13df80 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 msgr2=0x7fdd8c166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 0x7fdd8c166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 >> v1:172.21.15.175:6789/0 conn(0x7fdd8c13e360 legacy=0x7fdd8c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c06ca30 con 0x7fdd8c13df80 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fdd7c001670 con 0x7fdd8c13df80 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 >> v1:172.21.15.161:6789/0 conn(0x7fdd8c13df80 legacy=0x7fdd8c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 0x7fdd780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78003f20 0x7fdd780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd78004d00 0x7fdd78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c06c750 con 0x7fdd78004d00 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7800ba60 con 0x7fdd78003f20 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7800bc20 con 0x7fdd8c0cf9a0 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.125+0000 7fdd8bfff640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd78004d00 0x7fdd78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8b7fe640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 0x7fdd780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8affd640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78003f20 0x7fdd780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8bfff640 1 -- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 msgr2=0x7fdd780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8bfff640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c0cf9a0 0x7fdd780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8bfff640 1 -- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78003f20 msgr2=0x7fdd780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8bfff640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78003f20 0x7fdd780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8bfff640 1 -- 172.21.15.161:0/2437023265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd78003520 con 0x7fdd78004d00 2023-11-24T08:01:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.126+0000 7fdd8affd640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78003f20 0x7fdd780047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:18.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.127+0000 7fdd8bfff640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd78004d00 0x7fdd78005180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009f90 tx=0x7fdd780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e81e5dc6a5fc0b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:18.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.127+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8402cbd0 con 0x7fdd78004d00 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.127+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8400f040 con 0x7fdd78004d00 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.127+0000 7fdd8a7fc640 1 -- 172.21.15.161:0/2437023265 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84034440 con 0x7fdd78004d00 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd92168640 1 -- 172.21.15.161:0/2437023265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd78004d00 msgr2=0x7fdd78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd92168640 1 --2- 172.21.15.161:0/2437023265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd78004d00 0x7fdd78005180 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009f90 tx=0x7fdd780057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd8bfff640 1 -- 172.21.15.161:0/2437023265 reap_dead start 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd92168640 1 -- 172.21.15.161:0/2437023265 shutdown_connections 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd92168640 1 -- 172.21.15.161:0/2437023265 >> 172.21.15.161:0/2437023265 conn(0x7fdd8c06a800 msgr2=0x7fdd8c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd92168640 1 -- 172.21.15.161:0/2437023265 shutdown_connections 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.128+0000 7fdd92168640 1 -- 172.21.15.161:0/2437023265 wait complete. 2023-11-24T08:01:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.130+0000 7fdd92168640 1 Processor -- start 2023-11-24T08:01:18.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.130+0000 7fdd92168640 1 -- start start 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd92168640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78004d00 0x7fdd8c152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd92168640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 0x7fdd8c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd92168640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c13d670 0x7fdd8c13a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd92168640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c153a10 con 0x7fdd8c153ea0 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd92168640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c152e00 con 0x7fdd78004d00 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd92168640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1530e0 con 0x7fdd8c13d670 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 0x7fdd8c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 0x7fdd8c15d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52908/0 (socket says 172.21.15.161:52908) 2023-11-24T08:01:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8affd640 1 -- 172.21.15.161:0/3846279847 learned_addr learned my addr 172.21.15.161:0/3846279847 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8affd640 1 -- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c13d670 msgr2=0x7fdd8c13a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8b7fe640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78004d00 0x7fdd8c152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8affd640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c13d670 0x7fdd8c13a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.131+0000 7fdd8affd640 1 -- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78004d00 msgr2=0x7fdd8c152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd8affd640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78004d00 0x7fdd8c152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd8affd640 1 -- 172.21.15.161:0/3846279847 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c1533c0 con 0x7fdd8c153ea0 2023-11-24T08:01:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd8affd640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 0x7fdd8c15d400 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400d720 tx=0x7fdd7400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74017070 con 0x7fdd8c153ea0 2023-11-24T08:01:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd74005070 con 0x7fdd8c153ea0 2023-11-24T08:01:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74005420 con 0x7fdd8c153ea0 2023-11-24T08:01:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1536a0 con 0x7fdd8c153ea0 2023-11-24T08:01:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.132+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c15d940 con 0x7fdd8c153ea0 2023-11-24T08:01:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.134+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c153bc0 con 0x7fdd8c153ea0 2023-11-24T08:01:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.134+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd74007030 con 0x7fdd8c153ea0 2023-11-24T08:01:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.135+0000 7fdd83fff640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6c06ae40 0x7fdd6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.135+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdd74088e90 con 0x7fdd8c153ea0 2023-11-24T08:01:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.136+0000 7fdd8b7fe640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6c06ae40 0x7fdd6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.137+0000 7fdd8b7fe640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6c06ae40 0x7fdd6c06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c001c90 tx=0x7fdd7c0014b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:18.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.141+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd8c153bc0 con 0x7fdd8c153ea0 2023-11-24T08:01:18.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.332+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd8c0cf7c0 con 0x7fdd8c153ea0 2023-11-24T08:01:18.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.333+0000 7fdd83fff640 1 -- 172.21.15.161:0/3846279847 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd74053f80 con 0x7fdd8c153ea0 2023-11-24T08:01:18.335 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:18.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6c06ae40 msgr2=0x7fdd6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6c06ae40 0x7fdd6c06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c001c90 tx=0x7fdd7c0014b0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 msgr2=0x7fdd8c15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 0x7fdd8c15d400 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400d720 tx=0x7fdd7400dbe0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 shutdown_connections 2023-11-24T08:01:18.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6c06ae40 0x7fdd6c06d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd8c13d670 0x7fdd8c13a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd8c153ea0 0x7fdd8c15d400 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 --2- 172.21.15.161:0/3846279847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd78004d00 0x7fdd8c152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 >> 172.21.15.161:0/3846279847 conn(0x7fdd8c06a800 msgr2=0x7fdd8c0ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:18.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 shutdown_connections 2023-11-24T08:01:18.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.336+0000 7fdd92168640 1 -- 172.21.15.161:0/3846279847 wait complete. 2023-11-24T08:01:18.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:18.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.561+0000 7f152e891640 1 Processor -- start 2023-11-24T08:01:18.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.561+0000 7f152e891640 1 -- start start 2023-11-24T08:01:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152e891640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f152813cfa0 0x7f152815afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152e891640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15280cd530 0x7f152813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152e891640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15280cdec0 con 0x7f15280cd9e0 2023-11-24T08:01:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152e891640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15280ce1a0 con 0x7f15280cd530 2023-11-24T08:01:18.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152e891640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15280ce480 con 0x7f152813cfa0 2023-11-24T08:01:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152d08e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15280cd530 0x7f152813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152d08e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f15280cd530 0x7f152813f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52920/0 (socket says 172.21.15.161:52920) 2023-11-24T08:01:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.563+0000 7f152d08e640 1 -- 172.21.15.161:0/3243187983 learned_addr learned my addr 172.21.15.161:0/3243187983 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:18.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.564+0000 7f152d88f640 1 --2- 172.21.15.161:0/3243187983 >> v2:172.21.15.175:3300/0 conn(0x7f152813cfa0 0x7f152815afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.564+0000 7f152d08e640 1 -- 172.21.15.161:0/3243187983 >> v2:172.21.15.175:3300/0 conn(0x7f152813cfa0 msgr2=0x7f152815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:18.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.564+0000 7f152d08e640 1 --2- 172.21.15.161:0/3243187983 >> v2:172.21.15.175:3300/0 conn(0x7f152813cfa0 0x7f152815afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.564+0000 7f152d08e640 1 -- 172.21.15.161:0/3243187983 >> v1:172.21.15.175:6789/0 conn(0x7f15280cd9e0 legacy=0x7f152815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:18.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.564+0000 7f152d08e640 1 -- 172.21.15.161:0/3243187983 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15280ce760 con 0x7f15280cd530 2023-11-24T08:01:18.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.565+0000 7f152d08e640 1 --2- 172.21.15.161:0/3243187983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd530 0x7f152813f5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f152806cf00 tx=0x7f151802e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa4fb1c3233b20b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:18.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.565+0000 7f152c88d640 1 -- 172.21.15.161:0/3243187983 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151802ee00 con 0x7f15280cd530 2023-11-24T08:01:18.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.565+0000 7f152c88d640 1 -- 172.21.15.161:0/3243187983 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518036440 con 0x7f15280cd530 2023-11-24T08:01:18.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.565+0000 7f152c88d640 1 -- 172.21.15.161:0/3243187983 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180367d0 con 0x7f15280cd530 2023-11-24T08:01:18.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 -- 172.21.15.161:0/3243187983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd530 msgr2=0x7f152813f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 --2- 172.21.15.161:0/3243187983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd530 0x7f152813f5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f152806cf00 tx=0x7f151802e050 comp rx=0 tx=0).stop 2023-11-24T08:01:18.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 -- 172.21.15.161:0/3243187983 shutdown_connections 2023-11-24T08:01:18.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 --2- 172.21.15.161:0/3243187983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd530 0x7f152813f5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 --2- 172.21.15.161:0/3243187983 >> v2:172.21.15.175:3300/0 conn(0x7f152813cfa0 0x7f152815afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 -- 172.21.15.161:0/3243187983 >> 172.21.15.161:0/3243187983 conn(0x7f152806a800 msgr2=0x7f152806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:18.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 -- 172.21.15.161:0/3243187983 shutdown_connections 2023-11-24T08:01:18.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.566+0000 7f152e891640 1 -- 172.21.15.161:0/3243187983 wait complete. 2023-11-24T08:01:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.568+0000 7f152e891640 1 Processor -- start 2023-11-24T08:01:18.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.568+0000 7f152e891640 1 -- start start 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152e891640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15280cd530 0x7f15281533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152e891640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 0x7f1528155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152e891640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152813cfa0 0x7f15280ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152e891640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281538f0 con 0x7f15280cd9e0 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152e891640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15281561e0 con 0x7f15280cd530 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152e891640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15281564c0 con 0x7f152813cfa0 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152d08e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 0x7f1528155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152d08e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 0x7f1528155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52936/0 (socket says 172.21.15.161:52936) 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.569+0000 7f152d08e640 1 -- 172.21.15.161:0/1121236434 learned_addr learned my addr 172.21.15.161:0/1121236434 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d88f640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15280cd530 0x7f15281533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d08e640 1 -- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152813cfa0 msgr2=0x7f15280ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152e090640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152813cfa0 0x7f15280ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d08e640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152813cfa0 0x7f15280ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d08e640 1 -- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15280cd530 msgr2=0x7f15281533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d08e640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15280cd530 0x7f15281533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d08e640 1 -- 172.21.15.161:0/1121236434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151800b770 con 0x7f15280cd9e0 2023-11-24T08:01:18.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152e090640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152813cfa0 0x7f15280ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f152d08e640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 0x7f1528155890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f151802e090 tx=0x7f15180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.570+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15180348d0 con 0x7f15280cd9e0 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.571+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518034a30 con 0x7f15280cd9e0 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.571+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15281567a0 con 0x7f15280cd9e0 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.571+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518034de0 con 0x7f15280cd9e0 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.571+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1528151a80 con 0x7f15280cd9e0 2023-11-24T08:01:18.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.572+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1528067450 con 0x7f15280cd9e0 2023-11-24T08:01:18.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.573+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15180403e0 con 0x7f15280cd9e0 2023-11-24T08:01:18.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.574+0000 7f151e7fc640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:18.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.574+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f15180abbc0 con 0x7f15280cd9e0 2023-11-24T08:01:18.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.574+0000 7f152d88f640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:18.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.575+0000 7f152d88f640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1524006fd0 tx=0x7f1524008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:18.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.578+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1518076c80 con 0x7f15280cd9e0 2023-11-24T08:01:18.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.786+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f15280b4000 con 0x7f15280cd9e0 2023-11-24T08:01:18.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.786+0000 7f151e7fc640 1 -- 172.21.15.161:0/1121236434 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f151803b080 con 0x7f15280cd9e0 2023-11-24T08:01:18.788 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:18.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.788+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 msgr2=0x7f150c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.788+0000 7f152e891640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1524006fd0 tx=0x7f1524008040 comp rx=0 tx=0).stop 2023-11-24T08:01:18.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 msgr2=0x7f1528155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:18.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 0x7f1528155890 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f151802e090 tx=0x7f15180046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 shutdown_connections 2023-11-24T08:01:18.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f150c06ae40 0x7f150c06d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f152813cfa0 0x7f15280ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f15280cd9e0 0x7f1528155890 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 --2- 172.21.15.161:0/1121236434 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f15280cd530 0x7f15281533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:18.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 >> 172.21.15.161:0/1121236434 conn(0x7f152806a800 msgr2=0x7f1528070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:18.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 shutdown_connections 2023-11-24T08:01:18.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:18.789+0000 7f152e891640 1 -- 172.21.15.161:0/1121236434 wait complete. 2023-11-24T08:01:18.809 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-24T08:01:18.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:18.809 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:18.915 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:18.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:01:18.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:18.916 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:01:18.975 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:18.976 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:19.031 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:19.031 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:19.078 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:19.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.323+0000 7f37c1747640 1 Processor -- start 2023-11-24T08:01:19.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.323+0000 7f37c1747640 1 -- start start 2023-11-24T08:01:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37c1747640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 0x7f37bc1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37c1747640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc06aea0 con 0x7f37bc161890 2023-11-24T08:01:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37c1747640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc06b180 con 0x7f37bc0cef70 2023-11-24T08:01:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37c1747640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0cd390 con 0x7f37bc071290 2023-11-24T08:01:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37b3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f37bc161890 0x7f37bc070b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47486/0 (socket says 172.21.15.161:47486) 2023-11-24T08:01:19.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37b3fff640 1 -- 172.21.15.161:0/3206777122 learned_addr learned my addr 172.21.15.161:0/3206777122 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831819151 0 0) 0x7f37bc06aea0 con 0x7f37bc161890 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37c0f46640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 0x7f37bc1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.325+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003520 con 0x7f37bc161890 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8332110 0 0) 0x7f37a8003520 con 0x7f37bc161890 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 msgr2=0x7f37bc1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 0x7f37bc1539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 >> v1:172.21.15.175:6789/0 conn(0x7f37bc0cef70 legacy=0x7f37bc06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc160db0 con 0x7f37bc161890 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f37a4001810 con 0x7f37bc161890 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 >> v1:172.21.15.161:6789/0 conn(0x7f37bc161890 legacy=0x7f37bc070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37a8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 0x7f37a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37a8004d00 0x7f37a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bb10 con 0x7f37a80039a0 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bc80 con 0x7f37a8004d00 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800be40 con 0x7f37bc071290 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.326+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37a8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37c0f46640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37a8004d00 0x7f37a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37b3fff640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 0x7f37a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37bbfff640 1 -- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 msgr2=0x7f37a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc071290 0x7f37a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37bbfff640 1 -- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37a8004d00 msgr2=0x7f37a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37a8004d00 0x7f37a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.327+0000 7f37bbfff640 1 -- 172.21.15.161:0/3206777122 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8003520 con 0x7f37a80039a0 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.328+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37a8003dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37ac001750 tx=0x7f37a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b55a5f0baadaef3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.328+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0052d0 con 0x7f37a80039a0 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.328+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac02e050 con 0x7f37a80039a0 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.328+0000 7f37bb7fe640 1 -- 172.21.15.161:0/3206777122 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0035f0 con 0x7f37a80039a0 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c1747640 1 -- 172.21.15.161:0/3206777122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 msgr2=0x7f37a8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c1747640 1 --2- 172.21.15.161:0/3206777122 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37a8003dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f37ac001750 tx=0x7f37a80057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c0f46640 1 -- 172.21.15.161:0/3206777122 reap_dead start 2023-11-24T08:01:19.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c1747640 1 -- 172.21.15.161:0/3206777122 shutdown_connections 2023-11-24T08:01:19.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c1747640 1 -- 172.21.15.161:0/3206777122 >> 172.21.15.161:0/3206777122 conn(0x7f37bc0cc1d0 msgr2=0x7f37bc0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:19.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c1747640 1 -- 172.21.15.161:0/3206777122 shutdown_connections 2023-11-24T08:01:19.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.329+0000 7f37c1747640 1 -- 172.21.15.161:0/3206777122 wait complete. 2023-11-24T08:01:19.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.331+0000 7f37c1747640 1 Processor -- start 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.331+0000 7f37c1747640 1 -- start start 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c1747640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37bc1f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c1747640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc0b3c40 0x7f37bc0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c1747640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc1f2010 0x7f37bc1f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c1747640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc0b4600 con 0x7f37a80039a0 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c1747640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc15b110 con 0x7f37bc1f2010 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c1747640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1f3970 con 0x7f37bc0b3c40 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37bbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37bc1f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37bbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37bc1f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52952/0 (socket says 172.21.15.161:52952) 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37bbfff640 1 -- 172.21.15.161:0/3026250082 learned_addr learned my addr 172.21.15.161:0/3026250082 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37b3fff640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc0b3c40 0x7f37bc0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37bbfff640 1 -- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc0b3c40 msgr2=0x7f37bc0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc0b3c40 0x7f37bc0b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37bbfff640 1 -- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc1f2010 msgr2=0x7f37bc1f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.332+0000 7f37c0f46640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc1f2010 0x7f37bc1f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc1f2010 0x7f37bc1f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37bbfff640 1 -- 172.21.15.161:0/3026250082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc1f6cc0 con 0x7f37a80039a0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37c0f46640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc1f2010 0x7f37bc1f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37bbfff640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37bc1f6780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37ac005040 tx=0x7f37ac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac0076c0 con 0x7f37a80039a0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37ac007a30 con 0x7f37a80039a0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37ac006be0 con 0x7f37a80039a0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc1f2ce0 con 0x7f37a80039a0 2023-11-24T08:01:19.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.333+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc1f32a0 con 0x7f37a80039a0 2023-11-24T08:01:19.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.335+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc06bad0 con 0x7f37a80039a0 2023-11-24T08:01:19.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.335+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37ac006d40 con 0x7f37a80039a0 2023-11-24T08:01:19.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.336+0000 7f37b97fa640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f379c06ae70 0x7f379c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.336+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f37ac0ab350 con 0x7f37a80039a0 2023-11-24T08:01:19.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.337+0000 7f37b3fff640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f379c06ae70 0x7f379c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.338+0000 7f37b3fff640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f379c06ae70 0x7f379c06d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f37a40011d0 tx=0x7f37a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:19.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.341+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37ac076530 con 0x7f37a80039a0 2023-11-24T08:01:19.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.532+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37bc0b4600 con 0x7f37a80039a0 2023-11-24T08:01:19.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.535+0000 7f37b97fa640 1 -- 172.21.15.161:0/3026250082 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f37ac079b50 con 0x7f37a80039a0 2023-11-24T08:01:19.537 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:19.538 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.537+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f379c06ae70 msgr2=0x7f379c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.537+0000 7f37c1747640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f379c06ae70 0x7f379c06d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f37a40011d0 tx=0x7f37a4009040 comp rx=0 tx=0).stop 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.537+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 msgr2=0x7f37bc1f6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.537+0000 7f37c1747640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37bc1f6780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f37ac005040 tx=0x7f37ac001120 comp rx=0 tx=0).stop 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 shutdown_connections 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f379c06ae70 0x7f379c06d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37bc1f2010 0x7f37bc1f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37bc0b3c40 0x7f37bc0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 --2- 172.21.15.161:0/3026250082 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37a80039a0 0x7f37bc1f6780 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 >> 172.21.15.161:0/3026250082 conn(0x7f37bc0cc1d0 msgr2=0x7f37bc15dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:19.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 shutdown_connections 2023-11-24T08:01:19.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.538+0000 7f37c1747640 1 -- 172.21.15.161:0/3026250082 wait complete. 2023-11-24T08:01:19.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:19.560 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:19.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.760+0000 7f56857b0640 1 Processor -- start 2023-11-24T08:01:19.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.760+0000 7f56857b0640 1 -- start start 2023-11-24T08:01:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.761+0000 7f56857b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56800cd240 0x7f56800b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.761+0000 7f56857b0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568006cea0 con 0x7f568009a170 2023-11-24T08:01:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.761+0000 7f56857b0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568006cbc0 con 0x7f568006c6b0 2023-11-24T08:01:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.761+0000 7f56857b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568006f350 con 0x7f56800cd240 2023-11-24T08:01:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567effd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f56800cd240 0x7f56800b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f568009a170 0x7f56800cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:47496/0 (socket says 172.21.15.161:47496) 2023-11-24T08:01:19.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567f7fe640 1 -- 172.21.15.161:0/3337829229 learned_addr learned my addr 172.21.15.161:0/3337829229 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:19.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567effd640 1 -- 172.21.15.161:0/3337829229 >> v1:172.21.15.175:6789/0 conn(0x7f568006c6b0 legacy=0x7f5680099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:19.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567effd640 1 -- 172.21.15.161:0/3337829229 >> v1:172.21.15.161:6789/0 conn(0x7f568009a170 legacy=0x7f56800cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567effd640 1 -- 172.21.15.161:0/3337829229 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568006f630 con 0x7f56800cd240 2023-11-24T08:01:19.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.762+0000 7f567e7fc640 1 -- 172.21.15.161:0/3337829229 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1920296287 0 0) 0x7f568006cea0 con 0x7f568009a170 2023-11-24T08:01:19.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.763+0000 7f567effd640 1 --2- 172.21.15.161:0/3337829229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56800cd240 0x7f56800b3820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56700097a0 tx=0x7f567002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f23a676fe7ece0e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:19.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f567e7fc640 1 -- 172.21.15.161:0/3337829229 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031830 con 0x7f56800cd240 2023-11-24T08:01:19.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f567e7fc640 1 -- 172.21.15.161:0/3337829229 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5670031990 con 0x7f56800cd240 2023-11-24T08:01:19.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f567e7fc640 1 -- 172.21.15.161:0/3337829229 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670031d20 con 0x7f56800cd240 2023-11-24T08:01:19.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 -- 172.21.15.161:0/3337829229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56800cd240 msgr2=0x7f56800b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 --2- 172.21.15.161:0/3337829229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56800cd240 0x7f56800b3820 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f56700097a0 tx=0x7f567002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 -- 172.21.15.161:0/3337829229 shutdown_connections 2023-11-24T08:01:19.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 --2- 172.21.15.161:0/3337829229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f56800cd240 0x7f56800b3820 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 -- 172.21.15.161:0/3337829229 >> 172.21.15.161:0/3337829229 conn(0x7f56800b2d00 msgr2=0x7f56800b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:19.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 -- 172.21.15.161:0/3337829229 shutdown_connections 2023-11-24T08:01:19.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.764+0000 7f56857b0640 1 -- 172.21.15.161:0/3337829229 wait complete. 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.766+0000 7f56857b0640 1 Processor -- start 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.766+0000 7f56857b0640 1 -- start start 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.767+0000 7f56857b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568006c6b0 0x7f56801516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.767+0000 7f56857b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 0x7f56800b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.767+0000 7f56857b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56800cd240 0x7f56800c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.767+0000 7f56857b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b50f0 con 0x7f568009a170 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.767+0000 7f56857b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568015dd80 con 0x7f56800cd240 2023-11-24T08:01:19.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.767+0000 7f56857b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5680151bf0 con 0x7f568006c6b0 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 0x7f56800b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 0x7f56800b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52966/0 (socket says 172.21.15.161:52966) 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 -- 172.21.15.161:0/1452696478 learned_addr learned my addr 172.21.15.161:0/1452696478 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 -- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568006c6b0 msgr2=0x7f56801516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f567effd640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568006c6b0 0x7f56801516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f567f7fe640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56800cd240 0x7f56800c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568006c6b0 0x7f56801516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 -- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56800cd240 msgr2=0x7f56800c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56800cd240 0x7f56800c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 -- 172.21.15.161:0/1452696478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5670009400 con 0x7f568009a170 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f5677fff640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 0x7f56800b5510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f566800c400 tx=0x7f566800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.768+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011790 con 0x7f568009a170 2023-11-24T08:01:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.769+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668011930 con 0x7f568009a170 2023-11-24T08:01:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.769+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800b4a70 con 0x7f568009a170 2023-11-24T08:01:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.769+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011ce0 con 0x7f568009a170 2023-11-24T08:01:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.769+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56800b6eb0 con 0x7f568009a170 2023-11-24T08:01:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.770+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56800675d0 con 0x7f568009a170 2023-11-24T08:01:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.771+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f566801c460 con 0x7f568009a170 2023-11-24T08:01:19.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.773+0000 7f56777fe640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f566006ae40 0x7f566006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.773+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5668089610 con 0x7f568009a170 2023-11-24T08:01:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.773+0000 7f567effd640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f566006ae40 0x7f566006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:19.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.774+0000 7f567effd640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f566006ae40 0x7f566006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5670036000 tx=0x7f567003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:19.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.778+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5668054630 con 0x7f568009a170 2023-11-24T08:01:19.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.968+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56800ccab0 con 0x7f568009a170 2023-11-24T08:01:19.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.968+0000 7f56777fe640 1 -- 172.21.15.161:0/1452696478 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5668057c50 con 0x7f568009a170 2023-11-24T08:01:19.971 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f566006ae40 msgr2=0x7f566006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f566006ae40 0x7f566006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5670036000 tx=0x7f567003c040 comp rx=0 tx=0).stop 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 msgr2=0x7f56800b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 0x7f56800b5510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f566800c400 tx=0x7f566800c8c0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 shutdown_connections 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f566006ae40 0x7f566006d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56800cd240 0x7f56800c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f568009a170 0x7f56800b5510 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 --2- 172.21.15.161:0/1452696478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f568006c6b0 0x7f56801516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:19.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 >> 172.21.15.161:0/1452696478 conn(0x7f56800b2d00 msgr2=0x7f56800cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:19.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 shutdown_connections 2023-11-24T08:01:19.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:19.971+0000 7f56857b0640 1 -- 172.21.15.161:0/1452696478 wait complete. 2023-11-24T08:01:19.992 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.192+0000 7f3057d01640 1 Processor -- start 2023-11-24T08:01:20.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.193+0000 7f3057d01640 1 -- start start 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.194+0000 7f3057d01640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f305013e360 0x7f30500cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.194+0000 7f3057d01640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f305015f9c0 0x7f30500cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.194+0000 7f3057d01640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f305015c5f0 con 0x7f305013df80 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.194+0000 7f3057d01640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305006c470 con 0x7f305013e360 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.194+0000 7f3057d01640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f305006c750 con 0x7f305015f9c0 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f305013e360 0x7f30500cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f305013e360 0x7f30500cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52976/0 (socket says 172.21.15.161:52976) 2023-11-24T08:01:20.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 -- 172.21.15.161:0/3895516058 learned_addr learned my addr 172.21.15.161:0/3895516058 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:20.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 -- 172.21.15.161:0/3895516058 >> v2:172.21.15.175:3300/0 conn(0x7f305015f9c0 msgr2=0x7f30500cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:20.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 --2- 172.21.15.161:0/3895516058 >> v2:172.21.15.175:3300/0 conn(0x7f305015f9c0 0x7f30500cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 -- 172.21.15.161:0/3895516058 >> v1:172.21.15.175:6789/0 conn(0x7f305013df80 legacy=0x7f305015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:20.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.195+0000 7f305529c640 1 -- 172.21.15.161:0/3895516058 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f305006ca30 con 0x7f305013e360 2023-11-24T08:01:20.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.196+0000 7f305529c640 1 --2- 172.21.15.161:0/3895516058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500cf290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f305006ded0 tx=0x7f304002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97df53df2ea58f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:20.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3054a9b640 1 -- 172.21.15.161:0/3895516058 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040031640 con 0x7f305013e360 2023-11-24T08:01:20.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3054a9b640 1 -- 172.21.15.161:0/3895516058 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30400317a0 con 0x7f305013e360 2023-11-24T08:01:20.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3054a9b640 1 -- 172.21.15.161:0/3895516058 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040031b30 con 0x7f305013e360 2023-11-24T08:01:20.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 -- 172.21.15.161:0/3895516058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 msgr2=0x7f30500cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 --2- 172.21.15.161:0/3895516058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500cf290 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f305006ded0 tx=0x7f304002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 -- 172.21.15.161:0/3895516058 shutdown_connections 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 --2- 172.21.15.161:0/3895516058 >> v2:172.21.15.175:3300/0 conn(0x7f305015f9c0 0x7f30500cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 --2- 172.21.15.161:0/3895516058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500cf290 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 -- 172.21.15.161:0/3895516058 >> 172.21.15.161:0/3895516058 conn(0x7f305006a800 msgr2=0x7f305006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 -- 172.21.15.161:0/3895516058 shutdown_connections 2023-11-24T08:01:20.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.197+0000 7f3057d01640 1 -- 172.21.15.161:0/3895516058 wait complete. 2023-11-24T08:01:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.199+0000 7f3057d01640 1 Processor -- start 2023-11-24T08:01:20.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.199+0000 7f3057d01640 1 -- start start 2023-11-24T08:01:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.200+0000 7f3057d01640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305013df80 0x7f305013d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.200+0000 7f3057d01640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500a85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.200+0000 7f3057d01640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305015f9c0 0x7f30500a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.200+0000 7f3057d01640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501509f0 con 0x7f305013e360 2023-11-24T08:01:20.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.200+0000 7f3057d01640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30501376c0 con 0x7f305015f9c0 2023-11-24T08:01:20.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.200+0000 7f3057d01640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30500b37b0 con 0x7f305013df80 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500a85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500a85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52980/0 (socket says 172.21.15.161:52980) 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 -- 172.21.15.161:0/1687992816 learned_addr learned my addr 172.21.15.161:0/1687992816 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305629e640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305015f9c0 0x7f30500a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f3055a9d640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305013df80 0x7f305013d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 -- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305013df80 msgr2=0x7f305013d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305013df80 0x7f305013d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 -- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305015f9c0 msgr2=0x7f30500a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305015f9c0 0x7f30500a8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305529c640 1 -- 172.21.15.161:0/1687992816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400094d0 con 0x7f305013e360 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.201+0000 7f305629e640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305015f9c0 0x7f30500a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.202+0000 7f305529c640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500a85e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3040000c00 tx=0x7f30400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.202+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304003ac40 con 0x7f305013e360 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.202+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304003ada0 con 0x7f305013e360 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.202+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040044630 con 0x7f305013e360 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.202+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500b31f0 con 0x7f305013e360 2023-11-24T08:01:20.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.202+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3050137350 con 0x7f305013e360 2023-11-24T08:01:20.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.203+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30500675d0 con 0x7f305013e360 2023-11-24T08:01:20.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.204+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f304002f050 con 0x7f305013e360 2023-11-24T08:01:20.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.205+0000 7f30467fc640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303406ae40 0x7f303406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.205+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f30400ab780 con 0x7f305013e360 2023-11-24T08:01:20.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.206+0000 7f3055a9d640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303406ae40 0x7f303406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.206+0000 7f3055a9d640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303406ae40 0x7f303406d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f304c006fd0 tx=0x7f304c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:20.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.209+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3040076710 con 0x7f305013e360 2023-11-24T08:01:20.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.385+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f305006df00 con 0x7f305013e360 2023-11-24T08:01:20.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.386+0000 7f30467fc640 1 -- 172.21.15.161:0/1687992816 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3040031e60 con 0x7f305013e360 2023-11-24T08:01:20.388 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:20.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303406ae40 msgr2=0x7f303406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303406ae40 0x7f303406d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f304c006fd0 tx=0x7f304c008040 comp rx=0 tx=0).stop 2023-11-24T08:01:20.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 msgr2=0x7f30500a85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500a85e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3040000c00 tx=0x7f30400046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 shutdown_connections 2023-11-24T08:01:20.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f303406ae40 0x7f303406d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f305015f9c0 0x7f30500a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f305013e360 0x7f30500a85e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.388+0000 7f3057d01640 1 --2- 172.21.15.161:0/1687992816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f305013df80 0x7f305013d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.389+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 >> 172.21.15.161:0/1687992816 conn(0x7f305006a800 msgr2=0x7f3050070630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:20.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.389+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 shutdown_connections 2023-11-24T08:01:20.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.389+0000 7f3057d01640 1 -- 172.21.15.161:0/1687992816 wait complete. 2023-11-24T08:01:20.409 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:20.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.619+0000 7f9639483640 1 Processor -- start 2023-11-24T08:01:20.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.619+0000 7f9639483640 1 -- start start 2023-11-24T08:01:20.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f9639483640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96340cf9a0 0x7f963415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f9639483640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f963415e1e0 0x7f96340702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f9639483640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96340b1ee0 con 0x7f9634143ae0 2023-11-24T08:01:20.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f9639483640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96340b2780 con 0x7f963415e1e0 2023-11-24T08:01:20.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f9639483640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963415e990 con 0x7f96340cf9a0 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f96337fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f963415e1e0 0x7f96340702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.621+0000 7f96327fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96340cf9a0 0x7f963415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.622+0000 7f96337fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f963415e1e0 0x7f96340702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:49930/0 (socket says 172.21.15.161:49930) 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.622+0000 7f96337fe640 1 -- 172.21.15.161:0/4105913343 learned_addr learned my addr 172.21.15.161:0/4105913343 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.622+0000 7f96337fe640 1 -- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96340cf9a0 msgr2=0x7f963415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.622+0000 7f96337fe640 1 --2- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96340cf9a0 0x7f963415dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.622+0000 7f96337fe640 1 -- 172.21.15.161:0/4105913343 >> v1:172.21.15.175:6789/0 conn(0x7f9634143ae0 legacy=0x7f96340cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.622+0000 7f96337fe640 1 -- 172.21.15.161:0/4105913343 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96340b2130 con 0x7f963415e1e0 2023-11-24T08:01:20.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.624+0000 7f96337fe640 1 --2- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f963415e1e0 0x7f96340702c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f962c009e50 tx=0x7f962c02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc52a6a0bb2b5be7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:20.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.624+0000 7f9631ffb640 1 -- 172.21.15.161:0/4105913343 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c02cb00 con 0x7f963415e1e0 2023-11-24T08:01:20.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.624+0000 7f9631ffb640 1 -- 172.21.15.161:0/4105913343 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c02cc60 con 0x7f963415e1e0 2023-11-24T08:01:20.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.624+0000 7f9631ffb640 1 -- 172.21.15.161:0/4105913343 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c0343f0 con 0x7f963415e1e0 2023-11-24T08:01:20.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 -- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f963415e1e0 msgr2=0x7f96340702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 --2- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f963415e1e0 0x7f96340702c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f962c009e50 tx=0x7f962c02bf60 comp rx=0 tx=0).stop 2023-11-24T08:01:20.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 -- 172.21.15.161:0/4105913343 shutdown_connections 2023-11-24T08:01:20.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 --2- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f963415e1e0 0x7f96340702c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 --2- 172.21.15.161:0/4105913343 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96340cf9a0 0x7f963415dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 -- 172.21.15.161:0/4105913343 >> 172.21.15.161:0/4105913343 conn(0x7f963406a800 msgr2=0x7f963406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:20.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 -- 172.21.15.161:0/4105913343 shutdown_connections 2023-11-24T08:01:20.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.625+0000 7f9639483640 1 -- 172.21.15.161:0/4105913343 wait complete. 2023-11-24T08:01:20.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.627+0000 7f9639483640 1 Processor -- start 2023-11-24T08:01:20.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.627+0000 7f9639483640 1 -- start start 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.628+0000 7f9639483640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 0x7f96340af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.628+0000 7f9639483640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9634143ae0 0x7f963413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9639483640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f963415e1e0 0x7f96341411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9639483640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340b02a0 con 0x7f96340cf9a0 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9639483640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963413f4e0 con 0x7f9634143ae0 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9639483640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963413f350 con 0x7f963415e1e0 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 0x7f96340af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 0x7f96340af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52984/0 (socket says 172.21.15.161:52984) 2023-11-24T08:01:20.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 -- 172.21.15.161:0/2428250883 learned_addr learned my addr 172.21.15.161:0/2428250883 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 -- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f963415e1e0 msgr2=0x7f96341411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f963415e1e0 0x7f96341411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 -- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9634143ae0 msgr2=0x7f963413ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9634143ae0 0x7f963413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.629+0000 7f9632ffd640 1 -- 172.21.15.161:0/2428250883 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c009b30 con 0x7f96340cf9a0 2023-11-24T08:01:20.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.630+0000 7f9632ffd640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 0x7f96340af590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f962400c450 tx=0x7f962400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:20.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.630+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240052d0 con 0x7f96340cf9a0 2023-11-24T08:01:20.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.630+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9624005430 con 0x7f96340cf9a0 2023-11-24T08:01:20.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.630+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624012870 con 0x7f96340cf9a0 2023-11-24T08:01:20.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.630+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96341416e0 con 0x7f96340cf9a0 2023-11-24T08:01:20.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.630+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96340b0760 con 0x7f96340cf9a0 2023-11-24T08:01:20.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.631+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96340b0980 con 0x7f96340cf9a0 2023-11-24T08:01:20.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.632+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96240129d0 con 0x7f96340cf9a0 2023-11-24T08:01:20.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.633+0000 7f961b7fe640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f962006ae40 0x7f962006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:20.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.633+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9624088fa0 con 0x7f96340cf9a0 2023-11-24T08:01:20.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.633+0000 7f96327fc640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f962006ae40 0x7f962006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:20.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.635+0000 7f96327fc640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f962006ae40 0x7f962006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9634142dd0 tx=0x7f96280095a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:20.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.638+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96240bbe90 con 0x7f96340cf9a0 2023-11-24T08:01:20.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.816+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96341416e0 con 0x7f96340cf9a0 2023-11-24T08:01:20.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.817+0000 7f961b7fe640 1 -- 172.21.15.161:0/2428250883 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96341416e0 con 0x7f96340cf9a0 2023-11-24T08:01:20.819 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.819+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f962006ae40 msgr2=0x7f962006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.819+0000 7f9639483640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f962006ae40 0x7f962006d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9634142dd0 tx=0x7f96280095a0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.819+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 msgr2=0x7f96340af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.819+0000 7f9639483640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 0x7f96340af590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f962400c450 tx=0x7f962400c910 comp rx=0 tx=0).stop 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 shutdown_connections 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f962006ae40 0x7f962006d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f963415e1e0 0x7f96341411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9634143ae0 0x7f963413ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 --2- 172.21.15.161:0/2428250883 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96340cf9a0 0x7f96340af590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:20.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 >> 172.21.15.161:0/2428250883 conn(0x7f963406a800 msgr2=0x7f963415b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:20.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 shutdown_connections 2023-11-24T08:01:20.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:20.820+0000 7f9639483640 1 -- 172.21.15.161:0/2428250883 wait complete. 2023-11-24T08:01:20.841 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:21.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.050+0000 7f7ab8ebb640 1 Processor -- start 2023-11-24T08:01:21.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.050+0000 7f7ab8ebb640 1 -- start start 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab8ebb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ab40cf9a0 0x7f7ab415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab8ebb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab415e1e0 0x7f7ab40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab8ebb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab40b1ee0 con 0x7f7ab4143ae0 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab8ebb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab40b2780 con 0x7f7ab40cf9a0 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab8ebb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab415e990 con 0x7f7ab415e1e0 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab1d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ab40cf9a0 0x7f7ab415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab1d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7ab40cf9a0 0x7f7ab415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44072/0 (socket says 172.21.15.161:44072) 2023-11-24T08:01:21.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab1d9b640 1 -- 172.21.15.161:0/3370229946 learned_addr learned my addr 172.21.15.161:0/3370229946 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:21.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab2d9d640 1 --2- 172.21.15.161:0/3370229946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab415e1e0 0x7f7ab40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab1d9b640 1 -- 172.21.15.161:0/3370229946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab415e1e0 msgr2=0x7f7ab40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:21.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab1d9b640 1 --2- 172.21.15.161:0/3370229946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab415e1e0 0x7f7ab40702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.052+0000 7f7ab1d9b640 1 -- 172.21.15.161:0/3370229946 >> v1:172.21.15.175:6789/0 conn(0x7f7ab4143ae0 legacy=0x7f7ab40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:21.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.053+0000 7f7ab1d9b640 1 -- 172.21.15.161:0/3370229946 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40b2130 con 0x7f7ab40cf9a0 2023-11-24T08:01:21.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.054+0000 7f7ab1d9b640 1 --2- 172.21.15.161:0/3370229946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab40cf9a0 0x7f7ab415dca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009870 tx=0x7f7aa802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337f576d8c8d0646 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:21.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.054+0000 7f7ab159a640 1 -- 172.21.15.161:0/3370229946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8031640 con 0x7f7ab40cf9a0 2023-11-24T08:01:21.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.054+0000 7f7ab159a640 1 -- 172.21.15.161:0/3370229946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa80317a0 con 0x7f7ab40cf9a0 2023-11-24T08:01:21.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.054+0000 7f7ab159a640 1 -- 172.21.15.161:0/3370229946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8031b30 con 0x7f7ab40cf9a0 2023-11-24T08:01:21.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/3370229946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab40cf9a0 msgr2=0x7f7ab415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/3370229946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab40cf9a0 0x7f7ab415dca0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8009870 tx=0x7f7aa802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/3370229946 shutdown_connections 2023-11-24T08:01:21.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/3370229946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab415e1e0 0x7f7ab40702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/3370229946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab40cf9a0 0x7f7ab415dca0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/3370229946 >> 172.21.15.161:0/3370229946 conn(0x7f7ab406a800 msgr2=0x7f7ab406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:21.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/3370229946 shutdown_connections 2023-11-24T08:01:21.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.055+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/3370229946 wait complete. 2023-11-24T08:01:21.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.057+0000 7f7ab8ebb640 1 Processor -- start 2023-11-24T08:01:21.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.057+0000 7f7ab8ebb640 1 -- start start 2023-11-24T08:01:21.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab8ebb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cf9a0 0x7f7ab40ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab8ebb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab4143ae0 0x7f7ab41598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab8ebb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 0x7f7ab4140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab8ebb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab413c530 con 0x7f7ab415e1e0 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab8ebb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab40ad990 con 0x7f7ab4143ae0 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab8ebb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab4159e30 con 0x7f7ab40cf9a0 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab2d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 0x7f7ab4140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab2d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 0x7f7ab4140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44086/0 (socket says 172.21.15.161:44086) 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab2d9d640 1 -- 172.21.15.161:0/373311818 learned_addr learned my addr 172.21.15.161:0/373311818 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.058+0000 7f7ab259c640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cf9a0 0x7f7ab40ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab1d9b640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab4143ae0 0x7f7ab41598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab2d9d640 1 -- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cf9a0 msgr2=0x7f7ab40ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab2d9d640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cf9a0 0x7f7ab40ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab2d9d640 1 -- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab4143ae0 msgr2=0x7f7ab41598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab2d9d640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab4143ae0 0x7f7ab41598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab2d9d640 1 -- 172.21.15.161:0/373311818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80094d0 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab1d9b640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab4143ae0 0x7f7ab41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab2d9d640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 0x7f7ab4140880 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7aac007e60 tx=0x7f7aac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac014420 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac0145a0 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac014950 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab41f3ac0 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.059+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab40ac970 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.060+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab40675d0 con 0x7f7ab415e1e0 2023-11-24T08:01:21.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.061+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7aac014ab0 con 0x7f7ab415e1e0 2023-11-24T08:01:21.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.062+0000 7f7aa2ffd640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7a9406ae40 0x7f7a9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.062+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7aac08a080 con 0x7f7ab415e1e0 2023-11-24T08:01:21.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.063+0000 7f7ab259c640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7a9406ae40 0x7f7a9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.064+0000 7f7ab259c640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7a9406ae40 0x7f7a9406d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4004ea0 tx=0x7f7aa4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:21.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.067+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7aac0bce90 con 0x7f7ab415e1e0 2023-11-24T08:01:21.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.269+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ab40702c0 con 0x7f7ab415e1e0 2023-11-24T08:01:21.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.270+0000 7f7aa2ffd640 1 -- 172.21.15.161:0/373311818 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7aac055010 con 0x7f7ab415e1e0 2023-11-24T08:01:21.272 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:21.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7a9406ae40 msgr2=0x7f7a9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7a9406ae40 0x7f7a9406d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4004ea0 tx=0x7f7aa4009040 comp rx=0 tx=0).stop 2023-11-24T08:01:21.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 msgr2=0x7f7ab4140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 0x7f7ab4140880 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7aac007e60 tx=0x7f7aac00e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 shutdown_connections 2023-11-24T08:01:21.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7a9406ae40 0x7f7a9406d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7ab415e1e0 0x7f7ab4140880 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ab4143ae0 0x7f7ab41598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 --2- 172.21.15.161:0/373311818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ab40cf9a0 0x7f7ab40ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 >> 172.21.15.161:0/373311818 conn(0x7f7ab406a800 msgr2=0x7f7ab406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:21.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 shutdown_connections 2023-11-24T08:01:21.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.273+0000 7f7ab8ebb640 1 -- 172.21.15.161:0/373311818 wait complete. 2023-11-24T08:01:21.293 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:21.293 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:21.348 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:21.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.562+0000 7f8386cda640 1 Processor -- start 2023-11-24T08:01:21.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.562+0000 7f8386cda640 1 -- start start 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.563+0000 7f8386cda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83800ae5a0 0x7f838015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8386cda640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f83800b3ae0 0x7f838006cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8386cda640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8380070c40 con 0x7f838006d120 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8386cda640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8380071450 con 0x7f83800b3ae0 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8386cda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838006c470 con 0x7f83800ae5a0 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8385277640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f838006d120 0x7f83800cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59926/0 (socket says 172.21.15.161:59926) 2023-11-24T08:01:21.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8385277640 1 -- 172.21.15.161:0/2361935422 learned_addr learned my addr 172.21.15.161:0/2361935422 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f8384a76640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83800ae5a0 0x7f838015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147253170 0 0) 0x7f8380070c40 con 0x7f838006d120 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f837ffff640 1 --2- 172.21.15.161:0/2361935422 >> v2:172.21.15.175:3300/0 conn(0x7f83800b3ae0 0x7f838006cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.564+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8370003520 con 0x7f838006d120 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847832526 0 0) 0x7f8370003520 con 0x7f838006d120 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83800ae5a0 msgr2=0x7f838015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83800ae5a0 0x7f838015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 >> v2:172.21.15.175:3300/0 conn(0x7f83800b3ae0 msgr2=0x7f838006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 --2- 172.21.15.161:0/2361935422 >> v2:172.21.15.175:3300/0 conn(0x7f83800b3ae0 0x7f838006cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838006c750 con 0x7f838006d120 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f83780019f0 con 0x7f838006d120 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 >> v1:172.21.15.161:6789/0 conn(0x7f838006d120 legacy=0x7f83800cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8370003970 0x7f8370003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83700047c0 0x7f8370004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8370005180 0x7f837000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8380071450 con 0x7f83700047c0 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838006c470 con 0x7f8370005180 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837000c020 con 0x7f8370003970 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f837ffff640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83700047c0 0x7f8370004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f8384a76640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8370003970 0x7f8370003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.565+0000 7f8385277640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8370005180 0x7f837000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.566+0000 7f837ffff640 1 -- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8370003970 msgr2=0x7f8370003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.566+0000 7f837ffff640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8370003970 0x7f8370003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.566+0000 7f837ffff640 1 -- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8370005180 msgr2=0x7f837000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.566+0000 7f837ffff640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8370005180 0x7f837000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.566+0000 7f837ffff640 1 -- 172.21.15.161:0/2361935422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370003520 con 0x7f83700047c0 2023-11-24T08:01:21.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.567+0000 7f837ffff640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83700047c0 0x7f8370004c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f836c00ba30 tx=0x7f83700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9120700a0cb7e14c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:21.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c032680 con 0x7f83700047c0 2023-11-24T08:01:21.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0327e0 con 0x7f83700047c0 2023-11-24T08:01:21.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f837f7fe640 1 -- 172.21.15.161:0/2361935422 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c032b70 con 0x7f83700047c0 2023-11-24T08:01:21.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8386cda640 1 -- 172.21.15.161:0/2361935422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83700047c0 msgr2=0x7f8370004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8386cda640 1 --2- 172.21.15.161:0/2361935422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83700047c0 0x7f8370004c40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f836c00ba30 tx=0x7f83700057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8385277640 1 -- 172.21.15.161:0/2361935422 reap_dead start 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8386cda640 1 -- 172.21.15.161:0/2361935422 shutdown_connections 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8386cda640 1 -- 172.21.15.161:0/2361935422 >> 172.21.15.161:0/2361935422 conn(0x7f838006a800 msgr2=0x7f838006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8386cda640 1 -- 172.21.15.161:0/2361935422 shutdown_connections 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.568+0000 7f8386cda640 1 -- 172.21.15.161:0/2361935422 wait complete. 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.570+0000 7f8386cda640 1 Processor -- start 2023-11-24T08:01:21.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.570+0000 7f8386cda640 1 -- start start 2023-11-24T08:01:21.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.571+0000 7f8386cda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83700047c0 0x7f83800ce860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.571+0000 7f8386cda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 0x7f83801569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.571+0000 7f8386cda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8380159210 0x7f8380158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.571+0000 7f8386cda640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838015ab00 con 0x7f83801f2ce0 2023-11-24T08:01:21.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.571+0000 7f8386cda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838015ade0 con 0x7f8380159210 2023-11-24T08:01:21.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.571+0000 7f8386cda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838015b0c0 con 0x7f83700047c0 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 0x7f83801569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 0x7f83801569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44094/0 (socket says 172.21.15.161:44094) 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 -- 172.21.15.161:0/70783483 learned_addr learned my addr 172.21.15.161:0/70783483 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f8385277640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8380159210 0x7f8380158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f8384a76640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83700047c0 0x7f83800ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 -- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83700047c0 msgr2=0x7f83800ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83700047c0 0x7f83800ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 -- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8380159210 msgr2=0x7f8380158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8380159210 0x7f8380158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f837ffff640 1 -- 172.21.15.161:0/70783483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838015b3a0 con 0x7f83801f2ce0 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.572+0000 7f8385277640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8380159210 0x7f8380158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:21.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.573+0000 7f837ffff640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 0x7f83801569f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f836c035040 tx=0x7f836c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:21.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.573+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c004220 con 0x7f83801f2ce0 2023-11-24T08:01:21.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.573+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0043a0 con 0x7f83801f2ce0 2023-11-24T08:01:21.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.573+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c030ae0 con 0x7f83801f2ce0 2023-11-24T08:01:21.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.573+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838015b680 con 0x7f83801f2ce0 2023-11-24T08:01:21.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.573+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838015a720 con 0x7f83801f2ce0 2023-11-24T08:01:21.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.574+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838015b840 con 0x7f83801f2ce0 2023-11-24T08:01:21.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.575+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f836c030c40 con 0x7f83801f2ce0 2023-11-24T08:01:21.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.576+0000 7f837d7fa640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f836406ae70 0x7f836406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:21.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.576+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f836c0ac180 con 0x7f83801f2ce0 2023-11-24T08:01:21.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.577+0000 7f8384a76640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f836406ae70 0x7f836406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:21.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.578+0000 7f8384a76640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f836406ae70 0x7f836406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8374006fd0 tx=0x7f8374008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:21.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.580+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f836c077110 con 0x7f83801f2ce0 2023-11-24T08:01:21.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.776+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f838015b840 con 0x7f83801f2ce0 2023-11-24T08:01:21.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.778+0000 7f837d7fa640 1 -- 172.21.15.161:0/70783483 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f836c07a730 con 0x7f83801f2ce0 2023-11-24T08:01:21.780 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:21.780 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.780+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f836406ae70 msgr2=0x7f836406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.780+0000 7f8386cda640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f836406ae70 0x7f836406d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8374006fd0 tx=0x7f8374008040 comp rx=0 tx=0).stop 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.780+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 msgr2=0x7f83801569f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.780+0000 7f8386cda640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 0x7f83801569f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f836c035040 tx=0x7f836c004730 comp rx=0 tx=0).stop 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 shutdown_connections 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f836406ae70 0x7f836406d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8380159210 0x7f8380158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f83801f2ce0 0x7f83801569f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 --2- 172.21.15.161:0/70783483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f83700047c0 0x7f83800ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:21.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 >> 172.21.15.161:0/70783483 conn(0x7f838006a800 msgr2=0x7f83800b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:21.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 shutdown_connections 2023-11-24T08:01:21.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:21.781+0000 7f8386cda640 1 -- 172.21.15.161:0/70783483 wait complete. 2023-11-24T08:01:21.802 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:21.802 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:22.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.011+0000 7f2fea039640 1 Processor -- start 2023-11-24T08:01:22.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.011+0000 7f2fea039640 1 -- start start 2023-11-24T08:01:22.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.012+0000 7f2fea039640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fe415d110 0x7f2fe4160e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.012+0000 7f2fea039640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.012+0000 7f2fea039640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fe40ce7f0 0x7f2fe40ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.012+0000 7f2fea039640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe406b090 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.012+0000 7f2fea039640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe40b51a0 con 0x7f2fe415d110 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.012+0000 7f2fea039640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe41614f0 con 0x7f2fe415d4f0 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fe40ce7f0 0x7f2fe40ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fe40ce7f0 0x7f2fe40ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44100/0 (socket says 172.21.15.161:44100) 2023-11-24T08:01:22.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 -- 172.21.15.161:0/3444140786 learned_addr learned my addr 172.21.15.161:0/3444140786 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9037640 1 --2- 172.21.15.161:0/3444140786 >> v2:172.21.15.175:3300/0 conn(0x7f2fe415d110 0x7f2fe4160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe8836640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 -- 172.21.15.161:0/3444140786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 msgr2=0x7f2fe40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe40cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 -- 172.21.15.161:0/3444140786 >> v2:172.21.15.175:3300/0 conn(0x7f2fe415d110 msgr2=0x7f2fe4160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 --2- 172.21.15.161:0/3444140786 >> v2:172.21.15.175:3300/0 conn(0x7f2fe415d110 0x7f2fe4160e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe9838640 1 -- 172.21.15.161:0/3444140786 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe41617d0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.013+0000 7f2fe8836640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe40cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:22.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.015+0000 7f2fe9838640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe40ccbd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406f130 tx=0x7f2fdc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e8bbeb8b729f6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.015+0000 7f2fe3fff640 1 -- 172.21.15.161:0/3444140786 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0317d0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.015+0000 7f2fe3fff640 1 -- 172.21.15.161:0/3444140786 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fdc031930 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.015+0000 7f2fe3fff640 1 -- 172.21.15.161:0/3444140786 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc031cc0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.015+0000 7f2fea039640 1 -- 172.21.15.161:0/3444140786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 msgr2=0x7f2fe40ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.015+0000 7f2fea039640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe40ccbd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406f130 tx=0x7f2fdc02b870 comp rx=0 tx=0).stop 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 -- 172.21.15.161:0/3444140786 shutdown_connections 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe40ccbd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 --2- 172.21.15.161:0/3444140786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe40cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 --2- 172.21.15.161:0/3444140786 >> v2:172.21.15.175:3300/0 conn(0x7f2fe415d110 0x7f2fe4160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 -- 172.21.15.161:0/3444140786 >> 172.21.15.161:0/3444140786 conn(0x7f2fe40b1ba0 msgr2=0x7f2fe40b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 -- 172.21.15.161:0/3444140786 shutdown_connections 2023-11-24T08:01:22.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.016+0000 7f2fea039640 1 -- 172.21.15.161:0/3444140786 wait complete. 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.017+0000 7f2fea039640 1 Processor -- start 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 -- start start 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fe415d110 0x7f2fe4160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe41f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe415d900 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe4160760 con 0x7f2fe415d110 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.018+0000 7f2fea039640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe414f170 con 0x7f2fe415d4f0 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe414de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44112/0 (socket says 172.21.15.161:44112) 2023-11-24T08:01:22.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 -- 172.21.15.161:0/2054079186 learned_addr learned my addr 172.21.15.161:0/2054079186 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 -- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 msgr2=0x7f2fe41f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9838640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe41f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe41f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 -- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fe415d110 msgr2=0x7f2fe4160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fe415d110 0x7f2fe4160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.019+0000 7f2fe9037640 1 -- 172.21.15.161:0/2054079186 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0094d0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.020+0000 7f2fe9037640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe414de90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007ef0 tx=0x7f2fd400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.020+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4014620 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.020+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd400ee90 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.020+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40149c0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.020+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe4156030 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.020+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe414f6a0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.021+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe4067b60 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.022+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fd4014b20 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.023+0000 7f2fe1ffb640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fd006ae70 0x7f2fd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.023+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2fd4089ff0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.024+0000 7f2fe8836640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fd006ae70 0x7f2fd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.025+0000 7f2fe8836640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fd006ae70 0x7f2fd006d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b2690 tx=0x7f2fd8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.028+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2fd4054fe0 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.217+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fe414e520 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.218+0000 7f2fe1ffb640 1 -- 172.21.15.161:0/2054079186 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fd4058600 con 0x7f2fe40ce7f0 2023-11-24T08:01:22.220 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fd006ae70 msgr2=0x7f2fd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fd006ae70 0x7f2fd006d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2fe40b2690 tx=0x7f2fd8008040 comp rx=0 tx=0).stop 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 msgr2=0x7f2fe414de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe414de90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4007ef0 tx=0x7f2fd400e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 shutdown_connections 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fd006ae70 0x7f2fd006d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fe415d4f0 0x7f2fe41f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fe415d110 0x7f2fe4160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 --2- 172.21.15.161:0/2054079186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fe40ce7f0 0x7f2fe414de90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 >> 172.21.15.161:0/2054079186 conn(0x7f2fe40b1ba0 msgr2=0x7f2fe406e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:22.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.220+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 shutdown_connections 2023-11-24T08:01:22.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.221+0000 7f2fea039640 1 -- 172.21.15.161:0/2054079186 wait complete. 2023-11-24T08:01:22.241 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:22.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.455+0000 7fb75bfff640 1 Processor -- start 2023-11-24T08:01:22.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.455+0000 7fb75bfff640 1 -- start start 2023-11-24T08:01:22.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.456+0000 7fb75bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 0x7fb75c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb75bfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0ce440 con 0x7fb75c0cdc20 2023-11-24T08:01:22.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb75bfff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0ce720 con 0x7fb75c13cf10 2023-11-24T08:01:22.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb75bfff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0cea00 con 0x7fb75c13fcb0 2023-11-24T08:01:22.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb75b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb75c0cdc20 0x7fb75c0b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59932/0 (socket says 172.21.15.161:59932) 2023-11-24T08:01:22.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb75b7fe640 1 -- 172.21.15.161:0/867313523 learned_addr learned my addr 172.21.15.161:0/867313523 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb75a7fc640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 0x7fb75c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 80402260 0 0) 0x7fb75c0ce440 con 0x7fb75c0cdc20 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.457+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744005730 con 0x7fb75c0cdc20 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790924368 0 0) 0x7fb744005730 con 0x7fb75c0cdc20 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 msgr2=0x7fb75c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 0x7fb75c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 >> v1:172.21.15.175:6789/0 conn(0x7fb75c13cf10 legacy=0x7fb75c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0b1d90 con 0x7fb75c0cdc20 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fb754001670 con 0x7fb75c0cdc20 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 >> v1:172.21.15.161:6789/0 conn(0x7fb75c0cdc20 legacy=0x7fb75c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb744005bb0 0x7fb744005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7440069d0 0x7fb744006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 0x7fb744007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0cea00 con 0x7fb744005bb0 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74400dd50 con 0x7fb7440069d0 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74400df10 con 0x7fb75c13fcb0 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.458+0000 7fb75affd640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb744005bb0 0x7fb744005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75a7fc640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7440069d0 0x7fb744006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75b7fe640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 0x7fb744007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75affd640 1 -- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 msgr2=0x7fb744007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75affd640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb75c13fcb0 0x7fb744007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75affd640 1 -- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7440069d0 msgr2=0x7fb744006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75affd640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7440069d0 0x7fb744006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.459+0000 7fb75affd640 1 -- 172.21.15.161:0/867313523 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744005730 con 0x7fb744005bb0 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.460+0000 7fb75affd640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb744005bb0 0x7fb744005fd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb74c001e50 tx=0x7fb744007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a018faa60f7e1765 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.460+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c003b70 con 0x7fb744005bb0 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.460+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74c003cd0 con 0x7fb744005bb0 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.460+0000 7fb759ffb640 1 -- 172.21.15.161:0/867313523 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74c005310 con 0x7fb744005bb0 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75bfff640 1 -- 172.21.15.161:0/867313523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb744005bb0 msgr2=0x7fb744005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75bfff640 1 --2- 172.21.15.161:0/867313523 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb744005bb0 0x7fb744005fd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb74c001e50 tx=0x7fb744007a00 comp rx=0 tx=0).stop 2023-11-24T08:01:22.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75b7fe640 1 -- 172.21.15.161:0/867313523 reap_dead start 2023-11-24T08:01:22.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75bfff640 1 -- 172.21.15.161:0/867313523 shutdown_connections 2023-11-24T08:01:22.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75bfff640 1 -- 172.21.15.161:0/867313523 >> 172.21.15.161:0/867313523 conn(0x7fb75c06a7d0 msgr2=0x7fb75c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:22.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75bfff640 1 -- 172.21.15.161:0/867313523 shutdown_connections 2023-11-24T08:01:22.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.461+0000 7fb75bfff640 1 -- 172.21.15.161:0/867313523 wait complete. 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.463+0000 7fb75bfff640 1 Processor -- start 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.463+0000 7fb75bfff640 1 -- start start 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb744005bb0 0x7fb75c13c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb75c13dc80 0x7fb75c13e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 0x7fb75c070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75bfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c13e620 con 0x7fb75c070790 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75bfff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c072140 con 0x7fb75c13dc80 2023-11-24T08:01:22.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75bfff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0725d0 con 0x7fb744005bb0 2023-11-24T08:01:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 0x7fb75c070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 0x7fb75c070c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44136/0 (socket says 172.21.15.161:44136) 2023-11-24T08:01:22.467 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75b7fe640 1 -- 172.21.15.161:0/1769571095 learned_addr learned my addr 172.21.15.161:0/1769571095 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75a7fc640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb75c13dc80 0x7fb75c13e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.464+0000 7fb75affd640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb744005bb0 0x7fb75c13c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75b7fe640 1 -- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb744005bb0 msgr2=0x7fb75c13c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75b7fe640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb744005bb0 0x7fb75c13c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75b7fe640 1 -- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb75c13dc80 msgr2=0x7fb75c13e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75b7fe640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb75c13dc80 0x7fb75c13e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75b7fe640 1 -- 172.21.15.161:0/1769571095 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c071530 con 0x7fb75c070790 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75b7fe640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 0x7fb75c070c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0b3f10 tx=0x7fb75400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400eed0 con 0x7fb75c070790 2023-11-24T08:01:22.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400c610 con 0x7fb75c070790 2023-11-24T08:01:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400c9a0 con 0x7fb75c070790 2023-11-24T08:01:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c071810 con 0x7fb75c070790 2023-11-24T08:01:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.465+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c071dd0 con 0x7fb75c070790 2023-11-24T08:01:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.467+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c0722f0 con 0x7fb75c070790 2023-11-24T08:01:22.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.467+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb75400cb00 con 0x7fb75c070790 2023-11-24T08:01:22.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.468+0000 7fb7437fe640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb74806ae40 0x7fb74806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.470 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.468+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb7540892a0 con 0x7fb75c070790 2023-11-24T08:01:22.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.469+0000 7fb75affd640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb74806ae40 0x7fb74806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.470+0000 7fb75affd640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb74806ae40 0x7fb74806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb74c034000 tx=0x7fb74c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.473+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb75c0722f0 con 0x7fb75c070790 2023-11-24T08:01:22.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.662+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb75c0ad8e0 con 0x7fb75c070790 2023-11-24T08:01:22.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.663+0000 7fb7437fe640 1 -- 172.21.15.161:0/1769571095 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7540542c0 con 0x7fb75c070790 2023-11-24T08:01:22.665 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb74806ae40 msgr2=0x7fb74806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb74806ae40 0x7fb74806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb74c034000 tx=0x7fb74c009030 comp rx=0 tx=0).stop 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 msgr2=0x7fb75c070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 0x7fb75c070c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0b3f10 tx=0x7fb75400eb90 comp rx=0 tx=0).stop 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 shutdown_connections 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb74806ae40 0x7fb74806d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb75c070790 0x7fb75c070c10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb75c13dc80 0x7fb75c13e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 --2- 172.21.15.161:0/1769571095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb744005bb0 0x7fb75c13c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 >> 172.21.15.161:0/1769571095 conn(0x7fb75c06a7d0 msgr2=0x7fb75c0af650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:22.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 shutdown_connections 2023-11-24T08:01:22.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.666+0000 7fb75bfff640 1 -- 172.21.15.161:0/1769571095 wait complete. 2023-11-24T08:01:22.687 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:22.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.901+0000 7f9bf1fa9640 1 Processor -- start 2023-11-24T08:01:22.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.901+0000 7f9bf1fa9640 1 -- start start 2023-11-24T08:01:22.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.902+0000 7f9bf1fa9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9bec14b2c0 0x7f9bec0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bf1fa9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec0cfbf0 con 0x7f9bec071070 2023-11-24T08:01:22.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bf1fa9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bec071690 con 0x7f9bec0cf7d0 2023-11-24T08:01:22.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bf1fa9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec14b6a0 con 0x7f9bec14b2c0 2023-11-24T08:01:22.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bebfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9bec071070 0x7f9bec0cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59946/0 (socket says 172.21.15.161:59946) 2023-11-24T08:01:22.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bebfff640 1 -- 172.21.15.161:0/169722557 learned_addr learned my addr 172.21.15.161:0/169722557 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9beb7fe640 1 --2- 172.21.15.161:0/169722557 >> v2:172.21.15.175:3300/0 conn(0x7f9bec14b2c0 0x7f9bec0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850522897 0 0) 0x7f9bec0cfbf0 con 0x7f9bec071070 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.903+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd4003520 con 0x7f9bec071070 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3898975314 0 0) 0x7f9bd4003520 con 0x7f9bec071070 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 >> v2:172.21.15.175:3300/0 conn(0x7f9bec14b2c0 msgr2=0x7f9bec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 --2- 172.21.15.161:0/169722557 >> v2:172.21.15.175:3300/0 conn(0x7f9bec14b2c0 0x7f9bec0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 >> v1:172.21.15.175:6789/0 conn(0x7f9bec0cf7d0 legacy=0x7f9bec070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec071970 con 0x7f9bec071070 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f9be40019f0 con 0x7f9bec071070 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 >> v1:172.21.15.161:6789/0 conn(0x7f9bec071070 legacy=0x7f9bec0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd4003970 0x7f9bd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40047c0 0x7f9bd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd4005180 0x7f9bd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec14b6a0 con 0x7f9bd40047c0 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400c020 con 0x7f9bd4003970 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd400c1e0 con 0x7f9bd4005180 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.904+0000 7f9beaffd640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40047c0 0x7f9bd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9beb7fe640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd4003970 0x7f9bd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9bebfff640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd4005180 0x7f9bd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9beaffd640 1 -- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd4005180 msgr2=0x7f9bd400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9beaffd640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd4005180 0x7f9bd400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9beaffd640 1 -- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd4003970 msgr2=0x7f9bd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9beaffd640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd4003970 0x7f9bd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9beaffd640 1 -- 172.21.15.161:0/169722557 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd4003520 con 0x7f9bd40047c0 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.905+0000 7f9bebfff640 1 -- 172.21.15.161:0/169722557 reap_dead start 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.906+0000 7f9beaffd640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40047c0 0x7f9bd4004c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9be0001750 tx=0x7f9bd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de7073c5d7d73e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.906+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be00052d0 con 0x7f9bd40047c0 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.906+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be002e050 con 0x7f9bd40047c0 2023-11-24T08:01:22.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.906+0000 7f9bea7fc640 1 -- 172.21.15.161:0/169722557 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be0003830 con 0x7f9bd40047c0 2023-11-24T08:01:22.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/169722557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40047c0 msgr2=0x7f9bd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40047c0 0x7f9bd4004c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9be0001750 tx=0x7f9bd40057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/169722557 shutdown_connections 2023-11-24T08:01:22.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/169722557 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd40047c0 0x7f9bd4004c40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/169722557 >> 172.21.15.161:0/169722557 conn(0x7f9bec06a800 msgr2=0x7f9bec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:22.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/169722557 shutdown_connections 2023-11-24T08:01:22.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.907+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/169722557 wait complete. 2023-11-24T08:01:22.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.909+0000 7f9bf1fa9640 1 Processor -- start 2023-11-24T08:01:22.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.909+0000 7f9bf1fa9640 1 -- start start 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bf1fa9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd40047c0 0x7f9bec1f72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bf1fa9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec1640e0 0x7f9bec161080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bf1fa9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 0x7f9bec1f8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bf1fa9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec162ec0 con 0x7f9bec1f8490 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bf1fa9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1f7b00 con 0x7f9bec1640e0 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bf1fa9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec1f7de0 con 0x7f9bd40047c0 2023-11-24T08:01:22.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 0x7f9bec1f8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 0x7f9bec1f8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44152/0 (socket says 172.21.15.161:44152) 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9bebfff640 1 -- 172.21.15.161:0/3409609789 learned_addr learned my addr 172.21.15.161:0/3409609789 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9beaffd640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec1640e0 0x7f9bec161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.910+0000 7f9beb7fe640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd40047c0 0x7f9bec1f72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bebfff640 1 -- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd40047c0 msgr2=0x7f9bec1f72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bebfff640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd40047c0 0x7f9bec1f72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bebfff640 1 -- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec1640e0 msgr2=0x7f9bec161080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bebfff640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec1640e0 0x7f9bec161080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bebfff640 1 -- 172.21.15.161:0/3409609789 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec1f80c0 con 0x7f9bec1f8490 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bebfff640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 0x7f9bec1f8910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0cfe50 tx=0x7f9be400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be4004d60 con 0x7f9bec1f8490 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400bb20 con 0x7f9bec1f8490 2023-11-24T08:01:22.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be400bed0 con 0x7f9bec1f8490 2023-11-24T08:01:22.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec1630d0 con 0x7f9bec1f8490 2023-11-24T08:01:22.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.911+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec1615c0 con 0x7f9bec1f8490 2023-11-24T08:01:22.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.913+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec1f82b0 con 0x7f9bec1f8490 2023-11-24T08:01:22.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.913+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9be4007070 con 0x7f9bec1f8490 2023-11-24T08:01:22.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.914+0000 7f9bd3fff640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bd806ae40 0x7f9bd806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:22.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.914+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9be40899a0 con 0x7f9bec1f8490 2023-11-24T08:01:22.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.915+0000 7f9beb7fe640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bd806ae40 0x7f9bd806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:22.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.916+0000 7f9beb7fe640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bd806ae40 0x7f9bd806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009a90 tx=0x7f9bdc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:22.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:22.919+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9be40549d0 con 0x7f9bec1f8490 2023-11-24T08:01:23.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.112+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9bec1632c0 con 0x7f9bec1f8490 2023-11-24T08:01:23.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.113+0000 7f9bd3fff640 1 -- 172.21.15.161:0/3409609789 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9be4057ff0 con 0x7f9bec1f8490 2023-11-24T08:01:23.115 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.115+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bd806ae40 msgr2=0x7f9bd806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.115+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bd806ae40 0x7f9bd806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009a90 tx=0x7f9bdc008040 comp rx=0 tx=0).stop 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.115+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 msgr2=0x7f9bec1f8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.115+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 0x7f9bec1f8910 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0cfe50 tx=0x7f9be400b4a0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.115+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 shutdown_connections 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bd806ae40 0x7f9bd806d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bec1f8490 0x7f9bec1f8910 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bec1640e0 0x7f9bec161080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 --2- 172.21.15.161:0/3409609789 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd40047c0 0x7f9bec1f72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 >> 172.21.15.161:0/3409609789 conn(0x7f9bec06a800 msgr2=0x7f9bec06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:23.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 shutdown_connections 2023-11-24T08:01:23.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.116+0000 7f9bf1fa9640 1 -- 172.21.15.161:0/3409609789 wait complete. 2023-11-24T08:01:23.136 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:23.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.342+0000 7f506a85c640 1 Processor -- start 2023-11-24T08:01:23.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.343+0000 7f506a85c640 1 -- start start 2023-11-24T08:01:23.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.344+0000 7f506a85c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f506413e360 0x7f50640cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:23.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.344+0000 7f506a85c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f506415f9c0 0x7f50640cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:23.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.344+0000 7f506a85c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506415c5f0 con 0x7f506413df80 2023-11-24T08:01:23.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.344+0000 7f506a85c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506406c470 con 0x7f506415f9c0 2023-11-24T08:01:23.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.344+0000 7f506a85c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506406c750 con 0x7f506413e360 2023-11-24T08:01:23.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f506415f9c0 0x7f50640cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:23.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f506415f9c0 0x7f50640cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44166/0 (socket says 172.21.15.161:44166) 2023-11-24T08:01:23.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 -- 172.21.15.161:0/520530203 learned_addr learned my addr 172.21.15.161:0/520530203 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:23.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f505bfff640 1 --2- 172.21.15.161:0/520530203 >> v2:172.21.15.175:3300/0 conn(0x7f506413e360 0x7f50640cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:23.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 -- 172.21.15.161:0/520530203 >> v2:172.21.15.175:3300/0 conn(0x7f506413e360 msgr2=0x7f50640cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:23.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 --2- 172.21.15.161:0/520530203 >> v2:172.21.15.175:3300/0 conn(0x7f506413e360 0x7f50640cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 -- 172.21.15.161:0/520530203 >> v1:172.21.15.161:6789/0 conn(0x7f506413df80 legacy=0x7f506415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f50637fe640 1 -- 172.21.15.161:0/520530203 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303434044 0 0) 0x7f506415c5f0 con 0x7f506413df80 2023-11-24T08:01:23.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.345+0000 7f5068df9640 1 -- 172.21.15.161:0/520530203 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506406ca30 con 0x7f506415f9c0 2023-11-24T08:01:23.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.347+0000 7f5068df9640 1 --2- 172.21.15.161:0/520530203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50640cf7d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f506406ded0 tx=0x7f505c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f17b4f69e761c8a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:23.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.347+0000 7f50637fe640 1 -- 172.21.15.161:0/520530203 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c02cb10 con 0x7f506415f9c0 2023-11-24T08:01:23.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.347+0000 7f50637fe640 1 -- 172.21.15.161:0/520530203 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c02cc70 con 0x7f506415f9c0 2023-11-24T08:01:23.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.347+0000 7f50637fe640 1 -- 172.21.15.161:0/520530203 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c0343f0 con 0x7f506415f9c0 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 -- 172.21.15.161:0/520530203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 msgr2=0x7f50640cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 --2- 172.21.15.161:0/520530203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50640cf7d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f506406ded0 tx=0x7f505c02bf70 comp rx=0 tx=0).stop 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 -- 172.21.15.161:0/520530203 shutdown_connections 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 --2- 172.21.15.161:0/520530203 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50640cf7d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 --2- 172.21.15.161:0/520530203 >> v2:172.21.15.175:3300/0 conn(0x7f506413e360 0x7f50640cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 -- 172.21.15.161:0/520530203 >> 172.21.15.161:0/520530203 conn(0x7f506406a800 msgr2=0x7f506406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 -- 172.21.15.161:0/520530203 shutdown_connections 2023-11-24T08:01:23.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.348+0000 7f506a85c640 1 -- 172.21.15.161:0/520530203 wait complete. 2023-11-24T08:01:23.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.350+0000 7f506a85c640 1 Processor -- start 2023-11-24T08:01:23.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.350+0000 7f506a85c640 1 -- start start 2023-11-24T08:01:23.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f506a85c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f506413df80 0x7f50640aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:23.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f506a85c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f506413e360 0x7f50640acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:23.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f506a85c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50641482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:23.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f506a85c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5064146290 con 0x7f506415f9c0 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f506a85c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5064146530 con 0x7f506413df80 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f506a85c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5064148810 con 0x7f506413e360 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f5068df9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50641482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f5068df9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50641482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44180/0 (socket says 172.21.15.161:44180) 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f5068df9640 1 -- 172.21.15.161:0/3388878344 learned_addr learned my addr 172.21.15.161:0/3388878344 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f5063fff640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f506413df80 0x7f50640aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.351+0000 7f505bfff640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f506413e360 0x7f50640acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f5068df9640 1 -- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f506413e360 msgr2=0x7f50640acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f5068df9640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f506413e360 0x7f50640acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f5068df9640 1 -- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f506413df80 msgr2=0x7f50640aa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f5068df9640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f506413df80 0x7f50640aa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f5068df9640 1 -- 172.21.15.161:0/3388878344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c009b30 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f5068df9640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50641482d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f505c036040 tx=0x7f505c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c009510 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c03e450 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5064148ae0 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c03e800 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.352+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50641490a0 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.354+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50641466e0 con 0x7f506415f9c0 2023-11-24T08:01:23.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.355+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f505c03e960 con 0x7f506415f9c0 2023-11-24T08:01:23.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.356+0000 7f50617fa640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f504406ae70 0x7f504406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:23.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.356+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f505c0ac440 con 0x7f506415f9c0 2023-11-24T08:01:23.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.357+0000 7f5063fff640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f504406ae70 0x7f504406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:23.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.358+0000 7f5063fff640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f504406ae70 0x7f504406d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5054007fd0 tx=0x7f5054009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:23.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.360+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50641466e0 con 0x7f506415f9c0 2023-11-24T08:01:23.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.563+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5064149290 con 0x7f506415f9c0 2023-11-24T08:01:23.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.564+0000 7f50617fa640 1 -- 172.21.15.161:0/3388878344 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f505c077460 con 0x7f506415f9c0 2023-11-24T08:01:23.567 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:23.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f504406ae70 msgr2=0x7f504406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f504406ae70 0x7f504406d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5054007fd0 tx=0x7f5054009040 comp rx=0 tx=0).stop 2023-11-24T08:01:23.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 msgr2=0x7f50641482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:23.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50641482d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f505c036040 tx=0x7f505c004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:23.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 shutdown_connections 2023-11-24T08:01:23.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f504406ae70 0x7f504406d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f506415f9c0 0x7f50641482d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f506413e360 0x7f50640acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 --2- 172.21.15.161:0/3388878344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f506413df80 0x7f50640aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:23.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 >> 172.21.15.161:0/3388878344 conn(0x7f506406a800 msgr2=0x7f506415a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:23.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 shutdown_connections 2023-11-24T08:01:23.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:23.567+0000 7f506a85c640 1 -- 172.21.15.161:0/3388878344 wait complete. 2023-11-24T08:01:23.586 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2023-11-24T08:01:23.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:23.587 DEBUG:teuthology.orchestra.run.smithi161:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-24T08:01:23.683 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:23.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:01:23.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:23.683 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:01:23.735 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:01:23.735 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:23.795 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:01:23.795 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:23.846 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:24.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.066+0000 7fad649b0640 1 Processor -- start 2023-11-24T08:01:24.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.066+0000 7fad649b0640 1 -- start start 2023-11-24T08:01:24.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad649b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad6015bf20 0x7fad60162980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad649b0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad60162f30 0x7fad6006d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad649b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6006a3e0 0x7fad6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad649b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6006adb0 con 0x7fad6015bf20 2023-11-24T08:01:24.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad649b0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad601633b0 con 0x7fad60162f30 2023-11-24T08:01:24.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad649b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600b3240 con 0x7fad6006a3e0 2023-11-24T08:01:24.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad6015bf20 0x7fad60162980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad6015bf20 0x7fad60162980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44192/0 (socket says 172.21.15.161:44192) 2023-11-24T08:01:24.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 -- 172.21.15.161:0/4136606424 learned_addr learned my addr 172.21.15.161:0/4136606424 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:24.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 -- 172.21.15.161:0/4136606424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6006a3e0 msgr2=0x7fad6006a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:24.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 --2- 172.21.15.161:0/4136606424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6006a3e0 0x7fad6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 -- 172.21.15.161:0/4136606424 >> v2:172.21.15.175:3300/0 conn(0x7fad60162f30 msgr2=0x7fad6006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:24.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 --2- 172.21.15.161:0/4136606424 >> v2:172.21.15.175:3300/0 conn(0x7fad60162f30 0x7fad6006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.069+0000 7fad5e59c640 1 -- 172.21.15.161:0/4136606424 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6006dab0 con 0x7fad6015bf20 2023-11-24T08:01:24.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.070+0000 7fad5e59c640 1 --2- 172.21.15.161:0/4136606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad60162980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fad600b2a70 tx=0x7fad5002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e19bf804074873 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.070+0000 7fad5d59a640 1 -- 172.21.15.161:0/4136606424 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5002ca80 con 0x7fad6015bf20 2023-11-24T08:01:24.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.070+0000 7fad5d59a640 1 -- 172.21.15.161:0/4136606424 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5002cbe0 con 0x7fad6015bf20 2023-11-24T08:01:24.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.070+0000 7fad5d59a640 1 -- 172.21.15.161:0/4136606424 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500343f0 con 0x7fad6015bf20 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 -- 172.21.15.161:0/4136606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 msgr2=0x7fad60162980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 --2- 172.21.15.161:0/4136606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad60162980 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fad600b2a70 tx=0x7fad5002bee0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 -- 172.21.15.161:0/4136606424 shutdown_connections 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 --2- 172.21.15.161:0/4136606424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad6006a3e0 0x7fad6006a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 --2- 172.21.15.161:0/4136606424 >> v2:172.21.15.175:3300/0 conn(0x7fad60162f30 0x7fad6006d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 --2- 172.21.15.161:0/4136606424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad60162980 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 -- 172.21.15.161:0/4136606424 >> 172.21.15.161:0/4136606424 conn(0x7fad600b1bf0 msgr2=0x7fad600b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:24.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 -- 172.21.15.161:0/4136606424 shutdown_connections 2023-11-24T08:01:24.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.071+0000 7fad649b0640 1 -- 172.21.15.161:0/4136606424 wait complete. 2023-11-24T08:01:24.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.073+0000 7fad649b0640 1 Processor -- start 2023-11-24T08:01:24.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.073+0000 7fad649b0640 1 -- start start 2023-11-24T08:01:24.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad649b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad6006a3e0 0x7fad6014a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad649b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad600ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad649b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad60162f30 0x7fad6014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad649b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6014ad90 con 0x7fad6015bf20 2023-11-24T08:01:24.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad649b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad600ae0f0 con 0x7fad6006a3e0 2023-11-24T08:01:24.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad649b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600ae3d0 con 0x7fad60162f30 2023-11-24T08:01:24.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad5dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad600ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad5dd9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad600ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44204/0 (socket says 172.21.15.161:44204) 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.074+0000 7fad5dd9b640 1 -- 172.21.15.161:0/1146215666 learned_addr learned my addr 172.21.15.161:0/1146215666 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5e59c640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad6006a3e0 0x7fad6014a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5dd9b640 1 -- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad60162f30 msgr2=0x7fad6014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5dd9b640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad60162f30 0x7fad6014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5dd9b640 1 -- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad6006a3e0 msgr2=0x7fad6014a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5dd9b640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad6006a3e0 0x7fad6014a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5dd9b640 1 -- 172.21.15.161:0/1146215666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009b30 con 0x7fad6015bf20 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad5dd9b640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad600ad730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b4a0 tx=0x7fad4800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48010610 con 0x7fad6015bf20 2023-11-24T08:01:24.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48010770 con 0x7fad6015bf20 2023-11-24T08:01:24.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48010b20 con 0x7fad6015bf20 2023-11-24T08:01:24.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.075+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad600ae6b0 con 0x7fad6015bf20 2023-11-24T08:01:24.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.076+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad600aec70 con 0x7fad6015bf20 2023-11-24T08:01:24.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.077+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad600675d0 con 0x7fad6015bf20 2023-11-24T08:01:24.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.078+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad48010c80 con 0x7fad6015bf20 2023-11-24T08:01:24.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.079+0000 7fad56ffd640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad4006ae70 0x7fad4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.079+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fad48089220 con 0x7fad6015bf20 2023-11-24T08:01:24.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.079+0000 7fad5e59c640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad4006ae70 0x7fad4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.081+0000 7fad5e59c640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad4006ae70 0x7fad4006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad50035000 tx=0x7fad50030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.084+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad480542e0 con 0x7fad6015bf20 2023-11-24T08:01:24.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.276+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad60164a20 con 0x7fad6015bf20 2023-11-24T08:01:24.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.278+0000 7fad56ffd640 1 -- 172.21.15.161:0/1146215666 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7fad48057900 con 0x7fad6015bf20 2023-11-24T08:01:24.281 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:24.281 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:24.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.281+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad4006ae70 msgr2=0x7fad4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.281+0000 7fad649b0640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad4006ae70 0x7fad4006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad50035000 tx=0x7fad50030000 comp rx=0 tx=0).stop 2023-11-24T08:01:24.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.281+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 msgr2=0x7fad600ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.281+0000 7fad649b0640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad600ad730 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fad4800b4a0 tx=0x7fad4800b960 comp rx=0 tx=0).stop 2023-11-24T08:01:24.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 shutdown_connections 2023-11-24T08:01:24.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad4006ae70 0x7fad4006d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad60162f30 0x7fad6014d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad6015bf20 0x7fad600ad730 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 --2- 172.21.15.161:0/1146215666 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad6006a3e0 0x7fad6014a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 >> 172.21.15.161:0/1146215666 conn(0x7fad600b1bf0 msgr2=0x7fad600b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 shutdown_connections 2023-11-24T08:01:24.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.282+0000 7fad649b0640 1 -- 172.21.15.161:0/1146215666 wait complete. 2023-11-24T08:01:24.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:24.304 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.518+0000 7fb679275640 1 Processor -- start 2023-11-24T08:01:24.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.518+0000 7fb679275640 1 -- start start 2023-11-24T08:01:24.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb679275640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb67414b2c0 0x7fb6740cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb679275640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740cfbf0 con 0x7fb674071070 2023-11-24T08:01:24.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb679275640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb674071690 con 0x7fb6740cf7d0 2023-11-24T08:01:24.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb679275640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67414b6a0 con 0x7fb67414b2c0 2023-11-24T08:01:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb6737fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb674071070 0x7fb6740cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59974/0 (socket says 172.21.15.161:59974) 2023-11-24T08:01:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb6737fe640 1 -- 172.21.15.161:0/1585030650 learned_addr learned my addr 172.21.15.161:0/1585030650 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.520+0000 7fb672ffd640 1 --2- 172.21.15.161:0/1585030650 >> v2:172.21.15.161:3300/0 conn(0x7fb67414b2c0 0x7fb6740cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.521+0000 7fb6727fc640 1 -- 172.21.15.161:0/1585030650 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685038087 0 0) 0x7fb6740cfbf0 con 0x7fb674071070 2023-11-24T08:01:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.521+0000 7fb6727fc640 1 -- 172.21.15.161:0/1585030650 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb660003520 con 0x7fb674071070 2023-11-24T08:01:24.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.521+0000 7fb672ffd640 1 -- 172.21.15.161:0/1585030650 >> v1:172.21.15.175:6789/0 conn(0x7fb6740cf7d0 legacy=0x7fb674070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.521+0000 7fb672ffd640 1 -- 172.21.15.161:0/1585030650 >> v1:172.21.15.161:6789/0 conn(0x7fb674071070 legacy=0x7fb6740cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.521+0000 7fb672ffd640 1 -- 172.21.15.161:0/1585030650 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb674071970 con 0x7fb67414b2c0 2023-11-24T08:01:24.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.522+0000 7fb672ffd640 1 --2- 172.21.15.161:0/1585030650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67414b2c0 0x7fb6740cf290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097a0 tx=0x7fb66402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67a2001bdb2158a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.522+0000 7fb6727fc640 1 -- 172.21.15.161:0/1585030650 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664030610 con 0x7fb67414b2c0 2023-11-24T08:01:24.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.522+0000 7fb6727fc640 1 -- 172.21.15.161:0/1585030650 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664030770 con 0x7fb67414b2c0 2023-11-24T08:01:24.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.522+0000 7fb6727fc640 1 -- 172.21.15.161:0/1585030650 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664030b00 con 0x7fb67414b2c0 2023-11-24T08:01:24.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 -- 172.21.15.161:0/1585030650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67414b2c0 msgr2=0x7fb6740cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 --2- 172.21.15.161:0/1585030650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67414b2c0 0x7fb6740cf290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb6640097a0 tx=0x7fb66402b960 comp rx=0 tx=0).stop 2023-11-24T08:01:24.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 -- 172.21.15.161:0/1585030650 shutdown_connections 2023-11-24T08:01:24.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 --2- 172.21.15.161:0/1585030650 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb67414b2c0 0x7fb6740cf290 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 -- 172.21.15.161:0/1585030650 >> 172.21.15.161:0/1585030650 conn(0x7fb67406a800 msgr2=0x7fb67406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:24.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 -- 172.21.15.161:0/1585030650 shutdown_connections 2023-11-24T08:01:24.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.523+0000 7fb679275640 1 -- 172.21.15.161:0/1585030650 wait complete. 2023-11-24T08:01:24.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.525+0000 7fb679275640 1 Processor -- start 2023-11-24T08:01:24.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.525+0000 7fb679275640 1 -- start start 2023-11-24T08:01:24.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb679275640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 0x7fb6741527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb679275640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6740cf7d0 0x7fb6740b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb679275640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67414b2c0 0x7fb6740b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb679275640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6741f7f50 con 0x7fb674071070 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb679275640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6741f7c70 con 0x7fb67414b2c0 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb679275640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb674151d10 con 0x7fb6740cf7d0 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb672ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 0x7fb6741527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb672ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 0x7fb6741527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44226/0 (socket says 172.21.15.161:44226) 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.526+0000 7fb672ffd640 1 -- 172.21.15.161:0/3683872865 learned_addr learned my addr 172.21.15.161:0/3683872865 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb6737fe640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67414b2c0 0x7fb6740b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb672ffd640 1 -- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6740cf7d0 msgr2=0x7fb6740b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb66bfff640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6740cf7d0 0x7fb6740b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb672ffd640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6740cf7d0 0x7fb6740b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb672ffd640 1 -- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67414b2c0 msgr2=0x7fb6740b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb672ffd640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67414b2c0 0x7fb6740b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb672ffd640 1 -- 172.21.15.161:0/3683872865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb664009400 con 0x7fb674071070 2023-11-24T08:01:24.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb6737fe640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67414b2c0 0x7fb6740b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:24.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb672ffd640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 0x7fb6741527f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb66402bf70 tx=0x7fb6640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.527+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb66403e070 con 0x7fb674071070 2023-11-24T08:01:24.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.528+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664030e10 con 0x7fb674071070 2023-11-24T08:01:24.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.528+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664039c30 con 0x7fb674071070 2023-11-24T08:01:24.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.528+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb674151ff0 con 0x7fb674071070 2023-11-24T08:01:24.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.528+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6740cced0 con 0x7fb674071070 2023-11-24T08:01:24.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.529+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6740675d0 con 0x7fb674071070 2023-11-24T08:01:24.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.530+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb66404b400 con 0x7fb674071070 2023-11-24T08:01:24.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.530+0000 7fb66b7fe640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb65406ae40 0x7fb65406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.531+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb6640aba30 con 0x7fb674071070 2023-11-24T08:01:24.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.531+0000 7fb66bfff640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb65406ae40 0x7fb65406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.532+0000 7fb66bfff640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb65406ae40 0x7fb65406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb67415fb80 tx=0x7fb65c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.535+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb664076a50 con 0x7fb674071070 2023-11-24T08:01:24.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.723+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb674152510 con 0x7fb674071070 2023-11-24T08:01:24.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.724+0000 7fb66b7fe640 1 -- 172.21.15.161:0/3683872865 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb6640340a0 con 0x7fb674071070 2023-11-24T08:01:24.727 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:24.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb65406ae40 msgr2=0x7fb65406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb65406ae40 0x7fb65406d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb67415fb80 tx=0x7fb65c009040 comp rx=0 tx=0).stop 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 msgr2=0x7fb6741527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 0x7fb6741527f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb66402bf70 tx=0x7fb6640046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 shutdown_connections 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb65406ae40 0x7fb65406d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb67414b2c0 0x7fb6740b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6740cf7d0 0x7fb6740b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 --2- 172.21.15.161:0/3683872865 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb674071070 0x7fb6741527f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 >> 172.21.15.161:0/3683872865 conn(0x7fb67406a800 msgr2=0x7fb674148510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:24.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 shutdown_connections 2023-11-24T08:01:24.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.727+0000 7fb679275640 1 -- 172.21.15.161:0/3683872865 wait complete. 2023-11-24T08:01:24.751 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:24.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 Processor -- start 2023-11-24T08:01:24.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 -- start start 2023-11-24T08:01:24.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13df80 0x7f548c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f548c0cf9a0 0x7f548c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c06c470 con 0x7f548c13e360 2023-11-24T08:01:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c06c750 con 0x7f548c0cf9a0 2023-11-24T08:01:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.967+0000 7f54936ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c06ca30 con 0x7f548c13df80 2023-11-24T08:01:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f548c0cf9a0 0x7f548c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f548c0cf9a0 0x7f548c0cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44240/0 (socket says 172.21.15.161:44240) 2023-11-24T08:01:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 -- 172.21.15.161:0/3385205464 learned_addr learned my addr 172.21.15.161:0/3385205464 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:24.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 -- 172.21.15.161:0/3385205464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13df80 msgr2=0x7f548c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:24.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491449640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13df80 0x7f548c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13df80 0x7f548c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 -- 172.21.15.161:0/3385205464 >> v1:172.21.15.175:6789/0 conn(0x7f548c13e360 legacy=0x7f548c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:24.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491c4a640 1 -- 172.21.15.161:0/3385205464 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c06cd10 con 0x7f548c0cf9a0 2023-11-24T08:01:24.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.968+0000 7f5491449640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13df80 0x7f548c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:24.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.969+0000 7f5491c4a640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c0cd840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5484009e50 tx=0x7f548402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2455e64075d38f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f5483fff640 1 -- 172.21.15.161:0/3385205464 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548402ca80 con 0x7f548c0cf9a0 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f5483fff640 1 -- 172.21.15.161:0/3385205464 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548402cbe0 con 0x7f548c0cf9a0 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f5483fff640 1 -- 172.21.15.161:0/3385205464 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54840343f0 con 0x7f548c0cf9a0 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 -- 172.21.15.161:0/3385205464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 msgr2=0x7f548c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c0cd840 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5484009e50 tx=0x7f548402bee0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 -- 172.21.15.161:0/3385205464 shutdown_connections 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c0cd840 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 --2- 172.21.15.161:0/3385205464 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13df80 0x7f548c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 -- 172.21.15.161:0/3385205464 >> 172.21.15.161:0/3385205464 conn(0x7f548c06a800 msgr2=0x7f548c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:24.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 -- 172.21.15.161:0/3385205464 shutdown_connections 2023-11-24T08:01:24.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.970+0000 7f54936ad640 1 -- 172.21.15.161:0/3385205464 wait complete. 2023-11-24T08:01:24.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.972+0000 7f54936ad640 1 Processor -- start 2023-11-24T08:01:24.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.972+0000 7f54936ad640 1 -- start start 2023-11-24T08:01:24.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f54936ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c13d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f54936ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548c13df80 0x7f548c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f54936ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13e360 0x7f548c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f54936ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f6660 con 0x7f548c0cf9a0 2023-11-24T08:01:24.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f54936ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f6940 con 0x7f548c13df80 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f54936ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c1f6c20 con 0x7f548c13e360 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.973+0000 7f5491449640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c13d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c13d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44256/0 (socket says 172.21.15.161:44256) 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 -- 172.21.15.161:0/737812368 learned_addr learned my addr 172.21.15.161:0/737812368 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491c4a640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13e360 0x7f548c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 -- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13e360 msgr2=0x7f548c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13e360 0x7f548c0b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 -- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548c13df80 msgr2=0x7f548c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548c13df80 0x7f548c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 -- 172.21.15.161:0/737812368 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5484009b30 con 0x7f548c0cf9a0 2023-11-24T08:01:24.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491c4a640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13e360 0x7f548c0b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:24.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5491449640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c13d9f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f548800c7f0 tx=0x7f548800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.974+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488007a30 con 0x7f548c0cf9a0 2023-11-24T08:01:24.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.975+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488007b90 con 0x7f548c0cf9a0 2023-11-24T08:01:24.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.975+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548800ce40 con 0x7f548c0cf9a0 2023-11-24T08:01:24.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.975+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c1f6f00 con 0x7f548c0cf9a0 2023-11-24T08:01:24.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.975+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c0a90a0 con 0x7f548c0cf9a0 2023-11-24T08:01:24.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.976+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c06d920 con 0x7f548c0cf9a0 2023-11-24T08:01:24.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.977+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54880113f0 con 0x7f548c0cf9a0 2023-11-24T08:01:24.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.978+0000 7f5481ffb640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f547006ae40 0x7f547006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:24.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.978+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f54880897a0 con 0x7f548c0cf9a0 2023-11-24T08:01:24.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.979+0000 7f5490c48640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f547006ae40 0x7f547006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:24.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.980+0000 7f5490c48640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f547006ae40 0x7f547006d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f548c152290 tx=0x7f547c0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:24.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:24.983+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5488054860 con 0x7f548c0cf9a0 2023-11-24T08:01:25.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.175+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f548c1f7420 con 0x7f548c0cf9a0 2023-11-24T08:01:25.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.176+0000 7f5481ffb640 1 -- 172.21.15.161:0/737812368 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f548c1f7420 con 0x7f548c0cf9a0 2023-11-24T08:01:25.177 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:25.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f547006ae40 msgr2=0x7f547006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f547006ae40 0x7f547006d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f548c152290 tx=0x7f547c0079b0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 msgr2=0x7f548c13d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c13d9f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f548800c7f0 tx=0x7f548800cbf0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 shutdown_connections 2023-11-24T08:01:25.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f547006ae40 0x7f547006d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f548c13e360 0x7f548c0b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f548c13df80 0x7f548c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 --2- 172.21.15.161:0/737812368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f548c0cf9a0 0x7f548c13d9f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 >> 172.21.15.161:0/737812368 conn(0x7f548c06a800 msgr2=0x7f548c0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:25.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 shutdown_connections 2023-11-24T08:01:25.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.179+0000 7f54936ad640 1 -- 172.21.15.161:0/737812368 wait complete. 2023-11-24T08:01:25.199 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.416+0000 7f440a078640 1 Processor -- start 2023-11-24T08:01:25.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.416+0000 7f440a078640 1 -- start start 2023-11-24T08:01:25.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f440a078640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f44040cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f440a078640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040ce440 con 0x7f440413cf10 2023-11-24T08:01:25.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f440a078640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44040ce720 con 0x7f44040cdc20 2023-11-24T08:01:25.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f440a078640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44040cea00 con 0x7f440413fcb0 2023-11-24T08:01:25.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f4409076640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f440413cf10 0x7f440413f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59980/0 (socket says 172.21.15.161:59980) 2023-11-24T08:01:25.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f4409076640 1 -- 172.21.15.161:0/3296064617 learned_addr learned my addr 172.21.15.161:0/3296064617 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:25.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.418+0000 7f4408875640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f44040cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856081775 0 0) 0x7f44040ce440 con 0x7f440413cf10 2023-11-24T08:01:25.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43f0003520 con 0x7f440413cf10 2023-11-24T08:01:25.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356236237 0 0) 0x7f43f0003520 con 0x7f440413cf10 2023-11-24T08:01:25.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 msgr2=0x7f44040cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f44040cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 >> v1:172.21.15.175:6789/0 conn(0x7f44040cdc20 legacy=0x7f44040b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040b1d90 con 0x7f440413cf10 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f4400001670 con 0x7f440413cf10 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 >> v1:172.21.15.161:6789/0 conn(0x7f440413cf10 legacy=0x7f440413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f43f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f00047c0 0x7f43f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f43f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44040cea00 con 0x7f43f00039a0 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000ba60 con 0x7f43f00047c0 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f000de30 con 0x7f440413fcb0 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.419+0000 7f4409076640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f43f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409877640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f43f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409076640 1 -- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 msgr2=0x7f43f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4408875640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f00047c0 0x7f43f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409076640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f43f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409076640 1 -- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f00047c0 msgr2=0x7f43f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409076640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43f00047c0 0x7f43f0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409076640 1 -- 172.21.15.161:0/3296064617 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f0003520 con 0x7f43f00039a0 2023-11-24T08:01:25.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.420+0000 7f4409877640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f440413fcb0 0x7f43f0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.421+0000 7f4409076640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f43f0003dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4400001eb0 tx=0x7f43f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb70221aafe0cc53 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.421+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400005ad0 con 0x7f43f00039a0 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.421+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400005c30 con 0x7f43f00039a0 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.421+0000 7f43fbfff640 1 -- 172.21.15.161:0/3296064617 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440002c850 con 0x7f43f00039a0 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f440a078640 1 -- 172.21.15.161:0/3296064617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 msgr2=0x7f43f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f440a078640 1 --2- 172.21.15.161:0/3296064617 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f43f0003dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4400001eb0 tx=0x7f43f00057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f4409877640 1 -- 172.21.15.161:0/3296064617 reap_dead start 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f440a078640 1 -- 172.21.15.161:0/3296064617 shutdown_connections 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f440a078640 1 -- 172.21.15.161:0/3296064617 >> 172.21.15.161:0/3296064617 conn(0x7f440406a7d0 msgr2=0x7f440406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f440a078640 1 -- 172.21.15.161:0/3296064617 shutdown_connections 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.422+0000 7f440a078640 1 -- 172.21.15.161:0/3296064617 wait complete. 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.424+0000 7f440a078640 1 Processor -- start 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.424+0000 7f440a078640 1 -- start start 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f440a078640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f440413c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f440a078640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440415a4d0 0x7f4404154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f440a078640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4404070370 0x7f44040707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f440a078640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4404154fa0 con 0x7f43f00039a0 2023-11-24T08:01:25.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f440a078640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44041551b0 con 0x7f440415a4d0 2023-11-24T08:01:25.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f440a078640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4404159ff0 con 0x7f4404070370 2023-11-24T08:01:25.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f4409076640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f440413c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f4409076640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f440413c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44288/0 (socket says 172.21.15.161:44288) 2023-11-24T08:01:25.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f4409076640 1 -- 172.21.15.161:0/3371235711 learned_addr learned my addr 172.21.15.161:0/3371235711 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:25.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f4409877640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4404070370 0x7f44040707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.425+0000 7f4408875640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440415a4d0 0x7f4404154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f4409076640 1 -- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4404070370 msgr2=0x7f44040707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f4409076640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4404070370 0x7f44040707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f4409076640 1 -- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440415a4d0 msgr2=0x7f4404154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f4409076640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440415a4d0 0x7f4404154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f4409076640 1 -- 172.21.15.161:0/3371235711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44041528a0 con 0x7f43f00039a0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f4409076640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f440413c3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4400001930 tx=0x7f4400000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f440002cc60 con 0x7f43f00039a0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440002cdc0 con 0x7f43f00039a0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4404155530 con 0x7f43f00039a0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.426+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400007290 con 0x7f43f00039a0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.427+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4404155af0 con 0x7f43f00039a0 2023-11-24T08:01:25.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.428+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f440415a8b0 con 0x7f43f00039a0 2023-11-24T08:01:25.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.429+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4400032070 con 0x7f43f00039a0 2023-11-24T08:01:25.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.430+0000 7f43f9ffb640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43e806ae40 0x7f43e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.430+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f44000aaa50 con 0x7f43f00039a0 2023-11-24T08:01:25.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.431+0000 7f4408875640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43e806ae40 0x7f43e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.432+0000 7f4408875640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43e806ae40 0x7f43e806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4404156d90 tx=0x7f43f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:25.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.435+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4400075af0 con 0x7f43f00039a0 2023-11-24T08:01:25.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.627+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f440415a130 con 0x7f43f00039a0 2023-11-24T08:01:25.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.628+0000 7f43f9ffb640 1 -- 172.21.15.161:0/3371235711 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44000450a0 con 0x7f43f00039a0 2023-11-24T08:01:25.629 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43e806ae40 msgr2=0x7f43e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43e806ae40 0x7f43e806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4404156d90 tx=0x7f43f4008040 comp rx=0 tx=0).stop 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 msgr2=0x7f440413c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f440413c3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4400001930 tx=0x7f4400000fe0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 shutdown_connections 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43e806ae40 0x7f43e806d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4404070370 0x7f44040707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f440415a4d0 0x7f4404154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 --2- 172.21.15.161:0/3371235711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43f00039a0 0x7f440413c3b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.630+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 >> 172.21.15.161:0/3371235711 conn(0x7f440406a7d0 msgr2=0x7f44040b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:25.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.631+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 shutdown_connections 2023-11-24T08:01:25.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.631+0000 7f440a078640 1 -- 172.21.15.161:0/3371235711 wait complete. 2023-11-24T08:01:25.651 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:25.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.862+0000 7f6151501640 1 Processor -- start 2023-11-24T08:01:25.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.862+0000 7f6151501640 1 -- start start 2023-11-24T08:01:25.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.864+0000 7f6151501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 0x7f614c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.864+0000 7f6151501640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f614c15f9c0 0x7f614c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.864+0000 7f6151501640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c15c5f0 con 0x7f614c13df80 2023-11-24T08:01:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.864+0000 7f6151501640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c06c470 con 0x7f614c15f9c0 2023-11-24T08:01:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.864+0000 7f6151501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c06c750 con 0x7f614c13e360 2023-11-24T08:01:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.865+0000 7f614affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f614c13df80 0x7f614c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59994/0 (socket says 172.21.15.161:59994) 2023-11-24T08:01:25.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.865+0000 7f614affd640 1 -- 172.21.15.161:0/1421049461 learned_addr learned my addr 172.21.15.161:0/1421049461 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:25.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.865+0000 7f61427fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 0x7f614c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.865+0000 7f614b7fe640 1 --2- 172.21.15.161:0/1421049461 >> v2:172.21.15.175:3300/0 conn(0x7f614c15f9c0 0x7f614c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.865+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768587525 0 0) 0x7f614c15c5f0 con 0x7f614c13df80 2023-11-24T08:01:25.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.865+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6138003520 con 0x7f614c13df80 2023-11-24T08:01:25.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272298367 0 0) 0x7f6138003520 con 0x7f614c13df80 2023-11-24T08:01:25.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 msgr2=0x7f614c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 0x7f614c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 >> v2:172.21.15.175:3300/0 conn(0x7f614c15f9c0 msgr2=0x7f614c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 --2- 172.21.15.161:0/1421049461 >> v2:172.21.15.175:3300/0 conn(0x7f614c15f9c0 0x7f614c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c06ca30 con 0x7f614c13df80 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f613c001670 con 0x7f614c13df80 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 >> v1:172.21.15.161:6789/0 conn(0x7f614c13df80 legacy=0x7f614c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 0x7f6138003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6138003f40 0x7f61380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6138004d00 0x7f6138005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c06c470 con 0x7f6138003f40 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c06c750 con 0x7f6138004d00 2023-11-24T08:01:25.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613800b980 con 0x7f614c13e360 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.866+0000 7f61427fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6138003f40 0x7f61380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f614affd640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 0x7f6138003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f614b7fe640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6138004d00 0x7f6138005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f61427fc640 1 -- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 msgr2=0x7f6138003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f61427fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f614c13e360 0x7f6138003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f61427fc640 1 -- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6138004d00 msgr2=0x7f6138005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f61427fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6138004d00 0x7f6138005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f61427fc640 1 -- 172.21.15.161:0/1421049461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138003520 con 0x7f6138003f40 2023-11-24T08:01:25.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.867+0000 7f614b7fe640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6138004d00 0x7f6138005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:25.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f61427fc640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6138003f40 0x7f61380047c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6134009af0 tx=0x7f61380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8f53c4994e7215 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:25.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613402c6b0 con 0x7f6138003f40 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613402c810 con 0x7f6138003f40 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f614a7fc640 1 -- 172.21.15.161:0/1421049461 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613402cba0 con 0x7f6138003f40 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f6151501640 1 -- 172.21.15.161:0/1421049461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6138003f40 msgr2=0x7f61380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f6151501640 1 --2- 172.21.15.161:0/1421049461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6138003f40 0x7f61380047c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6134009af0 tx=0x7f61380057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.868+0000 7f614b7fe640 1 -- 172.21.15.161:0/1421049461 reap_dead start 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.869+0000 7f6151501640 1 -- 172.21.15.161:0/1421049461 shutdown_connections 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.869+0000 7f6151501640 1 -- 172.21.15.161:0/1421049461 >> 172.21.15.161:0/1421049461 conn(0x7f614c06a800 msgr2=0x7f614c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.869+0000 7f6151501640 1 -- 172.21.15.161:0/1421049461 shutdown_connections 2023-11-24T08:01:25.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.869+0000 7f6151501640 1 -- 172.21.15.161:0/1421049461 wait complete. 2023-11-24T08:01:25.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.870+0000 7f6151501640 1 Processor -- start 2023-11-24T08:01:25.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.871+0000 7f6151501640 1 -- start start 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.871+0000 7f6151501640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6138003f40 0x7f614c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.871+0000 7f6151501640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 0x7f614c14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f6151501640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f614c13d1a0 0x7f614c13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f6151501640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c14b560 con 0x7f614c14def0 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f6151501640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c14a970 con 0x7f614c13d1a0 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f6151501640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c14abc0 con 0x7f6138003f40 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 0x7f614c14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 0x7f614c14eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44304/0 (socket says 172.21.15.161:44304) 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 -- 172.21.15.161:0/1508784420 learned_addr learned my addr 172.21.15.161:0/1508784420 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:25.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f614b7fe640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f614c13d1a0 0x7f614c13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f614affd640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6138003f40 0x7f614c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 -- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6138003f40 msgr2=0x7f614c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6138003f40 0x7f614c154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 -- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f614c13d1a0 msgr2=0x7f614c13d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f614c13d1a0 0x7f614c13d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f61427fc640 1 -- 172.21.15.161:0/1508784420 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c14aea0 con 0x7f614c14def0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.872+0000 7f614b7fe640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f614c13d1a0 0x7f614c13d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.873+0000 7f61427fc640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 0x7f614c14eb70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6134037040 tx=0x7f6134004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.873+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134003810 con 0x7f614c14def0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.873+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134003970 con 0x7f614c14def0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.873+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134003ce0 con 0x7f614c14def0 2023-11-24T08:01:25.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.873+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c14b180 con 0x7f614c14def0 2023-11-24T08:01:25.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.873+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c14e370 con 0x7f614c14def0 2023-11-24T08:01:25.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.874+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c06df00 con 0x7f614c14def0 2023-11-24T08:01:25.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.875+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6134047450 con 0x7f614c14def0 2023-11-24T08:01:25.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.876+0000 7f6143fff640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f612c06aec0 0x7f612c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:25.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.876+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f61340ab730 con 0x7f614c14def0 2023-11-24T08:01:25.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.877+0000 7f614affd640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f612c06aec0 0x7f612c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:25.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.878+0000 7f614affd640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f612c06aec0 0x7f612c06d380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f613c001050 tx=0x7f613c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:25.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:25.880+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6134076900 con 0x7f614c14def0 2023-11-24T08:01:26.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.067+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f614c0675b0 con 0x7f614c14def0 2023-11-24T08:01:26.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.067+0000 7f6143fff640 1 -- 172.21.15.161:0/1508784420 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61340044e0 con 0x7f614c14def0 2023-11-24T08:01:26.069 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:26.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f612c06aec0 msgr2=0x7f612c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f612c06aec0 0x7f612c06d380 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f613c001050 tx=0x7f613c009040 comp rx=0 tx=0).stop 2023-11-24T08:01:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 msgr2=0x7f614c14eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 0x7f614c14eb70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6134037040 tx=0x7f6134004730 comp rx=0 tx=0).stop 2023-11-24T08:01:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 shutdown_connections 2023-11-24T08:01:26.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f612c06aec0 0x7f612c06d380 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f614c13d1a0 0x7f614c13d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f614c14def0 0x7f614c14eb70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 --2- 172.21.15.161:0/1508784420 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6138003f40 0x7f614c154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 >> 172.21.15.161:0/1508784420 conn(0x7f614c06a800 msgr2=0x7f614c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 shutdown_connections 2023-11-24T08:01:26.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.070+0000 7f6151501640 1 -- 172.21.15.161:0/1508784420 wait complete. 2023-11-24T08:01:26.090 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:01:26.090 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:01:26.150 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:26.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.363+0000 7f50d2941640 1 Processor -- start 2023-11-24T08:01:26.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.363+0000 7f50d2941640 1 -- start start 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.364+0000 7f50d2941640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f50cc0cf9a0 0x7f50cc15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50d2941640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0b1ee0 con 0x7f50cc143ae0 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50d2941640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50cc0b2780 con 0x7f50cc15e1e0 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50d2941640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50cc15e990 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50cbfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f50cc143ae0 0x7f50cc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60004/0 (socket says 172.21.15.161:60004) 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50cbfff640 1 -- 172.21.15.161:0/115048118 learned_addr learned my addr 172.21.15.161:0/115048118 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:26.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50c3fff640 1 --2- 172.21.15.161:0/115048118 >> v2:172.21.15.161:3300/0 conn(0x7f50cc0cf9a0 0x7f50cc15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50c3fff640 1 -- 172.21.15.161:0/115048118 >> v1:172.21.15.175:6789/0 conn(0x7f50cc15e1e0 legacy=0x7f50cc0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:26.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50cb7fe640 1 -- 172.21.15.161:0/115048118 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518315624 0 0) 0x7f50cc0b1ee0 con 0x7f50cc143ae0 2023-11-24T08:01:26.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50c3fff640 1 -- 172.21.15.161:0/115048118 >> v1:172.21.15.161:6789/0 conn(0x7f50cc143ae0 legacy=0x7f50cc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.365+0000 7f50c3fff640 1 -- 172.21.15.161:0/115048118 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc0b2130 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.367+0000 7f50c3fff640 1 --2- 172.21.15.161:0/115048118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc15dca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50b40097a0 tx=0x7f50b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc021517697063c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:26.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.367+0000 7f50cb7fe640 1 -- 172.21.15.161:0/115048118 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4031830 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.367+0000 7f50cb7fe640 1 -- 172.21.15.161:0/115048118 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4031990 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.367+0000 7f50cb7fe640 1 -- 172.21.15.161:0/115048118 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4031d20 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.367+0000 7f50d2941640 1 -- 172.21.15.161:0/115048118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 msgr2=0x7f50cc15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.367+0000 7f50d2941640 1 --2- 172.21.15.161:0/115048118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc15dca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f50b40097a0 tx=0x7f50b402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.368+0000 7f50d2941640 1 -- 172.21.15.161:0/115048118 shutdown_connections 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.368+0000 7f50d2941640 1 --2- 172.21.15.161:0/115048118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc15dca0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.368+0000 7f50d2941640 1 -- 172.21.15.161:0/115048118 >> 172.21.15.161:0/115048118 conn(0x7f50cc06a800 msgr2=0x7f50cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.368+0000 7f50d2941640 1 -- 172.21.15.161:0/115048118 shutdown_connections 2023-11-24T08:01:26.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.368+0000 7f50d2941640 1 -- 172.21.15.161:0/115048118 wait complete. 2023-11-24T08:01:26.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.369+0000 7f50d2941640 1 Processor -- start 2023-11-24T08:01:26.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 -- start start 2023-11-24T08:01:26.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc1f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50cc143ae0 0x7f50cc141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50cc15e1e0 0x7f50cc0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc15a1b0 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc141e20 con 0x7f50cc15e1e0 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.370+0000 7f50d2941640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc141b40 con 0x7f50cc143ae0 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc1f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc1f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44328/0 (socket says 172.21.15.161:44328) 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 -- 172.21.15.161:0/3106234207 learned_addr learned my addr 172.21.15.161:0/3106234207 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 -- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50cc143ae0 msgr2=0x7f50cc141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50cc143ae0 0x7f50cc141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 -- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50cc15e1e0 msgr2=0x7f50cc0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50cc15e1e0 0x7f50cc0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 -- 172.21.15.161:0/3106234207 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4009400 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.371+0000 7f50cbfff640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc1f6da0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c4d0 tx=0x7f50bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:26.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.372+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0074e0 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.372+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc007660 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.372+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc1f30f0 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.372+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc004a20 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.372+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc1f36b0 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.373+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50cc1f2f50 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.374+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50bc004b80 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.375+0000 7f50c97fa640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f50ac06ae40 0x7f50ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.375+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f50bc0888c0 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.376+0000 7f50c3fff640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f50ac06ae40 0x7f50ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.377+0000 7f50c3fff640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f50ac06ae40 0x7f50ac06d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50b4036000 tx=0x7f50b4030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:26.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.379+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50cc1f2f50 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.558+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50cc1f2f50 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.560+0000 7f50c97fa640 1 -- 172.21.15.161:0/3106234207 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f50cc1f2f50 con 0x7f50cc0cf9a0 2023-11-24T08:01:26.561 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:26.562 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f50ac06ae40 msgr2=0x7f50ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f50ac06ae40 0x7f50ac06d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50b4036000 tx=0x7f50b4030000 comp rx=0 tx=0).stop 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 msgr2=0x7f50cc1f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc1f6da0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c4d0 tx=0x7f50bc00c990 comp rx=0 tx=0).stop 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 shutdown_connections 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f50ac06ae40 0x7f50ac06d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50cc15e1e0 0x7f50cc0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50cc143ae0 0x7f50cc141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 --2- 172.21.15.161:0/3106234207 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f50cc0cf9a0 0x7f50cc1f6da0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.562+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 >> 172.21.15.161:0/3106234207 conn(0x7f50cc06a800 msgr2=0x7f50cc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:26.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.563+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 shutdown_connections 2023-11-24T08:01:26.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.563+0000 7f50d2941640 1 -- 172.21.15.161:0/3106234207 wait complete. 2023-11-24T08:01:26.585 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:26.586 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:26.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.790+0000 7fc5b7590640 1 Processor -- start 2023-11-24T08:01:26.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.790+0000 7fc5b7590640 1 -- start start 2023-11-24T08:01:26.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b7590640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc5b00d17e0 0x7fc5b00d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b7590640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc5b00b3890 0x7fc5b00b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b7590640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b00d2180 con 0x7fc5b015d610 2023-11-24T08:01:26.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b7590640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00d1390 con 0x7fc5b00d17e0 2023-11-24T08:01:26.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b7590640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b00b3400 con 0x7fc5b00b3890 2023-11-24T08:01:26.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b532c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc5b015d610 0x7fc5b00ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60014/0 (socket says 172.21.15.161:60014) 2023-11-24T08:01:26.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b532c640 1 -- 172.21.15.161:0/2288275975 learned_addr learned my addr 172.21.15.161:0/2288275975 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:26.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.792+0000 7fc5b4b2b640 1 --2- 172.21.15.161:0/2288275975 >> v2:172.21.15.161:3300/0 conn(0x7fc5b00d17e0 0x7fc5b00d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.793+0000 7fc5b4b2b640 1 -- 172.21.15.161:0/2288275975 >> v2:172.21.15.175:3300/0 conn(0x7fc5b00b3890 msgr2=0x7fc5b00b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:26.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.793+0000 7fc5b5b2d640 1 --2- 172.21.15.161:0/2288275975 >> v2:172.21.15.175:3300/0 conn(0x7fc5b00b3890 0x7fc5b00b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.793+0000 7fc5b4b2b640 1 --2- 172.21.15.161:0/2288275975 >> v2:172.21.15.175:3300/0 conn(0x7fc5b00b3890 0x7fc5b00b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.793+0000 7fc5b4b2b640 1 -- 172.21.15.161:0/2288275975 >> v1:172.21.15.161:6789/0 conn(0x7fc5b015d610 legacy=0x7fc5b00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.793+0000 7fc5b4b2b640 1 -- 172.21.15.161:0/2288275975 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b00b27f0 con 0x7fc5b00d17e0 2023-11-24T08:01:26.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.793+0000 7fc5b5b2d640 1 --2- 172.21.15.161:0/2288275975 >> v2:172.21.15.175:3300/0 conn(0x7fc5b00b3890 0x7fc5b00b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.794+0000 7fc5b4b2b640 1 --2- 172.21.15.161:0/2288275975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00d17e0 0x7fc5b00d1c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc5b008ba80 tx=0x7fc5a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552899bc646a08f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.794+0000 7fc5a7fff640 1 -- 172.21.15.161:0/2288275975 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0031830 con 0x7fc5b00d17e0 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.794+0000 7fc5a7fff640 1 -- 172.21.15.161:0/2288275975 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0031990 con 0x7fc5b00d17e0 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.794+0000 7fc5a7fff640 1 -- 172.21.15.161:0/2288275975 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0031d20 con 0x7fc5b00d17e0 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 -- 172.21.15.161:0/2288275975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00d17e0 msgr2=0x7fc5b00d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 --2- 172.21.15.161:0/2288275975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00d17e0 0x7fc5b00d1c40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc5b008ba80 tx=0x7fc5a002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 -- 172.21.15.161:0/2288275975 shutdown_connections 2023-11-24T08:01:26.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 --2- 172.21.15.161:0/2288275975 >> v2:172.21.15.175:3300/0 conn(0x7fc5b00b3890 0x7fc5b00b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 --2- 172.21.15.161:0/2288275975 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00d17e0 0x7fc5b00d1c40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 -- 172.21.15.161:0/2288275975 >> 172.21.15.161:0/2288275975 conn(0x7fc5b009c540 msgr2=0x7fc5b00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:26.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 -- 172.21.15.161:0/2288275975 shutdown_connections 2023-11-24T08:01:26.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.795+0000 7fc5b7590640 1 -- 172.21.15.161:0/2288275975 wait complete. 2023-11-24T08:01:26.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.797+0000 7fc5b7590640 1 Processor -- start 2023-11-24T08:01:26.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.797+0000 7fc5b7590640 1 -- start start 2023-11-24T08:01:26.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b7590640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 0x7fc5b0151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b7590640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b00d17e0 0x7fc5b009cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b7590640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5b015d610 0x7fc5b00b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b7590640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b00cc2e0 con 0x7fc5b00b3890 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b7590640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b0151b50 con 0x7fc5b00d17e0 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b7590640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b009d4f0 con 0x7fc5b015d610 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 0x7fc5b0151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 0x7fc5b0151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44348/0 (socket says 172.21.15.161:44348) 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 -- 172.21.15.161:0/3375529748 learned_addr learned my addr 172.21.15.161:0/3375529748 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b4b2b640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b00d17e0 0x7fc5b009cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 -- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5b015d610 msgr2=0x7fc5b00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5b015d610 0x7fc5b00b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 -- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b00d17e0 msgr2=0x7fc5b009cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b00d17e0 0x7fc5b009cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.798+0000 7fc5b532c640 1 -- 172.21.15.161:0/3375529748 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a0009400 con 0x7fc5b00b3890 2023-11-24T08:01:26.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.799+0000 7fc5b532c640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 0x7fc5b0151610 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00c4a0 tx=0x7fc5ac00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:26.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.799+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac005ce0 con 0x7fc5b00b3890 2023-11-24T08:01:26.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.799+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ac005e40 con 0x7fc5b00b3890 2023-11-24T08:01:26.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.799+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac007270 con 0x7fc5b00b3890 2023-11-24T08:01:26.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.799+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b00cb660 con 0x7fc5b00b3890 2023-11-24T08:01:26.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.799+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b00cbc20 con 0x7fc5b00b3890 2023-11-24T08:01:26.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.800+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b00cc420 con 0x7fc5b00b3890 2023-11-24T08:01:26.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.801+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5ac0073d0 con 0x7fc5b00b3890 2023-11-24T08:01:26.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.802+0000 7fc5a5ffb640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc59406ae40 0x7fc59406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:26.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.802+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc5ac088a90 con 0x7fc5b00b3890 2023-11-24T08:01:26.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.803+0000 7fc5b4b2b640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc59406ae40 0x7fc59406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:26.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.804+0000 7fc5b4b2b640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc59406ae40 0x7fc59406d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0036000 tx=0x7fc5a0008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:26.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.807+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5b00cc420 con 0x7fc5b00b3890 2023-11-24T08:01:26.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.981+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5b00cc420 con 0x7fc5b00b3890 2023-11-24T08:01:26.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.982+0000 7fc5a5ffb640 1 -- 172.21.15.161:0/3375529748 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5b00cc420 con 0x7fc5b00b3890 2023-11-24T08:01:26.983 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:26.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc59406ae40 msgr2=0x7fc59406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc59406ae40 0x7fc59406d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0036000 tx=0x7fc5a0008030 comp rx=0 tx=0).stop 2023-11-24T08:01:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 msgr2=0x7fc5b0151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 0x7fc5b0151610 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac00c4a0 tx=0x7fc5ac00c960 comp rx=0 tx=0).stop 2023-11-24T08:01:26.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 shutdown_connections 2023-11-24T08:01:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc59406ae40 0x7fc59406d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5b015d610 0x7fc5b00b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5b00d17e0 0x7fc5b009cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 --2- 172.21.15.161:0/3375529748 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc5b00b3890 0x7fc5b0151610 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:26.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 >> 172.21.15.161:0/3375529748 conn(0x7fc5b009c540 msgr2=0x7fc5b00ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:26.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 shutdown_connections 2023-11-24T08:01:26.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:26.985+0000 7fc5b7590640 1 -- 172.21.15.161:0/3375529748 wait complete. 2023-11-24T08:01:27.005 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:27.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.203+0000 7f77b187c640 1 Processor -- start 2023-11-24T08:01:27.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.203+0000 7f77b187c640 1 -- start start 2023-11-24T08:01:27.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.205+0000 7f77b187c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77ac0b3ae0 0x7f77ac15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.205+0000 7f77b187c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77ac0cf290 0x7f77ac0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.205+0000 7f77b187c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac070c40 con 0x7f77ac0ae5a0 2023-11-24T08:01:27.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.205+0000 7f77b187c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ac071450 con 0x7f77ac0cf290 2023-11-24T08:01:27.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.205+0000 7f77b187c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ac0cfc60 con 0x7f77ac0b3ae0 2023-11-24T08:01:27.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.206+0000 7f77ab7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77ac0cf290 0x7f77ac0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.206+0000 7f77ab7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f77ac0cf290 0x7f77ac0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44356/0 (socket says 172.21.15.161:44356) 2023-11-24T08:01:27.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.206+0000 7f77ab7fe640 1 -- 172.21.15.161:0/2796008754 learned_addr learned my addr 172.21.15.161:0/2796008754 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:27.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.206+0000 7f77a27fc640 1 --2- 172.21.15.161:0/2796008754 >> v2:172.21.15.175:3300/0 conn(0x7f77ac0b3ae0 0x7f77ac15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.206+0000 7f77ab7fe640 1 -- 172.21.15.161:0/2796008754 >> v2:172.21.15.175:3300/0 conn(0x7f77ac0b3ae0 msgr2=0x7f77ac15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:27.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.206+0000 7f77ab7fe640 1 --2- 172.21.15.161:0/2796008754 >> v2:172.21.15.175:3300/0 conn(0x7f77ac0b3ae0 0x7f77ac15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.207+0000 7f77ab7fe640 1 -- 172.21.15.161:0/2796008754 >> v1:172.21.15.175:6789/0 conn(0x7f77ac0ae5a0 legacy=0x7f77ac06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.207+0000 7f77ab7fe640 1 -- 172.21.15.161:0/2796008754 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac06c470 con 0x7f77ac0cf290 2023-11-24T08:01:27.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.207+0000 7f77a27fc640 1 --2- 172.21.15.161:0/2796008754 >> v2:172.21.15.175:3300/0 conn(0x7f77ac0b3ae0 0x7f77ac15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.208+0000 7f77ab7fe640 1 --2- 172.21.15.161:0/2796008754 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac0cf720 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0cfea0 tx=0x7f77a402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08f05c3394e3c41 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.208+0000 7f77aa7fc640 1 -- 172.21.15.161:0/2796008754 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a402f850 con 0x7f77ac0cf290 2023-11-24T08:01:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.208+0000 7f77aa7fc640 1 -- 172.21.15.161:0/2796008754 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a402f9b0 con 0x7f77ac0cf290 2023-11-24T08:01:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.208+0000 7f77aa7fc640 1 -- 172.21.15.161:0/2796008754 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a402fd40 con 0x7f77ac0cf290 2023-11-24T08:01:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 -- 172.21.15.161:0/2796008754 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 msgr2=0x7f77ac0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 --2- 172.21.15.161:0/2796008754 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac0cf720 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f77ac0cfea0 tx=0x7f77a402ba30 comp rx=0 tx=0).stop 2023-11-24T08:01:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 -- 172.21.15.161:0/2796008754 shutdown_connections 2023-11-24T08:01:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 --2- 172.21.15.161:0/2796008754 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac0cf720 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 --2- 172.21.15.161:0/2796008754 >> v2:172.21.15.175:3300/0 conn(0x7f77ac0b3ae0 0x7f77ac15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 -- 172.21.15.161:0/2796008754 >> 172.21.15.161:0/2796008754 conn(0x7f77ac06a800 msgr2=0x7f77ac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 -- 172.21.15.161:0/2796008754 shutdown_connections 2023-11-24T08:01:27.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.209+0000 7f77b187c640 1 -- 172.21.15.161:0/2796008754 wait complete. 2023-11-24T08:01:27.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.211+0000 7f77b187c640 1 Processor -- start 2023-11-24T08:01:27.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.211+0000 7f77b187c640 1 -- start start 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.212+0000 7f77b187c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac0ae5a0 0x7f77ac15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.212+0000 7f77b187c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77ac0b3ae0 0x7f77ac15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.212+0000 7f77b187c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.212+0000 7f77b187c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac146450 con 0x7f77ac0cf290 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.212+0000 7f77b187c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac158520 con 0x7f77ac0ae5a0 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.212+0000 7f77b187c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac157480 con 0x7f77ac0b3ae0 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac15fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44362/0 (socket says 172.21.15.161:44362) 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 -- 172.21.15.161:0/108490306 learned_addr learned my addr 172.21.15.161:0/108490306 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:27.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77aaffd640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac0ae5a0 0x7f77ac15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77a27fc640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77ac0b3ae0 0x7f77ac15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 -- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77ac0b3ae0 msgr2=0x7f77ac15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77ac0b3ae0 0x7f77ac15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 -- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac0ae5a0 msgr2=0x7f77ac15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac0ae5a0 0x7f77ac15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77ab7fe640 1 -- 172.21.15.161:0/108490306 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40094d0 con 0x7f77ac0cf290 2023-11-24T08:01:27.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.213+0000 7f77a27fc640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77ac0b3ae0 0x7f77ac15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:27.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.214+0000 7f77ab7fe640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac15fba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f77a40090b0 tx=0x7f77a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.214+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4037bc0 con 0x7f77ac0cf290 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.214+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4037d20 con 0x7f77ac0cf290 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.214+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4041640 con 0x7f77ac0cf290 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.214+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac157760 con 0x7f77ac0cf290 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.214+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac157d20 con 0x7f77ac0cf290 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.215+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac0675d0 con 0x7f77ac0cf290 2023-11-24T08:01:27.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.216+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77a40417a0 con 0x7f77ac0cf290 2023-11-24T08:01:27.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.217+0000 7f77a8ff9640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f778c06ae40 0x7f778c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.217+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f77a403c070 con 0x7f77ac0cf290 2023-11-24T08:01:27.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.218+0000 7f77aaffd640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f778c06ae40 0x7f778c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.219+0000 7f77aaffd640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f778c06ae40 0x7f778c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f779c0012e0 tx=0x7f779c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:27.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.222+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77a40773f0 con 0x7f77ac0cf290 2023-11-24T08:01:27.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.411+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77ac161c20 con 0x7f77ac0cf290 2023-11-24T08:01:27.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.412+0000 7f77a8ff9640 1 -- 172.21.15.161:0/108490306 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77a407aa10 con 0x7f77ac0cf290 2023-11-24T08:01:27.414 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f778c06ae40 msgr2=0x7f778c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f778c06ae40 0x7f778c06d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f779c0012e0 tx=0x7f779c009040 comp rx=0 tx=0).stop 2023-11-24T08:01:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 msgr2=0x7f77ac15fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac15fba0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f77a40090b0 tx=0x7f77a4004730 comp rx=0 tx=0).stop 2023-11-24T08:01:27.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 shutdown_connections 2023-11-24T08:01:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f778c06ae40 0x7f778c06d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77ac0cf290 0x7f77ac15fba0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77ac0b3ae0 0x7f77ac15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 --2- 172.21.15.161:0/108490306 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77ac0ae5a0 0x7f77ac15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.414+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 >> 172.21.15.161:0/108490306 conn(0x7f77ac06a800 msgr2=0x7f77ac15a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:27.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.415+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 shutdown_connections 2023-11-24T08:01:27.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.415+0000 7f77b187c640 1 -- 172.21.15.161:0/108490306 wait complete. 2023-11-24T08:01:27.434 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:27.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.646+0000 7fb21f831640 1 Processor -- start 2023-11-24T08:01:27.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.646+0000 7fb21f831640 1 -- start start 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21f831640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb218071200 0x7fb21806dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21f831640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21815deb0 con 0x7fb218157c30 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21f831640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21815e190 con 0x7fb2180cd600 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21f831640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21815ea30 con 0x7fb218071200 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21d5cd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb218157c30 0x7fb2181618f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60016/0 (socket says 172.21.15.161:60016) 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21d5cd640 1 -- 172.21.15.161:0/3190574271 learned_addr learned my addr 172.21.15.161:0/3190574271 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:27.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb21ddce640 1 --2- 172.21.15.161:0/3190574271 >> v2:172.21.15.161:3300/0 conn(0x7fb218071200 0x7fb21806dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.648+0000 7fb20ffff640 1 -- 172.21.15.161:0/3190574271 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457958823 0 0) 0x7fb21815deb0 con 0x7fb218157c30 2023-11-24T08:01:27.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.649+0000 7fb20ffff640 1 -- 172.21.15.161:0/3190574271 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb204003520 con 0x7fb218157c30 2023-11-24T08:01:27.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.649+0000 7fb21ddce640 1 -- 172.21.15.161:0/3190574271 >> v1:172.21.15.175:6789/0 conn(0x7fb2180cd600 legacy=0x7fb218070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.649+0000 7fb21ddce640 1 -- 172.21.15.161:0/3190574271 >> v1:172.21.15.161:6789/0 conn(0x7fb218157c30 legacy=0x7fb2181618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.649+0000 7fb21ddce640 1 -- 172.21.15.161:0/3190574271 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21815e470 con 0x7fb218071200 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.650+0000 7fb21ddce640 1 --2- 172.21.15.161:0/3190574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb218071200 0x7fb21806dcb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb210009d90 tx=0x7fb21002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe651d22c7272c33 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.650+0000 7fb20ffff640 1 -- 172.21.15.161:0/3190574271 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21002cd00 con 0x7fb218071200 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.650+0000 7fb20ffff640 1 -- 172.21.15.161:0/3190574271 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21002ce60 con 0x7fb218071200 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.650+0000 7fb20ffff640 1 -- 172.21.15.161:0/3190574271 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210034640 con 0x7fb218071200 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 -- 172.21.15.161:0/3190574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb218071200 msgr2=0x7fb21806dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 --2- 172.21.15.161:0/3190574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb218071200 0x7fb21806dcb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb210009d90 tx=0x7fb21002bf50 comp rx=0 tx=0).stop 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 -- 172.21.15.161:0/3190574271 shutdown_connections 2023-11-24T08:01:27.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 --2- 172.21.15.161:0/3190574271 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb218071200 0x7fb21806dcb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 -- 172.21.15.161:0/3190574271 >> 172.21.15.161:0/3190574271 conn(0x7fb2180cf700 msgr2=0x7fb2180cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:27.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 -- 172.21.15.161:0/3190574271 shutdown_connections 2023-11-24T08:01:27.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.651+0000 7fb21f831640 1 -- 172.21.15.161:0/3190574271 wait complete. 2023-11-24T08:01:27.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.653+0000 7fb21f831640 1 Processor -- start 2023-11-24T08:01:27.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.653+0000 7fb21f831640 1 -- start start 2023-11-24T08:01:27.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21f831640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb218071200 0x7fb218143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21f831640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 0x7fb2181565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21f831640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218157c30 0x7fb2181464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21f831640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2181552d0 con 0x7fb2180cd600 2023-11-24T08:01:27.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21f831640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb218155520 con 0x7fb218157c30 2023-11-24T08:01:27.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21f831640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb218155800 con 0x7fb218071200 2023-11-24T08:01:27.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21cdcc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 0x7fb2181565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21cdcc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 0x7fb2181565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44376/0 (socket says 172.21.15.161:44376) 2023-11-24T08:01:27.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21cdcc640 1 -- 172.21.15.161:0/1582482857 learned_addr learned my addr 172.21.15.161:0/1582482857 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:27.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.654+0000 7fb21d5cd640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb218071200 0x7fb218143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21ddce640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218157c30 0x7fb2181464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21cdcc640 1 -- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb218071200 msgr2=0x7fb218143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21cdcc640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb218071200 0x7fb218143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21cdcc640 1 -- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218157c30 msgr2=0x7fb2181464d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21cdcc640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218157c30 0x7fb2181464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21cdcc640 1 -- 172.21.15.161:0/1582482857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb210009a70 con 0x7fb2180cd600 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21d5cd640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb218071200 0x7fb218143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21cdcc640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 0x7fb2181565c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c400 tx=0x7fb20800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2080052d0 con 0x7fb2180cd600 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208005450 con 0x7fb2180cd600 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb218155ae0 con 0x7fb2180cd600 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208007260 con 0x7fb2180cd600 2023-11-24T08:01:27.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.655+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2181560a0 con 0x7fb2180cd600 2023-11-24T08:01:27.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.656+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2180675d0 con 0x7fb2180cd600 2023-11-24T08:01:27.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.657+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb2080073c0 con 0x7fb2180cd600 2023-11-24T08:01:27.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.658+0000 7fb20dffb640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1fc06ae40 0x7fb1fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:27.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.658+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb208088b60 con 0x7fb2180cd600 2023-11-24T08:01:27.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.659+0000 7fb21d5cd640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1fc06ae40 0x7fb1fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:27.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.660+0000 7fb21d5cd640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1fc06ae40 0x7fb1fc06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2140011e0 tx=0x7fb214009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:27.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.663+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb208053af0 con 0x7fb2180cd600 2023-11-24T08:01:27.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.840+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb218071ae0 con 0x7fb2180cd600 2023-11-24T08:01:27.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.841+0000 7fb20dffb640 1 -- 172.21.15.161:0/1582482857 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb208057110 con 0x7fb2180cd600 2023-11-24T08:01:27.842 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.843+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1fc06ae40 msgr2=0x7fb1fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.843+0000 7fb21f831640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1fc06ae40 0x7fb1fc06d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb2140011e0 tx=0x7fb214009040 comp rx=0 tx=0).stop 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.843+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 msgr2=0x7fb2181565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.843+0000 7fb21f831640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 0x7fb2181565c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c400 tx=0x7fb20800c8c0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 shutdown_connections 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb1fc06ae40 0x7fb1fc06d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb218157c30 0x7fb2181464d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2180cd600 0x7fb2181565c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 --2- 172.21.15.161:0/1582482857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb218071200 0x7fb218143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:27.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 >> 172.21.15.161:0/1582482857 conn(0x7fb2180cf700 msgr2=0x7fb21806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:27.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 shutdown_connections 2023-11-24T08:01:27.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:27.844+0000 7fb21f831640 1 -- 172.21.15.161:0/1582482857 wait complete. 2023-11-24T08:01:27.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:01:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.059+0000 7f52fbfff640 1 Processor -- start 2023-11-24T08:01:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.059+0000 7f52fbfff640 1 -- start start 2023-11-24T08:01:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.060+0000 7f52fbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52fc0cc500 0x7f52fc0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.060+0000 7f52fbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52fc06d160 0x7f52fc06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.060+0000 7f52fbfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc070e50 con 0x7f52fc143c40 2023-11-24T08:01:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.060+0000 7f52fbfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0723c0 con 0x7f52fc06d160 2023-11-24T08:01:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.060+0000 7f52fbfff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0cced0 con 0x7f52fc0cc500 2023-11-24T08:01:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52fb7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52fc06d160 0x7f52fc06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52faffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f52fc143c40 0x7f52fc071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60022/0 (socket says 172.21.15.161:60022) 2023-11-24T08:01:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52faffd640 1 -- 172.21.15.161:0/2941867094 learned_addr learned my addr 172.21.15.161:0/2941867094 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:28.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52fb7fe640 1 -- 172.21.15.161:0/2941867094 >> v2:172.21.15.175:3300/0 conn(0x7f52fc0cc500 msgr2=0x7f52fc0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:28.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52fb7fe640 1 --2- 172.21.15.161:0/2941867094 >> v2:172.21.15.175:3300/0 conn(0x7f52fc0cc500 0x7f52fc0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52fb7fe640 1 -- 172.21.15.161:0/2941867094 >> v1:172.21.15.161:6789/0 conn(0x7f52fc143c40 legacy=0x7f52fc071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.061+0000 7f52fb7fe640 1 -- 172.21.15.161:0/2941867094 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc144020 con 0x7f52fc06d160 2023-11-24T08:01:28.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.062+0000 7f52fb7fe640 1 --2- 172.21.15.161:0/2941867094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc06d160 0x7f52fc06d560 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b44a0 tx=0x7f52f402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee8784804c25d6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:28.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.062+0000 7f52f9ffb640 1 -- 172.21.15.161:0/2941867094 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f402cbe0 con 0x7f52fc06d160 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52f9ffb640 1 -- 172.21.15.161:0/2941867094 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f402cd40 con 0x7f52fc06d160 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52f9ffb640 1 -- 172.21.15.161:0/2941867094 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4034660 con 0x7f52fc06d160 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 -- 172.21.15.161:0/2941867094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc06d160 msgr2=0x7f52fc06d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2941867094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc06d160 0x7f52fc06d560 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0b44a0 tx=0x7f52f402be30 comp rx=0 tx=0).stop 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 -- 172.21.15.161:0/2941867094 shutdown_connections 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2941867094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc06d160 0x7f52fc06d560 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2941867094 >> v2:172.21.15.175:3300/0 conn(0x7f52fc0cc500 0x7f52fc0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 -- 172.21.15.161:0/2941867094 >> 172.21.15.161:0/2941867094 conn(0x7f52fc06a800 msgr2=0x7f52fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:28.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 -- 172.21.15.161:0/2941867094 shutdown_connections 2023-11-24T08:01:28.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.063+0000 7f52fbfff640 1 -- 172.21.15.161:0/2941867094 wait complete. 2023-11-24T08:01:28.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.065+0000 7f52fbfff640 1 Processor -- start 2023-11-24T08:01:28.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.065+0000 7f52fbfff640 1 -- start start 2023-11-24T08:01:28.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52fc06d160 0x7f52fc0b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 0x7f52fc13c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52fc143c40 0x7f52fc13e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fbfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1e7400 con 0x7f52fc0cc500 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fbfff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1e76e0 con 0x7f52fc06d160 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fbfff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1e79c0 con 0x7f52fc143c40 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fa7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 0x7f52fc13c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fa7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 0x7f52fc13c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44396/0 (socket says 172.21.15.161:44396) 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.066+0000 7f52fa7fc640 1 -- 172.21.15.161:0/2469649440 learned_addr learned my addr 172.21.15.161:0/2469649440 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fb7fe640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52fc143c40 0x7f52fc13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52faffd640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52fc06d160 0x7f52fc0b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fa7fc640 1 -- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52fc143c40 msgr2=0x7f52fc13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fa7fc640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52fc143c40 0x7f52fc13e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fa7fc640 1 -- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52fc06d160 msgr2=0x7f52fc0b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fa7fc640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52fc06d160 0x7f52fc0b2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fa7fc640 1 -- 172.21.15.161:0/2469649440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4009a70 con 0x7f52fc0cc500 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52fa7fc640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 0x7f52fc13c680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52f000b4a0 tx=0x7f52f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0010610 con 0x7f52fc0cc500 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0010770 con 0x7f52fc0cc500 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.067+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0010b20 con 0x7f52fc0cc500 2023-11-24T08:01:28.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.068+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc1e7ca0 con 0x7f52fc0cc500 2023-11-24T08:01:28.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.068+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc0b3300 con 0x7f52fc0cc500 2023-11-24T08:01:28.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.069+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc1e81c0 con 0x7f52fc0cc500 2023-11-24T08:01:28.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.070+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52f0010c80 con 0x7f52fc0cc500 2023-11-24T08:01:28.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.071+0000 7f52e3fff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52e806ae70 0x7f52e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.071+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f52f00893e0 con 0x7f52fc0cc500 2023-11-24T08:01:28.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.072+0000 7f52faffd640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52e806ae70 0x7f52e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.073+0000 7f52faffd640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52e806ae70 0x7f52e806d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52ec005880 tx=0x7f52ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:28.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.076+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52fc1e81c0 con 0x7f52fc0cc500 2023-11-24T08:01:28.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.283+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f52fc1e81c0 con 0x7f52fc0cc500 2023-11-24T08:01:28.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.284+0000 7f52e3fff640 1 -- 172.21.15.161:0/2469649440 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f52fc1e81c0 con 0x7f52fc0cc500 2023-11-24T08:01:28.285 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:01:28.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52e806ae70 msgr2=0x7f52e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52e806ae70 0x7f52e806d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52ec005880 tx=0x7f52ec009040 comp rx=0 tx=0).stop 2023-11-24T08:01:28.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 msgr2=0x7f52fc13c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 0x7f52fc13c680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52f000b4a0 tx=0x7f52f000b960 comp rx=0 tx=0).stop 2023-11-24T08:01:28.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 shutdown_connections 2023-11-24T08:01:28.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52e806ae70 0x7f52e806d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52fc143c40 0x7f52fc13e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52fc0cc500 0x7f52fc13c680 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 --2- 172.21.15.161:0/2469649440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52fc06d160 0x7f52fc0b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 >> 172.21.15.161:0/2469649440 conn(0x7f52fc06a800 msgr2=0x7f52fc071290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 shutdown_connections 2023-11-24T08:01:28.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.287+0000 7f52fbfff640 1 -- 172.21.15.161:0/2469649440 wait complete. 2023-11-24T08:01:28.307 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-24T08:01:28.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:28.308 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-24T08:01:28.412 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:28.413 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:01:28.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:28.413 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:01:28.458 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:01:28.458 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:01:28.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.679+0000 7f4e40dec640 1 Processor -- start 2023-11-24T08:01:28.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.679+0000 7f4e40dec640 1 -- start start 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e40dec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e3c0ae5a0 0x7f4e3c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e40dec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c0b3ae0 0x7f4e3c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e40dec640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c070c40 con 0x7f4e3c06d120 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e40dec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3c071450 con 0x7f4e3c0ae5a0 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e40dec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c06c470 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e3a59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e3c0ae5a0 0x7f4e3c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e3a59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e3c0ae5a0 0x7f4e3c15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44400/0 (socket says 172.21.15.161:44400) 2023-11-24T08:01:28.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e3a59c640 1 -- 172.21.15.161:0/1317761029 learned_addr learned my addr 172.21.15.161:0/1317761029 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:28.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.681+0000 7f4e39d9b640 1 --2- 172.21.15.161:0/1317761029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c0b3ae0 0x7f4e3c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.682+0000 7f4e3a59c640 1 -- 172.21.15.161:0/1317761029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c0b3ae0 msgr2=0x7f4e3c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:28.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.682+0000 7f4e3a59c640 1 --2- 172.21.15.161:0/1317761029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c0b3ae0 0x7f4e3c06cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.682+0000 7f4e3a59c640 1 -- 172.21.15.161:0/1317761029 >> v1:172.21.15.175:6789/0 conn(0x7f4e3c06d120 legacy=0x7f4e3c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:28.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.682+0000 7f4e3a59c640 1 -- 172.21.15.161:0/1317761029 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c06c750 con 0x7f4e3c0ae5a0 2023-11-24T08:01:28.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.683+0000 7f4e3a59c640 1 --2- 172.21.15.161:0/1317761029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c15e430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42054e364c8f87ed server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:28.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.683+0000 7f4e3959a640 1 -- 172.21.15.161:0/1317761029 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c031640 con 0x7f4e3c0ae5a0 2023-11-24T08:01:28.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.683+0000 7f4e3959a640 1 -- 172.21.15.161:0/1317761029 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c0317a0 con 0x7f4e3c0ae5a0 2023-11-24T08:01:28.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.683+0000 7f4e3959a640 1 -- 172.21.15.161:0/1317761029 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c031b30 con 0x7f4e3c0ae5a0 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 -- 172.21.15.161:0/1317761029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0ae5a0 msgr2=0x7f4e3c15e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 --2- 172.21.15.161:0/1317761029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c15e430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009870 tx=0x7f4e2c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 -- 172.21.15.161:0/1317761029 shutdown_connections 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 --2- 172.21.15.161:0/1317761029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c0b3ae0 0x7f4e3c06cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 --2- 172.21.15.161:0/1317761029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c15e430 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 -- 172.21.15.161:0/1317761029 >> 172.21.15.161:0/1317761029 conn(0x7f4e3c06a800 msgr2=0x7f4e3c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 -- 172.21.15.161:0/1317761029 shutdown_connections 2023-11-24T08:01:28.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.684+0000 7f4e40dec640 1 -- 172.21.15.161:0/1317761029 wait complete. 2023-11-24T08:01:28.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.686+0000 7f4e40dec640 1 Processor -- start 2023-11-24T08:01:28.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.686+0000 7f4e40dec640 1 -- start start 2023-11-24T08:01:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.687+0000 7f4e40dec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c06d120 0x7f4e3c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.687+0000 7f4e40dec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e40dec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 0x7f4e3c0b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e40dec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0cb950 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e40dec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c157270 con 0x7f4e3c0ae5a0 2023-11-24T08:01:28.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e40dec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c158120 con 0x7f4e3c06d120 2023-11-24T08:01:28.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 0x7f4e3c0b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 0x7f4e3c0b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44408/0 (socket says 172.21.15.161:44408) 2023-11-24T08:01:28.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 -- 172.21.15.161:0/2299384486 learned_addr learned my addr 172.21.15.161:0/2299384486 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:28.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3a59c640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c06d120 0x7f4e3c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e39d9b640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 -- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c06d120 msgr2=0x7f4e3c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c06d120 0x7f4e3c153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 -- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3c0ae5a0 msgr2=0x7f4e3c0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c0b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.688+0000 7f4e3ad9d640 1 -- 172.21.15.161:0/2299384486 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c0094d0 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.689+0000 7f4e3ad9d640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 0x7f4e3c0b2cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400b970 tx=0x7f4e3400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:28.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.689+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3400cb40 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.689+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3400cca0 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.689+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c158400 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.689+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34014680 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.689+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c1589c0 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.690+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c0cbb00 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.691+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e3401d3b0 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.692+0000 7f4e2affd640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e1c06ae70 0x7f4e1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:28.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.692+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4e340893b0 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.693+0000 7f4e3a59c640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e1c06ae70 0x7f4e1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:28.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.694+0000 7f4e3a59c640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e1c06ae70 0x7f4e1c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c036000 tx=0x7f4e2c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:28.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.697+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e34054470 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.931+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e3c158be0 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.933+0000 7f4e2affd640 1 -- 172.21.15.161:0/2299384486 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f4e34057a90 con 0x7f4e3c0b3ae0 2023-11-24T08:01:28.934 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:28.934 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:01:28.934 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.935+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e1c06ae70 msgr2=0x7f4e1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.935+0000 7f4e40dec640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e1c06ae70 0x7f4e1c06d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c036000 tx=0x7f4e2c03c040 comp rx=0 tx=0).stop 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.935+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 msgr2=0x7f4e3c0b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.935+0000 7f4e40dec640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 0x7f4e3c0b2cd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400b970 tx=0x7f4e3400be30 comp rx=0 tx=0).stop 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 shutdown_connections 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e1c06ae70 0x7f4e1c06d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e3c0b3ae0 0x7f4e3c0b2cd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e3c0ae5a0 0x7f4e3c0b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 --2- 172.21.15.161:0/2299384486 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e3c06d120 0x7f4e3c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 >> 172.21.15.161:0/2299384486 conn(0x7f4e3c06a800 msgr2=0x7f4e3c0ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:28.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 shutdown_connections 2023-11-24T08:01:28.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:28.936+0000 7f4e40dec640 1 -- 172.21.15.161:0/2299384486 wait complete. 2023-11-24T08:01:28.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:29.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.162+0000 7f34553a9640 1 Processor -- start 2023-11-24T08:01:29.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.162+0000 7f34553a9640 1 -- start start 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34553a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f345013df80 0x7f345015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34553a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f345013e360 0x7f34500cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34553a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345015f9c0 0x7f34500cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34553a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345006c470 con 0x7f345013e360 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34553a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345006c750 con 0x7f345013df80 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34553a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345006ca30 con 0x7f345015f9c0 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34467fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f345013e360 0x7f34500cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34467fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f345013e360 0x7f34500cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44422/0 (socket says 172.21.15.161:44422) 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f34467fc640 1 -- 172.21.15.161:0/4069912611 learned_addr learned my addr 172.21.15.161:0/4069912611 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:29.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f344f7fe640 1 --2- 172.21.15.161:0/4069912611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345015f9c0 0x7f34500cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.164+0000 7f344effd640 1 --2- 172.21.15.161:0/4069912611 >> v2:172.21.15.175:3300/0 conn(0x7f345013df80 0x7f345015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.165+0000 7f34467fc640 1 -- 172.21.15.161:0/4069912611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345015f9c0 msgr2=0x7f34500cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.165+0000 7f34467fc640 1 --2- 172.21.15.161:0/4069912611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345015f9c0 0x7f34500cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.165+0000 7f34467fc640 1 -- 172.21.15.161:0/4069912611 >> v2:172.21.15.175:3300/0 conn(0x7f345013df80 msgr2=0x7f345015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.165+0000 7f34467fc640 1 --2- 172.21.15.161:0/4069912611 >> v2:172.21.15.175:3300/0 conn(0x7f345013df80 0x7f345015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.165+0000 7f34467fc640 1 -- 172.21.15.161:0/4069912611 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345006cd10 con 0x7f345013e360 2023-11-24T08:01:29.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.165+0000 7f344effd640 1 --2- 172.21.15.161:0/4069912611 >> v2:172.21.15.175:3300/0 conn(0x7f345013df80 0x7f345015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:29.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.166+0000 7f34467fc640 1 --2- 172.21.15.161:0/4069912611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500cf290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3450072770 tx=0x7f343802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bf1c7a20d35e6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:29.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.166+0000 7f344e7fc640 1 -- 172.21.15.161:0/4069912611 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438031870 con 0x7f345013e360 2023-11-24T08:01:29.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.166+0000 7f344e7fc640 1 -- 172.21.15.161:0/4069912611 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34380319d0 con 0x7f345013e360 2023-11-24T08:01:29.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.166+0000 7f344e7fc640 1 -- 172.21.15.161:0/4069912611 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438031d60 con 0x7f345013e360 2023-11-24T08:01:29.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 -- 172.21.15.161:0/4069912611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 msgr2=0x7f34500cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 --2- 172.21.15.161:0/4069912611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500cf290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3450072770 tx=0x7f343802b910 comp rx=0 tx=0).stop 2023-11-24T08:01:29.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 -- 172.21.15.161:0/4069912611 shutdown_connections 2023-11-24T08:01:29.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 --2- 172.21.15.161:0/4069912611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345015f9c0 0x7f34500cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 --2- 172.21.15.161:0/4069912611 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500cf290 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 --2- 172.21.15.161:0/4069912611 >> v2:172.21.15.175:3300/0 conn(0x7f345013df80 0x7f345015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 -- 172.21.15.161:0/4069912611 >> 172.21.15.161:0/4069912611 conn(0x7f345006a800 msgr2=0x7f345006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:29.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 -- 172.21.15.161:0/4069912611 shutdown_connections 2023-11-24T08:01:29.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.167+0000 7f34553a9640 1 -- 172.21.15.161:0/4069912611 wait complete. 2023-11-24T08:01:29.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.169+0000 7f34553a9640 1 Processor -- start 2023-11-24T08:01:29.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.169+0000 7f34553a9640 1 -- start start 2023-11-24T08:01:29.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.170+0000 7f34553a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345013df80 0x7f345013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.170+0000 7f34553a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.170+0000 7f34553a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f345015f9c0 0x7f345013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.170+0000 7f34553a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450071990 con 0x7f345013e360 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.170+0000 7f34553a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3450070d10 con 0x7f345015f9c0 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.170+0000 7f34553a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3450070ff0 con 0x7f345013df80 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44426/0 (socket says 172.21.15.161:44426) 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 -- 172.21.15.161:0/1445507333 learned_addr learned my addr 172.21.15.161:0/1445507333 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f344effd640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345013df80 0x7f345013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f344f7fe640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f345015f9c0 0x7f345013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 -- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345013df80 msgr2=0x7f345013b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345013df80 0x7f345013b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 -- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f345015f9c0 msgr2=0x7f345013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f345015f9c0 0x7f345013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 -- 172.21.15.161:0/1445507333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380094d0 con 0x7f345013e360 2023-11-24T08:01:29.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f344effd640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345013df80 0x7f345013b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:29.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f344f7fe640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f345015f9c0 0x7f345013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:29.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.171+0000 7f34467fc640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500702c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f343802b950 tx=0x7f34380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.172+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343803ad30 con 0x7f345013e360 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.172+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34380443f0 con 0x7f345013e360 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.172+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34380447a0 con 0x7f345013e360 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.172+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34500712d0 con 0x7f345013e360 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.172+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345013bcf0 con 0x7f345013e360 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.173+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3450071ad0 con 0x7f345013e360 2023-11-24T08:01:29.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.174+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f343804d450 con 0x7f345013e360 2023-11-24T08:01:29.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.175+0000 7f3447fff640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f343006ae40 0x7f343006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.175+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f343802d040 con 0x7f345013e360 2023-11-24T08:01:29.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.176+0000 7f344effd640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f343006ae40 0x7f343006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.177+0000 7f344effd640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f343006ae40 0x7f343006d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3440007f40 tx=0x7f3440007490 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:29.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.179+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3450071ad0 con 0x7f345013e360 2023-11-24T08:01:29.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.399+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3450071ad0 con 0x7f345013e360 2023-11-24T08:01:29.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.401+0000 7f3447fff640 1 -- 172.21.15.161:0/1445507333 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f3450071ad0 con 0x7f345013e360 2023-11-24T08:01:29.402 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:29.402 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:29.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f343006ae40 msgr2=0x7f343006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f343006ae40 0x7f343006d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3440007f40 tx=0x7f3440007490 comp rx=0 tx=0).stop 2023-11-24T08:01:29.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 msgr2=0x7f34500702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500702c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f343802b950 tx=0x7f34380046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 shutdown_connections 2023-11-24T08:01:29.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f343006ae40 0x7f343006d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f345015f9c0 0x7f345013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f345013e360 0x7f34500702c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 --2- 172.21.15.161:0/1445507333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f345013df80 0x7f345013b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.403+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 >> 172.21.15.161:0/1445507333 conn(0x7f345006a800 msgr2=0x7f34500cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:29.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.404+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 shutdown_connections 2023-11-24T08:01:29.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.404+0000 7f34553a9640 1 -- 172.21.15.161:0/1445507333 wait complete. 2023-11-24T08:01:29.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:00:23.689801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:00:24.943820+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:29.423 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.635+0000 7f28a2fc9640 1 Processor -- start 2023-11-24T08:01:29.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.635+0000 7f28a2fc9640 1 -- start start 2023-11-24T08:01:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a2fc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c0cf9a0 0x7f289c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a2fc9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f289c15e1e0 0x7f289c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a2fc9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c0b1ee0 con 0x7f289c143ae0 2023-11-24T08:01:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a2fc9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c0b2780 con 0x7f289c15e1e0 2023-11-24T08:01:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a2fc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c15e990 con 0x7f289c0cf9a0 2023-11-24T08:01:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a1566640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f289c15e1e0 0x7f289c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a0d65640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f289c143ae0 0x7f289c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60030/0 (socket says 172.21.15.161:60030) 2023-11-24T08:01:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.637+0000 7f28a0d65640 1 -- 172.21.15.161:0/2746136011 learned_addr learned my addr 172.21.15.161:0/2746136011 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.638+0000 7f289bfff640 1 --2- 172.21.15.161:0/2746136011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c0cf9a0 0x7f289c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.638+0000 7f28a1566640 1 -- 172.21.15.161:0/2746136011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c0cf9a0 msgr2=0x7f289c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.638+0000 7f28a1566640 1 --2- 172.21.15.161:0/2746136011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c0cf9a0 0x7f289c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.638+0000 7f28a1566640 1 -- 172.21.15.161:0/2746136011 >> v1:172.21.15.161:6789/0 conn(0x7f289c143ae0 legacy=0x7f289c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.638+0000 7f28a1566640 1 -- 172.21.15.161:0/2746136011 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0b2130 con 0x7f289c15e1e0 2023-11-24T08:01:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.638+0000 7f289b7fe640 1 -- 172.21.15.161:0/2746136011 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103949848 0 0) 0x7f289c0b1ee0 con 0x7f289c143ae0 2023-11-24T08:01:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.639+0000 7f28a1566640 1 --2- 172.21.15.161:0/2746136011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c15e1e0 0x7f289c0702c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2894009d90 tx=0x7f289402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c565f6763f0607 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.639+0000 7f289b7fe640 1 -- 172.21.15.161:0/2746136011 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289402cc50 con 0x7f289c15e1e0 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.639+0000 7f289b7fe640 1 -- 172.21.15.161:0/2746136011 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289402cdb0 con 0x7f289c15e1e0 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.639+0000 7f289b7fe640 1 -- 172.21.15.161:0/2746136011 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894034660 con 0x7f289c15e1e0 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 -- 172.21.15.161:0/2746136011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c15e1e0 msgr2=0x7f289c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/2746136011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c15e1e0 0x7f289c0702c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2894009d90 tx=0x7f289402bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 -- 172.21.15.161:0/2746136011 shutdown_connections 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/2746136011 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c15e1e0 0x7f289c0702c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/2746136011 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c0cf9a0 0x7f289c15dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 -- 172.21.15.161:0/2746136011 >> 172.21.15.161:0/2746136011 conn(0x7f289c06a800 msgr2=0x7f289c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 -- 172.21.15.161:0/2746136011 shutdown_connections 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.640+0000 7f28a2fc9640 1 -- 172.21.15.161:0/2746136011 wait complete. 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.641+0000 7f28a2fc9640 1 Processor -- start 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.642+0000 7f28a2fc9640 1 -- start start 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a2fc9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 0x7f289c13ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a2fc9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c143ae0 0x7f289c1f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a2fc9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f289c15e1e0 0x7f289c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a2fc9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0cc650 con 0x7f289c0cf9a0 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a2fc9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c1f69e0 con 0x7f289c15e1e0 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a2fc9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c1f6cc0 con 0x7f289c143ae0 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 0x7f289c13ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 0x7f289c13ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44434/0 (socket says 172.21.15.161:44434) 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 -- 172.21.15.161:0/105137531 learned_addr learned my addr 172.21.15.161:0/105137531 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 -- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c143ae0 msgr2=0x7f289c1f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c143ae0 0x7f289c1f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 -- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f289c15e1e0 msgr2=0x7f289c0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f289c15e1e0 0x7f289c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.643+0000 7f28a0d65640 1 -- 172.21.15.161:0/105137531 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894009a70 con 0x7f289c0cf9a0 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.644+0000 7f28a0d65640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 0x7f289c13ea90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f289000c4d0 tx=0x7f289000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.644+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28900074e0 con 0x7f289c0cf9a0 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.644+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890007660 con 0x7f289c0cf9a0 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.644+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890004a20 con 0x7f289c0cf9a0 2023-11-24T08:01:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.644+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c0cc8a0 con 0x7f289c0cf9a0 2023-11-24T08:01:29.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.644+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c0cb020 con 0x7f289c0cf9a0 2023-11-24T08:01:29.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.645+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c0ccdc0 con 0x7f289c0cf9a0 2023-11-24T08:01:29.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.646+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2890004b80 con 0x7f289c0cf9a0 2023-11-24T08:01:29.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.647+0000 7f28997fa640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288006ae40 0x7f288006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:29.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.647+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f28900888d0 con 0x7f289c0cf9a0 2023-11-24T08:01:29.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.647+0000 7f289bfff640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288006ae40 0x7f288006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:29.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.649+0000 7f289bfff640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288006ae40 0x7f288006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f289c1f5ee0 tx=0x7f2888008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:29.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.651+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f289c0ccdc0 con 0x7f289c0cf9a0 2023-11-24T08:01:29.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.828+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f289c0ccdc0 con 0x7f289c0cf9a0 2023-11-24T08:01:29.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.829+0000 7f28997fa640 1 -- 172.21.15.161:0/105137531 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2890018020 con 0x7f289c0cf9a0 2023-11-24T08:01:29.831 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288006ae40 msgr2=0x7f288006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288006ae40 0x7f288006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f289c1f5ee0 tx=0x7f2888008040 comp rx=0 tx=0).stop 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 msgr2=0x7f289c13ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 0x7f289c13ea90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f289000c4d0 tx=0x7f289000c990 comp rx=0 tx=0).stop 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 shutdown_connections 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288006ae40 0x7f288006d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f289c15e1e0 0x7f289c0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f289c143ae0 0x7f289c1f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 --2- 172.21.15.161:0/105137531 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f289c0cf9a0 0x7f289c13ea90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:29.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.831+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 >> 172.21.15.161:0/105137531 conn(0x7f289c06a800 msgr2=0x7f289c06cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:29.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.832+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 shutdown_connections 2023-11-24T08:01:29.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:29.832+0000 7f28a2fc9640 1 -- 172.21.15.161:0/105137531 wait complete. 2023-11-24T08:01:29.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:01:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.054+0000 7f938b4ad640 1 Processor -- start 2023-11-24T08:01:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.054+0000 7f938b4ad640 1 -- start start 2023-11-24T08:01:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.055+0000 7f938b4ad640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9384143810 0x7f9384071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.055+0000 7f938b4ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f938415d770 0x7f938415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938b4ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840ae620 con 0x7f93840ae170 2023-11-24T08:01:30.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938b4ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9384143bf0 con 0x7f938415d770 2023-11-24T08:01:30.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938b4ad640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938406c730 con 0x7f9384143810 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f938415d770 0x7f938415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f938415d770 0x7f938415dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44440/0 (socket says 172.21.15.161:44440) 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 -- 172.21.15.161:0/1495269900 learned_addr learned my addr 172.21.15.161:0/1495269900 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938a4ab640 1 --2- 172.21.15.161:0/1495269900 >> v2:172.21.15.175:3300/0 conn(0x7f9384143810 0x7f9384071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 -- 172.21.15.161:0/1495269900 >> v2:172.21.15.175:3300/0 conn(0x7f9384143810 msgr2=0x7f9384071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 --2- 172.21.15.161:0/1495269900 >> v2:172.21.15.175:3300/0 conn(0x7f9384143810 0x7f9384071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 -- 172.21.15.161:0/1495269900 >> v1:172.21.15.175:6789/0 conn(0x7f93840ae170 legacy=0x7f938415e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.056+0000 7f938acac640 1 -- 172.21.15.161:0/1495269900 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840724d0 con 0x7f938415d770 2023-11-24T08:01:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938acac640 1 --2- 172.21.15.161:0/1495269900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f938415d770 0x7f938415dbc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f93840cec40 tx=0x7f937c02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1c8904da5fe82e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f93894a9640 1 -- 172.21.15.161:0/1495269900 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c02c960 con 0x7f938415d770 2023-11-24T08:01:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f93894a9640 1 -- 172.21.15.161:0/1495269900 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c02cac0 con 0x7f938415d770 2023-11-24T08:01:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f93894a9640 1 -- 172.21.15.161:0/1495269900 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c02ce50 con 0x7f938415d770 2023-11-24T08:01:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938b4ad640 1 -- 172.21.15.161:0/1495269900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f938415d770 msgr2=0x7f938415dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938b4ad640 1 --2- 172.21.15.161:0/1495269900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f938415d770 0x7f938415dbc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f93840cec40 tx=0x7f937c02bdc0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938b4ad640 1 -- 172.21.15.161:0/1495269900 shutdown_connections 2023-11-24T08:01:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938b4ad640 1 --2- 172.21.15.161:0/1495269900 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f938415d770 0x7f938415dbc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938b4ad640 1 --2- 172.21.15.161:0/1495269900 >> v2:172.21.15.175:3300/0 conn(0x7f9384143810 0x7f9384071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.058+0000 7f938b4ad640 1 -- 172.21.15.161:0/1495269900 >> 172.21.15.161:0/1495269900 conn(0x7f938406a7d0 msgr2=0x7f938406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.059+0000 7f938b4ad640 1 -- 172.21.15.161:0/1495269900 shutdown_connections 2023-11-24T08:01:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.059+0000 7f938b4ad640 1 -- 172.21.15.161:0/1495269900 wait complete. 2023-11-24T08:01:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.060+0000 7f938b4ad640 1 Processor -- start 2023-11-24T08:01:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.060+0000 7f938b4ad640 1 -- start start 2023-11-24T08:01:30.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.061+0000 7f938b4ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93840ae170 0x7f93840b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.061+0000 7f938b4ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 0x7f938415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.061+0000 7f938b4ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938415d770 0x7f938415cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.061+0000 7f938b4ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9384146a70 con 0x7f9384143810 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.061+0000 7f938b4ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93841464b0 con 0x7f938415d770 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.061+0000 7f938b4ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9384146790 con 0x7f93840ae170 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 0x7f938415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 0x7f938415c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44446/0 (socket says 172.21.15.161:44446) 2023-11-24T08:01:30.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 -- 172.21.15.161:0/3902110874 learned_addr learned my addr 172.21.15.161:0/3902110874 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f938a4ab640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93840ae170 0x7f93840b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f938acac640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938415d770 0x7f938415cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 -- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93840ae170 msgr2=0x7f93840b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93840ae170 0x7f93840b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 -- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938415d770 msgr2=0x7f938415cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938415d770 0x7f938415cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f9389caa640 1 -- 172.21.15.161:0/3902110874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c009b30 con 0x7f9384143810 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.062+0000 7f938acac640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938415d770 0x7f938415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.063+0000 7f9389caa640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 0x7f938415c6d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f937400c430 tx=0x7f937400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.063+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374011790 con 0x7f9384143810 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.063+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93740118f0 con 0x7f9384143810 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.063+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93840cb6f0 con 0x7f9384143810 2023-11-24T08:01:30.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.063+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374011ce0 con 0x7f9384143810 2023-11-24T08:01:30.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.063+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93840b3360 con 0x7f9384143810 2023-11-24T08:01:30.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.064+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93840b3520 con 0x7f9384143810 2023-11-24T08:01:30.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.065+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f937401c460 con 0x7f9384143810 2023-11-24T08:01:30.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.066+0000 7f937affd640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f936806ae70 0x7f936806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.066+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9374089750 con 0x7f9384143810 2023-11-24T08:01:30.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.066+0000 7f938a4ab640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f936806ae70 0x7f936806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.068+0000 7f938a4ab640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f936806ae70 0x7f936806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9380006fd0 tx=0x7f9380008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.070+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9374054650 con 0x7f9384143810 2023-11-24T08:01:30.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.262+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9384067450 con 0x7f9384143810 2023-11-24T08:01:30.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.263+0000 7f937affd640 1 -- 172.21.15.161:0/3902110874 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9374057c70 con 0x7f9384143810 2023-11-24T08:01:30.264 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:01:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.265+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f936806ae70 msgr2=0x7f936806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.265+0000 7f938b4ad640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f936806ae70 0x7f936806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9380006fd0 tx=0x7f9380008040 comp rx=0 tx=0).stop 2023-11-24T08:01:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.265+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 msgr2=0x7f938415c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.265+0000 7f938b4ad640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 0x7f938415c6d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f937400c430 tx=0x7f937400c8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 shutdown_connections 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f936806ae70 0x7f936806d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f938415d770 0x7f938415cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9384143810 0x7f938415c6d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 --2- 172.21.15.161:0/3902110874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93840ae170 0x7f93840b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 >> 172.21.15.161:0/3902110874 conn(0x7f938406a7d0 msgr2=0x7f938406d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 shutdown_connections 2023-11-24T08:01:30.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.266+0000 7f938b4ad640 1 -- 172.21.15.161:0/3902110874 wait complete. 2023-11-24T08:01:30.284 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:01:30.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.490+0000 7f00387d5640 1 Processor -- start 2023-11-24T08:01:30.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.490+0000 7f00387d5640 1 -- start start 2023-11-24T08:01:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f00387d5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f003013df80 0x7f003015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f00387d5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f00300cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f00387d5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003006c470 con 0x7f003013e360 2023-11-24T08:01:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f00387d5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003006c750 con 0x7f003013df80 2023-11-24T08:01:30.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f00387d5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003006ca30 con 0x7f00300cf9a0 2023-11-24T08:01:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f0035d70640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f003013e360 0x7f00300cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60042/0 (socket says 172.21.15.161:60042) 2023-11-24T08:01:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f0035d70640 1 -- 172.21.15.161:0/3339506549 learned_addr learned my addr 172.21.15.161:0/3339506549 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:30.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.492+0000 7f0036571640 1 --2- 172.21.15.161:0/3339506549 >> v2:172.21.15.161:3300/0 conn(0x7f003013df80 0x7f003015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f0036d72640 1 --2- 172.21.15.161:0/3339506549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f00300cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f003556f640 1 -- 172.21.15.161:0/3339506549 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421176914 0 0) 0x7f003006c470 con 0x7f003013e360 2023-11-24T08:01:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f003556f640 1 -- 172.21.15.161:0/3339506549 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c003520 con 0x7f003013e360 2023-11-24T08:01:30.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f0036571640 1 -- 172.21.15.161:0/3339506549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 msgr2=0x7f00300cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f0036571640 1 --2- 172.21.15.161:0/3339506549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f00300cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f0036571640 1 -- 172.21.15.161:0/3339506549 >> v1:172.21.15.161:6789/0 conn(0x7f003013e360 legacy=0x7f00300cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.493+0000 7f0036571640 1 -- 172.21.15.161:0/3339506549 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003006cd10 con 0x7f003013df80 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.494+0000 7f0036571640 1 --2- 172.21.15.161:0/3339506549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003015bee0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f002c0097a0 tx=0x7f002c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879974a5b90ebef9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.495+0000 7f003556f640 1 -- 172.21.15.161:0/3339506549 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c031830 con 0x7f003013df80 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.495+0000 7f003556f640 1 -- 172.21.15.161:0/3339506549 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c031990 con 0x7f003013df80 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.495+0000 7f003556f640 1 -- 172.21.15.161:0/3339506549 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c031d20 con 0x7f003013df80 2023-11-24T08:01:30.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.495+0000 7f00387d5640 1 -- 172.21.15.161:0/3339506549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 msgr2=0x7f003015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.495+0000 7f00387d5640 1 --2- 172.21.15.161:0/3339506549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003015bee0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f002c0097a0 tx=0x7f002c02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.495+0000 7f00387d5640 1 -- 172.21.15.161:0/3339506549 shutdown_connections 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.496+0000 7f00387d5640 1 --2- 172.21.15.161:0/3339506549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f00300cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.496+0000 7f00387d5640 1 --2- 172.21.15.161:0/3339506549 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003015bee0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.496+0000 7f00387d5640 1 -- 172.21.15.161:0/3339506549 >> 172.21.15.161:0/3339506549 conn(0x7f003006a800 msgr2=0x7f003006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.496+0000 7f00387d5640 1 -- 172.21.15.161:0/3339506549 shutdown_connections 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.496+0000 7f00387d5640 1 -- 172.21.15.161:0/3339506549 wait complete. 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.497+0000 7f00387d5640 1 Processor -- start 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.498+0000 7f00387d5640 1 -- start start 2023-11-24T08:01:30.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.498+0000 7f00387d5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f003014c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f00387d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f00387d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f003013e360 0x7f00300b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f00387d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003014b900 con 0x7f003013df80 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f00387d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003014ca70 con 0x7f003013e360 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f00387d5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003014cd70 con 0x7f00300cf9a0 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003014b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:44456/0 (socket says 172.21.15.161:44456) 2023-11-24T08:01:30.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 -- 172.21.15.161:0/3951119445 learned_addr learned my addr 172.21.15.161:0/3951119445 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0036571640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f003014c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0036d72640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f003013e360 0x7f00300b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 -- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 msgr2=0x7f003014c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f003014c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 -- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f003013e360 msgr2=0x7f00300b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f003013e360 0x7f00300b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0035d70640 1 -- 172.21.15.161:0/3951119445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009400 con 0x7f003013df80 2023-11-24T08:01:30.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.499+0000 7f0036571640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f003014c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:30.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.500+0000 7f0035d70640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003014b3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f002000c4d0 tx=0x7f002000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.500+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020005ce0 con 0x7f003013df80 2023-11-24T08:01:30.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.500+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020005e40 con 0x7f003013df80 2023-11-24T08:01:30.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.500+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020007270 con 0x7f003013df80 2023-11-24T08:01:30.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.500+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003014d050 con 0x7f003013df80 2023-11-24T08:01:30.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.500+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003014d610 con 0x7f003013df80 2023-11-24T08:01:30.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.501+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00300675d0 con 0x7f003013df80 2023-11-24T08:01:30.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.502+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0020007490 con 0x7f003013df80 2023-11-24T08:01:30.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.503+0000 7f0026ffd640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f001406ae40 0x7f001406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.503+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0020088ca0 con 0x7f003013df80 2023-11-24T08:01:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.504+0000 7f0036571640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f001406ae40 0x7f001406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.505+0000 7f0036571640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f001406ae40 0x7f001406d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f002c036000 tx=0x7f002c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.507+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0020053c50 con 0x7f003013df80 2023-11-24T08:01:30.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.686+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f003006df00 con 0x7f003013df80 2023-11-24T08:01:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.688+0000 7f0026ffd640 1 -- 172.21.15.161:0/3951119445 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0020017070 con 0x7f003013df80 2023-11-24T08:01:30.689 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:01:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f001406ae40 msgr2=0x7f001406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f001406ae40 0x7f001406d300 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f002c036000 tx=0x7f002c008030 comp rx=0 tx=0).stop 2023-11-24T08:01:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 msgr2=0x7f003014b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003014b3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f002000c4d0 tx=0x7f002000c990 comp rx=0 tx=0).stop 2023-11-24T08:01:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 shutdown_connections 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f001406ae40 0x7f001406d300 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f003013e360 0x7f00300b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f003013df80 0x7f003014b3c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 --2- 172.21.15.161:0/3951119445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f00300cf9a0 0x7f003014c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 >> 172.21.15.161:0/3951119445 conn(0x7f003006a800 msgr2=0x7f0030153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.690+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 shutdown_connections 2023-11-24T08:01:30.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.691+0000 7f00387d5640 1 -- 172.21.15.161:0/3951119445 wait complete. 2023-11-24T08:01:30.709 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:01:30.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.914+0000 7f86733fb640 1 Processor -- start 2023-11-24T08:01:30.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.914+0000 7f86733fb640 1 -- start start 2023-11-24T08:01:30.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.916+0000 7f86733fb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f866c13df80 0x7f866c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.916+0000 7f86733fb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c0cf9a0 0x7f866c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.916+0000 7f86733fb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c06c470 con 0x7f866c13e360 2023-11-24T08:01:30.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.916+0000 7f86733fb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c06c750 con 0x7f866c13df80 2023-11-24T08:01:30.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.916+0000 7f86733fb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c06ca30 con 0x7f866c0cf9a0 2023-11-24T08:01:30.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.916+0000 7f8671197640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f866c13df80 0x7f866c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671197640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f866c13df80 0x7f866c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:33824/0 (socket says 172.21.15.161:33824) 2023-11-24T08:01:30.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671197640 1 -- 172.21.15.161:0/229929892 learned_addr learned my addr 172.21.15.161:0/229929892 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:30.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671998640 1 --2- 172.21.15.161:0/229929892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c0cf9a0 0x7f866c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671998640 1 -- 172.21.15.161:0/229929892 >> v2:172.21.15.175:3300/0 conn(0x7f866c13df80 msgr2=0x7f866c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:30.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671998640 1 --2- 172.21.15.161:0/229929892 >> v2:172.21.15.175:3300/0 conn(0x7f866c13df80 0x7f866c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671998640 1 -- 172.21.15.161:0/229929892 >> v1:172.21.15.175:6789/0 conn(0x7f866c13e360 legacy=0x7f866c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.917+0000 7f8671998640 1 -- 172.21.15.161:0/229929892 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c06cd10 con 0x7f866c0cf9a0 2023-11-24T08:01:30.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.919+0000 7f8671998640 1 --2- 172.21.15.161:0/229929892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c0cf9a0 0x7f866c0cd840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f866402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730b1481ecb431d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.919+0000 7f8663fff640 1 -- 172.21.15.161:0/229929892 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866402cc50 con 0x7f866c0cf9a0 2023-11-24T08:01:30.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.919+0000 7f8663fff640 1 -- 172.21.15.161:0/229929892 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866402cdb0 con 0x7f866c0cf9a0 2023-11-24T08:01:30.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.919+0000 7f8663fff640 1 -- 172.21.15.161:0/229929892 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664034660 con 0x7f866c0cf9a0 2023-11-24T08:01:30.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 -- 172.21.15.161:0/229929892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c0cf9a0 msgr2=0x7f866c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 --2- 172.21.15.161:0/229929892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c0cf9a0 0x7f866c0cd840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f866402bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 -- 172.21.15.161:0/229929892 shutdown_connections 2023-11-24T08:01:30.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 --2- 172.21.15.161:0/229929892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c0cf9a0 0x7f866c0cd840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 --2- 172.21.15.161:0/229929892 >> v2:172.21.15.175:3300/0 conn(0x7f866c13df80 0x7f866c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 -- 172.21.15.161:0/229929892 >> 172.21.15.161:0/229929892 conn(0x7f866c06a800 msgr2=0x7f866c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:30.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 -- 172.21.15.161:0/229929892 shutdown_connections 2023-11-24T08:01:30.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.920+0000 7f86733fb640 1 -- 172.21.15.161:0/229929892 wait complete. 2023-11-24T08:01:30.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.922+0000 7f86733fb640 1 Processor -- start 2023-11-24T08:01:30.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.923+0000 7f86733fb640 1 -- start start 2023-11-24T08:01:30.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f86733fb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f866c0cf9a0 0x7f866c12d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f86733fb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c13df80 0x7f866c153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f86733fb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 0x7f866c1e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f86733fb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c153580 con 0x7f866c13e360 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f86733fb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1e53b0 con 0x7f866c0cf9a0 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f86733fb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1e5690 con 0x7f866c13df80 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f8671998640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 0x7f866c1e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f8671998640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 0x7f866c1e49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38200/0 (socket says 172.21.15.161:38200) 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f8671998640 1 -- 172.21.15.161:0/2778379894 learned_addr learned my addr 172.21.15.161:0/2778379894 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.924+0000 7f8671197640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f866c0cf9a0 0x7f866c12d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8670996640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c13df80 0x7f866c153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8671998640 1 -- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c13df80 msgr2=0x7f866c153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8671998640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c13df80 0x7f866c153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8671998640 1 -- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f866c0cf9a0 msgr2=0x7f866c12d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:30.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8671998640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f866c0cf9a0 0x7f866c12d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8671998640 1 -- 172.21.15.161:0/2778379894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009a70 con 0x7f866c13e360 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.925+0000 7f8671998640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 0x7f866c1e49d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f8664004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.926+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664040650 con 0x7f866c13e360 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.926+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640407b0 con 0x7f866c13e360 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.926+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8664040b60 con 0x7f866c13e360 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.926+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c1e5970 con 0x7f866c13e360 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.926+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1e5f30 con 0x7f866c13e360 2023-11-24T08:01:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.927+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c0675d0 con 0x7f866c13e360 2023-11-24T08:01:30.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.928+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8664040cc0 con 0x7f866c13e360 2023-11-24T08:01:30.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.929+0000 7f8661ffb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f865006ae40 0x7f865006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:30.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.929+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f86640ac4e0 con 0x7f866c13e360 2023-11-24T08:01:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.930+0000 7f8671197640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f865006ae40 0x7f865006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:30.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.931+0000 7f8671197640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f865006ae40 0x7f865006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8668009bd0 tx=0x7f8668009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:30.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:30.933+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f86640773e0 con 0x7f866c13e360 2023-11-24T08:01:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.161+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f866c06df00 con 0x7f866c13e360 2023-11-24T08:01:31.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.162+0000 7f8661ffb640 1 -- 172.21.15.161:0/2778379894 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f8664009450 con 0x7f866c13e360 2023-11-24T08:01:31.163 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:31.163 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:01:31.163 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:01:31.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f865006ae40 msgr2=0x7f865006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f865006ae40 0x7f865006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8668009bd0 tx=0x7f8668009240 comp rx=0 tx=0).stop 2023-11-24T08:01:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 msgr2=0x7f866c1e49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 0x7f866c1e49d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f8664004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 shutdown_connections 2023-11-24T08:01:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f865006ae40 0x7f865006d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f866c13e360 0x7f866c1e49d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f866c13df80 0x7f866c153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 --2- 172.21.15.161:0/2778379894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f866c0cf9a0 0x7f866c12d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.164+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 >> 172.21.15.161:0/2778379894 conn(0x7f866c06a800 msgr2=0x7f866c0b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:31.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.165+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 shutdown_connections 2023-11-24T08:01:31.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.165+0000 7f86733fb640 1 -- 172.21.15.161:0/2778379894 wait complete. 2023-11-24T08:01:31.186 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:31.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.398+0000 7f6883abb640 1 Processor -- start 2023-11-24T08:01:31.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.398+0000 7f6883abb640 1 -- start start 2023-11-24T08:01:31.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6883abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 0x7f687c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6883abb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0b1ee0 con 0x7f687c15e1e0 2023-11-24T08:01:31.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6883abb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687c0b2780 con 0x7f687c143ae0 2023-11-24T08:01:31.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6883abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c15e990 con 0x7f687c0cf9a0 2023-11-24T08:01:31.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6882058640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f687c15e1e0 0x7f687c0702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33010/0 (socket says 172.21.15.161:33010) 2023-11-24T08:01:31.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6882058640 1 -- 172.21.15.161:0/1302881199 learned_addr learned my addr 172.21.15.161:0/1302881199 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:31.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.400+0000 7f6881056640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 0x7f687c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779009570 0 0) 0x7f687c0b1ee0 con 0x7f687c15e1e0 2023-11-24T08:01:31.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6868003520 con 0x7f687c15e1e0 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3453464073 0 0) 0x7f6868003520 con 0x7f687c15e1e0 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 msgr2=0x7f687c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 0x7f687c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 >> v1:172.21.15.175:6789/0 conn(0x7f687c143ae0 legacy=0x7f687c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0b2130 con 0x7f687c15e1e0 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6874001670 con 0x7f687c15e1e0 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 >> v1:172.21.15.161:6789/0 conn(0x7f687c15e1e0 legacy=0x7f687c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 0x7f68680039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6868003f20 0x7f68680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6868004d00 0x7f6868005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.404 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c15e990 con 0x7f6868004d00 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686800ba60 con 0x7f6868003f20 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.401+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686800bc20 con 0x7f687c0cf9a0 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6882058640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6868004d00 0x7f6868005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6881857640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 0x7f68680039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6881056640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6868003f20 0x7f68680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6882058640 1 -- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 msgr2=0x7f68680039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6882058640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f687c0cf9a0 0x7f68680039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6882058640 1 -- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6868003f20 msgr2=0x7f68680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6882058640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6868003f20 0x7f68680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6882058640 1 -- 172.21.15.161:0/1302881199 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868003520 con 0x7f6868004d00 2023-11-24T08:01:31.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.402+0000 7f6881056640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6868003f20 0x7f68680047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:31.406 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.403+0000 7f6882058640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6868004d00 0x7f6868005180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f687400c190 tx=0x7f68680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698f7297eb1c9c76 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.403+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874005ad0 con 0x7f6868004d00 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.403+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874005c30 con 0x7f6868004d00 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.403+0000 7f6880855640 1 -- 172.21.15.161:0/1302881199 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687402cae0 con 0x7f6868004d00 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6883abb640 1 -- 172.21.15.161:0/1302881199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6868004d00 msgr2=0x7f6868005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6883abb640 1 --2- 172.21.15.161:0/1302881199 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6868004d00 0x7f6868005180 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f687400c190 tx=0x7f68680057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6882058640 1 -- 172.21.15.161:0/1302881199 reap_dead start 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6883abb640 1 -- 172.21.15.161:0/1302881199 shutdown_connections 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6883abb640 1 -- 172.21.15.161:0/1302881199 >> 172.21.15.161:0/1302881199 conn(0x7f687c06a800 msgr2=0x7f687c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6883abb640 1 -- 172.21.15.161:0/1302881199 shutdown_connections 2023-11-24T08:01:31.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.404+0000 7f6883abb640 1 -- 172.21.15.161:0/1302881199 wait complete. 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.406+0000 7f6883abb640 1 Processor -- start 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.406+0000 7f6883abb640 1 -- start start 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6883abb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6868004d00 0x7f687c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6883abb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c1f1dd0 0x7f687c1f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6883abb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 0x7f687c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6883abb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c1f2790 con 0x7f687c0afc80 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6883abb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0b1530 con 0x7f687c1f1dd0 2023-11-24T08:01:31.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6883abb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687c0b09b0 con 0x7f6868004d00 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6882058640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 0x7f687c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6882058640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 0x7f687c0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38218/0 (socket says 172.21.15.161:38218) 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.407+0000 7f6882058640 1 -- 172.21.15.161:0/1376613382 learned_addr learned my addr 172.21.15.161:0/1376613382 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6881857640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6868004d00 0x7f687c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6881056640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c1f1dd0 0x7f687c1f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6882058640 1 -- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6868004d00 msgr2=0x7f687c0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6882058640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6868004d00 0x7f687c0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6882058640 1 -- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c1f1dd0 msgr2=0x7f687c1f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6882058640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c1f1dd0 0x7f687c1f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6882058640 1 -- 172.21.15.161:0/1376613382 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0b0c90 con 0x7f687c0afc80 2023-11-24T08:01:31.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6882058640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 0x7f687c0b0130 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f687402c510 tx=0x7f687402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:31.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687403c040 con 0x7f687c0afc80 2023-11-24T08:01:31.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687402ccb0 con 0x7f687c0afc80 2023-11-24T08:01:31.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874007270 con 0x7f687c0afc80 2023-11-24T08:01:31.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.408+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687c0b0f70 con 0x7f687c0afc80 2023-11-24T08:01:31.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.409+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687c0b0670 con 0x7f687c0afc80 2023-11-24T08:01:31.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.410+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687c0c3fa0 con 0x7f687c0afc80 2023-11-24T08:01:31.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.411+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6874032070 con 0x7f687c0afc80 2023-11-24T08:01:31.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.412+0000 7f68727fc640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f686006ae70 0x7f686006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.412+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f68740aa200 con 0x7f687c0afc80 2023-11-24T08:01:31.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.413+0000 7f6881857640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f686006ae70 0x7f686006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.414+0000 7f6881857640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f686006ae70 0x7f686006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6878001c90 tx=0x7f6878009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:31.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.417+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f687c0c3fa0 con 0x7f687c0afc80 2023-11-24T08:01:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.609+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f687c0c3fa0 con 0x7f687c0afc80 2023-11-24T08:01:31.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.612+0000 7f68727fc640 1 -- 172.21.15.161:0/1376613382 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7f6874075230 con 0x7f687c0afc80 2023-11-24T08:01:31.613 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:31.613 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f686006ae70 msgr2=0x7f686006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f686006ae70 0x7f686006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6878001c90 tx=0x7f6878009040 comp rx=0 tx=0).stop 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 msgr2=0x7f687c0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 0x7f687c0b0130 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f687402c510 tx=0x7f687402e070 comp rx=0 tx=0).stop 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 shutdown_connections 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f686006ae70 0x7f686006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f687c0afc80 0x7f687c0b0130 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f687c1f1dd0 0x7f687c1f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 --2- 172.21.15.161:0/1376613382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6868004d00 0x7f687c0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 >> 172.21.15.161:0/1376613382 conn(0x7f687c06a800 msgr2=0x7f687c0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:31.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 shutdown_connections 2023-11-24T08:01:31.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.615+0000 7f6883abb640 1 -- 172.21.15.161:0/1376613382 wait complete. 2023-11-24T08:01:31.639 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:01:31.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:01:31.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.853+0000 7f75dda7c640 1 Processor -- start 2023-11-24T08:01:31.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.854+0000 7f75dda7c640 1 -- start start 2023-11-24T08:01:31.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.855+0000 7f75dda7c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f75d80ae5a0 0x7f75d815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.855+0000 7f75dda7c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75d80b3ae0 0x7f75d806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.855+0000 7f75dda7c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d8070c40 con 0x7f75d806d120 2023-11-24T08:01:31.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.855+0000 7f75dda7c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d8071450 con 0x7f75d80ae5a0 2023-11-24T08:01:31.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.855+0000 7f75dda7c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d806c470 con 0x7f75d80b3ae0 2023-11-24T08:01:31.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f75d80ae5a0 0x7f75d815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f75d80ae5a0 0x7f75d815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38226/0 (socket says 172.21.15.161:38226) 2023-11-24T08:01:31.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 -- 172.21.15.161:0/1338596579 learned_addr learned my addr 172.21.15.161:0/1338596579 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:31.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75cffff640 1 --2- 172.21.15.161:0/1338596579 >> v2:172.21.15.175:3300/0 conn(0x7f75d80b3ae0 0x7f75d806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 -- 172.21.15.161:0/1338596579 >> v2:172.21.15.175:3300/0 conn(0x7f75d80b3ae0 msgr2=0x7f75d806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:31.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 --2- 172.21.15.161:0/1338596579 >> v2:172.21.15.175:3300/0 conn(0x7f75d80b3ae0 0x7f75d806cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 -- 172.21.15.161:0/1338596579 >> v1:172.21.15.175:6789/0 conn(0x7f75d806d120 legacy=0x7f75d80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:31.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.856+0000 7f75d77fe640 1 -- 172.21.15.161:0/1338596579 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d806c750 con 0x7f75d80ae5a0 2023-11-24T08:01:31.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.857+0000 7f75d77fe640 1 --2- 172.21.15.161:0/1338596579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80ae5a0 0x7f75d815e430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f75d80cfea0 tx=0x7f75c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf0e44ece7a3f60 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:31.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75d6ffd640 1 -- 172.21.15.161:0/1338596579 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8031870 con 0x7f75d80ae5a0 2023-11-24T08:01:31.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75d6ffd640 1 -- 172.21.15.161:0/1338596579 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c80319d0 con 0x7f75d80ae5a0 2023-11-24T08:01:31.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75d6ffd640 1 -- 172.21.15.161:0/1338596579 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8031d60 con 0x7f75d80ae5a0 2023-11-24T08:01:31.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 -- 172.21.15.161:0/1338596579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80ae5a0 msgr2=0x7f75d815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1338596579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80ae5a0 0x7f75d815e430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f75d80cfea0 tx=0x7f75c802b910 comp rx=0 tx=0).stop 2023-11-24T08:01:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 -- 172.21.15.161:0/1338596579 shutdown_connections 2023-11-24T08:01:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1338596579 >> v2:172.21.15.175:3300/0 conn(0x7f75d80b3ae0 0x7f75d806cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1338596579 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80ae5a0 0x7f75d815e430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 -- 172.21.15.161:0/1338596579 >> 172.21.15.161:0/1338596579 conn(0x7f75d806a800 msgr2=0x7f75d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:31.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 -- 172.21.15.161:0/1338596579 shutdown_connections 2023-11-24T08:01:31.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.858+0000 7f75dda7c640 1 -- 172.21.15.161:0/1338596579 wait complete. 2023-11-24T08:01:31.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.860+0000 7f75dda7c640 1 Processor -- start 2023-11-24T08:01:31.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.861+0000 7f75dda7c640 1 -- start start 2023-11-24T08:01:31.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75dda7c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d806d120 0x7f75d8152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75dda7c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75d80ae5a0 0x7f75d80cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75dda7c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 0x7f75d8160f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75dda7c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8152ed0 con 0x7f75d80b3ae0 2023-11-24T08:01:31.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75dda7c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80cc9e0 con 0x7f75d806d120 2023-11-24T08:01:31.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75dda7c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d80cccc0 con 0x7f75d80ae5a0 2023-11-24T08:01:31.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75d7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 0x7f75d8160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75d7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 0x7f75d8160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38234/0 (socket says 172.21.15.161:38234) 2023-11-24T08:01:31.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75d7fff640 1 -- 172.21.15.161:0/1307514595 learned_addr learned my addr 172.21.15.161:0/1307514595 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:31.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.862+0000 7f75d77fe640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d806d120 0x7f75d8152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75cffff640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75d80ae5a0 0x7f75d80cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d7fff640 1 -- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75d80ae5a0 msgr2=0x7f75d80cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d7fff640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75d80ae5a0 0x7f75d80cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d7fff640 1 -- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d806d120 msgr2=0x7f75d8152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:31.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d7fff640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d806d120 0x7f75d8152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:31.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d7fff640 1 -- 172.21.15.161:0/1307514595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80094d0 con 0x7f75d80b3ae0 2023-11-24T08:01:31.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d77fe640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d806d120 0x7f75d8152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:31.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d7fff640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 0x7f75d8160f30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c780 tx=0x7f75d000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:31.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d0003d80 con 0x7f75d80b3ae0 2023-11-24T08:01:31.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000ce90 con 0x7f75d80b3ae0 2023-11-24T08:01:31.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00052b0 con 0x7f75d80b3ae0 2023-11-24T08:01:31.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8156bc0 con 0x7f75d80b3ae0 2023-11-24T08:01:31.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.863+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8157180 con 0x7f75d80b3ae0 2023-11-24T08:01:31.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.864+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d806cbc0 con 0x7f75d80b3ae0 2023-11-24T08:01:31.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.866+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f75d0005410 con 0x7f75d80b3ae0 2023-11-24T08:01:31.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.867+0000 7f75d4ff9640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f75b806ae40 0x7f75b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:31.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.867+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f75d0088c00 con 0x7f75d80b3ae0 2023-11-24T08:01:31.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.867+0000 7f75d77fe640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f75b806ae40 0x7f75b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:31.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.868+0000 7f75d77fe640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f75b806ae40 0x7f75b806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75c8036000 tx=0x7f75c803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:31.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:31.871+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f75d0053b90 con 0x7f75d80b3ae0 2023-11-24T08:01:32.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.102+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75d80675d0 con 0x7f75d80b3ae0 2023-11-24T08:01:32.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.103+0000 7f75d4ff9640 1 -- 172.21.15.161:0/1307514595 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f75d0017020 con 0x7f75d80b3ae0 2023-11-24T08:01:32.117 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:32.118 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:01:32.119 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:01:32.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f75b806ae40 msgr2=0x7f75b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f75b806ae40 0x7f75b806d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75c8036000 tx=0x7f75c803c040 comp rx=0 tx=0).stop 2023-11-24T08:01:32.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 msgr2=0x7f75d8160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 0x7f75d8160f30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f75d000c780 tx=0x7f75d000cc40 comp rx=0 tx=0).stop 2023-11-24T08:01:32.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 shutdown_connections 2023-11-24T08:01:32.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f75b806ae40 0x7f75b806d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75d80b3ae0 0x7f75d8160f30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75d80ae5a0 0x7f75d80cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 --2- 172.21.15.161:0/1307514595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f75d806d120 0x7f75d8152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.106+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 >> 172.21.15.161:0/1307514595 conn(0x7f75d806a800 msgr2=0x7f75d80cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:32.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.107+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 shutdown_connections 2023-11-24T08:01:32.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.107+0000 7f75dda7c640 1 -- 172.21.15.161:0/1307514595 wait complete. 2023-11-24T08:01:32.124 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:01:32.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.335+0000 7f5e53239640 1 Processor -- start 2023-11-24T08:01:32.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.335+0000 7f5e53239640 1 -- start start 2023-11-24T08:01:32.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.336+0000 7f5e53239640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 0x7f5e4c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.336+0000 7f5e53239640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5e4c0cd530 0x7f5e4c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.336+0000 7f5e53239640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4c0cdec0 con 0x7f5e4c0cd9b0 2023-11-24T08:01:32.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.336+0000 7f5e53239640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4c0ce1a0 con 0x7f5e4c0cd530 2023-11-24T08:01:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.336+0000 7f5e53239640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0ce480 con 0x7f5e4c13cfa0 2023-11-24T08:01:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e52a38640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5e4c0cd9b0 0x7f5e4c15d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33024/0 (socket says 172.21.15.161:33024) 2023-11-24T08:01:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e52a38640 1 -- 172.21.15.161:0/1093551371 learned_addr learned my addr 172.21.15.161:0/1093551371 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:32.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e52237640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 0x7f5e4c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e51a36640 1 --2- 172.21.15.161:0/1093551371 >> v2:172.21.15.175:3300/0 conn(0x7f5e4c0cd530 0x7f5e4c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503188415 0 0) 0x7f5e4c0cdec0 con 0x7f5e4c0cd9b0 2023-11-24T08:01:32.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e38003520 con 0x7f5e4c0cd9b0 2023-11-24T08:01:32.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 28386896 0 0) 0x7f5e38003520 con 0x7f5e4c0cd9b0 2023-11-24T08:01:32.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 msgr2=0x7f5e4c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:32.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.337+0000 7f5e51235640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 0x7f5e4c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 >> v2:172.21.15.175:3300/0 conn(0x7f5e4c0cd530 msgr2=0x7f5e4c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:32.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 --2- 172.21.15.161:0/1093551371 >> v2:172.21.15.175:3300/0 conn(0x7f5e4c0cd530 0x7f5e4c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0ce760 con 0x7f5e4c0cd9b0 2023-11-24T08:01:32.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f5e44001a10 con 0x7f5e4c0cd9b0 2023-11-24T08:01:32.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 >> v1:172.21.15.161:6789/0 conn(0x7f5e4c0cd9b0 legacy=0x7f5e4c15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 0x7f5e380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e38004d00 0x7f5e38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0ce1a0 con 0x7f5e38003970 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0ce480 con 0x7f5e38004d00 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3800dbc0 con 0x7f5e4c13cfa0 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e52237640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e51a36640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 0x7f5e380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e52237640 1 -- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 msgr2=0x7f5e380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e52237640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c13cfa0 0x7f5e380047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e52237640 1 -- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e38004d00 msgr2=0x7f5e38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e52237640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e38004d00 0x7f5e38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.338+0000 7f5e52237640 1 -- 172.21.15.161:0/1093551371 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38003520 con 0x7f5e38003970 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.339+0000 7f5e52237640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e38003d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009ac0 tx=0x7f5e380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e01cc86385b021 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:32.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4802c6b0 con 0x7f5e38003970 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4802c810 con 0x7f5e38003970 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e51235640 1 -- 172.21.15.161:0/1093551371 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4802cba0 con 0x7f5e38003970 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e53239640 1 -- 172.21.15.161:0/1093551371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 msgr2=0x7f5e38003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e53239640 1 --2- 172.21.15.161:0/1093551371 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e38003d90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009ac0 tx=0x7f5e380057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e52a38640 1 -- 172.21.15.161:0/1093551371 reap_dead start 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e53239640 1 -- 172.21.15.161:0/1093551371 shutdown_connections 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e53239640 1 -- 172.21.15.161:0/1093551371 >> 172.21.15.161:0/1093551371 conn(0x7f5e4c06a800 msgr2=0x7f5e4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e53239640 1 -- 172.21.15.161:0/1093551371 shutdown_connections 2023-11-24T08:01:32.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.340+0000 7f5e53239640 1 -- 172.21.15.161:0/1093551371 wait complete. 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.342+0000 7f5e53239640 1 Processor -- start 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.342+0000 7f5e53239640 1 -- start start 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.343+0000 7f5e53239640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e4c13c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.343+0000 7f5e53239640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c0ad210 0x7f5e4c0ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.343+0000 7f5e53239640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c1e27e0 0x7f5e4c1e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.343+0000 7f5e53239640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c1f35a0 con 0x7f5e38003970 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.343+0000 7f5e53239640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c1554d0 con 0x7f5e4c1e27e0 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.343+0000 7f5e53239640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4c0ae690 con 0x7f5e4c0ad210 2023-11-24T08:01:32.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e4c13c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e4c13c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38244/0 (socket says 172.21.15.161:38244) 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 -- 172.21.15.161:0/3194689839 learned_addr learned my addr 172.21.15.161:0/3194689839 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 -- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c0ad210 msgr2=0x7f5e4c0ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c0ad210 0x7f5e4c0ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 -- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c1e27e0 msgr2=0x7f5e4c1e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c1e27e0 0x7f5e4c1e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 -- 172.21.15.161:0/3194689839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c1556e0 con 0x7f5e38003970 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.344+0000 7f5e52237640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e4c13c1c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009ac0 tx=0x7f5e48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.345+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48003810 con 0x7f5e38003970 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.345+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e48003970 con 0x7f5e38003970 2023-11-24T08:01:32.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.345+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4c1559c0 con 0x7f5e38003970 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.345+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e48003d00 con 0x7f5e38003970 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.345+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4c155f80 con 0x7f5e38003970 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.346+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c067450 con 0x7f5e38003970 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.347+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e48040450 con 0x7f5e38003970 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.348+0000 7f5e42ffd640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e3006ae40 0x7f5e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.348+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5e480ab710 con 0x7f5e38003970 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.349+0000 7f5e51a36640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e3006ae40 0x7f5e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.350+0000 7f5e51a36640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e3006ae40 0x7f5e3006d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c1f6b40 tx=0x7f5e3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:32.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.353+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e480766a0 con 0x7f5e38003970 2023-11-24T08:01:32.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.581+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e4c15b090 con 0x7f5e38003970 2023-11-24T08:01:32.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.582+0000 7f5e42ffd640 1 -- 172.21.15.161:0/3194689839 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4919 (secure 0 0 0) 0x7f5e480044e0 con 0x7f5e38003970 2023-11-24T08:01:32.583 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:32.584 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4211,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/3423278706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":3423278706},{"type":"v1","addr":"172.21.15.161:6835","nonce":3423278706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4212,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3794966668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3794966668},{"type":"v1","addr":"172.21.15.161:6834","nonce":3794966668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4224,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2084286403","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2084286403},{"type":"v1","addr":"172.21.15.175:6835","nonce":2084286403}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:00:25.921462+0000","modified":"2023-11-24T08:00:29.255218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6837/1099349504","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":1099349504},{"type":"v1","addr":"172.21.15.175:6837","nonce":1099349504}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T08:01:32.584 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 8 2023-11-24T08:01:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e3006ae40 msgr2=0x7f5e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e3006ae40 0x7f5e3006d300 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c1f6b40 tx=0x7f5e3c008040 comp rx=0 tx=0).stop 2023-11-24T08:01:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 msgr2=0x7f5e4c13c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e4c13c1c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5e48009ac0 tx=0x7f5e48004730 comp rx=0 tx=0).stop 2023-11-24T08:01:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 shutdown_connections 2023-11-24T08:01:32.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5e3006ae40 0x7f5e3006d300 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5e4c1e27e0 0x7f5e4c1e2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5e4c0ad210 0x7f5e4c0ad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 --2- 172.21.15.161:0/3194689839 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5e38003970 0x7f5e4c13c1c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.585+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 >> 172.21.15.161:0/3194689839 conn(0x7f5e4c06a800 msgr2=0x7f5e4c0af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.586+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 shutdown_connections 2023-11-24T08:01:32.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.586+0000 7f5e53239640 1 -- 172.21.15.161:0/3194689839 wait complete. 2023-11-24T08:01:32.604 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:32.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.805+0000 7fecb746b640 1 Processor -- start 2023-11-24T08:01:32.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.805+0000 7fecb746b640 1 -- start start 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.806+0000 7fecb746b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb00cf9a0 0x7fecb015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.806+0000 7fecb746b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fecb015e1e0 0x7fecb00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb746b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb00b1ee0 con 0x7fecb0143ae0 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb746b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00b2780 con 0x7fecb015e1e0 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb746b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb015e990 con 0x7fecb00cf9a0 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5207640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fecb0143ae0 0x7fecb00cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33036/0 (socket says 172.21.15.161:33036) 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5207640 1 -- 172.21.15.161:0/1926415966 learned_addr learned my addr 172.21.15.161:0/1926415966 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:32.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5a08640 1 --2- 172.21.15.161:0/1926415966 >> v2:172.21.15.161:3300/0 conn(0x7fecb015e1e0 0x7fecb00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7feca7fff640 1 -- 172.21.15.161:0/1926415966 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752542534 0 0) 0x7fecb00b1ee0 con 0x7fecb0143ae0 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5a08640 1 -- 172.21.15.161:0/1926415966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb00cf9a0 msgr2=0x7fecb015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb4a06640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb00cf9a0 0x7fecb015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5a08640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb00cf9a0 0x7fecb015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5a08640 1 -- 172.21.15.161:0/1926415966 >> v1:172.21.15.161:6789/0 conn(0x7fecb0143ae0 legacy=0x7fecb00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb5a08640 1 -- 172.21.15.161:0/1926415966 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb00b2130 con 0x7fecb015e1e0 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.807+0000 7fecb4a06640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb00cf9a0 0x7fecb015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.808+0000 7fecb5a08640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb00702c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feca8009d90 tx=0x7feca802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcab30aaa39341a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7feca7fff640 1 -- 172.21.15.161:0/1926415966 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca802cc50 con 0x7fecb015e1e0 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7feca7fff640 1 -- 172.21.15.161:0/1926415966 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca802cdb0 con 0x7fecb015e1e0 2023-11-24T08:01:32.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7feca7fff640 1 -- 172.21.15.161:0/1926415966 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8034660 con 0x7fecb015e1e0 2023-11-24T08:01:32.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7fecb746b640 1 -- 172.21.15.161:0/1926415966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 msgr2=0x7fecb00702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7fecb746b640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb00702c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feca8009d90 tx=0x7feca802bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7fecb746b640 1 -- 172.21.15.161:0/1926415966 shutdown_connections 2023-11-24T08:01:32.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7fecb746b640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb00702c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7fecb746b640 1 --2- 172.21.15.161:0/1926415966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb00cf9a0 0x7fecb015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.809+0000 7fecb746b640 1 -- 172.21.15.161:0/1926415966 >> 172.21.15.161:0/1926415966 conn(0x7fecb006a800 msgr2=0x7fecb006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.810+0000 7fecb746b640 1 -- 172.21.15.161:0/1926415966 shutdown_connections 2023-11-24T08:01:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.810+0000 7fecb746b640 1 -- 172.21.15.161:0/1926415966 wait complete. 2023-11-24T08:01:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.811+0000 7fecb746b640 1 Processor -- start 2023-11-24T08:01:32.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.811+0000 7fecb746b640 1 -- start start 2023-11-24T08:01:32.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.812+0000 7fecb746b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb00cf9a0 0x7fecb01409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.812+0000 7fecb746b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb0143ae0 0x7fecb01668e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.812+0000 7fecb746b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb0158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.812+0000 7fecb746b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb0159380 con 0x7fecb015e1e0 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.812+0000 7fecb746b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00ccd50 con 0x7fecb00cf9a0 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.812+0000 7fecb746b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00cd030 con 0x7fecb0143ae0 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb0158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb0158e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38272/0 (socket says 172.21.15.161:38272) 2023-11-24T08:01:32.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 -- 172.21.15.161:0/343330101 learned_addr learned my addr 172.21.15.161:0/343330101 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5207640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb00cf9a0 0x7fecb01409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 -- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb0143ae0 msgr2=0x7fecb01668e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb4a06640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb0143ae0 0x7fecb01668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb0143ae0 0x7fecb01668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 -- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb00cf9a0 msgr2=0x7fecb01409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb00cf9a0 0x7fecb01409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 -- 172.21.15.161:0/343330101 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8009a70 con 0x7fecb015e1e0 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5207640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb00cf9a0 0x7fecb01409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:32.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.813+0000 7fecb5a08640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb0158e40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feca8009eb0 tx=0x7feca8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.814+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca803f420 con 0x7fecb015e1e0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.814+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca803f580 con 0x7fecb015e1e0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.814+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb00cd780 con 0x7fecb015e1e0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.814+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca803f8f0 con 0x7fecb015e1e0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.814+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb00cd310 con 0x7fecb015e1e0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.815+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb00cdca0 con 0x7fecb015e1e0 2023-11-24T08:01:32.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.816+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feca803fa50 con 0x7fecb015e1e0 2023-11-24T08:01:32.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.817+0000 7feca5ffb640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fec9406ae40 0x7fec9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:32.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.817+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feca80ac350 con 0x7fecb015e1e0 2023-11-24T08:01:32.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.817+0000 7fecb5207640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fec9406ae40 0x7fec9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:32.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.818+0000 7fecb5207640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fec9406ae40 0x7fec9406d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fecac000f60 tx=0x7fecac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:32.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:32.821+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fecb00cdca0 con 0x7fecb015e1e0 2023-11-24T08:01:33.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.010+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecb00cdca0 con 0x7fecb015e1e0 2023-11-24T08:01:33.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.012+0000 7feca5ffb640 1 -- 172.21.15.161:0/343330101 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16777 (secure 0 0 0) 0x7fecb00cdca0 con 0x7fecb015e1e0 2023-11-24T08:01:33.013 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:33.014 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":24,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:06.496021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:00:23.689801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T08:00:24.943820+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:33.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.014+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fec9406ae40 msgr2=0x7fec9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.014+0000 7fecb746b640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fec9406ae40 0x7fec9406d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fecac000f60 tx=0x7fecac009040 comp rx=0 tx=0).stop 2023-11-24T08:01:33.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 msgr2=0x7fecb0158e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb0158e40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feca8009eb0 tx=0x7feca8004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:33.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 shutdown_connections 2023-11-24T08:01:33.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fec9406ae40 0x7fec9406d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fecb015e1e0 0x7fecb0158e40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fecb0143ae0 0x7fecb01668e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 --2- 172.21.15.161:0/343330101 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fecb00cf9a0 0x7fecb01409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 >> 172.21.15.161:0/343330101 conn(0x7fecb006a800 msgr2=0x7fecb015bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:33.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 shutdown_connections 2023-11-24T08:01:33.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.015+0000 7fecb746b640 1 -- 172.21.15.161:0/343330101 wait complete. 2023-11-24T08:01:33.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:01:33.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.252+0000 7f03de483640 1 Processor -- start 2023-11-24T08:01:33.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.253+0000 7f03de483640 1 -- start start 2023-11-24T08:01:33.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.254+0000 7f03de483640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f03d8099a60 0x7f03d8099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.254+0000 7f03de483640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80cfa70 con 0x7f03d815e880 2023-11-24T08:01:33.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.254+0000 7f03de483640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d809a3e0 con 0x7f03d806e7c0 2023-11-24T08:01:33.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.254+0000 7f03de483640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d80cff00 con 0x7f03d8099a60 2023-11-24T08:01:33.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.254+0000 7f03d7fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f03d815e880 0x7f03d806ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33050/0 (socket says 172.21.15.161:33050) 2023-11-24T08:01:33.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.254+0000 7f03d7fff640 1 -- 172.21.15.161:0/1554945525 learned_addr learned my addr 172.21.15.161:0/1554945525 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d77fe640 1 --2- 172.21.15.161:0/1554945525 >> v2:172.21.15.175:3300/0 conn(0x7f03d8099a60 0x7f03d8099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372988183 0 0) 0x7f03d80cfa70 con 0x7f03d815e880 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c4003520 con 0x7f03d815e880 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363994442 0 0) 0x7f03c4003520 con 0x7f03d815e880 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 >> v2:172.21.15.175:3300/0 conn(0x7f03d8099a60 msgr2=0x7f03d8099ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 --2- 172.21.15.161:0/1554945525 >> v2:172.21.15.175:3300/0 conn(0x7f03d8099a60 0x7f03d8099ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 >> v1:172.21.15.175:6789/0 conn(0x7f03d806e7c0 legacy=0x7f03d806ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d806fc70 con 0x7f03d815e880 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f03c8001670 con 0x7f03d815e880 2023-11-24T08:01:33.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 >> v1:172.21.15.161:6789/0 conn(0x7f03d815e880 legacy=0x7f03d806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.255+0000 7f03d6ffd640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03c4003970 0x7f03c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d6ffd640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c40047c0 0x7f03c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d6ffd640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80cff00 con 0x7f03c4005180 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c400c030 con 0x7f03c4003970 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c400c1f0 con 0x7f03c40047c0 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03dca20640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d77fe640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c40047c0 0x7f03c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d7fff640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03c4003970 0x7f03c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03dca20640 1 -- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c40047c0 msgr2=0x7f03c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03dca20640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03c40047c0 0x7f03c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03dca20640 1 -- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03c4003970 msgr2=0x7f03c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03dca20640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03c4003970 0x7f03c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03dca20640 1 -- 172.21.15.161:0/1554945525 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4003520 con 0x7f03c4005180 2023-11-24T08:01:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.256+0000 7f03d7fff640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03c4003970 0x7f03c4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.257+0000 7f03dca20640 1 -- 172.21.15.161:0/1554945525 reap_dead start 2023-11-24T08:01:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.257+0000 7f03dca20640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03c400b980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f03d0001e50 tx=0x7f03c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20f7da565c9ccc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0003b70 con 0x7f03c4005180 2023-11-24T08:01:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d0003d10 con 0x7f03c4005180 2023-11-24T08:01:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03d6ffd640 1 -- 172.21.15.161:0/1554945525 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d0005310 con 0x7f03c4005180 2023-11-24T08:01:33.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 -- 172.21.15.161:0/1554945525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 msgr2=0x7f03c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03c400b980 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f03d0001e50 tx=0x7f03c40057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 -- 172.21.15.161:0/1554945525 shutdown_connections 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 --2- 172.21.15.161:0/1554945525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03c400b980 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 -- 172.21.15.161:0/1554945525 >> 172.21.15.161:0/1554945525 conn(0x7f03d80b2d00 msgr2=0x7f03d80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 -- 172.21.15.161:0/1554945525 shutdown_connections 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.258+0000 7f03de483640 1 -- 172.21.15.161:0/1554945525 wait complete. 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.260+0000 7f03de483640 1 Processor -- start 2023-11-24T08:01:33.262 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.260+0000 7f03de483640 1 -- start start 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03de483640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03d809beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03de483640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03d815d620 0x7f03d809e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03de483640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03d80c7030 0x7f03d80c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03de483640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80c79f0 con 0x7f03c4005180 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03de483640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80c82e0 con 0x7f03d815d620 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03de483640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d809eab0 con 0x7f03d80c7030 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.261+0000 7f03d7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03d809beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03d809beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38290/0 (socket says 172.21.15.161:38290) 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 -- 172.21.15.161:0/2423962137 learned_addr learned my addr 172.21.15.161:0/2423962137 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d77fe640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03d815d620 0x7f03d809e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03dca20640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03d80c7030 0x7f03d80c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 -- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03d80c7030 msgr2=0x7f03d80c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03d80c7030 0x7f03d80c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 -- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03d815d620 msgr2=0x7f03d809e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03d815d620 0x7f03d809e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 -- 172.21.15.161:0/2423962137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d809ed90 con 0x7f03c4005180 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d77fe640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03d815d620 0x7f03d809e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.262+0000 7f03d7fff640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03d809beb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d810 tx=0x7f03c800dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.263+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80074e0 con 0x7f03c4005180 2023-11-24T08:01:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.263+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c8007640 con 0x7f03c4005180 2023-11-24T08:01:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.263+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80049e0 con 0x7f03c4005180 2023-11-24T08:01:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.263+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80c8530 con 0x7f03c4005180 2023-11-24T08:01:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.263+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d809e6f0 con 0x7f03c4005180 2023-11-24T08:01:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.264+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d80675d0 con 0x7f03c4005180 2023-11-24T08:01:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.265+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03c8004b40 con 0x7f03c4005180 2023-11-24T08:01:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.266+0000 7f03d4ff9640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f03b806ae70 0x7f03b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.266+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f03c8088fd0 con 0x7f03c4005180 2023-11-24T08:01:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.266+0000 7f03d77fe640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f03b806ae70 0x7f03b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.267+0000 7f03d77fe640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f03b806ae70 0x7f03b806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f03d80c7b80 tx=0x7f03c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:33.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.270+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03c8053ff0 con 0x7f03c4005180 2023-11-24T08:01:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.499+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f03d80c6270 con 0x7f03c4005180 2023-11-24T08:01:33.501 INFO:tasks.ceph.mon.a.smithi161.stderr:2023-11-24T08:01:33.500+0000 7f2aa1f75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:01:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.503+0000 7f03d4ff9640 1 -- 172.21.15.161:0/2423962137 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f03c8019090 con 0x7f03c4005180 2023-11-24T08:01:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:01:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f03b806ae70 msgr2=0x7f03b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f03b806ae70 0x7f03b806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f03d80c7b80 tx=0x7f03c0008040 comp rx=0 tx=0).stop 2023-11-24T08:01:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 msgr2=0x7f03d809beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03d809beb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d810 tx=0x7f03c800dcd0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 shutdown_connections 2023-11-24T08:01:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f03b806ae70 0x7f03b806d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f03d80c7030 0x7f03d80c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f03d815d620 0x7f03d809e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 --2- 172.21.15.161:0/2423962137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f03c4005180 0x7f03d809beb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 >> 172.21.15.161:0/2423962137 conn(0x7f03d80b2d00 msgr2=0x7f03d80c6490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:33.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.506+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 shutdown_connections 2023-11-24T08:01:33.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.507+0000 7f03de483640 1 -- 172.21.15.161:0/2423962137 wait complete. 2023-11-24T08:01:33.526 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:01:33.533 INFO:tasks.ceph.mds.d.smithi175.stderr: -3638> 2023-11-24T08:00:29.517+0000 7f514119c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:01:33.624 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-24T08:01:33.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.729+0000 7ffa3ece0640 1 Processor -- start 2023-11-24T08:01:33.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.729+0000 7ffa3ece0640 1 -- start start 2023-11-24T08:01:33.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.730+0000 7ffa3ece0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffa3813e360 0x7ffa380cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.730+0000 7ffa3ece0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 0x7ffa380cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.730+0000 7ffa3ece0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3815c5f0 con 0x7ffa3813df80 2023-11-24T08:01:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.730+0000 7ffa3ece0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3806c470 con 0x7ffa3813e360 2023-11-24T08:01:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.730+0000 7ffa3ece0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3806c750 con 0x7ffa3815f9c0 2023-11-24T08:01:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa3ca7c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ffa3813df80 0x7ffa3815bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33066/0 (socket says 172.21.15.161:33066) 2023-11-24T08:01:33.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa3ca7c640 1 -- 172.21.15.161:0/1095077616 learned_addr learned my addr 172.21.15.161:0/1095077616 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:33.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869968340 0 0) 0x7ffa3815c5f0 con 0x7ffa3813df80 2023-11-24T08:01:33.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 0x7ffa380cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa37fff640 1 --2- 172.21.15.161:0/1095077616 >> v2:172.21.15.175:3300/0 conn(0x7ffa3813e360 0x7ffa380cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa28003520 con 0x7ffa3813df80 2023-11-24T08:01:33.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 799007778 0 0) 0x7ffa28003520 con 0x7ffa3813df80 2023-11-24T08:01:33.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 msgr2=0x7ffa380cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 0x7ffa380cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 >> v2:172.21.15.175:3300/0 conn(0x7ffa3813e360 msgr2=0x7ffa380cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 --2- 172.21.15.161:0/1095077616 >> v2:172.21.15.175:3300/0 conn(0x7ffa3813e360 0x7ffa380cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3806ca30 con 0x7ffa3813df80 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7ffa2c001690 con 0x7ffa3813df80 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa37fff640 1 --2- 172.21.15.161:0/1095077616 >> v2:172.21.15.175:3300/0 conn(0x7ffa3813e360 0x7ffa380cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:33.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.731+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 >> v1:172.21.15.161:6789/0 conn(0x7ffa3813df80 legacy=0x7ffa3815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa377fe640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 0x7ffa28003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa377fe640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28003fa0 0x7ffa280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa377fe640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa28004d00 0x7ffa28005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3806c470 con 0x7ffa28004d00 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3806c750 con 0x7ffa28003fa0 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2800ba80 con 0x7ffa3815f9c0 2023-11-24T08:01:33.740 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa28004d00 0x7ffa28005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3ca7c640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 0x7ffa28003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa37fff640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28003fa0 0x7ffa280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3d27d640 1 -- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 msgr2=0x7ffa28003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3815f9c0 0x7ffa28003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3d27d640 1 -- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28003fa0 msgr2=0x7ffa280047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28003fa0 0x7ffa280047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa3d27d640 1 -- 172.21.15.161:0/1095077616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28003520 con 0x7ffa28004d00 2023-11-24T08:01:33.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.732+0000 7ffa37fff640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28003fa0 0x7ffa280047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:33.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.733+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa28004d00 0x7ffa28005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffa30007330 tx=0x7ffa280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10f11d0247bfd0e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:33.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3002cca0 con 0x7ffa28004d00 2023-11-24T08:01:33.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3002ce00 con 0x7ffa28004d00 2023-11-24T08:01:33.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa377fe640 1 -- 172.21.15.161:0/1095077616 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30034680 con 0x7ffa28004d00 2023-11-24T08:01:33.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3ece0640 1 -- 172.21.15.161:0/1095077616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa28004d00 msgr2=0x7ffa28005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/1095077616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa28004d00 0x7ffa28005180 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ffa30007330 tx=0x7ffa280057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3d27d640 1 -- 172.21.15.161:0/1095077616 reap_dead start 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3ece0640 1 -- 172.21.15.161:0/1095077616 shutdown_connections 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3ece0640 1 -- 172.21.15.161:0/1095077616 >> 172.21.15.161:0/1095077616 conn(0x7ffa3806a800 msgr2=0x7ffa3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3ece0640 1 -- 172.21.15.161:0/1095077616 shutdown_connections 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.734+0000 7ffa3ece0640 1 -- 172.21.15.161:0/1095077616 wait complete. 2023-11-24T08:01:33.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.736+0000 7ffa3ece0640 1 Processor -- start 2023-11-24T08:01:33.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.736+0000 7ffa3ece0640 1 -- start start 2023-11-24T08:01:33.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3ece0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28004d00 0x7ffa3813d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3ece0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3814e080 0x7ffa3814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3ece0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 0x7ffa380b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3ece0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380b41f0 con 0x7ffa380b3830 2023-11-24T08:01:33.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3ece0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa381f16b0 con 0x7ffa28004d00 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3ece0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3814d5f0 con 0x7ffa3814e080 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.737+0000 7ffa3d27d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 0x7ffa380b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 0x7ffa380b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38304/0 (socket says 172.21.15.161:38304) 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 -- 172.21.15.161:0/2765474388 learned_addr learned my addr 172.21.15.161:0/2765474388 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa37fff640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3814e080 0x7ffa3814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3ca7c640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28004d00 0x7ffa3813d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 -- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3814e080 msgr2=0x7ffa3814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3814e080 0x7ffa3814e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 -- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28004d00 msgr2=0x7ffa3813d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28004d00 0x7ffa3813d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 -- 172.21.15.161:0/2765474388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3814d030 con 0x7ffa380b3830 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa3d27d640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 0x7ffa380b3cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa30007330 tx=0x7ffa30004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3003e640 con 0x7ffa380b3830 2023-11-24T08:01:33.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3003e7a0 con 0x7ffa380b3830 2023-11-24T08:01:33.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.738+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3003eb10 con 0x7ffa380b3830 2023-11-24T08:01:33.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.739+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa3814d310 con 0x7ffa380b3830 2023-11-24T08:01:33.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.739+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3814c1e0 con 0x7ffa380b3830 2023-11-24T08:01:33.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.740+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3814c3d0 con 0x7ffa380b3830 2023-11-24T08:01:33.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.741+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa3003ec70 con 0x7ffa380b3830 2023-11-24T08:01:33.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.741+0000 7ffa357fa640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffa1c06ae40 0x7ffa1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:33.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.742+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ffa300abb50 con 0x7ffa380b3830 2023-11-24T08:01:33.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.742+0000 7ffa3ca7c640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffa1c06ae40 0x7ffa1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:33.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.743+0000 7ffa3ca7c640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffa1c06ae40 0x7ffa1c06d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c000f60 tx=0x7ffa2c000ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:33.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.746+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa30076b20 con 0x7ffa380b3830 2023-11-24T08:01:33.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:33.966+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ffa380675d0 con 0x7ffa380b3830 2023-11-24T08:01:34.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.506+0000 7ffa357fa640 1 -- 172.21.15.161:0/2765474388 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffa3007a140 con 0x7ffa380b3830 2023-11-24T08:01:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffa1c06ae40 msgr2=0x7ffa1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffa1c06ae40 0x7ffa1c06d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c000f60 tx=0x7ffa2c000ed0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 msgr2=0x7ffa380b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 0x7ffa380b3cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa30007330 tx=0x7ffa30004ab0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 shutdown_connections 2023-11-24T08:01:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffa1c06ae40 0x7ffa1c06d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffa380b3830 0x7ffa380b3cb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa3814e080 0x7ffa3814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 --2- 172.21.15.161:0/2765474388 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa28004d00 0x7ffa3813d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.510+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 >> 172.21.15.161:0/2765474388 conn(0x7ffa3806a800 msgr2=0x7ffa3815cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:34.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.511+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 shutdown_connections 2023-11-24T08:01:34.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.511+0000 7ffa3ece0640 1 -- 172.21.15.161:0/2765474388 wait complete. 2023-11-24T08:01:34.533 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:01:34.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.748+0000 7fa0a0368640 1 Processor -- start 2023-11-24T08:01:34.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.748+0000 7fa0a0368640 1 -- start start 2023-11-24T08:01:34.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa0a0368640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa09813df80 0x7fa09815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:34.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa0a0368640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa0980cf9a0 0x7fa0980cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:34.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa0a0368640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa09806c470 con 0x7fa09813e360 2023-11-24T08:01:34.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa0a0368640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09806c750 con 0x7fa09813df80 2023-11-24T08:01:34.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa0a0368640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09806ca30 con 0x7fa0980cf9a0 2023-11-24T08:01:34.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa09e104640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa09813df80 0x7fa09815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:34.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa09d903640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa09813e360 0x7fa0980cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33078/0 (socket says 172.21.15.161:33078) 2023-11-24T08:01:34.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.750+0000 7fa09d903640 1 -- 172.21.15.161:0/3633056168 learned_addr learned my addr 172.21.15.161:0/3633056168 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.751+0000 7fa09e905640 1 --2- 172.21.15.161:0/3633056168 >> v2:172.21.15.175:3300/0 conn(0x7fa0980cf9a0 0x7fa0980cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.751+0000 7fa09e104640 1 -- 172.21.15.161:0/3633056168 >> v2:172.21.15.175:3300/0 conn(0x7fa0980cf9a0 msgr2=0x7fa0980cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.751+0000 7fa09e104640 1 --2- 172.21.15.161:0/3633056168 >> v2:172.21.15.175:3300/0 conn(0x7fa0980cf9a0 0x7fa0980cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.751+0000 7fa09e104640 1 -- 172.21.15.161:0/3633056168 >> v1:172.21.15.161:6789/0 conn(0x7fa09813e360 legacy=0x7fa0980cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.751+0000 7fa09d102640 1 -- 172.21.15.161:0/3633056168 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166201933 0 0) 0x7fa09806c470 con 0x7fa09813e360 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.751+0000 7fa09e104640 1 -- 172.21.15.161:0/3633056168 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09806cd10 con 0x7fa09813df80 2023-11-24T08:01:34.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.752+0000 7fa09e104640 1 --2- 172.21.15.161:0/3633056168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa09813df80 0x7fa09815bee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0980ccb10 tx=0x7fa09402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead5e65a56b8a8ae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:34.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.752+0000 7fa09d102640 1 -- 172.21.15.161:0/3633056168 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094031830 con 0x7fa09813df80 2023-11-24T08:01:34.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.752+0000 7fa09d102640 1 -- 172.21.15.161:0/3633056168 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094031990 con 0x7fa09813df80 2023-11-24T08:01:34.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.752+0000 7fa09d102640 1 -- 172.21.15.161:0/3633056168 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094031d20 con 0x7fa09813df80 2023-11-24T08:01:34.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 -- 172.21.15.161:0/3633056168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa09813df80 msgr2=0x7fa09815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:34.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 --2- 172.21.15.161:0/3633056168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa09813df80 0x7fa09815bee0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa0980ccb10 tx=0x7fa09402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 -- 172.21.15.161:0/3633056168 shutdown_connections 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 --2- 172.21.15.161:0/3633056168 >> v2:172.21.15.175:3300/0 conn(0x7fa0980cf9a0 0x7fa0980cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 --2- 172.21.15.161:0/3633056168 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa09813df80 0x7fa09815bee0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 -- 172.21.15.161:0/3633056168 >> 172.21.15.161:0/3633056168 conn(0x7fa09806a800 msgr2=0x7fa09806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 -- 172.21.15.161:0/3633056168 shutdown_connections 2023-11-24T08:01:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.753+0000 7fa0a0368640 1 -- 172.21.15.161:0/3633056168 wait complete. 2023-11-24T08:01:34.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.755+0000 7fa0a0368640 1 Processor -- start 2023-11-24T08:01:34.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.755+0000 7fa0a0368640 1 -- start start 2023-11-24T08:01:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa0a0368640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 0x7fa0980b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa0a0368640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa09813df80 0x7fa09814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa0a0368640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa09813e360 0x7fa09814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa0a0368640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09814c1b0 con 0x7fa0980cf9a0 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa0a0368640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09814e250 con 0x7fa09813df80 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa0a0368640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09814b530 con 0x7fa09813e360 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa09e104640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 0x7fa0980b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa09e104640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 0x7fa0980b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38312/0 (socket says 172.21.15.161:38312) 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.756+0000 7fa09e104640 1 -- 172.21.15.161:0/2141241310 learned_addr learned my addr 172.21.15.161:0/2141241310 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09d903640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa09813df80 0x7fa09814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e905640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa09813e360 0x7fa09814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e104640 1 -- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa09813e360 msgr2=0x7fa09814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e104640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa09813e360 0x7fa09814ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e104640 1 -- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa09813df80 msgr2=0x7fa09814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e104640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa09813df80 0x7fa09814a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:34.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e104640 1 -- 172.21.15.161:0/2141241310 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa094009400 con 0x7fa0980cf9a0 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09d903640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa09813df80 0x7fa09814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa09e104640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 0x7fa0980b31c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa094009890 tx=0x7fa0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09403ba70 con 0x7fa0980cf9a0 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09403bbd0 con 0x7fa0980cf9a0 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0940453f0 con 0x7fa0980cf9a0 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09814b810 con 0x7fa0980cf9a0 2023-11-24T08:01:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.757+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09814bdd0 con 0x7fa0980cf9a0 2023-11-24T08:01:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.758+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0980675d0 con 0x7fa0980cf9a0 2023-11-24T08:01:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.759+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa094045550 con 0x7fa0980cf9a0 2023-11-24T08:01:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.760+0000 7fa08effd640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa07c06ae40 0x7fa07c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.760+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fa0940abb00 con 0x7fa0980cf9a0 2023-11-24T08:01:34.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.761+0000 7fa09d903640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa07c06ae40 0x7fa07c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:34.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.762+0000 7fa09d903640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa07c06ae40 0x7fa07c06d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa09815aa70 tx=0x7fa088009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:34.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.765+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa0940ade60 con 0x7fa0980cf9a0 2023-11-24T08:01:34.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:34.942+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa09814c4d0 con 0x7fa0980cf9a0 2023-11-24T08:01:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.803+0000 7fa08effd640 1 -- 172.21.15.161:0/2141241310 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa094035070 con 0x7fa0980cf9a0 2023-11-24T08:01:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:01:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa07c06ae40 msgr2=0x7fa07c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa07c06ae40 0x7fa07c06d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa09815aa70 tx=0x7fa088009040 comp rx=0 tx=0).stop 2023-11-24T08:01:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 msgr2=0x7fa0980b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 0x7fa0980b31c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa094009890 tx=0x7fa0940046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 shutdown_connections 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa07c06ae40 0x7fa07c06d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa09813e360 0x7fa09814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa09813df80 0x7fa09814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 --2- 172.21.15.161:0/2141241310 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0980cf9a0 0x7fa0980b31c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.807+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 >> 172.21.15.161:0/2141241310 conn(0x7fa09806a800 msgr2=0x7fa0980cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.809+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 shutdown_connections 2023-11-24T08:01:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:35.809+0000 7fa0a0368640 1 -- 172.21.15.161:0/2141241310 wait complete. 2023-11-24T08:01:35.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:01:36.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.051+0000 7fdd8ca1e640 1 Processor -- start 2023-11-24T08:01:36.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.051+0000 7fdd8ca1e640 1 -- start start 2023-11-24T08:01:36.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.053+0000 7fdd8ca1e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd8815da10 0x7fdd88072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:36.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.053+0000 7fdd8ca1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 0x7fdd880b3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:36.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.053+0000 7fdd8ca1e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd88071190 con 0x7fdd88150760 2023-11-24T08:01:36.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.053+0000 7fdd8ca1e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd88071470 con 0x7fdd8815da10 2023-11-24T08:01:36.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.053+0000 7fdd8ca1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd88071750 con 0x7fdd880b2bd0 2023-11-24T08:01:36.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd85d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd8815da10 0x7fdd88072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:36.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 0x7fdd880b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:36.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 0x7fdd880b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:36802/0 (socket says 172.21.15.161:36802) 2023-11-24T08:01:36.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 -- 172.21.15.161:0/1898121805 learned_addr learned my addr 172.21.15.161:0/1898121805 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:36.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd85d9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdd8815da10 0x7fdd88072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:33998/0 (socket says 172.21.15.161:33998) 2023-11-24T08:01:36.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 -- 172.21.15.161:0/1898121805 >> v2:172.21.15.175:3300/0 conn(0x7fdd8815da10 msgr2=0x7fdd88072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:36.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 --2- 172.21.15.161:0/1898121805 >> v2:172.21.15.175:3300/0 conn(0x7fdd8815da10 0x7fdd88072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 -- 172.21.15.161:0/1898121805 >> v1:172.21.15.175:6789/0 conn(0x7fdd88150760 legacy=0x7fdd8815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:36.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.054+0000 7fdd86d9d640 1 -- 172.21.15.161:0/1898121805 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88071a30 con 0x7fdd880b2bd0 2023-11-24T08:01:36.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.056+0000 7fdd86d9d640 1 --2- 172.21.15.161:0/1898121805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 0x7fdd880b3060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009e50 tx=0x7fdd8002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80278def494ddfe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:36.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.057+0000 7fdd8559a640 1 -- 172.21.15.161:0/1898121805 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8002cb00 con 0x7fdd880b2bd0 2023-11-24T08:01:36.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.057+0000 7fdd8559a640 1 -- 172.21.15.161:0/1898121805 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8002cc60 con 0x7fdd880b2bd0 2023-11-24T08:01:36.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.057+0000 7fdd8559a640 1 -- 172.21.15.161:0/1898121805 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800343f0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.057+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1898121805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 msgr2=0x7fdd880b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:36.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.057+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1898121805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 0x7fdd880b3060 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009e50 tx=0x7fdd8002bf60 comp rx=0 tx=0).stop 2023-11-24T08:01:36.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.058+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1898121805 shutdown_connections 2023-11-24T08:01:36.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.058+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1898121805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd880b2bd0 0x7fdd880b3060 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.058+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1898121805 >> v2:172.21.15.175:3300/0 conn(0x7fdd8815da10 0x7fdd88072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.058+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1898121805 >> 172.21.15.161:0/1898121805 conn(0x7fdd8806a800 msgr2=0x7fdd8806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:36.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.058+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1898121805 shutdown_connections 2023-11-24T08:01:36.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.058+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1898121805 wait complete. 2023-11-24T08:01:36.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.060+0000 7fdd8ca1e640 1 Processor -- start 2023-11-24T08:01:36.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.060+0000 7fdd8ca1e640 1 -- start start 2023-11-24T08:01:36.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8ca1e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 0x7fdd88147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8ca1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd88150760 0x7fdd880cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8ca1e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd8815da10 0x7fdd88155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8ca1e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881f4490 con 0x7fdd880b2bd0 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8ca1e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881f3ed0 con 0x7fdd8815da10 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8ca1e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd881f41b0 con 0x7fdd88150760 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 0x7fdd88147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 0x7fdd88147de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38322/0 (socket says 172.21.15.161:38322) 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8659c640 1 -- 172.21.15.161:0/1023039335 learned_addr learned my addr 172.21.15.161:0/1023039335 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd85d9b640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd88150760 0x7fdd880cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:36.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd86d9d640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd8815da10 0x7fdd88155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8659c640 1 -- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd88150760 msgr2=0x7fdd880cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8659c640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd88150760 0x7fdd880cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.061+0000 7fdd8659c640 1 -- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd8815da10 msgr2=0x7fdd88155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd8659c640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd8815da10 0x7fdd88155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd8659c640 1 -- 172.21.15.161:0/1023039335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009b30 con 0x7fdd880b2bd0 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd86d9d640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd8815da10 0x7fdd88155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:36.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd8659c640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 0x7fdd88147de0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c400 tx=0x7fdd7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780052d0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78005450 con 0x7fdd880b2bd0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd881486b0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007260 con 0x7fdd880b2bd0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.062+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd88149dc0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.063+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd880675d0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.064+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd780073c0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.065+0000 7fdd76ffd640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6806ae40 0x7fdd6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.065+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fdd780889d0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.066+0000 7fdd85d9b640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6806ae40 0x7fdd6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:36.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.067+0000 7fdd85d9b640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6806ae40 0x7fdd6806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd88155470 tx=0x7fdd7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:36.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.069+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd78053ac0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.272+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd8806ad60 con 0x7fdd880b2bd0 2023-11-24T08:01:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.807+0000 7fdd76ffd640 1 -- 172.21.15.161:0/1023039335 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdd780570e0 con 0x7fdd880b2bd0 2023-11-24T08:01:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.813+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6806ae40 msgr2=0x7fdd6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.813+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6806ae40 0x7fdd6806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd88155470 tx=0x7fdd7c008040 comp rx=0 tx=0).stop 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.813+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 msgr2=0x7fdd88147de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.813+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 0x7fdd88147de0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c400 tx=0x7fdd7800c8c0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 shutdown_connections 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdd6806ae40 0x7fdd6806d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdd8815da10 0x7fdd88155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdd88150760 0x7fdd880cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 --2- 172.21.15.161:0/1023039335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd880b2bd0 0x7fdd88147de0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:36.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 >> 172.21.15.161:0/1023039335 conn(0x7fdd8806a800 msgr2=0x7fdd8806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:36.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 shutdown_connections 2023-11-24T08:01:36.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:36.814+0000 7fdd8ca1e640 1 -- 172.21.15.161:0/1023039335 wait complete. 2023-11-24T08:01:36.839 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:01:36.840 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:01:36.840 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:01:36.840 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:36.840 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:01:36.840 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:01:36.840 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:01:36.841 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:36.841 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:01:36.841 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:01:36.841 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:01:36.841 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:36.841 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:01:36.841 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:01:36.842 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:01:36.842 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:01:36.858 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:01:36.858 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:01:36.859 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:01:36.859 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:01:36.870 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:01:36.870 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:01:36.871 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:01:36.871 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:01:36.907 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:01:36.907 DEBUG:teuthology.parallel:result is None 2023-11-24T08:01:36.914 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:01:36.914 DEBUG:teuthology.parallel:result is None 2023-11-24T08:01:36.919 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:01:36.919 DEBUG:teuthology.parallel:result is None 2023-11-24T08:01:36.925 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:01:36.926 DEBUG:teuthology.parallel:result is None 2023-11-24T08:01:36.926 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:01:37.067 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-11-24T08:01:37.067 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2023-11-24T08:01:37.086 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-24T08:01:37.086 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-24T08:01:37.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.111+0000 7f2feb59e640 1 Processor -- start 2023-11-24T08:01:37.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.112+0000 7f2feb59e640 1 -- start start 2023-11-24T08:01:37.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2feb59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fec143c40 0x7f2fec071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2feb59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fec0717d0 0x7f2fec0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2feb59e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec070e50 con 0x7f2fec0cca40 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2feb59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0723c0 con 0x7f2fec0717d0 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2feb59e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0cce40 con 0x7f2fec143c40 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2fe1d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fec0717d0 0x7f2fec0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2fe1d9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2fec0717d0 0x7f2fec0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38360/0 (socket says 172.21.15.161:38360) 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/1122318383 learned_addr learned my addr 172.21.15.161:0/1122318383 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.113+0000 7f2fea59c640 1 --2- 172.21.15.161:0/1122318383 >> v2:172.21.15.175:3300/0 conn(0x7f2fec143c40 0x7f2fec071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.114+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/1122318383 >> v2:172.21.15.175:3300/0 conn(0x7f2fec143c40 msgr2=0x7f2fec071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.114+0000 7f2fe1d9b640 1 --2- 172.21.15.161:0/1122318383 >> v2:172.21.15.175:3300/0 conn(0x7f2fec143c40 0x7f2fec071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.114+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/1122318383 >> v1:172.21.15.175:6789/0 conn(0x7f2fec0cca40 legacy=0x7f2fec15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:37.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.114+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/1122318383 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec06e170 con 0x7f2fec0717d0 2023-11-24T08:01:37.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.115+0000 7f2fe1d9b640 1 --2- 172.21.15.161:0/1122318383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0717d0 0x7f2fec0cc500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fec06e410 tx=0x7f2fd402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb19a6ae95b93d3b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:37.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.115+0000 7f2fe9d9b640 1 -- 172.21.15.161:0/1122318383 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4031870 con 0x7f2fec0717d0 2023-11-24T08:01:37.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.115+0000 7f2fe9d9b640 1 -- 172.21.15.161:0/1122318383 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40319d0 con 0x7f2fec0717d0 2023-11-24T08:01:37.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.115+0000 7f2fe9d9b640 1 -- 172.21.15.161:0/1122318383 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4031d60 con 0x7f2fec0717d0 2023-11-24T08:01:37.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 -- 172.21.15.161:0/1122318383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0717d0 msgr2=0x7f2fec0cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:37.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 --2- 172.21.15.161:0/1122318383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0717d0 0x7f2fec0cc500 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2fec06e410 tx=0x7f2fd402b910 comp rx=0 tx=0).stop 2023-11-24T08:01:37.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 -- 172.21.15.161:0/1122318383 shutdown_connections 2023-11-24T08:01:37.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 --2- 172.21.15.161:0/1122318383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0717d0 0x7f2fec0cc500 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 --2- 172.21.15.161:0/1122318383 >> v2:172.21.15.175:3300/0 conn(0x7f2fec143c40 0x7f2fec071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 -- 172.21.15.161:0/1122318383 >> 172.21.15.161:0/1122318383 conn(0x7f2fec06a800 msgr2=0x7f2fec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:37.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 -- 172.21.15.161:0/1122318383 shutdown_connections 2023-11-24T08:01:37.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.116+0000 7f2feb59e640 1 -- 172.21.15.161:0/1122318383 wait complete. 2023-11-24T08:01:37.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.118+0000 7f2feb59e640 1 Processor -- start 2023-11-24T08:01:37.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.118+0000 7f2feb59e640 1 -- start start 2023-11-24T08:01:37.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2feb59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fec0717d0 0x7f2fec13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2feb59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 0x7f2fec0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2feb59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fec143c40 0x7f2fec1395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2feb59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0a9410 con 0x7f2fec0cca40 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2feb59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0aa6e0 con 0x7f2fec0717d0 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2feb59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0a9640 con 0x7f2fec143c40 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 0x7f2fec0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 0x7f2fec0a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38376/0 (socket says 172.21.15.161:38376) 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/3991080694 learned_addr learned my addr 172.21.15.161:0/3991080694 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:37.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fea59c640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fec0717d0 0x7f2fec13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fec143c40 msgr2=0x7f2fec1395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fec143c40 0x7f2fec1395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fec0717d0 msgr2=0x7f2fec13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fec0717d0 0x7f2fec13caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.119+0000 7f2fe1d9b640 1 -- 172.21.15.161:0/3991080694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40094d0 con 0x7f2fec0cca40 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.120+0000 7f2fe1d9b640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 0x7f2fec0a8ed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fd402b950 tx=0x7f2fd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.120+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd403abe0 con 0x7f2fec0cca40 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.120+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd403ad60 con 0x7f2fec0cca40 2023-11-24T08:01:37.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.120+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4044630 con 0x7f2fec0cca40 2023-11-24T08:01:37.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.120+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec0a9920 con 0x7f2fec0cca40 2023-11-24T08:01:37.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.120+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec0a9ee0 con 0x7f2fec0cca40 2023-11-24T08:01:37.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.121+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec067450 con 0x7f2fec0cca40 2023-11-24T08:01:37.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.122+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2fd404d450 con 0x7f2fec0cca40 2023-11-24T08:01:37.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.123+0000 7f2fe37fe640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fcc06ae40 0x7f2fcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:37.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.123+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2fd402d040 con 0x7f2fec0cca40 2023-11-24T08:01:37.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.124+0000 7f2fea59c640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fcc06ae40 0x7f2fcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:37.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.124+0000 7f2fea59c640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fcc06ae40 0x7f2fcc06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc011340 tx=0x7f2fdc00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:37.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.128+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2fd4076b90 con 0x7f2fec0cca40 2023-11-24T08:01:37.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.333+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2fec0ceb30 con 0x7f2fec0cca40 2023-11-24T08:01:37.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.847+0000 7f2fe37fe640 1 -- 172.21.15.161:0/3991080694 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2fd4035070 con 0x7f2fec0cca40 2023-11-24T08:01:37.849 INFO:teuthology.orchestra.run.smithi161.stderr: removed all blocklist entries 2023-11-24T08:01:37.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fcc06ae40 msgr2=0x7f2fcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:37.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fcc06ae40 0x7f2fcc06d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc011340 tx=0x7f2fdc00b040 comp rx=0 tx=0).stop 2023-11-24T08:01:37.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 msgr2=0x7f2fec0a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:37.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 0x7f2fec0a8ed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2fd402b950 tx=0x7f2fd40046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 shutdown_connections 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2fcc06ae40 0x7f2fcc06d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fec143c40 0x7f2fec1395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2fec0cca40 0x7f2fec0a8ed0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 --2- 172.21.15.161:0/3991080694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fec0717d0 0x7f2fec13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 >> 172.21.15.161:0/3991080694 conn(0x7f2fec06a800 msgr2=0x7f2fec15a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 shutdown_connections 2023-11-24T08:01:37.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:37.851+0000 7f2feb59e640 1 -- 172.21.15.161:0/3991080694 wait complete. 2023-11-24T08:01:37.873 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:01:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.081+0000 7efd13acf640 1 Processor -- start 2023-11-24T08:01:38.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.081+0000 7efd13acf640 1 -- start start 2023-11-24T08:01:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd13acf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd0c159040 0x7efd0c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd13acf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd0c0b34e0 0x7efd0c0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd13acf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c0c6060 con 0x7efd0c15c300 2023-11-24T08:01:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd13acf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c0c62d0 con 0x7efd0c159040 2023-11-24T08:01:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd13acf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c0c65b0 con 0x7efd0c0b34e0 2023-11-24T08:01:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1186b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efd0c159040 0x7efd0c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1106a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efd0c15c300 0x7efd0c15f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:33096/0 (socket says 172.21.15.161:33096) 2023-11-24T08:01:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1106a640 1 -- 172.21.15.161:0/3557356453 learned_addr learned my addr 172.21.15.161:0/3557356453 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1206c640 1 --2- 172.21.15.161:0/3557356453 >> v2:172.21.15.175:3300/0 conn(0x7efd0c0b34e0 0x7efd0c0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1186b640 1 -- 172.21.15.161:0/3557356453 >> v2:172.21.15.175:3300/0 conn(0x7efd0c0b34e0 msgr2=0x7efd0c0d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1186b640 1 --2- 172.21.15.161:0/3557356453 >> v2:172.21.15.175:3300/0 conn(0x7efd0c0b34e0 0x7efd0c0d0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.083+0000 7efd1186b640 1 -- 172.21.15.161:0/3557356453 >> v1:172.21.15.161:6789/0 conn(0x7efd0c15c300 legacy=0x7efd0c15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.084+0000 7efd1186b640 1 -- 172.21.15.161:0/3557356453 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c15eec0 con 0x7efd0c159040 2023-11-24T08:01:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.084+0000 7efd10869640 1 -- 172.21.15.161:0/3557356453 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453842569 0 0) 0x7efd0c0c6060 con 0x7efd0c15c300 2023-11-24T08:01:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.085+0000 7efd1186b640 1 --2- 172.21.15.161:0/3557356453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cf000 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0d0ac0 tx=0x7efd0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26249570bf0c6e71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.085+0000 7efd10869640 1 -- 172.21.15.161:0/3557356453 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08031830 con 0x7efd0c159040 2023-11-24T08:01:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.085+0000 7efd10869640 1 -- 172.21.15.161:0/3557356453 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd08031990 con 0x7efd0c159040 2023-11-24T08:01:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.085+0000 7efd10869640 1 -- 172.21.15.161:0/3557356453 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd08031d20 con 0x7efd0c159040 2023-11-24T08:01:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.085+0000 7efd13acf640 1 -- 172.21.15.161:0/3557356453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 msgr2=0x7efd0c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.085+0000 7efd13acf640 1 --2- 172.21.15.161:0/3557356453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cf000 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7efd0c0d0ac0 tx=0x7efd0802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.086+0000 7efd13acf640 1 -- 172.21.15.161:0/3557356453 shutdown_connections 2023-11-24T08:01:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.086+0000 7efd13acf640 1 --2- 172.21.15.161:0/3557356453 >> v2:172.21.15.175:3300/0 conn(0x7efd0c0b34e0 0x7efd0c0d0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.086+0000 7efd13acf640 1 --2- 172.21.15.161:0/3557356453 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cf000 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.086+0000 7efd13acf640 1 -- 172.21.15.161:0/3557356453 >> 172.21.15.161:0/3557356453 conn(0x7efd0c066690 msgr2=0x7efd0c06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:38.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.086+0000 7efd13acf640 1 -- 172.21.15.161:0/3557356453 shutdown_connections 2023-11-24T08:01:38.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.086+0000 7efd13acf640 1 -- 172.21.15.161:0/3557356453 wait complete. 2023-11-24T08:01:38.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.087+0000 7efd13acf640 1 Processor -- start 2023-11-24T08:01:38.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.088+0000 7efd13acf640 1 -- start start 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.088+0000 7efd13acf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c0b34e0 0x7efd0c148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.088+0000 7efd13acf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd13acf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd0c15c300 0x7efd0c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd13acf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0c8140 con 0x7efd0c159040 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd13acf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0c8390 con 0x7efd0c0b34e0 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd13acf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0c8670 con 0x7efd0c15c300 2023-11-24T08:01:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38404/0 (socket says 172.21.15.161:38404) 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 -- 172.21.15.161:0/1212962349 learned_addr learned my addr 172.21.15.161:0/1212962349 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1186b640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c0b34e0 0x7efd0c148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1206c640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd0c15c300 0x7efd0c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 -- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd0c15c300 msgr2=0x7efd0c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd0c15c300 0x7efd0c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 -- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c0b34e0 msgr2=0x7efd0c148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c0b34e0 0x7efd0c148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1106a640 1 -- 172.21.15.161:0/1212962349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08009400 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.089+0000 7efd1186b640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c0b34e0 0x7efd0c148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.090+0000 7efd1106a640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cc680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c430 tx=0x7efcfc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.090+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc0074e0 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.090+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc007660 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.090+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0c8950 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.090+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc004a20 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.090+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0c8f10 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.091+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c074a50 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.093+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcfc004b80 con 0x7efd0c159040 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.094+0000 7efd027fc640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efcf006ae40 0x7efcf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.094+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efcfc0890a0 con 0x7efd0c159040 2023-11-24T08:01:38.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.095+0000 7efd1186b640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efcf006ae40 0x7efcf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.096+0000 7efd1186b640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efcf006ae40 0x7efcf006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd08036000 tx=0x7efd08008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:38.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.099+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcfc054530 con 0x7efd0c159040 2023-11-24T08:01:38.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.360+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efd0c0675d0 con 0x7efd0c159040 2023-11-24T08:01:38.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.361+0000 7efd027fc640 1 -- 172.21.15.161:0/1212962349 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7efcfc057b50 con 0x7efd0c159040 2023-11-24T08:01:38.362 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:38.362 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:01:38.362 INFO:teuthology.orchestra.run.smithi161.stdout: "auth_dump": [ 2023-11-24T08:01:38.362 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.a", 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlHD6tGhAAHgfwFnLRAnZJYkP/R6LkDA==", 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.b", 2023-11-24T08:01:38.363 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlhwvbARAAhTRWPeXbP0Z85pAw4aEhzw==", 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.c", 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlBOzLKxAAodBeIc6gxGOmd7u2xqJcNQ==", 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.364 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.d", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2Blgdy3EhAATujalM2qKRTbZsSDt9Klkg==", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:01:38.365 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.0", 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWV2BlYGGZDRAAw5WGhgWYIelaXgs35FbP6Q==", 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.366 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.1", 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDZV2Bl7LRAJxAA/0jx7Tz254+nQpLEHq0DHw==", 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.367 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.2", 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDdV2BlGxntAxAAlq53dwY33JyEdL1bA4A4qg==", 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.368 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.3", 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDgV2BleVHNHBAA5WTP8GdbwtsQqAQGlBltKA==", 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.4", 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDnV2BlnBePIRAAiBKoHmbq5RakHSkloIHXiA==", 2023-11-24T08:01:38.369 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.5", 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDqV2BlPvd0KxAA0NN6x6VMmoheCO+k1+9Pqw==", 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.370 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.6", 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDtV2Bl93CTNBAAQciFc0K2H/YECC3VtUaz6A==", 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.371 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.7", 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDxV2Bl4WVOEhAA05ppVcoEr6QDrGDWYMXoWQ==", 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.0", 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA==", 2023-11-24T08:01:38.372 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.1", 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlsuSyNxAAzKRQWIED6Y00//mN8k2A2A==", 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.373 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.2", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlbNQdLRAAgt8XlhFRtS6ykHldSR/mTg==", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:01:38.374 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.3", 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDSV2BlFoFzBhAATWeUEX1fhVTvj03CuGTO/w==", 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:01:38.375 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.admin", 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDPV2BlOyC4DhAASM/sLxsmWpuy+0JqHTr6xw==", 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.376 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-mds", 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQD/V2Bl1DN9KhAAe7mduA5bRXbVPPIbWJXLhw==", 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQD/V2BloT19KhAAa3wQzQik/RZquTuL6Fb9hQ==", 2023-11-24T08:01:38.377 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-osd", 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQD/V2Bl9UV9KhAAdH5J4b+7VckXT7qBT3GoZw==", 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.378 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQD/V2BlEU99KhAAfnyNNgRDEy3frx3/TVXCOw==", 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQD/V2BlyVd9KhAANetuL66JtFVTr/UIJSgGDQ==", 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T08:01:38.379 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQD/V2Bl4GB9KhAAwKyQH0LHy60jPFMCWVpnSg==", 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.x", 2023-11-24T08:01:38.380 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlaY9ADhAA3F3uUt8RpzSr7R2IgBLQYA==", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.y", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlNxTcABAApZPsFQs537yAkIv0IJhzOg==", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-11-24T08:01:38.381 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:01:38.382 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.382 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:38.382 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2023-11-24T08:01:38.382 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.363+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efcf006ae40 msgr2=0x7efcf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.363+0000 7efd13acf640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efcf006ae40 0x7efcf006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7efd08036000 tx=0x7efd08008030 comp rx=0 tx=0).stop 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.363+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 msgr2=0x7efd0c0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.363+0000 7efd13acf640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cc680 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c430 tx=0x7efcfc00c8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 shutdown_connections 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efcf006ae40 0x7efcf006d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd0c15c300 0x7efd0c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd0c159040 0x7efd0c0cc680 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 --2- 172.21.15.161:0/1212962349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd0c0b34e0 0x7efd0c148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 >> 172.21.15.161:0/1212962349 conn(0x7efd0c066690 msgr2=0x7efd0c15da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 shutdown_connections 2023-11-24T08:01:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.364+0000 7efd13acf640 1 -- 172.21.15.161:0/1212962349 wait complete. 2023-11-24T08:01:38.385 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T08:01:38.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.599+0000 7feed6f47640 1 Processor -- start 2023-11-24T08:01:38.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.600+0000 7feed6f47640 1 -- start start 2023-11-24T08:01:38.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6f47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6f47640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feed00cf9f0 0x7feed00cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6f47640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feed0161010 0x7feed01614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6f47640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00d03b0 con 0x7feed0161010 2023-11-24T08:01:38.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6f47640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00d0a10 con 0x7feed00cf9f0 2023-11-24T08:01:38.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6f47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00cf080 con 0x7feed0160920 2023-11-24T08:01:38.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6746640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feed0161010 0x7feed01614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6746640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7feed0161010 0x7feed01614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38406/0 (socket says 172.21.15.161:38406) 2023-11-24T08:01:38.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.601+0000 7feed6746640 1 -- 172.21.15.161:0/4216651265 learned_addr learned my addr 172.21.15.161:0/4216651265 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:38.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed5744640 1 --2- 172.21.15.161:0/4216651265 >> v2:172.21.15.175:3300/0 conn(0x7feed00cf9f0 0x7feed00cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed5f45640 1 --2- 172.21.15.161:0/4216651265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed6746640 1 -- 172.21.15.161:0/4216651265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 msgr2=0x7feed00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:38.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed6746640 1 --2- 172.21.15.161:0/4216651265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed6746640 1 -- 172.21.15.161:0/4216651265 >> v2:172.21.15.175:3300/0 conn(0x7feed00cf9f0 msgr2=0x7feed00cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:38.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed6746640 1 --2- 172.21.15.161:0/4216651265 >> v2:172.21.15.175:3300/0 conn(0x7feed00cf9f0 0x7feed00cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.602+0000 7feed6746640 1 -- 172.21.15.161:0/4216651265 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00c6be0 con 0x7feed0161010 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.603+0000 7feed6746640 1 --2- 172.21.15.161:0/4216651265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0161010 0x7feed01614a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feed008d300 tx=0x7feec802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424f01f698d8ff5e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.603+0000 7feed4f43640 1 -- 172.21.15.161:0/4216651265 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec802ca70 con 0x7feed0161010 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.603+0000 7feed4f43640 1 -- 172.21.15.161:0/4216651265 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec802cbd0 con 0x7feed0161010 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.603+0000 7feed4f43640 1 -- 172.21.15.161:0/4216651265 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80343f0 con 0x7feed0161010 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 -- 172.21.15.161:0/4216651265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0161010 msgr2=0x7feed01614a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 --2- 172.21.15.161:0/4216651265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0161010 0x7feed01614a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feed008d300 tx=0x7feec802bed0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 -- 172.21.15.161:0/4216651265 shutdown_connections 2023-11-24T08:01:38.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 --2- 172.21.15.161:0/4216651265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed0161010 0x7feed01614a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 --2- 172.21.15.161:0/4216651265 >> v2:172.21.15.175:3300/0 conn(0x7feed00cf9f0 0x7feed00cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 --2- 172.21.15.161:0/4216651265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 -- 172.21.15.161:0/4216651265 >> 172.21.15.161:0/4216651265 conn(0x7feed00d3090 msgr2=0x7feed00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:38.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 -- 172.21.15.161:0/4216651265 shutdown_connections 2023-11-24T08:01:38.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.604+0000 7feed6f47640 1 -- 172.21.15.161:0/4216651265 wait complete. 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.606+0000 7feed6f47640 1 Processor -- start 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.606+0000 7feed6f47640 1 -- start start 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed6f47640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 0x7feed015b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed6f47640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed6f47640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed0161010 0x7feed00b82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed6f47640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed01f30a0 con 0x7feed00cf9f0 2023-11-24T08:01:38.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed6f47640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00b88f0 con 0x7feed0161010 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed6f47640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00b8bd0 con 0x7feed0160920 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed5f45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 0x7feed015b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed5f45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 0x7feed015b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38416/0 (socket says 172.21.15.161:38416) 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.607+0000 7feed5f45640 1 -- 172.21.15.161:0/2839919940 learned_addr learned my addr 172.21.15.161:0/2839919940 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5744640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed6746640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed0161010 0x7feed00b82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5f45640 1 -- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 msgr2=0x7feed00b7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5f45640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5f45640 1 -- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed0161010 msgr2=0x7feed00b82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5f45640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed0161010 0x7feed00b82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5f45640 1 -- 172.21.15.161:0/2839919940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009b30 con 0x7feed00cf9f0 2023-11-24T08:01:38.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5744640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed6746640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed0161010 0x7feed00b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed5f45640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 0x7feed015b8d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d800 tx=0x7feecc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00b6c0 con 0x7feed00cf9f0 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc00b820 con 0x7feed00cf9f0 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc00bbb0 con 0x7feed00cf9f0 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed015c810 con 0x7feed00cf9f0 2023-11-24T08:01:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.608+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed006c170 con 0x7feed00cf9f0 2023-11-24T08:01:38.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.609+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed015c670 con 0x7feed00cf9f0 2023-11-24T08:01:38.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.610+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feecc00bd10 con 0x7feed00cf9f0 2023-11-24T08:01:38.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.611+0000 7feec67fc640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406ae40 0x7feeb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:38.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.611+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feecc089900 con 0x7feed00cf9f0 2023-11-24T08:01:38.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.612+0000 7feed5744640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406ae40 0x7feeb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.613+0000 7feed5744640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406ae40 0x7feeb406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feec0006fd0 tx=0x7feec0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.616+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feed015c670 con 0x7feed00cf9f0 2023-11-24T08:01:38.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:01:38.882 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:01:38.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.880+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7feed015c670 con 0x7feed00cf9f0 2023-11-24T08:01:38.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.885+0000 7feec67fc640 1 -- 172.21.15.161:0/2839919940 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7feed015c670 con 0x7feed00cf9f0 2023-11-24T08:01:38.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406ae40 msgr2=0x7feeb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406ae40 0x7feeb406d300 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7feec0006fd0 tx=0x7feec0008040 comp rx=0 tx=0).stop 2023-11-24T08:01:38.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 msgr2=0x7feed015b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 0x7feed015b8d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d800 tx=0x7feecc00dcc0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 shutdown_connections 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406ae40 0x7feeb406d300 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feed0161010 0x7feed00b82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed0160920 0x7feed00b7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 --2- 172.21.15.161:0/2839919940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00cf9f0 0x7feed015b8d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 >> 172.21.15.161:0/2839919940 conn(0x7feed00d3090 msgr2=0x7feed00d3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 shutdown_connections 2023-11-24T08:01:38.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:38.888+0000 7feed6f47640 1 -- 172.21.15.161:0/2839919940 wait complete. 2023-11-24T08:01:38.907 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T08:01:39.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.145+0000 7fd0593de640 1 Processor -- start 2023-11-24T08:01:39.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.146+0000 7fd0593de640 1 -- start start 2023-11-24T08:01:39.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.147+0000 7fd0593de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.149 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.147+0000 7fd0593de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0540ce6f0 0x7fd0540b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.147+0000 7fd0593de640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540b6750 con 0x7fd05415d590 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.147+0000 7fd0593de640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0540cf1f0 con 0x7fd0540ce6f0 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.147+0000 7fd0593de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540cef10 con 0x7fd0540d0280 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0540ce6f0 0x7fd0540b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd0540ce6f0 0x7fd0540b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38428/0 (socket says 172.21.15.161:38428) 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 -- 172.21.15.161:0/2797722461 learned_addr learned my addr 172.21.15.161:0/2797722461 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0527fc640 1 --2- 172.21.15.161:0/2797722461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 -- 172.21.15.161:0/2797722461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 msgr2=0x7fd0540ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 --2- 172.21.15.161:0/2797722461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 -- 172.21.15.161:0/2797722461 >> v1:172.21.15.175:6789/0 conn(0x7fd05415d590 legacy=0x7fd0540cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:39.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.148+0000 7fd0537fe640 1 -- 172.21.15.161:0/2797722461 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540b6100 con 0x7fd0540ce6f0 2023-11-24T08:01:39.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.150+0000 7fd0537fe640 1 --2- 172.21.15.161:0/2797722461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0540ce6f0 0x7fd0540b6be0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009870 tx=0x7fd04c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6975a8adb1553f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:39.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.150+0000 7fd051ffb640 1 -- 172.21.15.161:0/2797722461 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c031640 con 0x7fd0540ce6f0 2023-11-24T08:01:39.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.150+0000 7fd051ffb640 1 -- 172.21.15.161:0/2797722461 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c0317a0 con 0x7fd0540ce6f0 2023-11-24T08:01:39.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.150+0000 7fd051ffb640 1 -- 172.21.15.161:0/2797722461 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c031b30 con 0x7fd0540ce6f0 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 -- 172.21.15.161:0/2797722461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0540ce6f0 msgr2=0x7fd0540b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 --2- 172.21.15.161:0/2797722461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0540ce6f0 0x7fd0540b6be0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009870 tx=0x7fd04c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 -- 172.21.15.161:0/2797722461 shutdown_connections 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 --2- 172.21.15.161:0/2797722461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd0540ce6f0 0x7fd0540b6be0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 --2- 172.21.15.161:0/2797722461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 -- 172.21.15.161:0/2797722461 >> 172.21.15.161:0/2797722461 conn(0x7fd05409c540 msgr2=0x7fd0540d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:39.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 -- 172.21.15.161:0/2797722461 shutdown_connections 2023-11-24T08:01:39.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.151+0000 7fd0593de640 1 -- 172.21.15.161:0/2797722461 wait complete. 2023-11-24T08:01:39.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.153+0000 7fd0593de640 1 Processor -- start 2023-11-24T08:01:39.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.153+0000 7fd0593de640 1 -- start start 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0593de640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0540ce6f0 0x7fd0540cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0593de640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0593de640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 0x7fd0540cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0593de640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05414ce30 con 0x7fd05415d590 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0593de640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd05415b7d0 con 0x7fd0540ce6f0 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0593de640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd05414c4d0 con 0x7fd0540d0280 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0537fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 0x7fd0540cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0537fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 0x7fd0540cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38444/0 (socket says 172.21.15.161:38444) 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0537fe640 1 -- 172.21.15.161:0/2720752320 learned_addr learned my addr 172.21.15.161:0/2720752320 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:39.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0527fc640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd052ffd640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0540ce6f0 0x7fd0540cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.155+0000 7fd0537fe640 1 -- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 msgr2=0x7fd0540ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0537fe640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0537fe640 1 -- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0540ce6f0 msgr2=0x7fd0540cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0537fe640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0540ce6f0 0x7fd0540cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0537fe640 1 -- 172.21.15.161:0/2720752320 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0094d0 con 0x7fd05415d590 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0527fc640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd052ffd640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0540ce6f0 0x7fd0540cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:39.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0537fe640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 0x7fd0540cae50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009870 tx=0x7fd04c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:39.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c03ac60 con 0x7fd05415d590 2023-11-24T08:01:39.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c03ade0 con 0x7fd05415d590 2023-11-24T08:01:39.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c044630 con 0x7fd05415d590 2023-11-24T08:01:39.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd05414c770 con 0x7fd05415d590 2023-11-24T08:01:39.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.156+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd05409d520 con 0x7fd05415d590 2023-11-24T08:01:39.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.158+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05414cf70 con 0x7fd05415d590 2023-11-24T08:01:39.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.158+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd04c02f050 con 0x7fd05415d590 2023-11-24T08:01:39.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.160+0000 7fd04b7fe640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd03406ae40 0x7fd03406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.160+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd04c0ab200 con 0x7fd05415d590 2023-11-24T08:01:39.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.161+0000 7fd052ffd640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd03406ae40 0x7fd03406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.162+0000 7fd052ffd640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd03406ae40 0x7fd03406d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd044007e90 tx=0x7fd0440073a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:39.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.165+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd05414cf70 con 0x7fd05415d590 2023-11-24T08:01:39.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.425+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd05414cf70 con 0x7fd05415d590 2023-11-24T08:01:39.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.429+0000 7fd04b7fe640 1 -- 172.21.15.161:0/2720752320 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd05414cf70 con 0x7fd05415d590 2023-11-24T08:01:39.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd03406ae40 msgr2=0x7fd03406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd03406ae40 0x7fd03406d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd044007e90 tx=0x7fd0440073a0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 msgr2=0x7fd0540cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 0x7fd0540cae50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009870 tx=0x7fd04c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 shutdown_connections 2023-11-24T08:01:39.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd03406ae40 0x7fd03406d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd05415d590 0x7fd0540cae50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd0540d0280 0x7fd0540ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 --2- 172.21.15.161:0/2720752320 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd0540ce6f0 0x7fd0540cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 >> 172.21.15.161:0/2720752320 conn(0x7fd05409c540 msgr2=0x7fd05415fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 shutdown_connections 2023-11-24T08:01:39.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.432+0000 7fd0593de640 1 -- 172.21.15.161:0/2720752320 wait complete. 2023-11-24T08:01:39.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T08:01:39.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.666+0000 7fc36d54e640 1 Processor -- start 2023-11-24T08:01:39.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.666+0000 7fc36d54e640 1 -- start start 2023-11-24T08:01:39.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36d54e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0100 0x7fc3680b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36d54e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3680d0f40 0x7fc3680d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36d54e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680d0a10 con 0x7fc368160920 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36d54e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680cf080 con 0x7fc3680d0f40 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36d54e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680c6be0 con 0x7fc3680d0100 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3680d0f40 0x7fc3680d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3680d0f40 0x7fc3680d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38456/0 (socket says 172.21.15.161:38456) 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 -- 172.21.15.161:0/685327474 learned_addr learned my addr 172.21.15.161:0/685327474 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc3677fe640 1 --2- 172.21.15.161:0/685327474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0100 0x7fc3680b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 -- 172.21.15.161:0/685327474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0100 msgr2=0x7fc3680b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 --2- 172.21.15.161:0/685327474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0100 0x7fc3680b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 -- 172.21.15.161:0/685327474 >> v1:172.21.15.175:6789/0 conn(0x7fc368160920 legacy=0x7fc3680cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.668+0000 7fc36cd4d640 1 -- 172.21.15.161:0/685327474 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680ce7e0 con 0x7fc3680d0f40 2023-11-24T08:01:39.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.670+0000 7fc36cd4d640 1 --2- 172.21.15.161:0/685327474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3680d0f40 0x7fc3680d13f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc360009870 tx=0x7fc36002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d211550399e5c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:39.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.670+0000 7fc366ffd640 1 -- 172.21.15.161:0/685327474 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360030840 con 0x7fc3680d0f40 2023-11-24T08:01:39.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.670+0000 7fc366ffd640 1 -- 172.21.15.161:0/685327474 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3600309a0 con 0x7fc3680d0f40 2023-11-24T08:01:39.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.670+0000 7fc366ffd640 1 -- 172.21.15.161:0/685327474 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360030d30 con 0x7fc3680d0f40 2023-11-24T08:01:39.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.670+0000 7fc36d54e640 1 -- 172.21.15.161:0/685327474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3680d0f40 msgr2=0x7fc3680d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.670+0000 7fc36d54e640 1 --2- 172.21.15.161:0/685327474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3680d0f40 0x7fc3680d13f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc360009870 tx=0x7fc36002b980 comp rx=0 tx=0).stop 2023-11-24T08:01:39.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.671+0000 7fc36d54e640 1 -- 172.21.15.161:0/685327474 shutdown_connections 2023-11-24T08:01:39.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.671+0000 7fc36d54e640 1 --2- 172.21.15.161:0/685327474 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3680d0f40 0x7fc3680d13f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.671+0000 7fc36d54e640 1 --2- 172.21.15.161:0/685327474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0100 0x7fc3680b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.671+0000 7fc36d54e640 1 -- 172.21.15.161:0/685327474 >> 172.21.15.161:0/685327474 conn(0x7fc3680d3090 msgr2=0x7fc3680d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:39.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.671+0000 7fc36d54e640 1 -- 172.21.15.161:0/685327474 shutdown_connections 2023-11-24T08:01:39.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.671+0000 7fc36d54e640 1 -- 172.21.15.161:0/685327474 wait complete. 2023-11-24T08:01:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.673+0000 7fc36d54e640 1 Processor -- start 2023-11-24T08:01:39.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.673+0000 7fc36d54e640 1 -- start start 2023-11-24T08:01:39.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36d54e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3680d0100 0x7fc3680ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36d54e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0f40 0x7fc3681515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36d54e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 0x7fc3680c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36d54e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc368151f50 con 0x7fc368160920 2023-11-24T08:01:39.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36d54e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681f6750 con 0x7fc3680d0100 2023-11-24T08:01:39.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36d54e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc368151ae0 con 0x7fc3680d0f40 2023-11-24T08:01:39.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36cd4d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 0x7fc3680c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36cd4d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 0x7fc3680c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38468/0 (socket says 172.21.15.161:38468) 2023-11-24T08:01:39.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc36cd4d640 1 -- 172.21.15.161:0/477608410 learned_addr learned my addr 172.21.15.161:0/477608410 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:39.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc367fff640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3680d0100 0x7fc3680ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.674+0000 7fc3677fe640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0f40 0x7fc3681515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36cd4d640 1 -- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0f40 msgr2=0x7fc3681515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36cd4d640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0f40 0x7fc3681515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36cd4d640 1 -- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3680d0100 msgr2=0x7fc3680ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36cd4d640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3680d0100 0x7fc3680ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36cd4d640 1 -- 172.21.15.161:0/477608410 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600094d0 con 0x7fc368160920 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc367fff640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3680d0100 0x7fc3680ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36cd4d640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 0x7fc3680c8630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc36002b9c0 tx=0x7fc360004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360039c90 con 0x7fc368160920 2023-11-24T08:01:39.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc360039df0 con 0x7fc368160920 2023-11-24T08:01:39.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360043640 con 0x7fc368160920 2023-11-24T08:01:39.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680cbd60 con 0x7fc368160920 2023-11-24T08:01:39.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.675+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3681f6c80 con 0x7fc368160920 2023-11-24T08:01:39.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.676+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc368067450 con 0x7fc368160920 2023-11-24T08:01:39.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.677+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc3600437a0 con 0x7fc368160920 2023-11-24T08:01:39.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.678+0000 7fc364ff9640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc34806ae90 0x7fc34806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:39.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.678+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc36003e070 con 0x7fc368160920 2023-11-24T08:01:39.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.679+0000 7fc367fff640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc34806ae90 0x7fc34806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:39.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.680+0000 7fc367fff640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc34806ae90 0x7fc34806d350 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc3580012e0 tx=0x7fc358009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:39.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.683+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3600776f0 con 0x7fc368160920 2023-11-24T08:01:39.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.937+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc36808c7e0 con 0x7fc368160920 2023-11-24T08:01:39.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.941+0000 7fc364ff9640 1 -- 172.21.15.161:0/477608410 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc36007ad10 con 0x7fc368160920 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc34806ae90 msgr2=0x7fc34806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc34806ae90 0x7fc34806d350 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc3580012e0 tx=0x7fc358009040 comp rx=0 tx=0).stop 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 msgr2=0x7fc3680c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 0x7fc3680c8630 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc36002b9c0 tx=0x7fc360004730 comp rx=0 tx=0).stop 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 shutdown_connections 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc34806ae90 0x7fc34806d350 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc368160920 0x7fc3680c8630 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3680d0f40 0x7fc3681515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 --2- 172.21.15.161:0/477608410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3680d0100 0x7fc3680ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:39.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 >> 172.21.15.161:0/477608410 conn(0x7fc3680d3090 msgr2=0x7fc36806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:39.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 shutdown_connections 2023-11-24T08:01:39.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:39.944+0000 7fc36d54e640 1 -- 172.21.15.161:0/477608410 wait complete. 2023-11-24T08:01:39.962 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T08:01:40.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.164+0000 7f2aec00e640 1 Processor -- start 2023-11-24T08:01:40.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.164+0000 7f2aec00e640 1 -- start start 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2aec00e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ae413df80 0x7f2ae415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2aec00e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae413e360 0x7f2ae40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2aec00e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2ae415f9c0 0x7f2ae40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2aec00e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae406c470 con 0x7f2ae413df80 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2aec00e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae406c750 con 0x7f2ae415f9c0 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2aec00e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae406ca30 con 0x7f2ae413e360 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2ae9daa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ae413df80 0x7f2ae415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2ae9daa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2ae413df80 0x7f2ae415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38484/0 (socket says 172.21.15.161:38484) 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.166+0000 7f2ae9daa640 1 -- 172.21.15.161:0/2441816435 learned_addr learned my addr 172.21.15.161:0/2441816435 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2ae95a9640 1 --2- 172.21.15.161:0/2441816435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae413e360 0x7f2ae40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2aea5ab640 1 --2- 172.21.15.161:0/2441816435 >> v2:172.21.15.175:3300/0 conn(0x7f2ae415f9c0 0x7f2ae40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2ae9daa640 1 -- 172.21.15.161:0/2441816435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae413e360 msgr2=0x7f2ae40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2ae9daa640 1 --2- 172.21.15.161:0/2441816435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae413e360 0x7f2ae40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2ae9daa640 1 -- 172.21.15.161:0/2441816435 >> v2:172.21.15.175:3300/0 conn(0x7f2ae415f9c0 msgr2=0x7f2ae40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2ae9daa640 1 --2- 172.21.15.161:0/2441816435 >> v2:172.21.15.175:3300/0 conn(0x7f2ae415f9c0 0x7f2ae40cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.167+0000 7f2ae9daa640 1 -- 172.21.15.161:0/2441816435 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae406cd10 con 0x7f2ae413df80 2023-11-24T08:01:40.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.168+0000 7f2ae9daa640 1 --2- 172.21.15.161:0/2441816435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae415bee0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2ae406e6d0 tx=0x7f2ae002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b090c561215c03 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:40.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.168+0000 7f2ae8da8640 1 -- 172.21.15.161:0/2441816435 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0031870 con 0x7f2ae413df80 2023-11-24T08:01:40.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.168+0000 7f2ae8da8640 1 -- 172.21.15.161:0/2441816435 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00319d0 con 0x7f2ae413df80 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.168+0000 7f2ae8da8640 1 -- 172.21.15.161:0/2441816435 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0031d60 con 0x7f2ae413df80 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 -- 172.21.15.161:0/2441816435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 msgr2=0x7f2ae415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 --2- 172.21.15.161:0/2441816435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae415bee0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2ae406e6d0 tx=0x7f2ae002b910 comp rx=0 tx=0).stop 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 -- 172.21.15.161:0/2441816435 shutdown_connections 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 --2- 172.21.15.161:0/2441816435 >> v2:172.21.15.175:3300/0 conn(0x7f2ae415f9c0 0x7f2ae40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 --2- 172.21.15.161:0/2441816435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae413e360 0x7f2ae40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 --2- 172.21.15.161:0/2441816435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae415bee0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 -- 172.21.15.161:0/2441816435 >> 172.21.15.161:0/2441816435 conn(0x7f2ae406a800 msgr2=0x7f2ae406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:40.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 -- 172.21.15.161:0/2441816435 shutdown_connections 2023-11-24T08:01:40.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.169+0000 7f2aec00e640 1 -- 172.21.15.161:0/2441816435 wait complete. 2023-11-24T08:01:40.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.171+0000 7f2aec00e640 1 Processor -- start 2023-11-24T08:01:40.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.171+0000 7f2aec00e640 1 -- start start 2023-11-24T08:01:40.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aec00e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aec00e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ae413e360 0x7f2ae41f1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aec00e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae415f9c0 0x7f2ae41f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aec00e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae413ce20 con 0x7f2ae413df80 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aec00e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41f0c30 con 0x7f2ae413e360 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aec00e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae41591a0 con 0x7f2ae415f9c0 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae413c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38488/0 (socket says 172.21.15.161:38488) 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 -- 172.21.15.161:0/1761076510 learned_addr learned my addr 172.21.15.161:0/1761076510 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:40.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aea5ab640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae415f9c0 0x7f2ae41f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae95a9640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ae413e360 0x7f2ae41f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 -- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae415f9c0 msgr2=0x7f2ae41f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae415f9c0 0x7f2ae41f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 -- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ae413e360 msgr2=0x7f2ae41f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ae413e360 0x7f2ae41f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae9daa640 1 -- 172.21.15.161:0/1761076510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae00094d0 con 0x7f2ae413df80 2023-11-24T08:01:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2ae95a9640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ae413e360 0x7f2ae41f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.173+0000 7f2aea5ab640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae415f9c0 0x7f2ae41f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:40.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.174+0000 7f2ae9daa640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae413c8e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ae002b950 tx=0x7f2ae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.174+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae003ad30 con 0x7f2ae413df80 2023-11-24T08:01:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.174+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae00443f0 con 0x7f2ae413df80 2023-11-24T08:01:40.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.174+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00447a0 con 0x7f2ae413df80 2023-11-24T08:01:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.174+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae4159480 con 0x7f2ae413df80 2023-11-24T08:01:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.174+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae4159a40 con 0x7f2ae413df80 2023-11-24T08:01:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.175+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae41f0da0 con 0x7f2ae413df80 2023-11-24T08:01:40.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.176+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ae004d450 con 0x7f2ae413df80 2023-11-24T08:01:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.177+0000 7f2ada7fc640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ac806ae40 0x7f2ac806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.177+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ae002d040 con 0x7f2ae413df80 2023-11-24T08:01:40.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.178+0000 7f2ae95a9640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ac806ae40 0x7f2ac806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.179+0000 7f2ae95a9640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ac806ae40 0x7f2ac806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40b01e0 tx=0x7f2ad4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:40.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.181+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ae0076c30 con 0x7f2ae413df80 2023-11-24T08:01:40.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.443+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f2ae40675d0 con 0x7f2ae413df80 2023-11-24T08:01:40.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.448+0000 7f2ada7fc640 1 -- 172.21.15.161:0/1761076510 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2ae0035020 con 0x7f2ae413df80 2023-11-24T08:01:40.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ac806ae40 msgr2=0x7f2ac806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ac806ae40 0x7f2ac806d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40b01e0 tx=0x7f2ad4008040 comp rx=0 tx=0).stop 2023-11-24T08:01:40.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 msgr2=0x7f2ae413c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae413c8e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2ae002b950 tx=0x7f2ae00046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 shutdown_connections 2023-11-24T08:01:40.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ac806ae40 0x7f2ac806d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ae415f9c0 0x7f2ae41f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ae413e360 0x7f2ae41f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 --2- 172.21.15.161:0/1761076510 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2ae413df80 0x7f2ae413c8e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 >> 172.21.15.161:0/1761076510 conn(0x7f2ae406a800 msgr2=0x7f2ae40b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:40.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 shutdown_connections 2023-11-24T08:01:40.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.451+0000 7f2aec00e640 1 -- 172.21.15.161:0/1761076510 wait complete. 2023-11-24T08:01:40.471 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T08:01:40.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.673+0000 7f5bda49b640 1 Processor -- start 2023-11-24T08:01:40.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.674+0000 7f5bda49b640 1 -- start start 2023-11-24T08:01:40.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.675+0000 7f5bda49b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 0x7f5bd40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.675+0000 7f5bda49b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5bd415f9c0 0x7f5bd40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.675+0000 7f5bda49b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd415c5f0 con 0x7f5bd413df80 2023-11-24T08:01:40.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.675+0000 7f5bda49b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd406c470 con 0x7f5bd415f9c0 2023-11-24T08:01:40.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.675+0000 7f5bda49b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd406c750 con 0x7f5bd413e360 2023-11-24T08:01:40.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 0x7f5bd40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 0x7f5bd40cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:36928/0 (socket says 172.21.15.161:36928) 2023-11-24T08:01:40.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 -- 172.21.15.161:0/2096974851 learned_addr learned my addr 172.21.15.161:0/2096974851 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bd8a38640 1 --2- 172.21.15.161:0/2096974851 >> v2:172.21.15.175:3300/0 conn(0x7f5bd415f9c0 0x7f5bd40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 -- 172.21.15.161:0/2096974851 >> v2:172.21.15.175:3300/0 conn(0x7f5bd415f9c0 msgr2=0x7f5bd40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 --2- 172.21.15.161:0/2096974851 >> v2:172.21.15.175:3300/0 conn(0x7f5bd415f9c0 0x7f5bd40cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 -- 172.21.15.161:0/2096974851 >> v1:172.21.15.175:6789/0 conn(0x7f5bd413df80 legacy=0x7f5bd415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bcbfff640 1 -- 172.21.15.161:0/2096974851 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd406ca30 con 0x7f5bd413e360 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.676+0000 7f5bd37fe640 1 -- 172.21.15.161:0/2096974851 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425493691 0 0) 0x7f5bd415c5f0 con 0x7f5bd413df80 2023-11-24T08:01:40.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.678+0000 7f5bcbfff640 1 --2- 172.21.15.161:0/2096974851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 0x7f5bd40cf290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009870 tx=0x7f5bbc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a42169c28ae6464 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:40.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.678+0000 7f5bd37fe640 1 -- 172.21.15.161:0/2096974851 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc030840 con 0x7f5bd413e360 2023-11-24T08:01:40.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.678+0000 7f5bd37fe640 1 -- 172.21.15.161:0/2096974851 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc0309a0 con 0x7f5bd413e360 2023-11-24T08:01:40.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.678+0000 7f5bd37fe640 1 -- 172.21.15.161:0/2096974851 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc030d30 con 0x7f5bd413e360 2023-11-24T08:01:40.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 -- 172.21.15.161:0/2096974851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 msgr2=0x7f5bd40cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 --2- 172.21.15.161:0/2096974851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 0x7f5bd40cf290 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009870 tx=0x7f5bbc02b980 comp rx=0 tx=0).stop 2023-11-24T08:01:40.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 -- 172.21.15.161:0/2096974851 shutdown_connections 2023-11-24T08:01:40.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 --2- 172.21.15.161:0/2096974851 >> v2:172.21.15.175:3300/0 conn(0x7f5bd415f9c0 0x7f5bd40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 --2- 172.21.15.161:0/2096974851 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd413e360 0x7f5bd40cf290 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 -- 172.21.15.161:0/2096974851 >> 172.21.15.161:0/2096974851 conn(0x7f5bd406a800 msgr2=0x7f5bd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:40.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 -- 172.21.15.161:0/2096974851 shutdown_connections 2023-11-24T08:01:40.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.679+0000 7f5bda49b640 1 -- 172.21.15.161:0/2096974851 wait complete. 2023-11-24T08:01:40.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.681+0000 7f5bda49b640 1 Processor -- start 2023-11-24T08:01:40.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.681+0000 7f5bda49b640 1 -- start start 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bda49b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 0x7f5bd4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bda49b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd413e360 0x7f5bd40aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bda49b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd415f9c0 0x7f5bd40adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bda49b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40ad500 con 0x7f5bd413df80 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bda49b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd4153a40 con 0x7f5bd413e360 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bda49b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd40a98f0 con 0x7f5bd415f9c0 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bd3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 0x7f5bd4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bd3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 0x7f5bd4153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38496/0 (socket says 172.21.15.161:38496) 2023-11-24T08:01:40.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.682+0000 7f5bd3fff640 1 -- 172.21.15.161:0/791741953 learned_addr learned my addr 172.21.15.161:0/791741953 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd3fff640 1 -- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd415f9c0 msgr2=0x7f5bd40adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd8a38640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd415f9c0 0x7f5bd40adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd3fff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd415f9c0 0x7f5bd40adbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bcbfff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd413e360 0x7f5bd40aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd3fff640 1 -- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd413e360 msgr2=0x7f5bd40aa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd3fff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd413e360 0x7f5bd40aa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd3fff640 1 -- 172.21.15.161:0/791741953 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0094d0 con 0x7f5bd413df80 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bcbfff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd413e360 0x7f5bd40aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd3fff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 0x7f5bd4153500 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c410 tx=0x7f5bc400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:40.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40035f0 con 0x7f5bd413df80 2023-11-24T08:01:40.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc4003770 con 0x7f5bd413df80 2023-11-24T08:01:40.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4003b20 con 0x7f5bd413df80 2023-11-24T08:01:40.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.683+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd40a9bd0 con 0x7f5bd413df80 2023-11-24T08:01:40.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.684+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd40aa190 con 0x7f5bd413df80 2023-11-24T08:01:40.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.685+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd40675d0 con 0x7f5bd413df80 2023-11-24T08:01:40.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.686+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5bc4003c80 con 0x7f5bd413df80 2023-11-24T08:01:40.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.686+0000 7f5bd17fa640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5bb406ae40 0x7f5bb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:40.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.686+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5bc4088850 con 0x7f5bd413df80 2023-11-24T08:01:40.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.687+0000 7f5bcbfff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5bb406ae40 0x7f5bb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:40.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.688+0000 7f5bcbfff640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5bb406ae40 0x7f5bb406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc036000 tx=0x7f5bbc03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:40.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.691+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5bc4053ce0 con 0x7f5bd413df80 2023-11-24T08:01:40.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.931+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5bd40b42a0 con 0x7f5bd413df80 2023-11-24T08:01:40.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.935+0000 7f5bd17fa640 1 -- 172.21.15.161:0/791741953 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5bc4017020 con 0x7f5bd413df80 2023-11-24T08:01:40.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5bb406ae40 msgr2=0x7f5bb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5bb406ae40 0x7f5bb406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc036000 tx=0x7f5bbc03b040 comp rx=0 tx=0).stop 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 msgr2=0x7f5bd4153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 0x7f5bd4153500 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5bc400c410 tx=0x7f5bc400c8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 shutdown_connections 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5bb406ae40 0x7f5bb406d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5bd415f9c0 0x7f5bd40adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5bd413e360 0x7f5bd40aa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 --2- 172.21.15.161:0/791741953 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5bd413df80 0x7f5bd4153500 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:40.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 >> 172.21.15.161:0/791741953 conn(0x7f5bd406a800 msgr2=0x7f5bd40cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:40.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 shutdown_connections 2023-11-24T08:01:40.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:40.938+0000 7f5bda49b640 1 -- 172.21.15.161:0/791741953 wait complete. 2023-11-24T08:01:40.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T08:01:41.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.159+0000 7fac428e7640 1 Processor -- start 2023-11-24T08:01:41.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.159+0000 7fac428e7640 1 -- start start 2023-11-24T08:01:41.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac428e7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0ae5a0 0x7fac3c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac428e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac3c0b3ae0 0x7fac3c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac428e7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac3c070c40 con 0x7fac3c06d120 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac428e7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac3c071450 con 0x7fac3c0b3ae0 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac428e7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c06c470 con 0x7fac3c0ae5a0 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac337fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac3c0b3ae0 0x7fac3c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac337fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fac3c0b3ae0 0x7fac3c06cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46884/0 (socket says 172.21.15.161:46884) 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.161+0000 7fac337fe640 1 -- 172.21.15.161:0/4108383009 learned_addr learned my addr 172.21.15.161:0/4108383009 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:41.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.162+0000 7fac3bfff640 1 --2- 172.21.15.161:0/4108383009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0ae5a0 0x7fac3c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.162+0000 7fac337fe640 1 -- 172.21.15.161:0/4108383009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0ae5a0 msgr2=0x7fac3c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:41.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.162+0000 7fac337fe640 1 --2- 172.21.15.161:0/4108383009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0ae5a0 0x7fac3c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.162+0000 7fac337fe640 1 -- 172.21.15.161:0/4108383009 >> v1:172.21.15.175:6789/0 conn(0x7fac3c06d120 legacy=0x7fac3c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:41.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.162+0000 7fac337fe640 1 -- 172.21.15.161:0/4108383009 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c06c750 con 0x7fac3c0b3ae0 2023-11-24T08:01:41.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.163+0000 7fac337fe640 1 --2- 172.21.15.161:0/4108383009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c0b3ae0 0x7fac3c06cbe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac24009870 tx=0x7fac2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d3df136868ed3e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:41.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.163+0000 7fac3b7fe640 1 -- 172.21.15.161:0/4108383009 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24031640 con 0x7fac3c0b3ae0 2023-11-24T08:01:41.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.163+0000 7fac3b7fe640 1 -- 172.21.15.161:0/4108383009 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac240317a0 con 0x7fac3c0b3ae0 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.163+0000 7fac3b7fe640 1 -- 172.21.15.161:0/4108383009 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24031b30 con 0x7fac3c0b3ae0 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 -- 172.21.15.161:0/4108383009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c0b3ae0 msgr2=0x7fac3c06cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 --2- 172.21.15.161:0/4108383009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c0b3ae0 0x7fac3c06cbe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fac24009870 tx=0x7fac2402b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 -- 172.21.15.161:0/4108383009 shutdown_connections 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 --2- 172.21.15.161:0/4108383009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c0b3ae0 0x7fac3c06cbe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 --2- 172.21.15.161:0/4108383009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0ae5a0 0x7fac3c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 -- 172.21.15.161:0/4108383009 >> 172.21.15.161:0/4108383009 conn(0x7fac3c06a800 msgr2=0x7fac3c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 -- 172.21.15.161:0/4108383009 shutdown_connections 2023-11-24T08:01:41.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.164+0000 7fac428e7640 1 -- 172.21.15.161:0/4108383009 wait complete. 2023-11-24T08:01:41.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.166+0000 7fac428e7640 1 Processor -- start 2023-11-24T08:01:41.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.166+0000 7fac428e7640 1 -- start start 2023-11-24T08:01:41.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac428e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 0x7fac3c1f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac428e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c0ae5a0 0x7fac3c0cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac428e7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0b3ae0 0x7fac3c155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac428e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0ce890 con 0x7fac3c06d120 2023-11-24T08:01:41.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac428e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1f3d60 con 0x7fac3c0ae5a0 2023-11-24T08:01:41.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac428e7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c0afe30 con 0x7fac3c0b3ae0 2023-11-24T08:01:41.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac3bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 0x7fac3c1f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac3bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 0x7fac3c1f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46892/0 (socket says 172.21.15.161:46892) 2023-11-24T08:01:41.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.167+0000 7fac3bfff640 1 -- 172.21.15.161:0/2466988905 learned_addr learned my addr 172.21.15.161:0/2466988905 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac40e84640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0b3ae0 0x7fac3c155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac337fe640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c0ae5a0 0x7fac3c0cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac3bfff640 1 -- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0b3ae0 msgr2=0x7fac3c155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac3bfff640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0b3ae0 0x7fac3c155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac3bfff640 1 -- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c0ae5a0 msgr2=0x7fac3c0cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac3bfff640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c0ae5a0 0x7fac3c0cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac3bfff640 1 -- 172.21.15.161:0/2466988905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac240094d0 con 0x7fac3c06d120 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac40e84640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0b3ae0 0x7fac3c155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac3bfff640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 0x7fac3c1f3820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007ef0 tx=0x7fac2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c014620 con 0x7fac3c06d120 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c014780 con 0x7fac3c06d120 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c014b30 con 0x7fac3c06d120 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c0cdc80 con 0x7fac3c06d120 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.168+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c0ce240 con 0x7fac3c06d120 2023-11-24T08:01:41.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.170+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c0675d0 con 0x7fac3c06d120 2023-11-24T08:01:41.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.170+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac2c014c90 con 0x7fac3c06d120 2023-11-24T08:01:41.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.172+0000 7fac397fa640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac1c06ae70 0x7fac1c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.172+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac2c089c80 con 0x7fac3c06d120 2023-11-24T08:01:41.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.172+0000 7fac337fe640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac1c06ae70 0x7fac1c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.173+0000 7fac337fe640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac1c06ae70 0x7fac1c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac24036000 tx=0x7fac2403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:41.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.176+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac2c055110 con 0x7fac3c06d120 2023-11-24T08:01:41.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.437+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fac3c067d00 con 0x7fac3c06d120 2023-11-24T08:01:41.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.441+0000 7fac397fa640 1 -- 172.21.15.161:0/2466988905 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fac2c058730 con 0x7fac3c06d120 2023-11-24T08:01:41.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.443+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac1c06ae70 msgr2=0x7fac1c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac1c06ae70 0x7fac1c06d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac24036000 tx=0x7fac2403c040 comp rx=0 tx=0).stop 2023-11-24T08:01:41.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 msgr2=0x7fac3c1f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 0x7fac3c1f3820 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fac2c007ef0 tx=0x7fac2c00e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 shutdown_connections 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac1c06ae70 0x7fac1c06d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac3c0b3ae0 0x7fac3c155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac3c0ae5a0 0x7fac3c0cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 --2- 172.21.15.161:0/2466988905 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac3c06d120 0x7fac3c1f3820 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 >> 172.21.15.161:0/2466988905 conn(0x7fac3c06a800 msgr2=0x7fac3c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 shutdown_connections 2023-11-24T08:01:41.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.444+0000 7fac428e7640 1 -- 172.21.15.161:0/2466988905 wait complete. 2023-11-24T08:01:41.463 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:41.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.670+0000 7f380f59e640 1 Processor -- start 2023-11-24T08:01:41.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.670+0000 7f380f59e640 1 -- start start 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.671+0000 7f380f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 0x7f3810071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.671+0000 7f380f59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f38100ccc10 0x7f381006d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.671+0000 7f380f59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3810070e50 con 0x7f38100717d0 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f380f59e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38100723c0 con 0x7f38100ccc10 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f380f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3810144020 con 0x7f3810143c40 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f3807fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f38100717d0 0x7f38100cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51980/0 (socket says 172.21.15.161:51980) 2023-11-24T08:01:41.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f3807fff640 1 -- 172.21.15.161:0/1462849130 learned_addr learned my addr 172.21.15.161:0/1462849130 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:41.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f380e59c640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 0x7f3810071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f380ed9d640 1 --2- 172.21.15.161:0/1462849130 >> v2:172.21.15.175:3300/0 conn(0x7f38100ccc10 0x7f381006d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740046511 0 0) 0x7f3810070e50 con 0x7f38100717d0 2023-11-24T08:01:41.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.672+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37fc003520 con 0x7f38100717d0 2023-11-24T08:01:41.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2698221392 0 0) 0x7f37fc003520 con 0x7f38100717d0 2023-11-24T08:01:41.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 msgr2=0x7f3810071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 0x7f3810071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 >> v2:172.21.15.175:3300/0 conn(0x7f38100ccc10 msgr2=0x7f381006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 --2- 172.21.15.161:0/1462849130 >> v2:172.21.15.175:3300/0 conn(0x7f38100ccc10 0x7f381006d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810071e00 con 0x7f38100717d0 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f37f8001670 con 0x7f38100717d0 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 >> v1:172.21.15.161:6789/0 conn(0x7f38100717d0 legacy=0x7f38100cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f37fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 0x7f37fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37fc004d00 0x7f37fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38100723c0 con 0x7f37fc003970 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3810144020 con 0x7f37fc004d00 2023-11-24T08:01:41.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37fc00b980 con 0x7f3810143c40 2023-11-24T08:01:41.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380e59c640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f37fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f3807fff640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 0x7f37fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380e59c640 1 -- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 msgr2=0x7f37fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:41.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380e59c640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3810143c40 0x7f37fc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.673+0000 7f380e59c640 1 -- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37fc004d00 msgr2=0x7f37fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:41.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.674+0000 7f380e59c640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37fc004d00 0x7f37fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.674+0000 7f380e59c640 1 -- 172.21.15.161:0/1462849130 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37fc003520 con 0x7f37fc003970 2023-11-24T08:01:41.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380e59c640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f37fc003d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3800009ac0 tx=0x7f37fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffaa13dfef8cc28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:41.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380002c6b0 con 0x7f37fc003970 2023-11-24T08:01:41.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380002c810 con 0x7f37fc003970 2023-11-24T08:01:41.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380dd9b640 1 -- 172.21.15.161:0/1462849130 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380002cba0 con 0x7f37fc003970 2023-11-24T08:01:41.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380f59e640 1 -- 172.21.15.161:0/1462849130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 msgr2=0x7f37fc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380f59e640 1 --2- 172.21.15.161:0/1462849130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f37fc003d90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3800009ac0 tx=0x7f37fc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380ed9d640 1 -- 172.21.15.161:0/1462849130 reap_dead start 2023-11-24T08:01:41.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380f59e640 1 -- 172.21.15.161:0/1462849130 shutdown_connections 2023-11-24T08:01:41.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.675+0000 7f380f59e640 1 -- 172.21.15.161:0/1462849130 >> 172.21.15.161:0/1462849130 conn(0x7f381006a800 msgr2=0x7f381006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:41.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.676+0000 7f380f59e640 1 -- 172.21.15.161:0/1462849130 shutdown_connections 2023-11-24T08:01:41.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.676+0000 7f380f59e640 1 -- 172.21.15.161:0/1462849130 wait complete. 2023-11-24T08:01:41.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.677+0000 7f380f59e640 1 Processor -- start 2023-11-24T08:01:41.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 -- start start 2023-11-24T08:01:41.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f381012b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38100c7400 0x7f381006d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38100c7880 0x7f381006d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381015afa0 con 0x7f37fc003970 2023-11-24T08:01:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38100c7da0 con 0x7f38100c7400 2023-11-24T08:01:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.678+0000 7f380f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38100c97b0 con 0x7f38100c7880 2023-11-24T08:01:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f381012b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f381012b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46916/0 (socket says 172.21.15.161:46916) 2023-11-24T08:01:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 -- 172.21.15.161:0/946543634 learned_addr learned my addr 172.21.15.161:0/946543634 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 -- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38100c7880 msgr2=0x7f381006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380ed9d640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38100c7880 0x7f381006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f3807fff640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38100c7400 0x7f381006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38100c7880 0x7f381006d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 -- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38100c7400 msgr2=0x7f381006d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38100c7400 0x7f381006d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 -- 172.21.15.161:0/946543634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38100c9a90 con 0x7f37fc003970 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f3807fff640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38100c7400 0x7f381006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.679+0000 7f380e59c640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f381012b520 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f380002c250 tx=0x7f3800004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.680+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800003810 con 0x7f37fc003970 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.680+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800003970 con 0x7f37fc003970 2023-11-24T08:01:41.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.680+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3800003ce0 con 0x7f37fc003970 2023-11-24T08:01:41.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.680+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38100c9d70 con 0x7f37fc003970 2023-11-24T08:01:41.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.680+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38100c4210 con 0x7f37fc003970 2023-11-24T08:01:41.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.681+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3810067450 con 0x7f37fc003970 2023-11-24T08:01:41.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.682+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3800034440 con 0x7f37fc003970 2023-11-24T08:01:41.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.683+0000 7f3806ffd640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37f006ae70 0x7f37f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:41.693 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.683+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f38000ab580 con 0x7f37fc003970 2023-11-24T08:01:41.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.683+0000 7f3807fff640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37f006ae70 0x7f37f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:41.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.685+0000 7f3807fff640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37f006ae70 0x7f37f006d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37f80017a0 tx=0x7f37f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:41.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.688+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3800076a20 con 0x7f37fc003970 2023-11-24T08:01:41.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.883+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38100ceb30 con 0x7f37fc003970 2023-11-24T08:01:41.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.885+0000 7f3806ffd640 1 -- 172.21.15.161:0/946543634 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f38000044e0 con 0x7f37fc003970 2023-11-24T08:01:41.886 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:41.886 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":31,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:37.859684+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37f006ae70 msgr2=0x7f37f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37f006ae70 0x7f37f006d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f37f80017a0 tx=0x7f37f8009040 comp rx=0 tx=0).stop 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 msgr2=0x7f381012b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f381012b520 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f380002c250 tx=0x7f3800004730 comp rx=0 tx=0).stop 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 shutdown_connections 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37f006ae70 0x7f37f006d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38100c7880 0x7f381006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38100c7400 0x7f381006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 --2- 172.21.15.161:0/946543634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37fc003970 0x7f381012b520 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:41.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 >> 172.21.15.161:0/946543634 conn(0x7f381006a800 msgr2=0x7f38100cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:41.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 shutdown_connections 2023-11-24T08:01:41.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:41.888+0000 7f380f59e640 1 -- 172.21.15.161:0/946543634 wait complete. 2023-11-24T08:01:41.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:01:41.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:01:42.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.117+0000 7f545e7a9640 1 Processor -- start 2023-11-24T08:01:42.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.117+0000 7f545e7a9640 1 -- start start 2023-11-24T08:01:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.119+0000 7f545e7a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5458143ae0 0x7f54580cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.119+0000 7f545e7a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f54580702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.119+0000 7f545e7a9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580cfc30 con 0x7f54580cf7d0 2023-11-24T08:01:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.119+0000 7f545e7a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54580b1ee0 con 0x7f5458143ae0 2023-11-24T08:01:42.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.119+0000 7f545e7a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580b2780 con 0x7f545815e3b0 2023-11-24T08:01:42.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.120+0000 7f544ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f54580cf7d0 0x7f545815dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:42488/0 (socket says 172.21.15.161:42488) 2023-11-24T08:01:42.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.120+0000 7f544ffff640 1 -- 172.21.15.161:0/3024523219 learned_addr learned my addr 172.21.15.161:0/3024523219 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:42.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.120+0000 7f545cd46640 1 --2- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f54580702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.120+0000 7f5457fff640 1 --2- 172.21.15.161:0/3024523219 >> v2:172.21.15.175:3300/0 conn(0x7f5458143ae0 0x7f54580cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.121+0000 7f5457fff640 1 -- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 msgr2=0x7f54580702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:42.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.121+0000 7f5457fff640 1 --2- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f54580702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.121+0000 7f5457fff640 1 -- 172.21.15.161:0/3024523219 >> v1:172.21.15.175:6789/0 conn(0x7f54580cf7d0 legacy=0x7f545815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.121+0000 7f5457fff640 1 -- 172.21.15.161:0/3024523219 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545815e990 con 0x7f5458143ae0 2023-11-24T08:01:42.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.122+0000 7f5457fff640 1 --2- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5458143ae0 0x7f54580cf290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54480097a0 tx=0x7f544802dac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72a3ccc2f523ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:42.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.123+0000 7f54577fe640 1 -- 172.21.15.161:0/3024523219 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544802f880 con 0x7f5458143ae0 2023-11-24T08:01:42.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.123+0000 7f54577fe640 1 -- 172.21.15.161:0/3024523219 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544802f9e0 con 0x7f5458143ae0 2023-11-24T08:01:42.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.123+0000 7f54577fe640 1 -- 172.21.15.161:0/3024523219 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544802fd70 con 0x7f5458143ae0 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.123+0000 7f545e7a9640 1 -- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5458143ae0 msgr2=0x7f54580cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.123+0000 7f545e7a9640 1 --2- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5458143ae0 0x7f54580cf290 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f54480097a0 tx=0x7f544802dac0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.124+0000 7f545e7a9640 1 -- 172.21.15.161:0/3024523219 shutdown_connections 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.124+0000 7f545e7a9640 1 --2- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f54580702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.124+0000 7f545e7a9640 1 --2- 172.21.15.161:0/3024523219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5458143ae0 0x7f54580cf290 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.124+0000 7f545e7a9640 1 -- 172.21.15.161:0/3024523219 >> 172.21.15.161:0/3024523219 conn(0x7f545806a800 msgr2=0x7f545806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.124+0000 7f545e7a9640 1 -- 172.21.15.161:0/3024523219 shutdown_connections 2023-11-24T08:01:42.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.124+0000 7f545e7a9640 1 -- 172.21.15.161:0/3024523219 wait complete. 2023-11-24T08:01:42.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.125+0000 7f545e7a9640 1 Processor -- start 2023-11-24T08:01:42.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.126+0000 7f545e7a9640 1 -- start start 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.126+0000 7f545e7a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54580cf7d0 0x7f5458159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.126+0000 7f545e7a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 0x7f5458141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f545e7a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f5458140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f545e7a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581403d0 con 0x7f5458143ae0 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f545e7a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458159fd0 con 0x7f54580cf7d0 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f545e7a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54581416b0 con 0x7f545815e3b0 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 0x7f5458141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 0x7f5458141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46930/0 (socket says 172.21.15.161:46930) 2023-11-24T08:01:42.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 -- 172.21.15.161:0/2864767816 learned_addr learned my addr 172.21.15.161:0/2864767816 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:42.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f5457fff640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54580cf7d0 0x7f5458159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f545cd46640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f5458140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 -- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 msgr2=0x7f5458140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f5458140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 -- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54580cf7d0 msgr2=0x7f5458159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54580cf7d0 0x7f5458159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f544ffff640 1 -- 172.21.15.161:0/2864767816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448009400 con 0x7f5458143ae0 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.127+0000 7f545cd46640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f5458140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.128+0000 7f544ffff640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 0x7f5458141170 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f544000c400 tx=0x7f544000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.128+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440005ce0 con 0x7f5458143ae0 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.128+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440005e40 con 0x7f5458143ae0 2023-11-24T08:01:42.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.128+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545813f7c0 con 0x7f5458143ae0 2023-11-24T08:01:42.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.128+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54400072d0 con 0x7f5458143ae0 2023-11-24T08:01:42.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.128+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545813fd80 con 0x7f5458143ae0 2023-11-24T08:01:42.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.129+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5458140540 con 0x7f5458143ae0 2023-11-24T08:01:42.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.130+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f54400074f0 con 0x7f5458143ae0 2023-11-24T08:01:42.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.131+0000 7f54557fa640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f543806ae40 0x7f543806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.131+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f54400888f0 con 0x7f5458143ae0 2023-11-24T08:01:42.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.132+0000 7f5457fff640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f543806ae40 0x7f543806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.133+0000 7f5457fff640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f543806ae40 0x7f543806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5448038000 tx=0x7f5448008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:42.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.136+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5440053ce0 con 0x7f5458143ae0 2023-11-24T08:01:42.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.327+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54580675d0 con 0x7f5458143ae0 2023-11-24T08:01:42.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.328+0000 7f54557fa640 1 -- 172.21.15.161:0/2864767816 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5440017020 con 0x7f5458143ae0 2023-11-24T08:01:42.329 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:01:42.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f543806ae40 msgr2=0x7f543806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f543806ae40 0x7f543806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5448038000 tx=0x7f5448008030 comp rx=0 tx=0).stop 2023-11-24T08:01:42.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 msgr2=0x7f5458141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 0x7f5458141170 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f544000c400 tx=0x7f544000c8c0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 shutdown_connections 2023-11-24T08:01:42.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f543806ae40 0x7f543806d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f545815e3b0 0x7f5458140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5458143ae0 0x7f5458141170 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.330+0000 7f545e7a9640 1 --2- 172.21.15.161:0/2864767816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f54580cf7d0 0x7f5458159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.331+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 >> 172.21.15.161:0/2864767816 conn(0x7f545806a800 msgr2=0x7f545815b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:42.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.331+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 shutdown_connections 2023-11-24T08:01:42.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.331+0000 7f545e7a9640 1 -- 172.21.15.161:0/2864767816 wait complete. 2023-11-24T08:01:42.350 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:01:42.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.567+0000 7f6a74e31640 1 Processor -- start 2023-11-24T08:01:42.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.567+0000 7f6a74e31640 1 -- start start 2023-11-24T08:01:42.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.568+0000 7f6a74e31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6a7013df80 0x7f6a7015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.568+0000 7f6a74e31640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a700cf9a0 0x7f6a700cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.568+0000 7f6a74e31640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a7006c470 con 0x7f6a7013e360 2023-11-24T08:01:42.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.568+0000 7f6a74e31640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7006c750 con 0x7f6a700cf9a0 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.568+0000 7f6a74e31640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a7006ca30 con 0x7f6a7013df80 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a700cf9a0 0x7f6a700cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a700cf9a0 0x7f6a700cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46946/0 (socket says 172.21.15.161:46946) 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 -- 172.21.15.161:0/3610535282 learned_addr learned my addr 172.21.15.161:0/3610535282 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6e59c640 1 --2- 172.21.15.161:0/3610535282 >> v2:172.21.15.175:3300/0 conn(0x7f6a7013df80 0x7f6a7015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 -- 172.21.15.161:0/3610535282 >> v2:172.21.15.175:3300/0 conn(0x7f6a7013df80 msgr2=0x7f6a7015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:42.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 --2- 172.21.15.161:0/3610535282 >> v2:172.21.15.175:3300/0 conn(0x7f6a7013df80 0x7f6a7015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 -- 172.21.15.161:0/3610535282 >> v1:172.21.15.175:6789/0 conn(0x7f6a7013e360 legacy=0x7f6a700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:42.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.569+0000 7f6a6ed9d640 1 -- 172.21.15.161:0/3610535282 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7006cd10 con 0x7f6a700cf9a0 2023-11-24T08:01:42.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.570+0000 7f6a6ed9d640 1 --2- 172.21.15.161:0/3610535282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a700cd840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6a70072770 tx=0x7f6a6802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2520bd63fc61944a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:42.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a6d59a640 1 -- 172.21.15.161:0/3610535282 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6802ca80 con 0x7f6a700cf9a0 2023-11-24T08:01:42.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a6d59a640 1 -- 172.21.15.161:0/3610535282 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6802cbe0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a6d59a640 1 -- 172.21.15.161:0/3610535282 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a680343f0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a74e31640 1 -- 172.21.15.161:0/3610535282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 msgr2=0x7f6a700cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a74e31640 1 --2- 172.21.15.161:0/3610535282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a700cd840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f6a70072770 tx=0x7f6a6802bee0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a74e31640 1 -- 172.21.15.161:0/3610535282 shutdown_connections 2023-11-24T08:01:42.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a74e31640 1 --2- 172.21.15.161:0/3610535282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a700cd840 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a74e31640 1 --2- 172.21.15.161:0/3610535282 >> v2:172.21.15.175:3300/0 conn(0x7f6a7013df80 0x7f6a7015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.571+0000 7f6a74e31640 1 -- 172.21.15.161:0/3610535282 >> 172.21.15.161:0/3610535282 conn(0x7f6a7006a800 msgr2=0x7f6a7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.572+0000 7f6a74e31640 1 -- 172.21.15.161:0/3610535282 shutdown_connections 2023-11-24T08:01:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.572+0000 7f6a74e31640 1 -- 172.21.15.161:0/3610535282 wait complete. 2023-11-24T08:01:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.573+0000 7f6a74e31640 1 Processor -- start 2023-11-24T08:01:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.574+0000 7f6a74e31640 1 -- start start 2023-11-24T08:01:42.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.574+0000 7f6a74e31640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a701e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.574+0000 7f6a74e31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a7013df80 0x7f6a70152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a74e31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a7013e360 0x7f6a70153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a74e31640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b37e0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a74e31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b3500 con 0x7f6a7013e360 2023-11-24T08:01:42.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a74e31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701e4cf0 con 0x7f6a7013df80 2023-11-24T08:01:42.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a701e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a701e78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46952/0 (socket says 172.21.15.161:46952) 2023-11-24T08:01:42.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 -- 172.21.15.161:0/2115016461 learned_addr learned my addr 172.21.15.161:0/2115016461 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 -- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a7013df80 msgr2=0x7f6a70152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6dd9b640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a7013df80 0x7f6a70152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a7013df80 0x7f6a70152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 -- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a7013e360 msgr2=0x7f6a70153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a7013e360 0x7f6a70153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6e59c640 1 -- 172.21.15.161:0/2115016461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a68009b30 con 0x7f6a700cf9a0 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.575+0000 7f6a6dd9b640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a7013df80 0x7f6a70152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:42.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.576+0000 7f6a6e59c640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a701e78e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000d800 tx=0x7f6a6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:42.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.576+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000b6c0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.576+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6000b820 con 0x7f6a700cf9a0 2023-11-24T08:01:42.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.576+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a701e4fd0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.576+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6000bbb0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.576+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a701e7e20 con 0x7f6a700cf9a0 2023-11-24T08:01:42.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.577+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a701e7fe0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.578+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a6000bd10 con 0x7f6a700cf9a0 2023-11-24T08:01:42.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.579+0000 7f6a5effd640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6a5006ae40 0x7f6a5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:42.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.579+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a60089820 con 0x7f6a700cf9a0 2023-11-24T08:01:42.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.580+0000 7f6a6dd9b640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6a5006ae40 0x7f6a5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:42.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.581+0000 7f6a6dd9b640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6a5006ae40 0x7f6a5006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6a7013df30 tx=0x7f6a64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:42.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.584+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a60054c20 con 0x7f6a700cf9a0 2023-11-24T08:01:42.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.775+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6a700675d0 con 0x7f6a700cf9a0 2023-11-24T08:01:42.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.776+0000 7f6a5effd640 1 -- 172.21.15.161:0/2115016461 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6a60058240 con 0x7f6a700cf9a0 2023-11-24T08:01:42.777 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:42.777 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:01:42.777 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:42.777 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2023-11-24T08:01:42.777 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2023-11-24T08:01:42.778 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:42.778 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:01:42.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6a5006ae40 msgr2=0x7f6a5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6a5006ae40 0x7f6a5006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6a7013df30 tx=0x7f6a64009040 comp rx=0 tx=0).stop 2023-11-24T08:01:42.780 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 msgr2=0x7f6a701e78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a701e78e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6a6000d800 tx=0x7f6a6000dcc0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 shutdown_connections 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6a5006ae40 0x7f6a5006d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6a7013e360 0x7f6a70153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6a7013df80 0x7f6a70152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 --2- 172.21.15.161:0/2115016461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a700cf9a0 0x7f6a701e78e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 >> 172.21.15.161:0/2115016461 conn(0x7f6a7006a800 msgr2=0x7f6a7015d390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 shutdown_connections 2023-11-24T08:01:42.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:42.779+0000 7f6a74e31640 1 -- 172.21.15.161:0/2115016461 wait complete. 2023-11-24T08:01:42.800 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:01:42.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:01:43.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.020+0000 7f5c762bb640 1 Processor -- start 2023-11-24T08:01:43.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.020+0000 7f5c762bb640 1 -- start start 2023-11-24T08:01:43.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c762bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c70143ae0 0x7f5c700cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:43.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c762bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5c7015e3b0 0x7f5c700702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:43.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c762bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c700cfc30 con 0x7f5c700cf7d0 2023-11-24T08:01:43.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c762bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c700b1ee0 con 0x7f5c7015e3b0 2023-11-24T08:01:43.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c762bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700b2780 con 0x7f5c70143ae0 2023-11-24T08:01:43.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c74858640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5c7015e3b0 0x7f5c700702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:43.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c6f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5c700cf7d0 0x7f5c7015dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:51992/0 (socket says 172.21.15.161:51992) 2023-11-24T08:01:43.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.022+0000 7f5c6f7fe640 1 -- 172.21.15.161:0/2746909062 learned_addr learned my addr 172.21.15.161:0/2746909062 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:43.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.023+0000 7f5c6ffff640 1 --2- 172.21.15.161:0/2746909062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c70143ae0 0x7f5c700cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:43.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.023+0000 7f5c74858640 1 -- 172.21.15.161:0/2746909062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c70143ae0 msgr2=0x7f5c700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:43.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.023+0000 7f5c74858640 1 --2- 172.21.15.161:0/2746909062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c70143ae0 0x7f5c700cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.023+0000 7f5c74858640 1 -- 172.21.15.161:0/2746909062 >> v1:172.21.15.161:6789/0 conn(0x7f5c700cf7d0 legacy=0x7f5c7015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:43.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.023+0000 7f5c74858640 1 -- 172.21.15.161:0/2746909062 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7015e990 con 0x7f5c7015e3b0 2023-11-24T08:01:43.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.023+0000 7f5c6effd640 1 -- 172.21.15.161:0/2746909062 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362854665 0 0) 0x7f5c700cfc30 con 0x7f5c700cf7d0 2023-11-24T08:01:43.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.024+0000 7f5c74858640 1 --2- 172.21.15.161:0/2746909062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c7015e3b0 0x7f5c700702c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009d90 tx=0x7f5c6802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1094a250da06b113 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:43.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.024+0000 7f5c6effd640 1 -- 172.21.15.161:0/2746909062 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6802cc50 con 0x7f5c7015e3b0 2023-11-24T08:01:43.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.024+0000 7f5c6effd640 1 -- 172.21.15.161:0/2746909062 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6802cdb0 con 0x7f5c7015e3b0 2023-11-24T08:01:43.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.024+0000 7f5c6effd640 1 -- 172.21.15.161:0/2746909062 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c68034660 con 0x7f5c7015e3b0 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 -- 172.21.15.161:0/2746909062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c7015e3b0 msgr2=0x7f5c700702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2746909062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c7015e3b0 0x7f5c700702c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009d90 tx=0x7f5c6802bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 -- 172.21.15.161:0/2746909062 shutdown_connections 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2746909062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c7015e3b0 0x7f5c700702c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2746909062 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c70143ae0 0x7f5c700cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 -- 172.21.15.161:0/2746909062 >> 172.21.15.161:0/2746909062 conn(0x7f5c7006a800 msgr2=0x7f5c7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 -- 172.21.15.161:0/2746909062 shutdown_connections 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.025+0000 7f5c762bb640 1 -- 172.21.15.161:0/2746909062 wait complete. 2023-11-24T08:01:43.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.027+0000 7f5c762bb640 1 Processor -- start 2023-11-24T08:01:43.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.027+0000 7f5c762bb640 1 -- start start 2023-11-24T08:01:43.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c762bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c700cf7d0 0x7f5c700afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:43.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c762bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 0x7f5c70140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:43.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c762bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c7015e3b0 0x7f5c700ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:43.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c762bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700b0700 con 0x7f5c70143ae0 2023-11-24T08:01:43.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c762bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c700affb0 con 0x7f5c7015e3b0 2023-11-24T08:01:43.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c762bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7013f450 con 0x7f5c700cf7d0 2023-11-24T08:01:43.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c6f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 0x7f5c70140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:43.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c6f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 0x7f5c70140e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:46982/0 (socket says 172.21.15.161:46982) 2023-11-24T08:01:43.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c6f7fe640 1 -- 172.21.15.161:0/2742150400 learned_addr learned my addr 172.21.15.161:0/2742150400 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:43.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c6ffff640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c700cf7d0 0x7f5c700afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:43.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c6f7fe640 1 -- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c700cf7d0 msgr2=0x7f5c700afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:43.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.028+0000 7f5c6f7fe640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c700cf7d0 0x7f5c700afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c74858640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c7015e3b0 0x7f5c700ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6f7fe640 1 -- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c7015e3b0 msgr2=0x7f5c700ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6f7fe640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c7015e3b0 0x7f5c700ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6f7fe640 1 -- 172.21.15.161:0/2742150400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c68009a70 con 0x7f5c70143ae0 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6ffff640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c700cf7d0 0x7f5c700afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6f7fe640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 0x7f5c70140e40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c4d0 tx=0x7f5c5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580074e0 con 0x7f5c70143ae0 2023-11-24T08:01:43.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58007660 con 0x7f5c70143ae0 2023-11-24T08:01:43.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c7013f730 con 0x7f5c70143ae0 2023-11-24T08:01:43.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58004a20 con 0x7f5c70143ae0 2023-11-24T08:01:43.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.029+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c7013fcf0 con 0x7f5c70143ae0 2023-11-24T08:01:43.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.030+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c701f31d0 con 0x7f5c70143ae0 2023-11-24T08:01:43.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.031+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5c58004b80 con 0x7f5c70143ae0 2023-11-24T08:01:43.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.032+0000 7f5c6cff9640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5c5006ae40 0x7f5c5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:43.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.032+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c580885e0 con 0x7f5c70143ae0 2023-11-24T08:01:43.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.033+0000 7f5c6ffff640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5c5006ae40 0x7f5c5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:43.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.034+0000 7f5c6ffff640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5c5006ae40 0x7f5c5006d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:43.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.037+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5c580538b0 con 0x7f5c70143ae0 2023-11-24T08:01:43.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.228+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5c700b28f0 con 0x7f5c70143ae0 2023-11-24T08:01:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.886+0000 7f5c6cff9640 1 -- 172.21.15.161:0/2742150400 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5c58018020 con 0x7f5c70143ae0 2023-11-24T08:01:43.888 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2023-11-24T08:01:43.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5c5006ae40 msgr2=0x7f5c5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:43.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5c5006ae40 0x7f5c5006d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c60006fd0 tx=0x7f5c60008040 comp rx=0 tx=0).stop 2023-11-24T08:01:43.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 msgr2=0x7f5c70140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:43.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 0x7f5c70140e40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c4d0 tx=0x7f5c5800c990 comp rx=0 tx=0).stop 2023-11-24T08:01:43.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 shutdown_connections 2023-11-24T08:01:43.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5c5006ae40 0x7f5c5006d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5c7015e3b0 0x7f5c700ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5c70143ae0 0x7f5c70140e40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 --2- 172.21.15.161:0/2742150400 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5c700cf7d0 0x7f5c700afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 >> 172.21.15.161:0/2742150400 conn(0x7f5c7006a800 msgr2=0x7f5c700b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 shutdown_connections 2023-11-24T08:01:43.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:43.890+0000 7f5c762bb640 1 -- 172.21.15.161:0/2742150400 wait complete. 2023-11-24T08:01:43.919 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:01:44.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.120+0000 7f66ae5b7640 1 Processor -- start 2023-11-24T08:01:44.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.120+0000 7f66ae5b7640 1 -- start start 2023-11-24T08:01:44.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66ae5b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 0x7f66a8071080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66ae5b7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a8070bf0 con 0x7f66a80b2660 2023-11-24T08:01:44.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66ae5b7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66a80702e0 con 0x7f66a8160fe0 2023-11-24T08:01:44.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66ae5b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80b2cc0 con 0x7f66a80ce490 2023-11-24T08:01:44.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66acb54640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f66a80b2660 0x7f66a80acd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:52008/0 (socket says 172.21.15.161:52008) 2023-11-24T08:01:44.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66acb54640 1 -- 172.21.15.161:0/317137158 learned_addr learned my addr 172.21.15.161:0/317137158 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.122+0000 7f66a7fff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 0x7f66a8071080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760981125 0 0) 0x7f66a8070bf0 con 0x7f66a80b2660 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6694003520 con 0x7f66a80b2660 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 918943689 0 0) 0x7f6694003520 con 0x7f66a80b2660 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 msgr2=0x7f66a8071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 0x7f66a8071080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 >> v1:172.21.15.175:6789/0 conn(0x7f66a8160fe0 legacy=0x7f66a80b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80705a0 con 0x7f66a80b2660 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f66a00019f0 con 0x7f66a80b2660 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 >> v1:172.21.15.161:6789/0 conn(0x7f66a80b2660 legacy=0x7f66a80acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f6694003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6694004350 0x7f6694004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 0x7f6694005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a80b2cc0 con 0x7f66940039a0 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669400b980 con 0x7f6694004350 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.123+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669400bb40 con 0x7f66a80ce490 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f66a7fff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f6694003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f669ffff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6694004350 0x7f6694004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:44.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f66a7fff640 1 -- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 msgr2=0x7f6694005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:44.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f66a7fff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a80ce490 0x7f6694005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f66a7fff640 1 -- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6694004350 msgr2=0x7f6694004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:44.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f66a7fff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6694004350 0x7f6694004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f66a7fff640 1 -- 172.21.15.161:0/317137158 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694003520 con 0x7f66940039a0 2023-11-24T08:01:44.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.124+0000 7f669ffff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6694004350 0x7f6694004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:44.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.125+0000 7f66a7fff640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f6694003d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6698009ac0 tx=0x7f66940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebc2e98ce3e7677 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:44.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.126+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669802c710 con 0x7f66940039a0 2023-11-24T08:01:44.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.126+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669802c870 con 0x7f66940039a0 2023-11-24T08:01:44.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.126+0000 7f66a77fe640 1 -- 172.21.15.161:0/317137158 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669802cc00 con 0x7f66940039a0 2023-11-24T08:01:44.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.126+0000 7f66ae5b7640 1 -- 172.21.15.161:0/317137158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 msgr2=0x7f6694003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.126+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/317137158 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f6694003d80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6698009ac0 tx=0x7f66940057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.126+0000 7f66acb54640 1 -- 172.21.15.161:0/317137158 reap_dead start 2023-11-24T08:01:44.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.127+0000 7f66ae5b7640 1 -- 172.21.15.161:0/317137158 shutdown_connections 2023-11-24T08:01:44.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.127+0000 7f66ae5b7640 1 -- 172.21.15.161:0/317137158 >> 172.21.15.161:0/317137158 conn(0x7f66a80b0be0 msgr2=0x7f66a80b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:44.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.127+0000 7f66ae5b7640 1 -- 172.21.15.161:0/317137158 shutdown_connections 2023-11-24T08:01:44.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.127+0000 7f66ae5b7640 1 -- 172.21.15.161:0/317137158 wait complete. 2023-11-24T08:01:44.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.129+0000 7f66ae5b7640 1 Processor -- start 2023-11-24T08:01:44.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.129+0000 7f66ae5b7640 1 -- start start 2023-11-24T08:01:44.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66ae5b7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f66a815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66ae5b7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a815d980 0x7f66a8140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66ae5b7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a8140f60 0x7f66a8141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66ae5b7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815e1b0 con 0x7f66940039a0 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66ae5b7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815e490 con 0x7f66a8140f60 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66ae5b7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66a815e770 con 0x7f66a815d980 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66a7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f66a815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66a7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f66a815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47004/0 (socket says 172.21.15.161:47004) 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66a7fff640 1 -- 172.21.15.161:0/1348057037 learned_addr learned my addr 172.21.15.161:0/1348057037 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66a7fff640 1 -- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a815d980 msgr2=0x7f66a8140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f669ffff640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a815d980 0x7f66a8140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.130+0000 7f66a7fff640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a815d980 0x7f66a8140a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a7fff640 1 -- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a8140f60 msgr2=0x7f66a8141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a7fff640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a8140f60 0x7f66a8141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a7fff640 1 -- 172.21.15.161:0/1348057037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a80aeaf0 con 0x7f66940039a0 2023-11-24T08:01:44.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a7fff640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f66a815d440 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6698037040 tx=0x7f6698004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698003810 con 0x7f66940039a0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698003970 con 0x7f66940039a0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698003d20 con 0x7f66940039a0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a80aedd0 con 0x7f66940039a0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.131+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a813e560 con 0x7f66940039a0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.132+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a80ae950 con 0x7f66940039a0 2023-11-24T08:01:44.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.134+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6698040450 con 0x7f66940039a0 2023-11-24T08:01:44.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.135+0000 7f66a57fa640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f668806ae70 0x7f668806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:44.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.135+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f66980ab870 con 0x7f66940039a0 2023-11-24T08:01:44.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.136+0000 7f669ffff640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f668806ae70 0x7f668806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:44.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.137+0000 7f669ffff640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f668806ae70 0x7f668806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f66a815a740 tx=0x7f6690009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:44.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.140+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6698076ae0 con 0x7f66940039a0 2023-11-24T08:01:44.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.326+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f66a80ae950 con 0x7f66940039a0 2023-11-24T08:01:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.900+0000 7f66a57fa640 1 -- 172.21.15.161:0/1348057037 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f66a80ae950 con 0x7f66940039a0 2023-11-24T08:01:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2023-11-24T08:01:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f668806ae70 msgr2=0x7f668806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f668806ae70 0x7f668806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f66a815a740 tx=0x7f6690009040 comp rx=0 tx=0).stop 2023-11-24T08:01:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 msgr2=0x7f66a815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f66a815d440 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6698037040 tx=0x7f6698004730 comp rx=0 tx=0).stop 2023-11-24T08:01:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 shutdown_connections 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f668806ae70 0x7f668806d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66a8140f60 0x7f66a8141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66a815d980 0x7f66a8140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 --2- 172.21.15.161:0/1348057037 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f66940039a0 0x7f66a815d440 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.904+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 >> 172.21.15.161:0/1348057037 conn(0x7f66a80b0be0 msgr2=0x7f66a8161440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.905+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 shutdown_connections 2023-11-24T08:01:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:44.905+0000 7f66ae5b7640 1 -- 172.21.15.161:0/1348057037 wait complete. 2023-11-24T08:01:44.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:01:45.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.120+0000 7f4d0a648640 1 Processor -- start 2023-11-24T08:01:45.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.120+0000 7f4d0a648640 1 -- start start 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d0a648640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4d040cf9a0 0x7f4d04166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d0a648640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0415c5f0 con 0x7f4d0413df80 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d0a648640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0406c470 con 0x7f4d0413e360 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d0a648640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0406c750 con 0x7f4d040cf9a0 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d03fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4d0413df80 0x7f4d0415bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:52010/0 (socket says 172.21.15.161:52010) 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d03fff640 1 -- 172.21.15.161:0/1304884993 learned_addr learned my addr 172.21.15.161:0/1304884993 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:45.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d08be5640 1 --2- 172.21.15.161:0/1304884993 >> v2:172.21.15.161:3300/0 conn(0x7f4d040cf9a0 0x7f4d04166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:45.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d02ffd640 1 -- 172.21.15.161:0/1304884993 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846911468 0 0) 0x7f4d0415c5f0 con 0x7f4d0413df80 2023-11-24T08:01:45.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d02ffd640 1 -- 172.21.15.161:0/1304884993 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf0003520 con 0x7f4d0413df80 2023-11-24T08:01:45.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.122+0000 7f4d08be5640 1 -- 172.21.15.161:0/1304884993 >> v1:172.21.15.175:6789/0 conn(0x7f4d0413e360 legacy=0x7f4d040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:45.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.123+0000 7f4d08be5640 1 -- 172.21.15.161:0/1304884993 >> v1:172.21.15.161:6789/0 conn(0x7f4d0413df80 legacy=0x7f4d0415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:45.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.123+0000 7f4d08be5640 1 -- 172.21.15.161:0/1304884993 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0406ca30 con 0x7f4d040cf9a0 2023-11-24T08:01:45.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.124+0000 7f4d08be5640 1 --2- 172.21.15.161:0/1304884993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d040cf9a0 0x7f4d04166030 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009d90 tx=0x7f4cfc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf9351686348d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.124+0000 7f4d02ffd640 1 -- 172.21.15.161:0/1304884993 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc02cc60 con 0x7f4d040cf9a0 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.124+0000 7f4d02ffd640 1 -- 172.21.15.161:0/1304884993 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc02cdc0 con 0x7f4d040cf9a0 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.124+0000 7f4d02ffd640 1 -- 172.21.15.161:0/1304884993 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc034640 con 0x7f4d040cf9a0 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.124+0000 7f4d0a648640 1 -- 172.21.15.161:0/1304884993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d040cf9a0 msgr2=0x7f4d04166030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.124+0000 7f4d0a648640 1 --2- 172.21.15.161:0/1304884993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d040cf9a0 0x7f4d04166030 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009d90 tx=0x7f4cfc02beb0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.125+0000 7f4d0a648640 1 -- 172.21.15.161:0/1304884993 shutdown_connections 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.125+0000 7f4d0a648640 1 --2- 172.21.15.161:0/1304884993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d040cf9a0 0x7f4d04166030 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.125+0000 7f4d0a648640 1 -- 172.21.15.161:0/1304884993 >> 172.21.15.161:0/1304884993 conn(0x7f4d0406a800 msgr2=0x7f4d0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.125+0000 7f4d0a648640 1 -- 172.21.15.161:0/1304884993 shutdown_connections 2023-11-24T08:01:45.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.125+0000 7f4d0a648640 1 -- 172.21.15.161:0/1304884993 wait complete. 2023-11-24T08:01:45.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.126+0000 7f4d0a648640 1 Processor -- start 2023-11-24T08:01:45.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.126+0000 7f4d0a648640 1 -- start start 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.127+0000 7f4d0a648640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d040cf9a0 0x7f4d040adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.127+0000 7f4d0a648640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d0413df80 0x7f4d0415a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.127+0000 7f4d0a648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 0x7f4d04132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.127+0000 7f4d0a648640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040ae2e0 con 0x7f4d0413e360 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.127+0000 7f4d0a648640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0412f800 con 0x7f4d040cf9a0 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.127+0000 7f4d0a648640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0412fae0 con 0x7f4d0413df80 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 0x7f4d04132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 0x7f4d04132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47030/0 (socket says 172.21.15.161:47030) 2023-11-24T08:01:45.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 -- 172.21.15.161:0/636541463 learned_addr learned my addr 172.21.15.161:0/636541463 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d03fff640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d040cf9a0 0x7f4d040adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d037fe640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d0413df80 0x7f4d0415a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 -- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d0413df80 msgr2=0x7f4d0415a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d0413df80 0x7f4d0415a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 -- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d040cf9a0 msgr2=0x7f4d040adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d040cf9a0 0x7f4d040adda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.128+0000 7f4d08be5640 1 -- 172.21.15.161:0/636541463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009a70 con 0x7f4d0413e360 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.129+0000 7f4d08be5640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 0x7f4d04132880 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009eb0 tx=0x7f4cfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.129+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc009450 con 0x7f4d0413e360 2023-11-24T08:01:45.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.129+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc03f420 con 0x7f4d0413e360 2023-11-24T08:01:45.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.129+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc03f7d0 con 0x7f4d0413e360 2023-11-24T08:01:45.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.129+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0412fdc0 con 0x7f4d0413e360 2023-11-24T08:01:45.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.129+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d04130380 con 0x7f4d0413e360 2023-11-24T08:01:45.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.130+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d040675d0 con 0x7f4d0413e360 2023-11-24T08:01:45.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.131+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4cfc03f930 con 0x7f4d0413e360 2023-11-24T08:01:45.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.132+0000 7f4d00ff9640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4ce406ae40 0x7f4ce406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:45.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.132+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4cfc0abeb0 con 0x7f4d0413e360 2023-11-24T08:01:45.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.132+0000 7f4d03fff640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4ce406ae40 0x7f4ce406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:45.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.133+0000 7f4d03fff640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4ce406ae40 0x7f4ce406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4000f60 tx=0x7f4cf4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:45.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.137+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4cfc076fc0 con 0x7f4d0413e360 2023-11-24T08:01:45.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.364+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4d0406df00 con 0x7f4d0413e360 2023-11-24T08:01:45.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.903+0000 7f4d00ff9640 1 -- 172.21.15.161:0/636541463 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4cfc0430c0 con 0x7f4d0413e360 2023-11-24T08:01:45.906 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.906+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4ce406ae40 msgr2=0x7f4ce406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.906+0000 7f4d0a648640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4ce406ae40 0x7f4ce406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4000f60 tx=0x7f4cf4009040 comp rx=0 tx=0).stop 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.906+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 msgr2=0x7f4d04132880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.906+0000 7f4d0a648640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 0x7f4d04132880 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009eb0 tx=0x7f4cfc004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 shutdown_connections 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4ce406ae40 0x7f4ce406d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4d0413e360 0x7f4d04132880 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d0413df80 0x7f4d0415a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 --2- 172.21.15.161:0/636541463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d040cf9a0 0x7f4d040adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:45.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 >> 172.21.15.161:0/636541463 conn(0x7f4d0406a800 msgr2=0x7f4d040af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:45.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 shutdown_connections 2023-11-24T08:01:45.910 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:45.907+0000 7f4d0a648640 1 -- 172.21.15.161:0/636541463 wait complete. 2023-11-24T08:01:45.935 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:46.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.125+0000 7f5365d55640 1 Processor -- start 2023-11-24T08:01:46.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.125+0000 7f5365d55640 1 -- start start 2023-11-24T08:01:46.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365d55640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5360143c40 0x7f5360071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365d55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365d55640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5360070e50 con 0x7f53600cca40 2023-11-24T08:01:46.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365d55640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600723c0 con 0x7f5360143c40 2023-11-24T08:01:46.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365d55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53600cce70 con 0x7f53600717d0 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365554640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f53600cca40 0x7f536015eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:52014/0 (socket says 172.21.15.161:52014) 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5364d53640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5360143c40 0x7f5360071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.127+0000 7f5365554640 1 -- 172.21.15.161:0/156993212 learned_addr learned my addr 172.21.15.161:0/156993212 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.128+0000 7f535ffff640 1 --2- 172.21.15.161:0/156993212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.128+0000 7f5364d53640 1 -- 172.21.15.161:0/156993212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 msgr2=0x7f53600cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.128+0000 7f5364d53640 1 --2- 172.21.15.161:0/156993212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.128+0000 7f5364d53640 1 -- 172.21.15.161:0/156993212 >> v1:172.21.15.161:6789/0 conn(0x7f53600cca40 legacy=0x7f536015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.128+0000 7f5364d53640 1 -- 172.21.15.161:0/156993212 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536006e170 con 0x7f5360143c40 2023-11-24T08:01:46.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.128+0000 7f535f7fe640 1 -- 172.21.15.161:0/156993212 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050606173 0 0) 0x7f5360070e50 con 0x7f53600cca40 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.129+0000 7f5364d53640 1 --2- 172.21.15.161:0/156993212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5360143c40 0x7f5360071290 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53540097a0 tx=0x7f535402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5050843beaf24653 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.129+0000 7f535f7fe640 1 -- 172.21.15.161:0/156993212 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535402e070 con 0x7f5360143c40 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.129+0000 7f535f7fe640 1 -- 172.21.15.161:0/156993212 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53540315a0 con 0x7f5360143c40 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.129+0000 7f535f7fe640 1 -- 172.21.15.161:0/156993212 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354031930 con 0x7f5360143c40 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 -- 172.21.15.161:0/156993212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5360143c40 msgr2=0x7f5360071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 --2- 172.21.15.161:0/156993212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5360143c40 0x7f5360071290 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53540097a0 tx=0x7f535402b840 comp rx=0 tx=0).stop 2023-11-24T08:01:46.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 -- 172.21.15.161:0/156993212 shutdown_connections 2023-11-24T08:01:46.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 --2- 172.21.15.161:0/156993212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 --2- 172.21.15.161:0/156993212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5360143c40 0x7f5360071290 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 -- 172.21.15.161:0/156993212 >> 172.21.15.161:0/156993212 conn(0x7f536006a800 msgr2=0x7f536006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:46.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 -- 172.21.15.161:0/156993212 shutdown_connections 2023-11-24T08:01:46.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.130+0000 7f5365d55640 1 -- 172.21.15.161:0/156993212 wait complete. 2023-11-24T08:01:46.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.132+0000 7f5365d55640 1 Processor -- start 2023-11-24T08:01:46.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.132+0000 7f5365d55640 1 -- start start 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5365d55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5365d55640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 0x7f536013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5365d55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5360143c40 0x7f53600b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5365d55640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ad1d0 con 0x7f53600cca40 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5365d55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600ad4b0 con 0x7f5360143c40 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5365d55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53601420e0 con 0x7f53600717d0 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f535ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 0x7f536013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f535ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 0x7f536013ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47044/0 (socket says 172.21.15.161:47044) 2023-11-24T08:01:46.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f535ffff640 1 -- 172.21.15.161:0/3774560175 learned_addr learned my addr 172.21.15.161:0/3774560175 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f5364d53640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f535ffff640 1 -- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 msgr2=0x7f53600ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.133+0000 7f535ffff640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535ffff640 1 -- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5360143c40 msgr2=0x7f53600b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535ffff640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5360143c40 0x7f53600b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535ffff640 1 -- 172.21.15.161:0/3774560175 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009400 con 0x7f53600cca40 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535ffff640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 0x7f536013ab30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c7f0 tx=0x7f534c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c004220 con 0x7f53600cca40 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c0043a0 con 0x7f53600cca40 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53601423c0 con 0x7f53600cca40 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c007860 con 0x7f53600cca40 2023-11-24T08:01:46.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.134+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53600ace10 con 0x7f53600cca40 2023-11-24T08:01:46.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.135+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5360142600 con 0x7f53600cca40 2023-11-24T08:01:46.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.136+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f534c007bd0 con 0x7f53600cca40 2023-11-24T08:01:46.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.137+0000 7f535d7fa640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f534406ae40 0x7f534406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.137+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f534c089650 con 0x7f53600cca40 2023-11-24T08:01:46.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.138+0000 7f5364d53640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f534406ae40 0x7f534406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.139+0000 7f5364d53640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f534406ae40 0x7f534406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5354036000 tx=0x7f5354008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:46.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.142+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5360142600 con 0x7f53600cca40 2023-11-24T08:01:46.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.332+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5360142600 con 0x7f53600cca40 2023-11-24T08:01:46.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.336+0000 7f535d7fa640 1 -- 172.21.15.161:0/3774560175 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16606 (secure 0 0 0) 0x7f5360142600 con 0x7f53600cca40 2023-11-24T08:01:46.338 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:46.338 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":34,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:45.366172+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:46.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f534406ae40 msgr2=0x7f534406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f534406ae40 0x7f534406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5354036000 tx=0x7f5354008030 comp rx=0 tx=0).stop 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 msgr2=0x7f536013ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 0x7f536013ab30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f534c00c7f0 tx=0x7f534c00ccb0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 shutdown_connections 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f534406ae40 0x7f534406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5360143c40 0x7f53600b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f53600cca40 0x7f536013ab30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 --2- 172.21.15.161:0/3774560175 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53600717d0 0x7f53600ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 >> 172.21.15.161:0/3774560175 conn(0x7f536006a800 msgr2=0x7f536006d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 shutdown_connections 2023-11-24T08:01:46.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.338+0000 7f5365d55640 1 -- 172.21.15.161:0/3774560175 wait complete. 2023-11-24T08:01:46.360 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:46.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.574+0000 7f8f6a29b640 1 Processor -- start 2023-11-24T08:01:46.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.574+0000 7f8f6a29b640 1 -- start start 2023-11-24T08:01:46.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f6a29b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 0x7f8f640cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f6a29b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f640cf7d0 0x7f8f6415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f6a29b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640cfc30 con 0x7f8f6415e1e0 2023-11-24T08:01:46.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f6a29b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640b1ee0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f6a29b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b2780 con 0x7f8f64143ae0 2023-11-24T08:01:46.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f640cf7d0 0x7f8f6415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f640cf7d0 0x7f8f6415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47046/0 (socket says 172.21.15.161:47046) 2023-11-24T08:01:46.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 -- 172.21.15.161:0/50855709 learned_addr learned my addr 172.21.15.161:0/50855709 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:46.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 -- 172.21.15.161:0/50855709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 msgr2=0x7f8f640cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:46.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 --2- 172.21.15.161:0/50855709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 0x7f8f640cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 -- 172.21.15.161:0/50855709 >> v1:172.21.15.175:6789/0 conn(0x7f8f6415e1e0 legacy=0x7f8f6415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:46.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.576+0000 7f8f5bfff640 1 -- 172.21.15.161:0/50855709 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6415e990 con 0x7f8f640cf7d0 2023-11-24T08:01:46.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.577+0000 7f8f5bfff640 1 --2- 172.21.15.161:0/50855709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6415dca0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009870 tx=0x7f8f4c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3442db8351d65e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:46.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f637fe640 1 -- 172.21.15.161:0/50855709 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c031640 con 0x7f8f640cf7d0 2023-11-24T08:01:46.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f637fe640 1 -- 172.21.15.161:0/50855709 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0317a0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f637fe640 1 -- 172.21.15.161:0/50855709 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c031b30 con 0x7f8f640cf7d0 2023-11-24T08:01:46.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f6a29b640 1 -- 172.21.15.161:0/50855709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 msgr2=0x7f8f6415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/50855709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6415dca0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009870 tx=0x7f8f4c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f6a29b640 1 -- 172.21.15.161:0/50855709 shutdown_connections 2023-11-24T08:01:46.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/50855709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6415dca0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/50855709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 0x7f8f640cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.578+0000 7f8f6a29b640 1 -- 172.21.15.161:0/50855709 >> 172.21.15.161:0/50855709 conn(0x7f8f6406a800 msgr2=0x7f8f6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:46.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.579+0000 7f8f6a29b640 1 -- 172.21.15.161:0/50855709 shutdown_connections 2023-11-24T08:01:46.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.579+0000 7f8f6a29b640 1 -- 172.21.15.161:0/50855709 wait complete. 2023-11-24T08:01:46.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.580+0000 7f8f6a29b640 1 Processor -- start 2023-11-24T08:01:46.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.580+0000 7f8f6a29b640 1 -- start start 2023-11-24T08:01:46.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.581+0000 7f8f6a29b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6413c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.581+0000 7f8f6a29b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 0x7f8f641f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.581+0000 7f8f6a29b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f6415e1e0 0x7f8f64138a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.581+0000 7f8f6a29b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6413e210 con 0x7f8f640cf7d0 2023-11-24T08:01:46.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.581+0000 7f8f6a29b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641f4b20 con 0x7f8f6415e1e0 2023-11-24T08:01:46.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.581+0000 7f8f6a29b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f641f4e00 con 0x7f8f64143ae0 2023-11-24T08:01:46.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6413c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6413c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47048/0 (socket says 172.21.15.161:47048) 2023-11-24T08:01:46.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 -- 172.21.15.161:0/1827014489 learned_addr learned my addr 172.21.15.161:0/1827014489 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:46.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 -- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 msgr2=0x7f8f641f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 0x7f8f641f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 -- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f6415e1e0 msgr2=0x7f8f64138a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f6415e1e0 0x7f8f64138a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 -- 172.21.15.161:0/1827014489 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c0094d0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.582+0000 7f8f63fff640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6413c6b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400b4a0 tx=0x7f8f5400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.583+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54010610 con 0x7f8f640cf7d0 2023-11-24T08:01:46.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.583+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f54010770 con 0x7f8f640cf7d0 2023-11-24T08:01:46.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.583+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f641f50e0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.583+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54010b20 con 0x7f8f640cf7d0 2023-11-24T08:01:46.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.583+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f641f4810 con 0x7f8f640cf7d0 2023-11-24T08:01:46.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.584+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f640b2bf0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.585+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f54010c80 con 0x7f8f640cf7d0 2023-11-24T08:01:46.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.586+0000 7f8f617fa640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f4406ae40 0x7f8f4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:46.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.586+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f540892d0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.587+0000 7f8f5bfff640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f4406ae40 0x7f8f4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:46.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.588+0000 7f8f5bfff640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f4406ae40 0x7f8f4406d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c036000 tx=0x7f8f4c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:46.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.591+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f640b2bf0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.781+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f6413e6f0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.784+0000 7f8f617fa640 1 -- 172.21.15.161:0/1827014489 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f8f6413e6f0 con 0x7f8f640cf7d0 2023-11-24T08:01:46.787 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:46.787 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.786+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f4406ae40 msgr2=0x7f8f4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.786+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f4406ae40 0x7f8f4406d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c036000 tx=0x7f8f4c030000 comp rx=0 tx=0).stop 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 msgr2=0x7f8f6413c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6413c6b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8f5400b4a0 tx=0x7f8f5400b960 comp rx=0 tx=0).stop 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 shutdown_connections 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f4406ae40 0x7f8f4406d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f6415e1e0 0x7f8f64138a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f64143ae0 0x7f8f641f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 --2- 172.21.15.161:0/1827014489 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f640cf7d0 0x7f8f6413c6b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:46.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 >> 172.21.15.161:0/1827014489 conn(0x7f8f6406a800 msgr2=0x7f8f640702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:46.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 shutdown_connections 2023-11-24T08:01:46.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:46.787+0000 7f8f6a29b640 1 -- 172.21.15.161:0/1827014489 wait complete. 2023-11-24T08:01:46.808 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:01:47.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.024+0000 7efca2685640 1 Processor -- start 2023-11-24T08:01:47.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.024+0000 7efca2685640 1 -- start start 2023-11-24T08:01:47.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.026+0000 7efca2685640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 0x7efc9c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:47.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.026+0000 7efca2685640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc9c15bf10 0x7efc9c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:47.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.026+0000 7efca2685640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c15f4e0 con 0x7efc9c0adf20 2023-11-24T08:01:47.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.026+0000 7efca2685640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c15f970 con 0x7efc9c15bf10 2023-11-24T08:01:47.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.026+0000 7efca2685640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c15c3c0 con 0x7efc9c0ccb50 2023-11-24T08:01:47.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.026+0000 7efca0e82640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 0x7efc9c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:47.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efca0e82640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 0x7efc9c070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:43472/0 (socket says 172.21.15.161:43472) 2023-11-24T08:01:47.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efca0e82640 1 -- 172.21.15.161:0/1326783222 learned_addr learned my addr 172.21.15.161:0/1326783222 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:47.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efca1e84640 1 --2- 172.21.15.161:0/1326783222 >> v2:172.21.15.175:3300/0 conn(0x7efc9c15bf10 0x7efc9c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:47.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efca0e82640 1 -- 172.21.15.161:0/1326783222 >> v2:172.21.15.175:3300/0 conn(0x7efc9c15bf10 msgr2=0x7efc9c143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:47.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efca0e82640 1 --2- 172.21.15.161:0/1326783222 >> v2:172.21.15.175:3300/0 conn(0x7efc9c15bf10 0x7efc9c143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efca0e82640 1 -- 172.21.15.161:0/1326783222 >> v1:172.21.15.175:6789/0 conn(0x7efc9c0adf20 legacy=0x7efc9c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:47.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.027+0000 7efc93fff640 1 -- 172.21.15.161:0/1326783222 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204873653 0 0) 0x7efc9c15f4e0 con 0x7efc9c0adf20 2023-11-24T08:01:47.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.028+0000 7efca0e82640 1 -- 172.21.15.161:0/1326783222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c071130 con 0x7efc9c0ccb50 2023-11-24T08:01:47.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.029+0000 7efca0e82640 1 --2- 172.21.15.161:0/1326783222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 0x7efc9c070a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009870 tx=0x7efc8c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c62fdb6dc721d1ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.029+0000 7efc93fff640 1 -- 172.21.15.161:0/1326783222 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c031640 con 0x7efc9c0ccb50 2023-11-24T08:01:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.029+0000 7efc93fff640 1 -- 172.21.15.161:0/1326783222 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c0317a0 con 0x7efc9c0ccb50 2023-11-24T08:01:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.029+0000 7efc93fff640 1 -- 172.21.15.161:0/1326783222 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c031b30 con 0x7efc9c0ccb50 2023-11-24T08:01:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 -- 172.21.15.161:0/1326783222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 msgr2=0x7efc9c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 --2- 172.21.15.161:0/1326783222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 0x7efc9c070a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009870 tx=0x7efc8c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 -- 172.21.15.161:0/1326783222 shutdown_connections 2023-11-24T08:01:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 --2- 172.21.15.161:0/1326783222 >> v2:172.21.15.175:3300/0 conn(0x7efc9c15bf10 0x7efc9c143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 --2- 172.21.15.161:0/1326783222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c0ccb50 0x7efc9c070a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 -- 172.21.15.161:0/1326783222 >> 172.21.15.161:0/1326783222 conn(0x7efc9c06a7d0 msgr2=0x7efc9c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:47.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 -- 172.21.15.161:0/1326783222 shutdown_connections 2023-11-24T08:01:47.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.030+0000 7efca2685640 1 -- 172.21.15.161:0/1326783222 wait complete. 2023-11-24T08:01:47.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.032+0000 7efca2685640 1 Processor -- start 2023-11-24T08:01:47.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.032+0000 7efca2685640 1 -- start start 2023-11-24T08:01:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca2685640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc9c0adf20 0x7efc9c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca2685640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 0x7efc9c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca2685640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c15bf10 0x7efc9c0b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca2685640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c139f20 con 0x7efc9c0ccb50 2023-11-24T08:01:47.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca2685640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0ca7c0 con 0x7efc9c0adf20 2023-11-24T08:01:47.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca2685640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0caaa0 con 0x7efc9c15bf10 2023-11-24T08:01:47.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca0e82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 0x7efc9c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:47.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca0e82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 0x7efc9c15a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47054/0 (socket says 172.21.15.161:47054) 2023-11-24T08:01:47.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.033+0000 7efca0e82640 1 -- 172.21.15.161:0/3073185808 learned_addr learned my addr 172.21.15.161:0/3073185808 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca1e84640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c15bf10 0x7efc9c0b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca1683640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc9c0adf20 0x7efc9c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca0e82640 1 -- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c15bf10 msgr2=0x7efc9c0b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca0e82640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c15bf10 0x7efc9c0b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca0e82640 1 -- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc9c0adf20 msgr2=0x7efc9c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca0e82640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc9c0adf20 0x7efc9c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca0e82640 1 -- 172.21.15.161:0/3073185808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c0094d0 con 0x7efc9c0ccb50 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca1683640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc9c0adf20 0x7efc9c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efca0e82640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 0x7efc9c15a810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009870 tx=0x7efc8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.034+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c03a930 con 0x7efc9c0ccb50 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.035+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c03aa90 con 0x7efc9c0ccb50 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.035+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c03ae40 con 0x7efc9c0ccb50 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.035+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0cad80 con 0x7efc9c0ccb50 2023-11-24T08:01:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.035+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c0cb340 con 0x7efc9c0ccb50 2023-11-24T08:01:47.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.036+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c067450 con 0x7efc9c0ccb50 2023-11-24T08:01:47.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.037+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc8c02f050 con 0x7efc9c0ccb50 2023-11-24T08:01:47.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.037+0000 7efc91ffb640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc8006ae40 0x7efc8006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:47.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.038+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc8c0ab6e0 con 0x7efc9c0ccb50 2023-11-24T08:01:47.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.038+0000 7efca1683640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc8006ae40 0x7efc8006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:47.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.039+0000 7efca1683640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc8006ae40 0x7efc8006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc980012e0 tx=0x7efc98009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.042+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc8c0766f0 con 0x7efc9c0ccb50 2023-11-24T08:01:47.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.273+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efc9c0cbfa0 con 0x7efc9c0ccb50 2023-11-24T08:01:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.925+0000 7efc91ffb640 1 -- 172.21.15.161:0/3073185808 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7efc8c079d10 con 0x7efc9c0ccb50 2023-11-24T08:01:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc8006ae40 msgr2=0x7efc8006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc8006ae40 0x7efc8006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efc980012e0 tx=0x7efc98009040 comp rx=0 tx=0).stop 2023-11-24T08:01:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 msgr2=0x7efc9c15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 0x7efc9c15a810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efc8c009870 tx=0x7efc8c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 shutdown_connections 2023-11-24T08:01:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc8006ae40 0x7efc8006d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc9c15bf10 0x7efc9c0b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc9c0ccb50 0x7efc9c15a810 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 --2- 172.21.15.161:0/3073185808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc9c0adf20 0x7efc9c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.929+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 >> 172.21.15.161:0/3073185808 conn(0x7efc9c06a7d0 msgr2=0x7efc9c06d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.930+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 shutdown_connections 2023-11-24T08:01:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:47.930+0000 7efca2685640 1 -- 172.21.15.161:0/3073185808 wait complete. 2023-11-24T08:01:47.953 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:01:47.953 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:01:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.172+0000 7f3d8d11d640 1 Processor -- start 2023-11-24T08:01:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.172+0000 7f3d8d11d640 1 -- start start 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.173+0000 7f3d8d11d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d880cc1e0 0x7f3d880cea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.173+0000 7f3d8d11d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d880ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.173+0000 7f3d8d11d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d88162100 con 0x7f3d880ae750 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.173+0000 7f3d8d11d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d880ccf20 con 0x7f3d880cc1e0 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.173+0000 7f3d8d11d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880cd200 con 0x7f3d88074520 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d86d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3d880cc1e0 0x7f3d880cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d8759e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3d880ae750 0x7f3d880ac590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:52022/0 (socket says 172.21.15.161:52022) 2023-11-24T08:01:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d8759e640 1 -- 172.21.15.161:0/2306250352 learned_addr learned my addr 172.21.15.161:0/2306250352 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d7ffff640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d880ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d86d9d640 1 -- 172.21.15.161:0/2306250352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 msgr2=0x7f3d880ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d86d9d640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d880ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d86d9d640 1 -- 172.21.15.161:0/2306250352 >> v1:172.21.15.161:6789/0 conn(0x7f3d880ae750 legacy=0x7f3d880ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d86d9d640 1 -- 172.21.15.161:0/2306250352 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8806daa0 con 0x7f3d880cc1e0 2023-11-24T08:01:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d8659c640 1 -- 172.21.15.161:0/2306250352 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595133256 0 0) 0x7f3d88162100 con 0x7f3d880ae750 2023-11-24T08:01:48.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.174+0000 7f3d7ffff640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d880ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:48.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.175+0000 7f3d86d9d640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880cea50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d7802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f778683ba628a553 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8659c640 1 -- 172.21.15.161:0/2306250352 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7802f050 con 0x7f3d880cc1e0 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8659c640 1 -- 172.21.15.161:0/2306250352 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d78031700 con 0x7f3d880cc1e0 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8659c640 1 -- 172.21.15.161:0/2306250352 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d78031a90 con 0x7f3d880cc1e0 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8d11d640 1 -- 172.21.15.161:0/2306250352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 msgr2=0x7f3d880cea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880cea50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3d780097a0 tx=0x7f3d7802b7a0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8d11d640 1 -- 172.21.15.161:0/2306250352 shutdown_connections 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d880ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/2306250352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880cea50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.176+0000 7f3d8d11d640 1 -- 172.21.15.161:0/2306250352 >> 172.21.15.161:0/2306250352 conn(0x7f3d880b0d70 msgr2=0x7f3d880b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:48.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.177+0000 7f3d8d11d640 1 -- 172.21.15.161:0/2306250352 shutdown_connections 2023-11-24T08:01:48.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.177+0000 7f3d8d11d640 1 -- 172.21.15.161:0/2306250352 wait complete. 2023-11-24T08:01:48.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.178+0000 7f3d8d11d640 1 Processor -- start 2023-11-24T08:01:48.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.179+0000 7f3d8d11d640 1 -- start start 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8d11d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d88098890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8d11d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d880ae750 0x7f3d880c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8d11d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8d11d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880b2b90 con 0x7f3d880cc1e0 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8d11d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880b2e70 con 0x7f3d880ae750 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8d11d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d880b3150 con 0x7f3d88074520 2023-11-24T08:01:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:48.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47066/0 (socket says 172.21.15.161:47066) 2023-11-24T08:01:48.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8759e640 1 -- 172.21.15.161:0/3713676912 learned_addr learned my addr 172.21.15.161:0/3713676912 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8759e640 1 -- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 msgr2=0x7f3d88098890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d86d9d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d88098890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d7ffff640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d880ae750 0x7f3d880c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.180+0000 7f3d8759e640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d88098890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d8759e640 1 -- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d880ae750 msgr2=0x7f3d880c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d8759e640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d880ae750 0x7f3d880c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d8759e640 1 -- 172.21.15.161:0/3713676912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78009400 con 0x7f3d880cc1e0 2023-11-24T08:01:48.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d8759e640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880c6830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001560 tx=0x7f3d8000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:48.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000a640 con 0x7f3d880cc1e0 2023-11-24T08:01:48.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000a7a0 con 0x7f3d880cc1e0 2023-11-24T08:01:48.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000ab30 con 0x7f3d880cc1e0 2023-11-24T08:01:48.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d880b3430 con 0x7f3d880cc1e0 2023-11-24T08:01:48.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.181+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d88098dd0 con 0x7f3d880cc1e0 2023-11-24T08:01:48.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.183+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d881611f0 con 0x7f3d880cc1e0 2023-11-24T08:01:48.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.183+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d8000ac90 con 0x7f3d880cc1e0 2023-11-24T08:01:48.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.184+0000 7f3d7f7fe640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d6806ae40 0x7f3d6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:48.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.184+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d80088b90 con 0x7f3d880cc1e0 2023-11-24T08:01:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.185+0000 7f3d86d9d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d6806ae40 0x7f3d6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.186+0000 7f3d86d9d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d6806ae40 0x7f3d6806d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3d78035000 tx=0x7f3d78008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.189+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d881611f0 con 0x7f3d880cc1e0 2023-11-24T08:01:48.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.417+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3d880b3950 con 0x7f3d880cc1e0 2023-11-24T08:01:48.866 INFO:tasks.ceph.mds.d.smithi175.stderr:2023-11-24T08:01:48.864+0000 7ff9f1c75640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:01:48.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.946+0000 7f3d7f7fe640 1 -- 172.21.15.161:0/3713676912 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d880b3950 con 0x7f3d880cc1e0 2023-11-24T08:01:48.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.949+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d6806ae40 msgr2=0x7f3d6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:48.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.949+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d6806ae40 0x7f3d6806d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3d78035000 tx=0x7f3d78008030 comp rx=0 tx=0).stop 2023-11-24T08:01:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 msgr2=0x7f3d880c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880c6830 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001560 tx=0x7f3d8000cc70 comp rx=0 tx=0).stop 2023-11-24T08:01:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 shutdown_connections 2023-11-24T08:01:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d6806ae40 0x7f3d6806d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3d880cc1e0 0x7f3d880c6830 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3d880ae750 0x7f3d880c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 --2- 172.21.15.161:0/3713676912 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3d88074520 0x7f3d88098890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 >> 172.21.15.161:0/3713676912 conn(0x7f3d880b0d70 msgr2=0x7f3d880c9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 shutdown_connections 2023-11-24T08:01:48.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:48.950+0000 7f3d8d11d640 1 -- 172.21.15.161:0/3713676912 wait complete. 2023-11-24T08:01:48.973 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:01:48.974 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:01:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.178+0000 7f3ca28d3640 1 Processor -- start 2023-11-24T08:01:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.178+0000 7f3ca28d3640 1 -- start start 2023-11-24T08:01:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.180+0000 7f3ca28d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3c9c143ae0 0x7f3c9c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.180+0000 7f3ca28d3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9c0cfc30 con 0x7f3c9c15e3b0 2023-11-24T08:01:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.180+0000 7f3ca28d3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c9c0b1ee0 con 0x7f3c9c0cf7d0 2023-11-24T08:01:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.180+0000 7f3ca28d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c9c0b2780 con 0x7f3c9c143ae0 2023-11-24T08:01:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.180+0000 7f3ca0e70640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3c9c15e3b0 0x7f3c9c0702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:52028/0 (socket says 172.21.15.161:52028) 2023-11-24T08:01:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.180+0000 7f3ca0e70640 1 -- 172.21.15.161:0/2335066996 learned_addr learned my addr 172.21.15.161:0/2335066996 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:49.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9bfff640 1 --2- 172.21.15.161:0/2335066996 >> v2:172.21.15.175:3300/0 conn(0x7f3c9c143ae0 0x7f3c9c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169208260 0 0) 0x7f3c9c0cfc30 con 0x7f3c9c15e3b0 2023-11-24T08:01:49.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c88003520 con 0x7f3c9c15e3b0 2023-11-24T08:01:49.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3750090070 0 0) 0x7f3c88003520 con 0x7f3c9c15e3b0 2023-11-24T08:01:49.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 >> v2:172.21.15.175:3300/0 conn(0x7f3c9c143ae0 msgr2=0x7f3c9c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:49.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 --2- 172.21.15.161:0/2335066996 >> v2:172.21.15.175:3300/0 conn(0x7f3c9c143ae0 0x7f3c9c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 >> v1:172.21.15.175:6789/0 conn(0x7f3c9c0cf7d0 legacy=0x7f3c9c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c15e990 con 0x7f3c9c15e3b0 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f3c940019f0 con 0x7f3c9c15e3b0 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 >> v1:172.21.15.161:6789/0 conn(0x7f3c9c15e3b0 legacy=0x7f3c9c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880039c0 0x7f3c88003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c880047c0 0x7f3c88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c88005180 0x7f3c8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c0b2780 con 0x7f3c880047c0 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8800c080 con 0x7f3c880039c0 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.181+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8800c240 con 0x7f3c88005180 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3c937fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c880047c0 0x7f3c88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3c937fe640 1 -- 172.21.15.161:0/2335066996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c88005180 msgr2=0x7f3c8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:49.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3c937fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c88005180 0x7f3c8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3c937fe640 1 -- 172.21.15.161:0/2335066996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880039c0 msgr2=0x7f3c88003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:49.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3c937fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880039c0 0x7f3c88003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3c937fe640 1 -- 172.21.15.161:0/2335066996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c88003520 con 0x7f3c880047c0 2023-11-24T08:01:49.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.182+0000 7f3ca0e70640 1 -- 172.21.15.161:0/2335066996 reap_dead start 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.183+0000 7f3c937fe640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c880047c0 0x7f3c88004c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001330 tx=0x7f3c880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be9a0579e97cce9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.183+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c840052d0 con 0x7f3c880047c0 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.183+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c84005430 con 0x7f3c880047c0 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.183+0000 7f3c9b7fe640 1 -- 172.21.15.161:0/2335066996 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c84003830 con 0x7f3c880047c0 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 -- 172.21.15.161:0/2335066996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c880047c0 msgr2=0x7f3c88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c880047c0 0x7f3c88004c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3c84001330 tx=0x7f3c880057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 -- 172.21.15.161:0/2335066996 shutdown_connections 2023-11-24T08:01:49.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/2335066996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c880047c0 0x7f3c88004c40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 -- 172.21.15.161:0/2335066996 >> 172.21.15.161:0/2335066996 conn(0x7f3c9c06a800 msgr2=0x7f3c9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:49.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 -- 172.21.15.161:0/2335066996 shutdown_connections 2023-11-24T08:01:49.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.184+0000 7f3ca28d3640 1 -- 172.21.15.161:0/2335066996 wait complete. 2023-11-24T08:01:49.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.186+0000 7f3ca28d3640 1 Processor -- start 2023-11-24T08:01:49.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.186+0000 7f3ca28d3640 1 -- start start 2023-11-24T08:01:49.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca28d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880047c0 0x7f3c9c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca28d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c9c15c8b0 0x7f3c9c15cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca28d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 0x7f3c9c0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca28d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15b440 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca28d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15b8d0 con 0x7f3c880047c0 2023-11-24T08:01:49.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca28d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c15a830 con 0x7f3c9c15c8b0 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca0e70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 0x7f3c9c0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca0e70640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 0x7f3c9c0acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47084/0 (socket says 172.21.15.161:47084) 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3ca0e70640 1 -- 172.21.15.161:0/699943156 learned_addr learned my addr 172.21.15.161:0/699943156 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.187+0000 7f3c9bfff640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880047c0 0x7f3c9c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3c937fe640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c9c15c8b0 0x7f3c9c15cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca0e70640 1 -- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c9c15c8b0 msgr2=0x7f3c9c15cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca0e70640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c9c15c8b0 0x7f3c9c15cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca0e70640 1 -- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880047c0 msgr2=0x7f3c9c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca0e70640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880047c0 0x7f3c9c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca0e70640 1 -- 172.21.15.161:0/699943156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c15ab10 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3c9bfff640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880047c0 0x7f3c9c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca0e70640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 0x7f3c9c0acd80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06e080 tx=0x7f3c9400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400ce50 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9400a610 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400a9c0 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c9c15adf0 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.188+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9c15a4e0 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.190+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c072610 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.191+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c9400ab20 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.192+0000 7f3c997fa640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3c7c06ae40 0x7f3c7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.192+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c940891a0 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.192+0000 7f3c9bfff640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3c7c06ae40 0x7f3c7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.193+0000 7f3c9bfff640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3c7c06ae40 0x7f3c7c06d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0cbfc0 tx=0x7f3c8c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:49.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.196+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c94057c40 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.428+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c9c15b5f0 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.429+0000 7f3c997fa640 1 -- 172.21.15.161:0/699943156 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f3c9c15b5f0 con 0x7f3c9c0ac8d0 2023-11-24T08:01:49.431 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:49.431 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:01:45.366812+0000","modified":"2023-11-24T08:01:48.419033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5175},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5175":{"gid":5175,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/1086564705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1086564705},{"type":"v1","addr":"172.21.15.175:6836","nonce":1086564705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:01:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 17 2023-11-24T08:01:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3c7c06ae40 msgr2=0x7f3c7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3c7c06ae40 0x7f3c7c06d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c0cbfc0 tx=0x7f3c8c008040 comp rx=0 tx=0).stop 2023-11-24T08:01:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 msgr2=0x7f3c9c0acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 0x7f3c9c0acd80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c06e080 tx=0x7f3c9400cc00 comp rx=0 tx=0).stop 2023-11-24T08:01:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 shutdown_connections 2023-11-24T08:01:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3c7c06ae40 0x7f3c7c06d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3c9c0ac8d0 0x7f3c9c0acd80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3c9c15c8b0 0x7f3c9c15cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 --2- 172.21.15.161:0/699943156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3c880047c0 0x7f3c9c0cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 >> 172.21.15.161:0/699943156 conn(0x7f3c9c06a800 msgr2=0x7f3c9c0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 shutdown_connections 2023-11-24T08:01:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.432+0000 7f3ca28d3640 1 -- 172.21.15.161:0/699943156 wait complete. 2023-11-24T08:01:49.453 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:01:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.660+0000 7fe8508ff640 1 Processor -- start 2023-11-24T08:01:49.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.660+0000 7fe8508ff640 1 -- start start 2023-11-24T08:01:49.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe8508ff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe84c160920 0x7fe84c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe8508ff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe84c0cfea0 0x7fe84c161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe8508ff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c0d0a10 con 0x7fe84c0cf9f0 2023-11-24T08:01:49.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe8508ff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c0d1f50 con 0x7fe84c160920 2023-11-24T08:01:49.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe8508ff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84c0cf080 con 0x7fe84c0cfea0 2023-11-24T08:01:49.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe84b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe84c160920 0x7fe84c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe84affd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe84c0cf9f0 0x7fe84c161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:52034/0 (socket says 172.21.15.161:52034) 2023-11-24T08:01:49.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.662+0000 7fe84affd640 1 -- 172.21.15.161:0/2224203514 learned_addr learned my addr 172.21.15.161:0/2224203514 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:49.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.663+0000 7fe84bfff640 1 --2- 172.21.15.161:0/2224203514 >> v2:172.21.15.175:3300/0 conn(0x7fe84c0cfea0 0x7fe84c161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.663+0000 7fe84b7fe640 1 -- 172.21.15.161:0/2224203514 >> v2:172.21.15.175:3300/0 conn(0x7fe84c0cfea0 msgr2=0x7fe84c161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:49.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.663+0000 7fe84b7fe640 1 --2- 172.21.15.161:0/2224203514 >> v2:172.21.15.175:3300/0 conn(0x7fe84c0cfea0 0x7fe84c161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.663+0000 7fe84b7fe640 1 -- 172.21.15.161:0/2224203514 >> v1:172.21.15.161:6789/0 conn(0x7fe84c0cf9f0 legacy=0x7fe84c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.663+0000 7fe84b7fe640 1 -- 172.21.15.161:0/2224203514 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0d0310 con 0x7fe84c160920 2023-11-24T08:01:49.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.663+0000 7fe84a7fc640 1 -- 172.21.15.161:0/2224203514 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376318503 0 0) 0x7fe84c0d0a10 con 0x7fe84c0cf9f0 2023-11-24T08:01:49.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.664+0000 7fe84b7fe640 1 --2- 172.21.15.161:0/2224203514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b3f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe84c08c2c0 tx=0x7fe83c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd23855cf98686cb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:49.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.664+0000 7fe84a7fc640 1 -- 172.21.15.161:0/2224203514 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c031830 con 0x7fe84c160920 2023-11-24T08:01:49.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.664+0000 7fe84a7fc640 1 -- 172.21.15.161:0/2224203514 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c031990 con 0x7fe84c160920 2023-11-24T08:01:49.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.664+0000 7fe84a7fc640 1 -- 172.21.15.161:0/2224203514 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c031d20 con 0x7fe84c160920 2023-11-24T08:01:49.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 -- 172.21.15.161:0/2224203514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 msgr2=0x7fe84c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2224203514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b3f30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe84c08c2c0 tx=0x7fe83c02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 -- 172.21.15.161:0/2224203514 shutdown_connections 2023-11-24T08:01:49.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2224203514 >> v2:172.21.15.175:3300/0 conn(0x7fe84c0cfea0 0x7fe84c161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2224203514 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b3f30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 -- 172.21.15.161:0/2224203514 >> 172.21.15.161:0/2224203514 conn(0x7fe84c0d3090 msgr2=0x7fe84c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 -- 172.21.15.161:0/2224203514 shutdown_connections 2023-11-24T08:01:49.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.665+0000 7fe8508ff640 1 -- 172.21.15.161:0/2224203514 wait complete. 2023-11-24T08:01:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.666+0000 7fe8508ff640 1 Processor -- start 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.667+0000 7fe8508ff640 1 -- start start 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.667+0000 7fe8508ff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe84c0cf9f0 0x7fe84c0b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.667+0000 7fe8508ff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe84c0cfea0 0x7fe84c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe8508ff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe8508ff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0b9010 con 0x7fe84c160920 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe8508ff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15e160 con 0x7fe84c0cfea0 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe8508ff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c15e440 con 0x7fe84c0cf9f0 2023-11-24T08:01:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47102/0 (socket says 172.21.15.161:47102) 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 -- 172.21.15.161:0/2769530567 learned_addr learned my addr 172.21.15.161:0/2769530567 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 -- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe84c0cf9f0 msgr2=0x7fe84c0b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe84c0cf9f0 0x7fe84c0b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 -- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe84c0cfea0 msgr2=0x7fe84c15d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe84c0cfea0 0x7fe84c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.668+0000 7fe84bfff640 1 -- 172.21.15.161:0/2769530567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009400 con 0x7fe84c160920 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.669+0000 7fe84bfff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b5c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe844007e60 tx=0x7fe84400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.669+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844014420 con 0x7fe84c160920 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.669+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440145a0 con 0x7fe84c160920 2023-11-24T08:01:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.669+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c15e720 con 0x7fe84c160920 2023-11-24T08:01:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.669+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844014950 con 0x7fe84c160920 2023-11-24T08:01:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.669+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c15ece0 con 0x7fe84c160920 2023-11-24T08:01:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.670+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c067450 con 0x7fe84c160920 2023-11-24T08:01:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.671+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe844014ab0 con 0x7fe84c160920 2023-11-24T08:01:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.672+0000 7fe833fff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe83806ae40 0x7fe83806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.673+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe844089fc0 con 0x7fe84c160920 2023-11-24T08:01:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.673+0000 7fe84b7fe640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe83806ae40 0x7fe83806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.674+0000 7fe84b7fe640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe83806ae40 0x7fe83806d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe83c036000 tx=0x7fe83c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.677+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe844054fd0 con 0x7fe84c160920 2023-11-24T08:01:49.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.871+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe84c08c7e0 con 0x7fe84c160920 2023-11-24T08:01:49.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.873+0000 7fe833fff640 1 -- 172.21.15.161:0/2769530567 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fe8440585f0 con 0x7fe84c160920 2023-11-24T08:01:49.876 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:49.876 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:01:49.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe83806ae40 msgr2=0x7fe83806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe83806ae40 0x7fe83806d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe83c036000 tx=0x7fe83c030000 comp rx=0 tx=0).stop 2023-11-24T08:01:49.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 msgr2=0x7fe84c0b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:49.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b5c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe844007e60 tx=0x7fe84400e4b0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 shutdown_connections 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe83806ae40 0x7fe83806d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe84c160920 0x7fe84c0b5c50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe84c0cfea0 0x7fe84c15d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 --2- 172.21.15.161:0/2769530567 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe84c0cf9f0 0x7fe84c0b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 >> 172.21.15.161:0/2769530567 conn(0x7fe84c0d3090 msgr2=0x7fe84c06c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 shutdown_connections 2023-11-24T08:01:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:49.876+0000 7fe8508ff640 1 -- 172.21.15.161:0/2769530567 wait complete. 2023-11-24T08:01:49.898 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:01:49.898 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:01:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.108+0000 7fa20e53c640 1 Processor -- start 2023-11-24T08:01:50.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.108+0000 7fa20e53c640 1 -- start start 2023-11-24T08:01:50.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa20e53c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa20813df80 0x7fa20815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa20e53c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20813e360 0x7fa2080cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa20e53c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20806c470 con 0x7fa20815f9c0 2023-11-24T08:01:50.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa20e53c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20806c750 con 0x7fa20813df80 2023-11-24T08:01:50.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa20e53c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20806ca30 con 0x7fa20813e360 2023-11-24T08:01:50.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa207fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa20813df80 0x7fa20815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa207fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa20813df80 0x7fa20815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47116/0 (socket says 172.21.15.161:47116) 2023-11-24T08:01:50.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.110+0000 7fa207fff640 1 -- 172.21.15.161:0/4068417550 learned_addr learned my addr 172.21.15.161:0/4068417550 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:50.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.111+0000 7fa207fff640 1 -- 172.21.15.161:0/4068417550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20813e360 msgr2=0x7fa2080cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:50.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.111+0000 7fa2077fe640 1 --2- 172.21.15.161:0/4068417550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20813e360 0x7fa2080cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.111+0000 7fa207fff640 1 --2- 172.21.15.161:0/4068417550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20813e360 0x7fa2080cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.111+0000 7fa207fff640 1 -- 172.21.15.161:0/4068417550 >> v1:172.21.15.175:6789/0 conn(0x7fa20815f9c0 legacy=0x7fa2081408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:50.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.111+0000 7fa207fff640 1 -- 172.21.15.161:0/4068417550 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20806cd10 con 0x7fa20813df80 2023-11-24T08:01:50.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.112+0000 7fa207fff640 1 --2- 172.21.15.161:0/4068417550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20815bee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa200009870 tx=0x7fa20002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46281ada4d569f93 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:50.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa206ffd640 1 -- 172.21.15.161:0/4068417550 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200031640 con 0x7fa20813df80 2023-11-24T08:01:50.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa206ffd640 1 -- 172.21.15.161:0/4068417550 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2000317a0 con 0x7fa20813df80 2023-11-24T08:01:50.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa206ffd640 1 -- 172.21.15.161:0/4068417550 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200031b30 con 0x7fa20813df80 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 -- 172.21.15.161:0/4068417550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 msgr2=0x7fa20815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 --2- 172.21.15.161:0/4068417550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20815bee0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa200009870 tx=0x7fa20002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 -- 172.21.15.161:0/4068417550 shutdown_connections 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 --2- 172.21.15.161:0/4068417550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20813e360 0x7fa2080cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 --2- 172.21.15.161:0/4068417550 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20815bee0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 -- 172.21.15.161:0/4068417550 >> 172.21.15.161:0/4068417550 conn(0x7fa20806a800 msgr2=0x7fa20806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 -- 172.21.15.161:0/4068417550 shutdown_connections 2023-11-24T08:01:50.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.113+0000 7fa20e53c640 1 -- 172.21.15.161:0/4068417550 wait complete. 2023-11-24T08:01:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.115+0000 7fa20e53c640 1 Processor -- start 2023-11-24T08:01:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.115+0000 7fa20e53c640 1 -- start start 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa20e53c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa20e53c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20813e360 0x7fa20813cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa20e53c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20815f9c0 0x7fa2081f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa20e53c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa208072390 con 0x7fa20813df80 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa20e53c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2080b0370 con 0x7fa20813e360 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa20e53c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa20813d270 con 0x7fa20815f9c0 2023-11-24T08:01:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa207fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.116+0000 7fa207fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20814d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47118/0 (socket says 172.21.15.161:47118) 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 -- 172.21.15.161:0/2963568595 learned_addr learned my addr 172.21.15.161:0/2963568595 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 -- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20815f9c0 msgr2=0x7fa2081f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20815f9c0 0x7fa2081f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 -- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20813e360 msgr2=0x7fa20813cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20813e360 0x7fa20813cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 -- 172.21.15.161:0/2963568595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000094d0 con 0x7fa20813df80 2023-11-24T08:01:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa207fff640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20814d830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa200009870 tx=0x7fa2000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.117+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20003ac60 con 0x7fa20813df80 2023-11-24T08:01:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.118+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20003ade0 con 0x7fa20813df80 2023-11-24T08:01:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.118+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200044630 con 0x7fa20813df80 2023-11-24T08:01:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.118+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2080b08a0 con 0x7fa20813df80 2023-11-24T08:01:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.118+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2080b2d50 con 0x7fa20813df80 2023-11-24T08:01:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.119+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2080675d0 con 0x7fa20813df80 2023-11-24T08:01:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.120+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa20002f050 con 0x7fa20813df80 2023-11-24T08:01:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.121+0000 7fa204ff9640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e806ae40 0x7fa1e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.121+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2000ab760 con 0x7fa20813df80 2023-11-24T08:01:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.121+0000 7fa2077fe640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e806ae40 0x7fa1e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.122+0000 7fa2077fe640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e806ae40 0x7fa1e806d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa20815bbc0 tx=0x7fa1f0007390 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:50.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.125+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa200076800 con 0x7fa20813df80 2023-11-24T08:01:50.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.311+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2080ce850 con 0x7fa1e806ae40 2023-11-24T08:01:50.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.329+0000 7fa204ff9640 1 -- 172.21.15.161:0/2963568595 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277948 (secure 0 0 0) 0x7fa1f0007a50 con 0x7fa1e806ae40 2023-11-24T08:01:50.334 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:50.337 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:01:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e806ae40 msgr2=0x7fa1e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e806ae40 0x7fa1e806d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa20815bbc0 tx=0x7fa1f0007390 comp rx=0 tx=0).stop 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 msgr2=0x7fa20814d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20814d830 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa200009870 tx=0x7fa2000046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 shutdown_connections 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e806ae40 0x7fa1e806d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa20815f9c0 0x7fa2081f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20813e360 0x7fa20813cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 --2- 172.21.15.161:0/2963568595 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa20813df80 0x7fa20814d830 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.336+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 >> 172.21.15.161:0/2963568595 conn(0x7fa20806a800 msgr2=0x7fa2080b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.337+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 shutdown_connections 2023-11-24T08:01:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.337+0000 7fa20e53c640 1 -- 172.21.15.161:0/2963568595 wait complete. 2023-11-24T08:01:50.356 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2023-11-24T08:01:48.555136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590494,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":220196,"kb_used_data":3984,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754524,"statfs":{"total":773094113280,"available":772868632576,"internally_reserved":0,"allocated":4079616,"data_stored":2279511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":126,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.665077"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538502+0000","last_change":"2023-11-24T08:01:45.532905+0000","last_active":"2023-11-24T08:01:46.538502+0000","last_peered":"2023-11-24T08:01:46.538502+0000","last_clean":"2023-11-24T08:01:46.538502+0000","last_became_active":"2023-11-24T08:01:45.532395+0000","last_became_peered":"2023-11-24T08:01:45.532395+0000","last_unstale":"2023-11-24T08:01:46.538502+0000","last_undegraded":"2023-11-24T08:01:46.538502+0000","last_fullsized":"2023-11-24T08:01:46.538502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:59:16.788249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538407+0000","last_change":"2023-11-24T08:01:45.529622+0000","last_active":"2023-11-24T08:01:46.538407+0000","last_peered":"2023-11-24T08:01:46.538407+0000","last_clean":"2023-11-24T08:01:46.538407+0000","last_became_active":"2023-11-24T08:01:45.529312+0000","last_became_peered":"2023-11-24T08:01:45.529312+0000","last_unstale":"2023-11-24T08:01:46.538407+0000","last_undegraded":"2023-11-24T08:01:46.538407+0000","last_fullsized":"2023-11-24T08:01:46.538407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:02.855378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538378+0000","last_change":"2023-11-24T08:01:45.534123+0000","last_active":"2023-11-24T08:01:46.538378+0000","last_peered":"2023-11-24T08:01:46.538378+0000","last_clean":"2023-11-24T08:01:46.538378+0000","last_became_active":"2023-11-24T08:01:45.533877+0000","last_became_peered":"2023-11-24T08:01:45.533877+0000","last_unstale":"2023-11-24T08:01:46.538378+0000","last_undegraded":"2023-11-24T08:01:46.538378+0000","last_fullsized":"2023-11-24T08:01:46.538378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:33.263583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536598+0000","last_change":"2023-11-24T08:01:45.531471+0000","last_active":"2023-11-24T08:01:46.536598+0000","last_peered":"2023-11-24T08:01:46.536598+0000","last_clean":"2023-11-24T08:01:46.536598+0000","last_became_active":"2023-11-24T08:01:45.531193+0000","last_became_peered":"2023-11-24T08:01:45.531193+0000","last_unstale":"2023-11-24T08:01:46.536598+0000","last_undegraded":"2023-11-24T08:01:46.536598+0000","last_fullsized":"2023-11-24T08:01:46.536598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:20.669564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536362+0000","last_change":"2023-11-24T08:01:45.541477+0000","last_active":"2023-11-24T08:01:46.536362+0000","last_peered":"2023-11-24T08:01:46.536362+0000","last_clean":"2023-11-24T08:01:46.536362+0000","last_became_active":"2023-11-24T08:01:45.541146+0000","last_became_peered":"2023-11-24T08:01:45.541146+0000","last_unstale":"2023-11-24T08:01:46.536362+0000","last_undegraded":"2023-11-24T08:01:46.536362+0000","last_fullsized":"2023-11-24T08:01:46.536362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:13.736591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536658+0000","last_change":"2023-11-24T08:01:45.528034+0000","last_active":"2023-11-24T08:01:46.536658+0000","last_peered":"2023-11-24T08:01:46.536658+0000","last_clean":"2023-11-24T08:01:46.536658+0000","last_became_active":"2023-11-24T08:01:45.527635+0000","last_became_peered":"2023-11-24T08:01:45.527635+0000","last_unstale":"2023-11-24T08:01:46.536658+0000","last_undegraded":"2023-11-24T08:01:46.536658+0000","last_fullsized":"2023-11-24T08:01:46.536658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:37.311188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538707+0000","last_change":"2023-11-24T08:01:45.531364+0000","last_active":"2023-11-24T08:01:46.538707+0000","last_peered":"2023-11-24T08:01:46.538707+0000","last_clean":"2023-11-24T08:01:46.538707+0000","last_became_active":"2023-11-24T08:01:45.531016+0000","last_became_peered":"2023-11-24T08:01:45.531016+0000","last_unstale":"2023-11-24T08:01:46.538707+0000","last_undegraded":"2023-11-24T08:01:46.538707+0000","last_fullsized":"2023-11-24T08:01:46.538707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:32:55.927856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539436+0000","last_change":"2023-11-24T08:01:45.533551+0000","last_active":"2023-11-24T08:01:46.539436+0000","last_peered":"2023-11-24T08:01:46.539436+0000","last_clean":"2023-11-24T08:01:46.539436+0000","last_became_active":"2023-11-24T08:01:45.529176+0000","last_became_peered":"2023-11-24T08:01:45.529176+0000","last_unstale":"2023-11-24T08:01:46.539436+0000","last_undegraded":"2023-11-24T08:01:46.539436+0000","last_fullsized":"2023-11-24T08:01:46.539436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:47:34.071353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536310+0000","last_change":"2023-11-24T08:01:45.541946+0000","last_active":"2023-11-24T08:01:46.536310+0000","last_peered":"2023-11-24T08:01:46.536310+0000","last_clean":"2023-11-24T08:01:46.536310+0000","last_became_active":"2023-11-24T08:01:45.541478+0000","last_became_peered":"2023-11-24T08:01:45.541478+0000","last_unstale":"2023-11-24T08:01:46.536310+0000","last_undegraded":"2023-11-24T08:01:46.536310+0000","last_fullsized":"2023-11-24T08:01:46.536310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:03.883352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538286+0000","last_change":"2023-11-24T08:01:45.527931+0000","last_active":"2023-11-24T08:01:46.538286+0000","last_peered":"2023-11-24T08:01:46.538286+0000","last_clean":"2023-11-24T08:01:46.538286+0000","last_became_active":"2023-11-24T08:01:45.527636+0000","last_became_peered":"2023-11-24T08:01:45.527636+0000","last_unstale":"2023-11-24T08:01:46.538286+0000","last_undegraded":"2023-11-24T08:01:46.538286+0000","last_fullsized":"2023-11-24T08:01:46.538286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:23.588161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538544+0000","last_change":"2023-11-24T08:01:44.940156+0000","last_active":"2023-11-24T08:01:46.538544+0000","last_peered":"2023-11-24T08:01:46.538544+0000","last_clean":"2023-11-24T08:01:46.538544+0000","last_became_active":"2023-11-24T08:01:44.939379+0000","last_became_peered":"2023-11-24T08:01:44.939379+0000","last_unstale":"2023-11-24T08:01:46.538544+0000","last_undegraded":"2023-11-24T08:01:46.538544+0000","last_fullsized":"2023-11-24T08:01:46.538544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:35.250141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537170+0000","last_change":"2023-11-24T08:01:45.541809+0000","last_active":"2023-11-24T08:01:46.537170+0000","last_peered":"2023-11-24T08:01:46.537170+0000","last_clean":"2023-11-24T08:01:46.537170+0000","last_became_active":"2023-11-24T08:01:45.541335+0000","last_became_peered":"2023-11-24T08:01:45.541335+0000","last_unstale":"2023-11-24T08:01:46.537170+0000","last_undegraded":"2023-11-24T08:01:46.537170+0000","last_fullsized":"2023-11-24T08:01:46.537170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:37.311188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539562+0000","last_change":"2023-11-24T08:01:45.528802+0000","last_active":"2023-11-24T08:01:46.539562+0000","last_peered":"2023-11-24T08:01:46.539562+0000","last_clean":"2023-11-24T08:01:46.539562+0000","last_became_active":"2023-11-24T08:01:45.528348+0000","last_became_peered":"2023-11-24T08:01:45.528348+0000","last_unstale":"2023-11-24T08:01:46.539562+0000","last_undegraded":"2023-11-24T08:01:46.539562+0000","last_fullsized":"2023-11-24T08:01:46.539562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:51.532292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536517+0000","last_change":"2023-11-24T08:01:44.933602+0000","last_active":"2023-11-24T08:01:46.536517+0000","last_peered":"2023-11-24T08:01:46.536517+0000","last_clean":"2023-11-24T08:01:46.536517+0000","last_became_active":"2023-11-24T08:01:44.932233+0000","last_became_peered":"2023-11-24T08:01:44.932233+0000","last_unstale":"2023-11-24T08:01:46.536517+0000","last_undegraded":"2023-11-24T08:01:46.536517+0000","last_fullsized":"2023-11-24T08:01:46.536517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:15.393492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536360+0000","last_change":"2023-11-24T08:01:44.931674+0000","last_active":"2023-11-24T08:01:46.536360+0000","last_peered":"2023-11-24T08:01:46.536360+0000","last_clean":"2023-11-24T08:01:46.536360+0000","last_became_active":"2023-11-24T08:01:44.931392+0000","last_became_peered":"2023-11-24T08:01:44.931392+0000","last_unstale":"2023-11-24T08:01:46.536360+0000","last_undegraded":"2023-11-24T08:01:46.536360+0000","last_fullsized":"2023-11-24T08:01:46.536360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:14.823306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536140+0000","last_change":"2023-11-24T08:01:45.529868+0000","last_active":"2023-11-24T08:01:46.536140+0000","last_peered":"2023-11-24T08:01:46.536140+0000","last_clean":"2023-11-24T08:01:46.536140+0000","last_became_active":"2023-11-24T08:01:45.527486+0000","last_became_peered":"2023-11-24T08:01:45.527486+0000","last_unstale":"2023-11-24T08:01:46.536140+0000","last_undegraded":"2023-11-24T08:01:46.536140+0000","last_fullsized":"2023-11-24T08:01:46.536140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:36.264394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537836+0000","last_change":"2023-11-24T08:01:45.529103+0000","last_active":"2023-11-24T08:01:46.537836+0000","last_peered":"2023-11-24T08:01:46.537836+0000","last_clean":"2023-11-24T08:01:46.537836+0000","last_became_active":"2023-11-24T08:01:45.528576+0000","last_became_peered":"2023-11-24T08:01:45.528576+0000","last_unstale":"2023-11-24T08:01:46.537836+0000","last_undegraded":"2023-11-24T08:01:46.537836+0000","last_fullsized":"2023-11-24T08:01:46.537836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:17.422388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.535963+0000","last_change":"2023-11-24T08:01:44.934438+0000","last_active":"2023-11-24T08:01:46.535963+0000","last_peered":"2023-11-24T08:01:46.535963+0000","last_clean":"2023-11-24T08:01:46.535963+0000","last_became_active":"2023-11-24T08:01:44.933659+0000","last_became_peered":"2023-11-24T08:01:44.933659+0000","last_unstale":"2023-11-24T08:01:46.535963+0000","last_undegraded":"2023-11-24T08:01:46.535963+0000","last_fullsized":"2023-11-24T08:01:46.535963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:22:57.780641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538757+0000","last_change":"2023-11-24T08:01:44.929753+0000","last_active":"2023-11-24T08:01:46.538757+0000","last_peered":"2023-11-24T08:01:46.538757+0000","last_clean":"2023-11-24T08:01:46.538757+0000","last_became_active":"2023-11-24T08:01:44.929092+0000","last_became_peered":"2023-11-24T08:01:44.929092+0000","last_unstale":"2023-11-24T08:01:46.538757+0000","last_undegraded":"2023-11-24T08:01:46.538757+0000","last_fullsized":"2023-11-24T08:01:46.538757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:12.722338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537977+0000","last_change":"2023-11-24T08:01:45.530194+0000","last_active":"2023-11-24T08:01:46.537977+0000","last_peered":"2023-11-24T08:01:46.537977+0000","last_clean":"2023-11-24T08:01:46.537977+0000","last_became_active":"2023-11-24T08:01:45.528794+0000","last_became_peered":"2023-11-24T08:01:45.528794+0000","last_unstale":"2023-11-24T08:01:46.537977+0000","last_undegraded":"2023-11-24T08:01:46.537977+0000","last_fullsized":"2023-11-24T08:01:46.537977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:25.163348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536768+0000","last_change":"2023-11-24T08:01:44.930779+0000","last_active":"2023-11-24T08:01:46.536768+0000","last_peered":"2023-11-24T08:01:46.536768+0000","last_clean":"2023-11-24T08:01:46.536768+0000","last_became_active":"2023-11-24T08:01:44.929904+0000","last_became_peered":"2023-11-24T08:01:44.929904+0000","last_unstale":"2023-11-24T08:01:46.536768+0000","last_undegraded":"2023-11-24T08:01:46.536768+0000","last_fullsized":"2023-11-24T08:01:46.536768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:52:06.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537868+0000","last_change":"2023-11-24T08:01:44.930315+0000","last_active":"2023-11-24T08:01:46.537868+0000","last_peered":"2023-11-24T08:01:46.537868+0000","last_clean":"2023-11-24T08:01:46.537868+0000","last_became_active":"2023-11-24T08:01:44.929989+0000","last_became_peered":"2023-11-24T08:01:44.929989+0000","last_unstale":"2023-11-24T08:01:46.537868+0000","last_undegraded":"2023-11-24T08:01:46.537868+0000","last_fullsized":"2023-11-24T08:01:46.537868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:01.841125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537566+0000","last_change":"2023-11-24T08:01:45.532651+0000","last_active":"2023-11-24T08:01:46.537566+0000","last_peered":"2023-11-24T08:01:46.537566+0000","last_clean":"2023-11-24T08:01:46.537566+0000","last_became_active":"2023-11-24T08:01:45.531961+0000","last_became_peered":"2023-11-24T08:01:45.531961+0000","last_unstale":"2023-11-24T08:01:46.537566+0000","last_undegraded":"2023-11-24T08:01:46.537566+0000","last_fullsized":"2023-11-24T08:01:46.537566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:16.921524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538887+0000","last_change":"2023-11-24T08:01:44.936017+0000","last_active":"2023-11-24T08:01:46.538887+0000","last_peered":"2023-11-24T08:01:46.538887+0000","last_clean":"2023-11-24T08:01:46.538887+0000","last_became_active":"2023-11-24T08:01:44.935565+0000","last_became_peered":"2023-11-24T08:01:44.935565+0000","last_unstale":"2023-11-24T08:01:46.538887+0000","last_undegraded":"2023-11-24T08:01:46.538887+0000","last_fullsized":"2023-11-24T08:01:46.538887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:19.655310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537801+0000","last_change":"2023-11-24T08:01:44.931340+0000","last_active":"2023-11-24T08:01:46.537801+0000","last_peered":"2023-11-24T08:01:46.537801+0000","last_clean":"2023-11-24T08:01:46.537801+0000","last_became_active":"2023-11-24T08:01:44.930998+0000","last_became_peered":"2023-11-24T08:01:44.930998+0000","last_unstale":"2023-11-24T08:01:46.537801+0000","last_undegraded":"2023-11-24T08:01:46.537801+0000","last_fullsized":"2023-11-24T08:01:46.537801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:45.928999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538854+0000","last_change":"2023-11-24T08:01:45.532643+0000","last_active":"2023-11-24T08:01:46.538854+0000","last_peered":"2023-11-24T08:01:46.538854+0000","last_clean":"2023-11-24T08:01:46.538854+0000","last_became_active":"2023-11-24T08:01:45.532282+0000","last_became_peered":"2023-11-24T08:01:45.532282+0000","last_unstale":"2023-11-24T08:01:46.538854+0000","last_undegraded":"2023-11-24T08:01:46.538854+0000","last_fullsized":"2023-11-24T08:01:46.538854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:38.867510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537679+0000","last_change":"2023-11-24T08:01:44.929088+0000","last_active":"2023-11-24T08:01:46.537679+0000","last_peered":"2023-11-24T08:01:46.537679+0000","last_clean":"2023-11-24T08:01:46.537679+0000","last_became_active":"2023-11-24T08:01:44.928731+0000","last_became_peered":"2023-11-24T08:01:44.928731+0000","last_unstale":"2023-11-24T08:01:46.537679+0000","last_undegraded":"2023-11-24T08:01:46.537679+0000","last_fullsized":"2023-11-24T08:01:46.537679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:13:13.299878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537061+0000","last_change":"2023-11-24T08:01:44.936490+0000","last_active":"2023-11-24T08:01:46.537061+0000","last_peered":"2023-11-24T08:01:46.537061+0000","last_clean":"2023-11-24T08:01:46.537061+0000","last_became_active":"2023-11-24T08:01:44.936234+0000","last_became_peered":"2023-11-24T08:01:44.936234+0000","last_unstale":"2023-11-24T08:01:46.537061+0000","last_undegraded":"2023-11-24T08:01:46.537061+0000","last_fullsized":"2023-11-24T08:01:46.537061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:27.255499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537297+0000","last_change":"2023-11-24T08:01:44.931175+0000","last_active":"2023-11-24T08:01:46.537297+0000","last_peered":"2023-11-24T08:01:46.537297+0000","last_clean":"2023-11-24T08:01:46.537297+0000","last_became_active":"2023-11-24T08:01:44.930904+0000","last_became_peered":"2023-11-24T08:01:44.930904+0000","last_unstale":"2023-11-24T08:01:46.537297+0000","last_undegraded":"2023-11-24T08:01:46.537297+0000","last_fullsized":"2023-11-24T08:01:46.537297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:30.513283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536126+0000","last_change":"2023-11-24T08:01:44.927016+0000","last_active":"2023-11-24T08:01:46.536126+0000","last_peered":"2023-11-24T08:01:46.536126+0000","last_clean":"2023-11-24T08:01:46.536126+0000","last_became_active":"2023-11-24T08:01:44.924823+0000","last_became_peered":"2023-11-24T08:01:44.924823+0000","last_unstale":"2023-11-24T08:01:46.536126+0000","last_undegraded":"2023-11-24T08:01:46.536126+0000","last_fullsized":"2023-11-24T08:01:46.536126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:08:31.176057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538983+0000","last_change":"2023-11-24T08:01:44.938149+0000","last_active":"2023-11-24T08:01:46.538983+0000","last_peered":"2023-11-24T08:01:46.538983+0000","last_clean":"2023-11-24T08:01:46.538983+0000","last_became_active":"2023-11-24T08:01:44.937848+0000","last_became_peered":"2023-11-24T08:01:44.937848+0000","last_unstale":"2023-11-24T08:01:46.538983+0000","last_undegraded":"2023-11-24T08:01:46.538983+0000","last_fullsized":"2023-11-24T08:01:46.538983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:36.296935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:47.096447+0000","last_change":"2023-11-24T08:01:44.929928+0000","last_active":"2023-11-24T08:01:47.096447+0000","last_peered":"2023-11-24T08:01:47.096447+0000","last_clean":"2023-11-24T08:01:47.096447+0000","last_became_active":"2023-11-24T08:01:44.929485+0000","last_became_peered":"2023-11-24T08:01:44.929485+0000","last_unstale":"2023-11-24T08:01:47.096447+0000","last_undegraded":"2023-11-24T08:01:47.096447+0000","last_fullsized":"2023-11-24T08:01:47.096447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:19.655310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537511+0000","last_change":"2023-11-24T08:01:45.531749+0000","last_active":"2023-11-24T08:01:46.537511+0000","last_peered":"2023-11-24T08:01:46.537511+0000","last_clean":"2023-11-24T08:01:46.537511+0000","last_became_active":"2023-11-24T08:01:45.531363+0000","last_became_peered":"2023-11-24T08:01:45.531363+0000","last_unstale":"2023-11-24T08:01:46.537511+0000","last_undegraded":"2023-11-24T08:01:46.537511+0000","last_fullsized":"2023-11-24T08:01:46.537511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:02.855378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539450+0000","last_change":"2023-11-24T08:01:44.927262+0000","last_active":"2023-11-24T08:01:46.539450+0000","last_peered":"2023-11-24T08:01:46.539450+0000","last_clean":"2023-11-24T08:01:46.539450+0000","last_became_active":"2023-11-24T08:01:44.926962+0000","last_became_peered":"2023-11-24T08:01:44.926962+0000","last_unstale":"2023-11-24T08:01:46.539450+0000","last_undegraded":"2023-11-24T08:01:46.539450+0000","last_fullsized":"2023-11-24T08:01:46.539450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:15.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537482+0000","last_change":"2023-11-24T08:01:44.933631+0000","last_active":"2023-11-24T08:01:46.537482+0000","last_peered":"2023-11-24T08:01:46.537482+0000","last_clean":"2023-11-24T08:01:46.537482+0000","last_became_active":"2023-11-24T08:01:44.933329+0000","last_became_peered":"2023-11-24T08:01:44.933329+0000","last_unstale":"2023-11-24T08:01:46.537482+0000","last_undegraded":"2023-11-24T08:01:46.537482+0000","last_fullsized":"2023-11-24T08:01:46.537482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:26.154123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537231+0000","last_change":"2023-11-24T08:01:45.522503+0000","last_active":"2023-11-24T08:01:46.537231+0000","last_peered":"2023-11-24T08:01:46.537231+0000","last_clean":"2023-11-24T08:01:46.537231+0000","last_became_active":"2023-11-24T08:01:45.522026+0000","last_became_peered":"2023-11-24T08:01:45.522026+0000","last_unstale":"2023-11-24T08:01:46.537231+0000","last_undegraded":"2023-11-24T08:01:46.537231+0000","last_fullsized":"2023-11-24T08:01:46.537231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:16.921524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537966+0000","last_change":"2023-11-24T08:01:44.937766+0000","last_active":"2023-11-24T08:01:46.537966+0000","last_peered":"2023-11-24T08:01:46.537966+0000","last_clean":"2023-11-24T08:01:46.537966+0000","last_became_active":"2023-11-24T08:01:44.937438+0000","last_became_peered":"2023-11-24T08:01:44.937438+0000","last_unstale":"2023-11-24T08:01:46.537966+0000","last_undegraded":"2023-11-24T08:01:46.537966+0000","last_fullsized":"2023-11-24T08:01:46.537966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:22.573907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536318+0000","last_change":"2023-11-24T08:01:44.934011+0000","last_active":"2023-11-24T08:01:46.536318+0000","last_peered":"2023-11-24T08:01:46.536318+0000","last_clean":"2023-11-24T08:01:46.536318+0000","last_became_active":"2023-11-24T08:01:44.933646+0000","last_became_peered":"2023-11-24T08:01:44.933646+0000","last_unstale":"2023-11-24T08:01:46.536318+0000","last_undegraded":"2023-11-24T08:01:46.536318+0000","last_fullsized":"2023-11-24T08:01:46.536318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:00.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536077+0000","last_change":"2023-11-24T08:01:45.534982+0000","last_active":"2023-11-24T08:01:46.536077+0000","last_peered":"2023-11-24T08:01:46.536077+0000","last_clean":"2023-11-24T08:01:46.536077+0000","last_became_active":"2023-11-24T08:01:45.534603+0000","last_became_peered":"2023-11-24T08:01:45.534603+0000","last_unstale":"2023-11-24T08:01:46.536077+0000","last_undegraded":"2023-11-24T08:01:46.536077+0000","last_fullsized":"2023-11-24T08:01:46.536077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:27.168377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:44.888020+0000","last_change":"2023-11-24T08:01:44.888020+0000","last_active":"2023-11-24T08:01:44.888020+0000","last_peered":"2023-11-24T08:01:44.888020+0000","last_clean":"2023-11-24T08:01:44.888020+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:44.888020+0000","last_undegraded":"2023-11-24T08:01:44.888020+0000","last_fullsized":"2023-11-24T08:01:44.888020+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:01:43.873767+0000","last_change":"2023-11-24T08:01:43.873767+0000","last_active":"2023-11-24T08:01:43.873767+0000","last_peered":"2023-11-24T08:01:43.873767+0000","last_clean":"2023-11-24T08:01:43.873767+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:01:43.873767+0000","last_undegraded":"2023-11-24T08:01:43.873767+0000","last_fullsized":"2023-11-24T08:01:43.873767+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":173,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-11-24T08:01:38.316138+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:01:38.316138+0000","last_peered":"2023-11-24T08:01:38.316138+0000","last_clean":"2023-11-24T08:01:38.316138+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:01:38.316138+0000","last_undegraded":"2023-11-24T08:01:38.316138+0000","last_fullsized":"2023-11-24T08:01:38.316138+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":40,"acting":40,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":126,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":38,"acting":38,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":933888,"data_stored":718063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.3899999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.2390000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.121},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.198}]},{"osd":4,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.3540000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.5680000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.456}]}]},{"osd":6,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27372,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":339968,"data_stored":127695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.84699999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.298},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.3580000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.831,"5min":2.831,"15min":2.831},"last":1.0920000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.458}]},{"osd":4,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.55},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.161}]},{"osd":5,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4119999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.6339999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":127695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.95499999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.88},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.028}]},{"osd":2,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.069},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.0029999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.2869999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.157},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.127},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.101}]},{"osd":7,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.2350000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":339968,"data_stored":127695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.224},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.69999999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.73499999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.282},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.111}]},{"osd":6,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.008},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.1819999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.022},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.95099999999999996}]}]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":127695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8040000000000003,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.81599999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.8460000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":6.0529999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":1.276}]},{"osd":3,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":1.143}]},{"osd":4,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":1.468},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":6.306,"5min":6.306,"15min":6.306},"last":1.343}]},{"osd":5,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":6.2160000000000002,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.1870000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.254},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":6.3470000000000004,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.218}]},{"osd":7,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":6.399,"5min":6.399,"15min":6.399},"last":1.3939999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.357},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.2809999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.617}]},{"osd":3,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.175}]},{"osd":5,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.53},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.7050000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.581}]},{"osd":7,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.488},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.409}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":154488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.266,"5min":3.266,"15min":3.266},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.754},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.95799999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.88600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.367,"5min":4.367,"15min":4.367},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.2609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.53},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.6120000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.4970000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.728,"5min":1.728,"15min":1.728},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":1.4359999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":743222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.454}]},{"osd":4,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.089},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.161}]},{"osd":5,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.839,"5min":2.839,"15min":2.839},"last":1.385},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.427}]},{"osd":6,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.232}]},{"osd":7,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.506}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:01:50.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:01:50.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.613+0000 7fcfb759e640 1 Processor -- start 2023-11-24T08:01:50.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.613+0000 7fcfb759e640 1 -- start start 2023-11-24T08:01:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcfb8160c70 0x7fcfb80d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcfb80c6be0 0x7fcfb80cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80cf6a0 con 0x7fcfb8160890 2023-11-24T08:01:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80d1430 con 0x7fcfb80c6be0 2023-11-24T08:01:50.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb759e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80b4370 con 0x7fcfb8160c70 2023-11-24T08:01:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb6d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcfb80c6be0 0x7fcfb80cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb6d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcfb80c6be0 0x7fcfb80cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47134/0 (socket says 172.21.15.161:47134) 2023-11-24T08:01:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.615+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3341722027 learned_addr learned my addr 172.21.15.161:0/3341722027 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.616+0000 7fcfadd9b640 1 --2- 172.21.15.161:0/3341722027 >> v2:172.21.15.175:3300/0 conn(0x7fcfb8160c70 0x7fcfb80d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.616+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3341722027 >> v2:172.21.15.175:3300/0 conn(0x7fcfb8160c70 msgr2=0x7fcfb80d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:50.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.616+0000 7fcfb6d9d640 1 --2- 172.21.15.161:0/3341722027 >> v2:172.21.15.175:3300/0 conn(0x7fcfb8160c70 0x7fcfb80d3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.616+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3341722027 >> v1:172.21.15.175:6789/0 conn(0x7fcfb8160890 legacy=0x7fcfb80d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.616+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3341722027 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80ce7c0 con 0x7fcfb80c6be0 2023-11-24T08:01:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.617+0000 7fcfb6d9d640 1 --2- 172.21.15.161:0/3341722027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80c6be0 0x7fcfb80cfb30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80b5c80 tx=0x7fcfb002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da867c587c84abb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.617+0000 7fcfb5d9b640 1 -- 172.21.15.161:0/3341722027 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb002c9f0 con 0x7fcfb80c6be0 2023-11-24T08:01:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.617+0000 7fcfb5d9b640 1 -- 172.21.15.161:0/3341722027 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb002cb50 con 0x7fcfb80c6be0 2023-11-24T08:01:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.617+0000 7fcfb5d9b640 1 -- 172.21.15.161:0/3341722027 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00343f0 con 0x7fcfb80c6be0 2023-11-24T08:01:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 -- 172.21.15.161:0/3341722027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80c6be0 msgr2=0x7fcfb80cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3341722027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80c6be0 0x7fcfb80cfb30 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80b5c80 tx=0x7fcfb002be50 comp rx=0 tx=0).stop 2023-11-24T08:01:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 -- 172.21.15.161:0/3341722027 shutdown_connections 2023-11-24T08:01:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3341722027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb80c6be0 0x7fcfb80cfb30 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3341722027 >> v2:172.21.15.175:3300/0 conn(0x7fcfb8160c70 0x7fcfb80d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 -- 172.21.15.161:0/3341722027 >> 172.21.15.161:0/3341722027 conn(0x7fcfb80d3090 msgr2=0x7fcfb80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 -- 172.21.15.161:0/3341722027 shutdown_connections 2023-11-24T08:01:50.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.618+0000 7fcfb759e640 1 -- 172.21.15.161:0/3341722027 wait complete. 2023-11-24T08:01:50.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.620+0000 7fcfb759e640 1 Processor -- start 2023-11-24T08:01:50.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.620+0000 7fcfb759e640 1 -- start start 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb80c6be0 0x7fcfb8152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb8160890 0x7fcfb8153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 0x7fcfb80cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8153550 con 0x7fcfb8160c70 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8152ad0 con 0x7fcfb8160890 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8153db0 con 0x7fcfb80c6be0 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 0x7fcfb80cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 0x7fcfb80cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47140/0 (socket says 172.21.15.161:47140) 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.621+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3502027353 learned_addr learned my addr 172.21.15.161:0/3502027353 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb80c6be0 msgr2=0x7fcfb8152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb6d9d640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb80c6be0 0x7fcfb8152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfadd9b640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb8160890 0x7fcfb8153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb8160890 msgr2=0x7fcfb8153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb6d9d640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb8160890 0x7fcfb8153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb6d9d640 1 -- 172.21.15.161:0/3502027353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009b30 con 0x7fcfb8160c70 2023-11-24T08:01:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb6d9d640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 0x7fcfb80cc330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036040 tx=0x7fcfb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0009510 con 0x7fcfb8160c70 2023-11-24T08:01:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb003e450 con 0x7fcfb8160c70 2023-11-24T08:01:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb003e800 con 0x7fcfb8160c70 2023-11-24T08:01:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb80b61f0 con 0x7fcfb8160c70 2023-11-24T08:01:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.622+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb80b67b0 con 0x7fcfb8160c70 2023-11-24T08:01:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.623+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8067450 con 0x7fcfb8160c70 2023-11-24T08:01:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.624+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfb003e960 con 0x7fcfb8160c70 2023-11-24T08:01:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.626+0000 7fcfaf7fe640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcf9806ae70 0x7fcf9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.626+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfb00ac410 con 0x7fcfb8160c70 2023-11-24T08:01:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.626+0000 7fcfb659c640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcf9806ae70 0x7fcf9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:50.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.627+0000 7fcfb659c640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcf9806ae70 0x7fcf9806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000f60 tx=0x7fcfa80079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:50.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.630+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfb0077420 con 0x7fcfb8160c70 2023-11-24T08:01:50.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.818+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfb80ced80 con 0x7fcf9806ae70 2023-11-24T08:01:50.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.842+0000 7fcfaf7fe640 1 -- 172.21.15.161:0/3502027353 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286883 (secure 0 0 0) 0x7fcfa8005080 con 0x7fcf9806ae70 2023-11-24T08:01:50.847 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:50.849 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:01:50.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcf9806ae70 msgr2=0x7fcf9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcf9806ae70 0x7fcf9806d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8000f60 tx=0x7fcfa80079b0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 msgr2=0x7fcfb80cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 0x7fcfb80cc330 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0036040 tx=0x7fcfb0004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 shutdown_connections 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcf9806ae70 0x7fcf9806d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfb8160c70 0x7fcfb80cc330 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcfb8160890 0x7fcfb8153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 --2- 172.21.15.161:0/3502027353 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcfb80c6be0 0x7fcfb8152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 >> 172.21.15.161:0/3502027353 conn(0x7fcfb80d3090 msgr2=0x7fcfb80b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 shutdown_connections 2023-11-24T08:01:50.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:50.847+0000 7fcfb759e640 1 -- 172.21.15.161:0/3502027353 wait complete. 2023-11-24T08:01:50.870 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2023-11-24T08:01:50.555812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220448,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754272,"statfs":{"total":773094113280,"available":772868374528,"internally_reserved":0,"allocated":4366336,"data_stored":2408388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001941"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513778+0000","last_change":"2023-11-24T08:01:45.533676+0000","last_active":"2023-11-24T08:01:46.513778+0000","last_peered":"2023-11-24T08:01:46.513778+0000","last_clean":"2023-11-24T08:01:46.513778+0000","last_became_active":"2023-11-24T08:01:45.533403+0000","last_became_peered":"2023-11-24T08:01:45.533403+0000","last_unstale":"2023-11-24T08:01:46.513778+0000","last_undegraded":"2023-11-24T08:01:46.513778+0000","last_fullsized":"2023-11-24T08:01:46.513778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:13:15.929230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.510176+0000","last_change":"2023-11-24T08:01:45.538220+0000","last_active":"2023-11-24T08:01:46.510176+0000","last_peered":"2023-11-24T08:01:46.510176+0000","last_clean":"2023-11-24T08:01:46.510176+0000","last_became_active":"2023-11-24T08:01:45.537890+0000","last_became_peered":"2023-11-24T08:01:45.537890+0000","last_unstale":"2023-11-24T08:01:46.510176+0000","last_undegraded":"2023-11-24T08:01:46.510176+0000","last_fullsized":"2023-11-24T08:01:46.510176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:14.057147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537970+0000","last_change":"2023-11-24T08:01:45.543350+0000","last_active":"2023-11-24T08:01:46.537970+0000","last_peered":"2023-11-24T08:01:46.537970+0000","last_clean":"2023-11-24T08:01:46.537970+0000","last_became_active":"2023-11-24T08:01:45.542528+0000","last_became_peered":"2023-11-24T08:01:45.542528+0000","last_unstale":"2023-11-24T08:01:46.537970+0000","last_undegraded":"2023-11-24T08:01:46.537970+0000","last_fullsized":"2023-11-24T08:01:46.537970+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:27.135342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538502+0000","last_change":"2023-11-24T08:01:45.532905+0000","last_active":"2023-11-24T08:01:46.538502+0000","last_peered":"2023-11-24T08:01:46.538502+0000","last_clean":"2023-11-24T08:01:46.538502+0000","last_became_active":"2023-11-24T08:01:45.532395+0000","last_became_peered":"2023-11-24T08:01:45.532395+0000","last_unstale":"2023-11-24T08:01:46.538502+0000","last_undegraded":"2023-11-24T08:01:46.538502+0000","last_fullsized":"2023-11-24T08:01:46.538502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:59:16.788249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.534608+0000","last_change":"2023-11-24T08:01:45.538824+0000","last_active":"2023-11-24T08:01:46.534608+0000","last_peered":"2023-11-24T08:01:46.534608+0000","last_clean":"2023-11-24T08:01:46.534608+0000","last_became_active":"2023-11-24T08:01:45.538248+0000","last_became_peered":"2023-11-24T08:01:45.538248+0000","last_unstale":"2023-11-24T08:01:46.534608+0000","last_undegraded":"2023-11-24T08:01:46.534608+0000","last_fullsized":"2023-11-24T08:01:46.534608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:06:43.321455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509183+0000","last_change":"2023-11-24T08:01:45.543021+0000","last_active":"2023-11-24T08:01:46.509183+0000","last_peered":"2023-11-24T08:01:46.509183+0000","last_clean":"2023-11-24T08:01:46.509183+0000","last_became_active":"2023-11-24T08:01:45.542730+0000","last_became_peered":"2023-11-24T08:01:45.542730+0000","last_unstale":"2023-11-24T08:01:46.509183+0000","last_undegraded":"2023-11-24T08:01:46.509183+0000","last_fullsized":"2023-11-24T08:01:46.509183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:23.629928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513253+0000","last_change":"2023-11-24T08:01:45.534525+0000","last_active":"2023-11-24T08:01:46.513253+0000","last_peered":"2023-11-24T08:01:46.513253+0000","last_clean":"2023-11-24T08:01:46.513253+0000","last_became_active":"2023-11-24T08:01:45.534180+0000","last_became_peered":"2023-11-24T08:01:45.534180+0000","last_unstale":"2023-11-24T08:01:46.513253+0000","last_undegraded":"2023-11-24T08:01:46.513253+0000","last_fullsized":"2023-11-24T08:01:46.513253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:10.451533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.511965+0000","last_change":"2023-11-24T08:01:45.538445+0000","last_active":"2023-11-24T08:01:46.511965+0000","last_peered":"2023-11-24T08:01:46.511965+0000","last_clean":"2023-11-24T08:01:46.511965+0000","last_became_active":"2023-11-24T08:01:45.537824+0000","last_became_peered":"2023-11-24T08:01:45.537824+0000","last_unstale":"2023-11-24T08:01:46.511965+0000","last_undegraded":"2023-11-24T08:01:46.511965+0000","last_fullsized":"2023-11-24T08:01:46.511965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:40.208507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538407+0000","last_change":"2023-11-24T08:01:45.529622+0000","last_active":"2023-11-24T08:01:46.538407+0000","last_peered":"2023-11-24T08:01:46.538407+0000","last_clean":"2023-11-24T08:01:46.538407+0000","last_became_active":"2023-11-24T08:01:45.529312+0000","last_became_peered":"2023-11-24T08:01:45.529312+0000","last_unstale":"2023-11-24T08:01:46.538407+0000","last_undegraded":"2023-11-24T08:01:46.538407+0000","last_fullsized":"2023-11-24T08:01:46.538407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:02.855378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538378+0000","last_change":"2023-11-24T08:01:45.534123+0000","last_active":"2023-11-24T08:01:46.538378+0000","last_peered":"2023-11-24T08:01:46.538378+0000","last_clean":"2023-11-24T08:01:46.538378+0000","last_became_active":"2023-11-24T08:01:45.533877+0000","last_became_peered":"2023-11-24T08:01:45.533877+0000","last_unstale":"2023-11-24T08:01:46.538378+0000","last_undegraded":"2023-11-24T08:01:46.538378+0000","last_fullsized":"2023-11-24T08:01:46.538378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:33.263583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513156+0000","last_change":"2023-11-24T08:01:45.540367+0000","last_active":"2023-11-24T08:01:46.513156+0000","last_peered":"2023-11-24T08:01:46.513156+0000","last_clean":"2023-11-24T08:01:46.513156+0000","last_became_active":"2023-11-24T08:01:45.540075+0000","last_became_peered":"2023-11-24T08:01:45.540075+0000","last_unstale":"2023-11-24T08:01:46.513156+0000","last_undegraded":"2023-11-24T08:01:46.513156+0000","last_fullsized":"2023-11-24T08:01:46.513156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:12.018098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538004+0000","last_change":"2023-11-24T08:01:45.543251+0000","last_active":"2023-11-24T08:01:46.538004+0000","last_peered":"2023-11-24T08:01:46.538004+0000","last_clean":"2023-11-24T08:01:46.538004+0000","last_became_active":"2023-11-24T08:01:45.542939+0000","last_became_peered":"2023-11-24T08:01:45.542939+0000","last_unstale":"2023-11-24T08:01:46.538004+0000","last_undegraded":"2023-11-24T08:01:46.538004+0000","last_fullsized":"2023-11-24T08:01:46.538004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:29.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.534755+0000","last_change":"2023-11-24T08:01:45.536814+0000","last_active":"2023-11-24T08:01:46.534755+0000","last_peered":"2023-11-24T08:01:46.534755+0000","last_clean":"2023-11-24T08:01:46.534755+0000","last_became_active":"2023-11-24T08:01:45.536364+0000","last_became_peered":"2023-11-24T08:01:45.536364+0000","last_unstale":"2023-11-24T08:01:46.534755+0000","last_undegraded":"2023-11-24T08:01:46.534755+0000","last_fullsized":"2023-11-24T08:01:46.534755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:01.663673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509537+0000","last_change":"2023-11-24T08:01:45.535819+0000","last_active":"2023-11-24T08:01:46.509537+0000","last_peered":"2023-11-24T08:01:46.509537+0000","last_clean":"2023-11-24T08:01:46.509537+0000","last_became_active":"2023-11-24T08:01:45.535548+0000","last_became_peered":"2023-11-24T08:01:45.535548+0000","last_unstale":"2023-11-24T08:01:46.509537+0000","last_undegraded":"2023-11-24T08:01:46.509537+0000","last_fullsized":"2023-11-24T08:01:46.509537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:30.689779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538195+0000","last_change":"2023-11-24T08:01:45.541391+0000","last_active":"2023-11-24T08:01:46.538195+0000","last_peered":"2023-11-24T08:01:46.538195+0000","last_clean":"2023-11-24T08:01:46.538195+0000","last_became_active":"2023-11-24T08:01:45.541157+0000","last_became_peered":"2023-11-24T08:01:45.541157+0000","last_unstale":"2023-11-24T08:01:46.538195+0000","last_undegraded":"2023-11-24T08:01:46.538195+0000","last_fullsized":"2023-11-24T08:01:46.538195+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:23.629928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.512982+0000","last_change":"2023-11-24T08:01:45.540594+0000","last_active":"2023-11-24T08:01:46.512982+0000","last_peered":"2023-11-24T08:01:46.512982+0000","last_clean":"2023-11-24T08:01:46.512982+0000","last_became_active":"2023-11-24T08:01:45.540344+0000","last_became_peered":"2023-11-24T08:01:45.540344+0000","last_unstale":"2023-11-24T08:01:46.512982+0000","last_undegraded":"2023-11-24T08:01:46.512982+0000","last_fullsized":"2023-11-24T08:01:46.512982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:30.689779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513207+0000","last_change":"2023-11-24T08:01:45.538634+0000","last_active":"2023-11-24T08:01:46.513207+0000","last_peered":"2023-11-24T08:01:46.513207+0000","last_clean":"2023-11-24T08:01:46.513207+0000","last_became_active":"2023-11-24T08:01:45.538369+0000","last_became_peered":"2023-11-24T08:01:45.538369+0000","last_unstale":"2023-11-24T08:01:46.513207+0000","last_undegraded":"2023-11-24T08:01:46.513207+0000","last_fullsized":"2023-11-24T08:01:46.513207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:13:36.692460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.510133+0000","last_change":"2023-11-24T08:01:45.540348+0000","last_active":"2023-11-24T08:01:46.510133+0000","last_peered":"2023-11-24T08:01:46.510133+0000","last_clean":"2023-11-24T08:01:46.510133+0000","last_became_active":"2023-11-24T08:01:45.540036+0000","last_became_peered":"2023-11-24T08:01:45.540036+0000","last_unstale":"2023-11-24T08:01:46.510133+0000","last_undegraded":"2023-11-24T08:01:46.510133+0000","last_fullsized":"2023-11-24T08:01:46.510133+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:10.451533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509652+0000","last_change":"2023-11-24T08:01:45.539886+0000","last_active":"2023-11-24T08:01:46.509652+0000","last_peered":"2023-11-24T08:01:46.509652+0000","last_clean":"2023-11-24T08:01:46.509652+0000","last_became_active":"2023-11-24T08:01:45.539615+0000","last_became_peered":"2023-11-24T08:01:45.539615+0000","last_unstale":"2023-11-24T08:01:46.509652+0000","last_undegraded":"2023-11-24T08:01:46.509652+0000","last_fullsized":"2023-11-24T08:01:46.509652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:12.018098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.535122+0000","last_change":"2023-11-24T08:01:45.530417+0000","last_active":"2023-11-24T08:01:46.535122+0000","last_peered":"2023-11-24T08:01:46.535122+0000","last_clean":"2023-11-24T08:01:46.535122+0000","last_became_active":"2023-11-24T08:01:45.526717+0000","last_became_peered":"2023-11-24T08:01:45.526717+0000","last_unstale":"2023-11-24T08:01:46.535122+0000","last_undegraded":"2023-11-24T08:01:46.535122+0000","last_fullsized":"2023-11-24T08:01:46.535122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:57:34.859746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536598+0000","last_change":"2023-11-24T08:01:45.531471+0000","last_active":"2023-11-24T08:01:46.536598+0000","last_peered":"2023-11-24T08:01:46.536598+0000","last_clean":"2023-11-24T08:01:46.536598+0000","last_became_active":"2023-11-24T08:01:45.531193+0000","last_became_peered":"2023-11-24T08:01:45.531193+0000","last_unstale":"2023-11-24T08:01:46.536598+0000","last_undegraded":"2023-11-24T08:01:46.536598+0000","last_fullsized":"2023-11-24T08:01:46.536598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:20.669564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536362+0000","last_change":"2023-11-24T08:01:45.541477+0000","last_active":"2023-11-24T08:01:46.536362+0000","last_peered":"2023-11-24T08:01:46.536362+0000","last_clean":"2023-11-24T08:01:46.536362+0000","last_became_active":"2023-11-24T08:01:45.541146+0000","last_became_peered":"2023-11-24T08:01:45.541146+0000","last_unstale":"2023-11-24T08:01:46.536362+0000","last_undegraded":"2023-11-24T08:01:46.536362+0000","last_fullsized":"2023-11-24T08:01:46.536362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:13.736591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536658+0000","last_change":"2023-11-24T08:01:45.528034+0000","last_active":"2023-11-24T08:01:46.536658+0000","last_peered":"2023-11-24T08:01:46.536658+0000","last_clean":"2023-11-24T08:01:46.536658+0000","last_became_active":"2023-11-24T08:01:45.527635+0000","last_became_peered":"2023-11-24T08:01:45.527635+0000","last_unstale":"2023-11-24T08:01:46.536658+0000","last_undegraded":"2023-11-24T08:01:46.536658+0000","last_fullsized":"2023-11-24T08:01:46.536658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:37.311188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537232+0000","last_change":"2023-11-24T08:01:45.530917+0000","last_active":"2023-11-24T08:01:46.537232+0000","last_peered":"2023-11-24T08:01:46.537232+0000","last_clean":"2023-11-24T08:01:46.537232+0000","last_became_active":"2023-11-24T08:01:45.530557+0000","last_became_peered":"2023-11-24T08:01:45.530557+0000","last_unstale":"2023-11-24T08:01:46.537232+0000","last_undegraded":"2023-11-24T08:01:46.537232+0000","last_fullsized":"2023-11-24T08:01:46.537232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:51.801558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538707+0000","last_change":"2023-11-24T08:01:45.531364+0000","last_active":"2023-11-24T08:01:46.538707+0000","last_peered":"2023-11-24T08:01:46.538707+0000","last_clean":"2023-11-24T08:01:46.538707+0000","last_became_active":"2023-11-24T08:01:45.531016+0000","last_became_peered":"2023-11-24T08:01:45.531016+0000","last_unstale":"2023-11-24T08:01:46.538707+0000","last_undegraded":"2023-11-24T08:01:46.538707+0000","last_fullsized":"2023-11-24T08:01:46.538707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:32:55.927856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.510309+0000","last_change":"2023-11-24T08:01:45.534748+0000","last_active":"2023-11-24T08:01:46.510309+0000","last_peered":"2023-11-24T08:01:46.510309+0000","last_clean":"2023-11-24T08:01:46.510309+0000","last_became_active":"2023-11-24T08:01:45.534464+0000","last_became_peered":"2023-11-24T08:01:45.534464+0000","last_unstale":"2023-11-24T08:01:46.510309+0000","last_undegraded":"2023-11-24T08:01:46.510309+0000","last_fullsized":"2023-11-24T08:01:46.510309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:28:45.589983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539436+0000","last_change":"2023-11-24T08:01:45.533551+0000","last_active":"2023-11-24T08:01:46.539436+0000","last_peered":"2023-11-24T08:01:46.539436+0000","last_clean":"2023-11-24T08:01:46.539436+0000","last_became_active":"2023-11-24T08:01:45.529176+0000","last_became_peered":"2023-11-24T08:01:45.529176+0000","last_unstale":"2023-11-24T08:01:46.539436+0000","last_undegraded":"2023-11-24T08:01:46.539436+0000","last_fullsized":"2023-11-24T08:01:46.539436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:47:34.071353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538049+0000","last_change":"2023-11-24T08:01:45.532944+0000","last_active":"2023-11-24T08:01:46.538049+0000","last_peered":"2023-11-24T08:01:46.538049+0000","last_clean":"2023-11-24T08:01:46.538049+0000","last_became_active":"2023-11-24T08:01:45.532565+0000","last_became_peered":"2023-11-24T08:01:45.532565+0000","last_unstale":"2023-11-24T08:01:46.538049+0000","last_undegraded":"2023-11-24T08:01:46.538049+0000","last_fullsized":"2023-11-24T08:01:46.538049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:15:04.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536310+0000","last_change":"2023-11-24T08:01:45.541946+0000","last_active":"2023-11-24T08:01:46.536310+0000","last_peered":"2023-11-24T08:01:46.536310+0000","last_clean":"2023-11-24T08:01:46.536310+0000","last_became_active":"2023-11-24T08:01:45.541478+0000","last_became_peered":"2023-11-24T08:01:45.541478+0000","last_unstale":"2023-11-24T08:01:46.536310+0000","last_undegraded":"2023-11-24T08:01:46.536310+0000","last_fullsized":"2023-11-24T08:01:46.536310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:58:03.883352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.512397+0000","last_change":"2023-11-24T08:01:45.535070+0000","last_active":"2023-11-24T08:01:46.512397+0000","last_peered":"2023-11-24T08:01:46.512397+0000","last_clean":"2023-11-24T08:01:46.512397+0000","last_became_active":"2023-11-24T08:01:45.534169+0000","last_became_peered":"2023-11-24T08:01:45.534169+0000","last_unstale":"2023-11-24T08:01:46.512397+0000","last_undegraded":"2023-11-24T08:01:46.512397+0000","last_fullsized":"2023-11-24T08:01:46.512397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:29.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.510972+0000","last_change":"2023-11-24T08:01:45.527042+0000","last_active":"2023-11-24T08:01:46.510972+0000","last_peered":"2023-11-24T08:01:46.510972+0000","last_clean":"2023-11-24T08:01:46.510972+0000","last_became_active":"2023-11-24T08:01:45.523835+0000","last_became_peered":"2023-11-24T08:01:45.523835+0000","last_unstale":"2023-11-24T08:01:46.510972+0000","last_undegraded":"2023-11-24T08:01:46.510972+0000","last_fullsized":"2023-11-24T08:01:46.510972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:26:26.872915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.512448+0000","last_change":"2023-11-24T08:01:45.538814+0000","last_active":"2023-11-24T08:01:46.512448+0000","last_peered":"2023-11-24T08:01:46.512448+0000","last_clean":"2023-11-24T08:01:46.512448+0000","last_became_active":"2023-11-24T08:01:45.538501+0000","last_became_peered":"2023-11-24T08:01:45.538501+0000","last_unstale":"2023-11-24T08:01:46.512448+0000","last_undegraded":"2023-11-24T08:01:46.512448+0000","last_fullsized":"2023-11-24T08:01:46.512448+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:15:04.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538286+0000","last_change":"2023-11-24T08:01:45.527931+0000","last_active":"2023-11-24T08:01:46.538286+0000","last_peered":"2023-11-24T08:01:46.538286+0000","last_clean":"2023-11-24T08:01:46.538286+0000","last_became_active":"2023-11-24T08:01:45.527636+0000","last_became_peered":"2023-11-24T08:01:45.527636+0000","last_unstale":"2023-11-24T08:01:46.538286+0000","last_undegraded":"2023-11-24T08:01:46.538286+0000","last_fullsized":"2023-11-24T08:01:46.538286+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:23.588161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513970+0000","last_change":"2023-11-24T08:01:44.940748+0000","last_active":"2023-11-24T08:01:46.513970+0000","last_peered":"2023-11-24T08:01:46.513970+0000","last_clean":"2023-11-24T08:01:46.513970+0000","last_became_active":"2023-11-24T08:01:44.940266+0000","last_became_peered":"2023-11-24T08:01:44.940266+0000","last_unstale":"2023-11-24T08:01:46.513970+0000","last_undegraded":"2023-11-24T08:01:46.513970+0000","last_fullsized":"2023-11-24T08:01:46.513970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:39:36.950998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.514054+0000","last_change":"2023-11-24T08:01:45.524662+0000","last_active":"2023-11-24T08:01:46.514054+0000","last_peered":"2023-11-24T08:01:46.514054+0000","last_clean":"2023-11-24T08:01:46.514054+0000","last_became_active":"2023-11-24T08:01:45.524076+0000","last_became_peered":"2023-11-24T08:01:45.524076+0000","last_unstale":"2023-11-24T08:01:46.514054+0000","last_undegraded":"2023-11-24T08:01:46.514054+0000","last_fullsized":"2023-11-24T08:01:46.514054+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:00:02.022267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538544+0000","last_change":"2023-11-24T08:01:44.940156+0000","last_active":"2023-11-24T08:01:46.538544+0000","last_peered":"2023-11-24T08:01:46.538544+0000","last_clean":"2023-11-24T08:01:46.538544+0000","last_became_active":"2023-11-24T08:01:44.939379+0000","last_became_peered":"2023-11-24T08:01:44.939379+0000","last_unstale":"2023-11-24T08:01:46.538544+0000","last_undegraded":"2023-11-24T08:01:46.538544+0000","last_fullsized":"2023-11-24T08:01:46.538544+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:35.250141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537170+0000","last_change":"2023-11-24T08:01:45.541809+0000","last_active":"2023-11-24T08:01:46.537170+0000","last_peered":"2023-11-24T08:01:46.537170+0000","last_clean":"2023-11-24T08:01:46.537170+0000","last_became_active":"2023-11-24T08:01:45.541335+0000","last_became_peered":"2023-11-24T08:01:45.541335+0000","last_unstale":"2023-11-24T08:01:46.537170+0000","last_undegraded":"2023-11-24T08:01:46.537170+0000","last_fullsized":"2023-11-24T08:01:46.537170+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:37.311188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509527+0000","last_change":"2023-11-24T08:01:44.936444+0000","last_active":"2023-11-24T08:01:46.509527+0000","last_peered":"2023-11-24T08:01:46.509527+0000","last_clean":"2023-11-24T08:01:46.509527+0000","last_became_active":"2023-11-24T08:01:44.935870+0000","last_became_peered":"2023-11-24T08:01:44.935870+0000","last_unstale":"2023-11-24T08:01:46.509527+0000","last_undegraded":"2023-11-24T08:01:46.509527+0000","last_fullsized":"2023-11-24T08:01:46.509527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:39.194253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539562+0000","last_change":"2023-11-24T08:01:45.528802+0000","last_active":"2023-11-24T08:01:46.539562+0000","last_peered":"2023-11-24T08:01:46.539562+0000","last_clean":"2023-11-24T08:01:46.539562+0000","last_became_active":"2023-11-24T08:01:45.528348+0000","last_became_peered":"2023-11-24T08:01:45.528348+0000","last_unstale":"2023-11-24T08:01:46.539562+0000","last_undegraded":"2023-11-24T08:01:46.539562+0000","last_fullsized":"2023-11-24T08:01:46.539562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:24:51.532292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.535149+0000","last_change":"2023-11-24T08:01:44.925127+0000","last_active":"2023-11-24T08:01:46.535149+0000","last_peered":"2023-11-24T08:01:46.535149+0000","last_clean":"2023-11-24T08:01:46.535149+0000","last_became_active":"2023-11-24T08:01:44.924865+0000","last_became_peered":"2023-11-24T08:01:44.924865+0000","last_unstale":"2023-11-24T08:01:46.535149+0000","last_undegraded":"2023-11-24T08:01:46.535149+0000","last_fullsized":"2023-11-24T08:01:46.535149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:32.261957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.512659+0000","last_change":"2023-11-24T08:01:45.538332+0000","last_active":"2023-11-24T08:01:46.512659+0000","last_peered":"2023-11-24T08:01:46.512659+0000","last_clean":"2023-11-24T08:01:46.512659+0000","last_became_active":"2023-11-24T08:01:45.538043+0000","last_became_peered":"2023-11-24T08:01:45.538043+0000","last_unstale":"2023-11-24T08:01:46.512659+0000","last_undegraded":"2023-11-24T08:01:46.512659+0000","last_fullsized":"2023-11-24T08:01:46.512659+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:19:23.629928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536517+0000","last_change":"2023-11-24T08:01:44.933602+0000","last_active":"2023-11-24T08:01:46.536517+0000","last_peered":"2023-11-24T08:01:46.536517+0000","last_clean":"2023-11-24T08:01:46.536517+0000","last_became_active":"2023-11-24T08:01:44.932233+0000","last_became_peered":"2023-11-24T08:01:44.932233+0000","last_unstale":"2023-11-24T08:01:46.536517+0000","last_undegraded":"2023-11-24T08:01:46.536517+0000","last_fullsized":"2023-11-24T08:01:46.536517+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:52:15.393492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537614+0000","last_change":"2023-11-24T08:01:45.538631+0000","last_active":"2023-11-24T08:01:46.537614+0000","last_peered":"2023-11-24T08:01:46.537614+0000","last_clean":"2023-11-24T08:01:46.537614+0000","last_became_active":"2023-11-24T08:01:45.538305+0000","last_became_peered":"2023-11-24T08:01:45.538305+0000","last_unstale":"2023-11-24T08:01:46.537614+0000","last_undegraded":"2023-11-24T08:01:46.537614+0000","last_fullsized":"2023-11-24T08:01:46.537614+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:31:40.208507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536360+0000","last_change":"2023-11-24T08:01:44.931674+0000","last_active":"2023-11-24T08:01:46.536360+0000","last_peered":"2023-11-24T08:01:46.536360+0000","last_clean":"2023-11-24T08:01:46.536360+0000","last_became_active":"2023-11-24T08:01:44.931392+0000","last_became_peered":"2023-11-24T08:01:44.931392+0000","last_unstale":"2023-11-24T08:01:46.536360+0000","last_undegraded":"2023-11-24T08:01:46.536360+0000","last_fullsized":"2023-11-24T08:01:46.536360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:14.823306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536140+0000","last_change":"2023-11-24T08:01:45.529868+0000","last_active":"2023-11-24T08:01:46.536140+0000","last_peered":"2023-11-24T08:01:46.536140+0000","last_clean":"2023-11-24T08:01:46.536140+0000","last_became_active":"2023-11-24T08:01:45.527486+0000","last_became_peered":"2023-11-24T08:01:45.527486+0000","last_unstale":"2023-11-24T08:01:46.536140+0000","last_undegraded":"2023-11-24T08:01:46.536140+0000","last_fullsized":"2023-11-24T08:01:46.536140+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:55:36.264394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.508490+0000","last_change":"2023-11-24T08:01:44.922366+0000","last_active":"2023-11-24T08:01:46.508490+0000","last_peered":"2023-11-24T08:01:46.508490+0000","last_clean":"2023-11-24T08:01:46.508490+0000","last_became_active":"2023-11-24T08:01:44.922051+0000","last_became_peered":"2023-11-24T08:01:44.922051+0000","last_unstale":"2023-11-24T08:01:46.508490+0000","last_undegraded":"2023-11-24T08:01:46.508490+0000","last_fullsized":"2023-11-24T08:01:46.508490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:03.661316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537836+0000","last_change":"2023-11-24T08:01:45.529103+0000","last_active":"2023-11-24T08:01:46.537836+0000","last_peered":"2023-11-24T08:01:46.537836+0000","last_clean":"2023-11-24T08:01:46.537836+0000","last_became_active":"2023-11-24T08:01:45.528576+0000","last_became_peered":"2023-11-24T08:01:45.528576+0000","last_unstale":"2023-11-24T08:01:46.537836+0000","last_undegraded":"2023-11-24T08:01:46.537836+0000","last_fullsized":"2023-11-24T08:01:46.537836+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:17.422388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.535963+0000","last_change":"2023-11-24T08:01:44.934438+0000","last_active":"2023-11-24T08:01:46.535963+0000","last_peered":"2023-11-24T08:01:46.535963+0000","last_clean":"2023-11-24T08:01:46.535963+0000","last_became_active":"2023-11-24T08:01:44.933659+0000","last_became_peered":"2023-11-24T08:01:44.933659+0000","last_unstale":"2023-11-24T08:01:46.535963+0000","last_undegraded":"2023-11-24T08:01:46.535963+0000","last_fullsized":"2023-11-24T08:01:46.535963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:22:57.780641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538658+0000","last_change":"2023-11-24T08:01:45.543454+0000","last_active":"2023-11-24T08:01:46.538658+0000","last_peered":"2023-11-24T08:01:46.538658+0000","last_clean":"2023-11-24T08:01:46.538658+0000","last_became_active":"2023-11-24T08:01:45.543069+0000","last_became_peered":"2023-11-24T08:01:45.543069+0000","last_unstale":"2023-11-24T08:01:46.538658+0000","last_undegraded":"2023-11-24T08:01:46.538658+0000","last_fullsized":"2023-11-24T08:01:46.538658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:53.224916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.510175+0000","last_change":"2023-11-24T08:01:44.940579+0000","last_active":"2023-11-24T08:01:46.510175+0000","last_peered":"2023-11-24T08:01:46.510175+0000","last_clean":"2023-11-24T08:01:46.510175+0000","last_became_active":"2023-11-24T08:01:44.940237+0000","last_became_peered":"2023-11-24T08:01:44.940237+0000","last_unstale":"2023-11-24T08:01:46.510175+0000","last_undegraded":"2023-11-24T08:01:46.510175+0000","last_fullsized":"2023-11-24T08:01:46.510175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:16:28.486908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.510109+0000","last_change":"2023-11-24T08:01:45.534372+0000","last_active":"2023-11-24T08:01:46.510109+0000","last_peered":"2023-11-24T08:01:46.510109+0000","last_clean":"2023-11-24T08:01:46.510109+0000","last_became_active":"2023-11-24T08:01:45.534064+0000","last_became_peered":"2023-11-24T08:01:45.534064+0000","last_unstale":"2023-11-24T08:01:46.510109+0000","last_undegraded":"2023-11-24T08:01:46.510109+0000","last_fullsized":"2023-11-24T08:01:46.510109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:13:36.692460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538757+0000","last_change":"2023-11-24T08:01:44.929753+0000","last_active":"2023-11-24T08:01:46.538757+0000","last_peered":"2023-11-24T08:01:46.538757+0000","last_clean":"2023-11-24T08:01:46.538757+0000","last_became_active":"2023-11-24T08:01:44.929092+0000","last_became_peered":"2023-11-24T08:01:44.929092+0000","last_unstale":"2023-11-24T08:01:46.538757+0000","last_undegraded":"2023-11-24T08:01:46.538757+0000","last_fullsized":"2023-11-24T08:01:46.538757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:56:12.722338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509662+0000","last_change":"2023-11-24T08:01:45.533950+0000","last_active":"2023-11-24T08:01:46.509662+0000","last_peered":"2023-11-24T08:01:46.509662+0000","last_clean":"2023-11-24T08:01:46.509662+0000","last_became_active":"2023-11-24T08:01:45.533579+0000","last_became_peered":"2023-11-24T08:01:45.533579+0000","last_unstale":"2023-11-24T08:01:46.509662+0000","last_undegraded":"2023-11-24T08:01:46.509662+0000","last_fullsized":"2023-11-24T08:01:46.509662+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:57.281514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538381+0000","last_change":"2023-11-24T08:01:44.943931+0000","last_active":"2023-11-24T08:01:46.538381+0000","last_peered":"2023-11-24T08:01:46.538381+0000","last_clean":"2023-11-24T08:01:46.538381+0000","last_became_active":"2023-11-24T08:01:44.943518+0000","last_became_peered":"2023-11-24T08:01:44.943518+0000","last_unstale":"2023-11-24T08:01:46.538381+0000","last_undegraded":"2023-11-24T08:01:46.538381+0000","last_fullsized":"2023-11-24T08:01:46.538381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:15:28.959155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537558+0000","last_change":"2023-11-24T08:01:45.543781+0000","last_active":"2023-11-24T08:01:46.537558+0000","last_peered":"2023-11-24T08:01:46.537558+0000","last_clean":"2023-11-24T08:01:46.537558+0000","last_became_active":"2023-11-24T08:01:45.543081+0000","last_became_peered":"2023-11-24T08:01:45.543081+0000","last_unstale":"2023-11-24T08:01:46.537558+0000","last_undegraded":"2023-11-24T08:01:46.537558+0000","last_fullsized":"2023-11-24T08:01:46.537558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:27:00.905016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509883+0000","last_change":"2023-11-24T08:01:44.928569+0000","last_active":"2023-11-24T08:01:46.509883+0000","last_peered":"2023-11-24T08:01:46.509883+0000","last_clean":"2023-11-24T08:01:46.509883+0000","last_became_active":"2023-11-24T08:01:44.928115+0000","last_became_peered":"2023-11-24T08:01:44.928115+0000","last_unstale":"2023-11-24T08:01:46.509883+0000","last_undegraded":"2023-11-24T08:01:46.509883+0000","last_fullsized":"2023-11-24T08:01:46.509883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:26.121088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537977+0000","last_change":"2023-11-24T08:01:45.530194+0000","last_active":"2023-11-24T08:01:46.537977+0000","last_peered":"2023-11-24T08:01:46.537977+0000","last_clean":"2023-11-24T08:01:46.537977+0000","last_became_active":"2023-11-24T08:01:45.528794+0000","last_became_peered":"2023-11-24T08:01:45.528794+0000","last_unstale":"2023-11-24T08:01:46.537977+0000","last_undegraded":"2023-11-24T08:01:46.537977+0000","last_fullsized":"2023-11-24T08:01:46.537977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:25.163348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536768+0000","last_change":"2023-11-24T08:01:44.930779+0000","last_active":"2023-11-24T08:01:46.536768+0000","last_peered":"2023-11-24T08:01:46.536768+0000","last_clean":"2023-11-24T08:01:46.536768+0000","last_became_active":"2023-11-24T08:01:44.929904+0000","last_became_peered":"2023-11-24T08:01:44.929904+0000","last_unstale":"2023-11-24T08:01:46.536768+0000","last_undegraded":"2023-11-24T08:01:46.536768+0000","last_fullsized":"2023-11-24T08:01:46.536768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:52:06.073694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.509363+0000","last_change":"2023-11-24T08:01:45.540139+0000","last_active":"2023-11-24T08:01:46.509363+0000","last_peered":"2023-11-24T08:01:46.509363+0000","last_clean":"2023-11-24T08:01:46.509363+0000","last_became_active":"2023-11-24T08:01:45.539842+0000","last_became_peered":"2023-11-24T08:01:45.539842+0000","last_unstale":"2023-11-24T08:01:46.509363+0000","last_undegraded":"2023-11-24T08:01:46.509363+0000","last_fullsized":"2023-11-24T08:01:46.509363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:53.224916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537868+0000","last_change":"2023-11-24T08:01:44.930315+0000","last_active":"2023-11-24T08:01:46.537868+0000","last_peered":"2023-11-24T08:01:46.537868+0000","last_clean":"2023-11-24T08:01:46.537868+0000","last_became_active":"2023-11-24T08:01:44.929989+0000","last_became_peered":"2023-11-24T08:01:44.929989+0000","last_unstale":"2023-11-24T08:01:46.537868+0000","last_undegraded":"2023-11-24T08:01:46.537868+0000","last_fullsized":"2023-11-24T08:01:46.537868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:01.841125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.512759+0000","last_change":"2023-11-24T08:01:45.538634+0000","last_active":"2023-11-24T08:01:46.512759+0000","last_peered":"2023-11-24T08:01:46.512759+0000","last_clean":"2023-11-24T08:01:46.512759+0000","last_became_active":"2023-11-24T08:01:45.538160+0000","last_became_peered":"2023-11-24T08:01:45.538160+0000","last_unstale":"2023-11-24T08:01:46.512759+0000","last_undegraded":"2023-11-24T08:01:46.512759+0000","last_fullsized":"2023-11-24T08:01:46.512759+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:53.224916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.508770+0000","last_change":"2023-11-24T08:01:44.939576+0000","last_active":"2023-11-24T08:01:46.508770+0000","last_peered":"2023-11-24T08:01:46.508770+0000","last_clean":"2023-11-24T08:01:46.508770+0000","last_became_active":"2023-11-24T08:01:44.939255+0000","last_became_peered":"2023-11-24T08:01:44.939255+0000","last_unstale":"2023-11-24T08:01:46.508770+0000","last_undegraded":"2023-11-24T08:01:46.508770+0000","last_fullsized":"2023-11-24T08:01:46.508770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:26:59.890763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.511278+0000","last_change":"2023-11-24T08:01:45.530620+0000","last_active":"2023-11-24T08:01:46.511278+0000","last_peered":"2023-11-24T08:01:46.511278+0000","last_clean":"2023-11-24T08:01:46.511278+0000","last_became_active":"2023-11-24T08:01:45.530270+0000","last_became_peered":"2023-11-24T08:01:45.530270+0000","last_unstale":"2023-11-24T08:01:46.511278+0000","last_undegraded":"2023-11-24T08:01:46.511278+0000","last_fullsized":"2023-11-24T08:01:46.511278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:38:56.159293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.508596+0000","last_change":"2023-11-24T08:01:44.925968+0000","last_active":"2023-11-24T08:01:46.508596+0000","last_peered":"2023-11-24T08:01:46.508596+0000","last_clean":"2023-11-24T08:01:46.508596+0000","last_became_active":"2023-11-24T08:01:44.925519+0000","last_became_peered":"2023-11-24T08:01:44.925519+0000","last_unstale":"2023-11-24T08:01:46.508596+0000","last_undegraded":"2023-11-24T08:01:46.508596+0000","last_fullsized":"2023-11-24T08:01:46.508596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:32:40.190062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537566+0000","last_change":"2023-11-24T08:01:45.532651+0000","last_active":"2023-11-24T08:01:46.537566+0000","last_peered":"2023-11-24T08:01:46.537566+0000","last_clean":"2023-11-24T08:01:46.537566+0000","last_became_active":"2023-11-24T08:01:45.531961+0000","last_became_peered":"2023-11-24T08:01:45.531961+0000","last_unstale":"2023-11-24T08:01:46.537566+0000","last_undegraded":"2023-11-24T08:01:46.537566+0000","last_fullsized":"2023-11-24T08:01:46.537566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:16.921524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538887+0000","last_change":"2023-11-24T08:01:44.936017+0000","last_active":"2023-11-24T08:01:46.538887+0000","last_peered":"2023-11-24T08:01:46.538887+0000","last_clean":"2023-11-24T08:01:46.538887+0000","last_became_active":"2023-11-24T08:01:44.935565+0000","last_became_peered":"2023-11-24T08:01:44.935565+0000","last_unstale":"2023-11-24T08:01:46.538887+0000","last_undegraded":"2023-11-24T08:01:46.538887+0000","last_fullsized":"2023-11-24T08:01:46.538887+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:19.655310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538846+0000","last_change":"2023-11-24T08:01:45.531786+0000","last_active":"2023-11-24T08:01:46.538846+0000","last_peered":"2023-11-24T08:01:46.538846+0000","last_clean":"2023-11-24T08:01:46.538846+0000","last_became_active":"2023-11-24T08:01:45.531490+0000","last_became_peered":"2023-11-24T08:01:45.531490+0000","last_unstale":"2023-11-24T08:01:46.538846+0000","last_undegraded":"2023-11-24T08:01:46.538846+0000","last_fullsized":"2023-11-24T08:01:46.538846+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:58:30.689779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537801+0000","last_change":"2023-11-24T08:01:44.931340+0000","last_active":"2023-11-24T08:01:46.537801+0000","last_peered":"2023-11-24T08:01:46.537801+0000","last_clean":"2023-11-24T08:01:46.537801+0000","last_became_active":"2023-11-24T08:01:44.930998+0000","last_became_peered":"2023-11-24T08:01:44.930998+0000","last_unstale":"2023-11-24T08:01:46.537801+0000","last_undegraded":"2023-11-24T08:01:46.537801+0000","last_fullsized":"2023-11-24T08:01:46.537801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:44:45.928999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538854+0000","last_change":"2023-11-24T08:01:45.532643+0000","last_active":"2023-11-24T08:01:46.538854+0000","last_peered":"2023-11-24T08:01:46.538854+0000","last_clean":"2023-11-24T08:01:46.538854+0000","last_became_active":"2023-11-24T08:01:45.532282+0000","last_became_peered":"2023-11-24T08:01:45.532282+0000","last_unstale":"2023-11-24T08:01:46.538854+0000","last_undegraded":"2023-11-24T08:01:46.538854+0000","last_fullsized":"2023-11-24T08:01:46.538854+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:38.867510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537679+0000","last_change":"2023-11-24T08:01:44.929088+0000","last_active":"2023-11-24T08:01:46.537679+0000","last_peered":"2023-11-24T08:01:46.537679+0000","last_clean":"2023-11-24T08:01:46.537679+0000","last_became_active":"2023-11-24T08:01:44.928731+0000","last_became_peered":"2023-11-24T08:01:44.928731+0000","last_unstale":"2023-11-24T08:01:46.537679+0000","last_undegraded":"2023-11-24T08:01:46.537679+0000","last_fullsized":"2023-11-24T08:01:46.537679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:13:13.299878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.534778+0000","last_change":"2023-11-24T08:01:45.536173+0000","last_active":"2023-11-24T08:01:46.534778+0000","last_peered":"2023-11-24T08:01:46.534778+0000","last_clean":"2023-11-24T08:01:46.534778+0000","last_became_active":"2023-11-24T08:01:45.534180+0000","last_became_peered":"2023-11-24T08:01:45.534180+0000","last_unstale":"2023-11-24T08:01:46.534778+0000","last_undegraded":"2023-11-24T08:01:46.534778+0000","last_fullsized":"2023-11-24T08:01:46.534778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:16:53.785564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537061+0000","last_change":"2023-11-24T08:01:44.936490+0000","last_active":"2023-11-24T08:01:46.537061+0000","last_peered":"2023-11-24T08:01:46.537061+0000","last_clean":"2023-11-24T08:01:46.537061+0000","last_became_active":"2023-11-24T08:01:44.936234+0000","last_became_peered":"2023-11-24T08:01:44.936234+0000","last_unstale":"2023-11-24T08:01:46.537061+0000","last_undegraded":"2023-11-24T08:01:46.537061+0000","last_fullsized":"2023-11-24T08:01:46.537061+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:09:27.255499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.534416+0000","last_change":"2023-11-24T08:01:45.534146+0000","last_active":"2023-11-24T08:01:46.534416+0000","last_peered":"2023-11-24T08:01:46.534416+0000","last_clean":"2023-11-24T08:01:46.534416+0000","last_became_active":"2023-11-24T08:01:45.533833+0000","last_became_peered":"2023-11-24T08:01:45.533833+0000","last_unstale":"2023-11-24T08:01:46.534416+0000","last_undegraded":"2023-11-24T08:01:46.534416+0000","last_fullsized":"2023-11-24T08:01:46.534416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:00:48.944599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537297+0000","last_change":"2023-11-24T08:01:44.931175+0000","last_active":"2023-11-24T08:01:46.537297+0000","last_peered":"2023-11-24T08:01:46.537297+0000","last_clean":"2023-11-24T08:01:46.537297+0000","last_became_active":"2023-11-24T08:01:44.930904+0000","last_became_peered":"2023-11-24T08:01:44.930904+0000","last_unstale":"2023-11-24T08:01:46.537297+0000","last_undegraded":"2023-11-24T08:01:46.537297+0000","last_fullsized":"2023-11-24T08:01:46.537297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:08:30.513283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.534895+0000","last_change":"2023-11-24T08:01:45.534305+0000","last_active":"2023-11-24T08:01:46.534895+0000","last_peered":"2023-11-24T08:01:46.534895+0000","last_clean":"2023-11-24T08:01:46.534895+0000","last_became_active":"2023-11-24T08:01:45.534046+0000","last_became_peered":"2023-11-24T08:01:45.534046+0000","last_unstale":"2023-11-24T08:01:46.534895+0000","last_undegraded":"2023-11-24T08:01:46.534895+0000","last_fullsized":"2023-11-24T08:01:46.534895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:47.200937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.511928+0000","last_change":"2023-11-24T08:01:44.939108+0000","last_active":"2023-11-24T08:01:46.511928+0000","last_peered":"2023-11-24T08:01:46.511928+0000","last_clean":"2023-11-24T08:01:46.511928+0000","last_became_active":"2023-11-24T08:01:44.938847+0000","last_became_peered":"2023-11-24T08:01:44.938847+0000","last_unstale":"2023-11-24T08:01:46.511928+0000","last_undegraded":"2023-11-24T08:01:46.511928+0000","last_fullsized":"2023-11-24T08:01:46.511928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:22:09.508354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.535021+0000","last_change":"2023-11-24T08:01:45.528417+0000","last_active":"2023-11-24T08:01:46.535021+0000","last_peered":"2023-11-24T08:01:46.535021+0000","last_clean":"2023-11-24T08:01:46.535021+0000","last_became_active":"2023-11-24T08:01:45.528077+0000","last_became_peered":"2023-11-24T08:01:45.528077+0000","last_unstale":"2023-11-24T08:01:46.535021+0000","last_undegraded":"2023-11-24T08:01:46.535021+0000","last_fullsized":"2023-11-24T08:01:46.535021+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:41:40.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536126+0000","last_change":"2023-11-24T08:01:44.927016+0000","last_active":"2023-11-24T08:01:46.536126+0000","last_peered":"2023-11-24T08:01:46.536126+0000","last_clean":"2023-11-24T08:01:46.536126+0000","last_became_active":"2023-11-24T08:01:44.924823+0000","last_became_peered":"2023-11-24T08:01:44.924823+0000","last_unstale":"2023-11-24T08:01:46.536126+0000","last_undegraded":"2023-11-24T08:01:46.536126+0000","last_fullsized":"2023-11-24T08:01:46.536126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:08:31.176057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.512207+0000","last_change":"2023-11-24T08:01:45.533345+0000","last_active":"2023-11-24T08:01:46.512207+0000","last_peered":"2023-11-24T08:01:46.512207+0000","last_clean":"2023-11-24T08:01:46.512207+0000","last_became_active":"2023-11-24T08:01:45.533051+0000","last_became_peered":"2023-11-24T08:01:45.533051+0000","last_unstale":"2023-11-24T08:01:46.512207+0000","last_undegraded":"2023-11-24T08:01:46.512207+0000","last_fullsized":"2023-11-24T08:01:46.512207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:27.135342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537454+0000","last_change":"2023-11-24T08:01:44.943948+0000","last_active":"2023-11-24T08:01:46.537454+0000","last_peered":"2023-11-24T08:01:46.537454+0000","last_clean":"2023-11-24T08:01:46.537454+0000","last_became_active":"2023-11-24T08:01:44.943402+0000","last_became_peered":"2023-11-24T08:01:44.943402+0000","last_unstale":"2023-11-24T08:01:46.537454+0000","last_undegraded":"2023-11-24T08:01:46.537454+0000","last_fullsized":"2023-11-24T08:01:46.537454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:46:26.947737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.534601+0000","last_change":"2023-11-24T08:01:45.535150+0000","last_active":"2023-11-24T08:01:46.534601+0000","last_peered":"2023-11-24T08:01:46.534601+0000","last_clean":"2023-11-24T08:01:46.534601+0000","last_became_active":"2023-11-24T08:01:45.534599+0000","last_became_peered":"2023-11-24T08:01:45.534599+0000","last_unstale":"2023-11-24T08:01:46.534601+0000","last_undegraded":"2023-11-24T08:01:46.534601+0000","last_fullsized":"2023-11-24T08:01:46.534601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:16:50.890701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.538983+0000","last_change":"2023-11-24T08:01:44.938149+0000","last_active":"2023-11-24T08:01:46.538983+0000","last_peered":"2023-11-24T08:01:46.538983+0000","last_clean":"2023-11-24T08:01:46.538983+0000","last_became_active":"2023-11-24T08:01:44.937848+0000","last_became_peered":"2023-11-24T08:01:44.937848+0000","last_unstale":"2023-11-24T08:01:46.538983+0000","last_undegraded":"2023-11-24T08:01:46.538983+0000","last_fullsized":"2023-11-24T08:01:46.538983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:39:36.296935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539024+0000","last_change":"2023-11-24T08:01:45.536337+0000","last_active":"2023-11-24T08:01:46.539024+0000","last_peered":"2023-11-24T08:01:46.539024+0000","last_clean":"2023-11-24T08:01:46.539024+0000","last_became_active":"2023-11-24T08:01:45.536029+0000","last_became_peered":"2023-11-24T08:01:45.536029+0000","last_unstale":"2023-11-24T08:01:46.539024+0000","last_undegraded":"2023-11-24T08:01:46.539024+0000","last_fullsized":"2023-11-24T08:01:46.539024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:12.018098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:47.096447+0000","last_change":"2023-11-24T08:01:44.929928+0000","last_active":"2023-11-24T08:01:47.096447+0000","last_peered":"2023-11-24T08:01:47.096447+0000","last_clean":"2023-11-24T08:01:47.096447+0000","last_became_active":"2023-11-24T08:01:44.929485+0000","last_became_peered":"2023-11-24T08:01:44.929485+0000","last_unstale":"2023-11-24T08:01:47.096447+0000","last_undegraded":"2023-11-24T08:01:47.096447+0000","last_fullsized":"2023-11-24T08:01:47.096447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:54:19.655310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537511+0000","last_change":"2023-11-24T08:01:45.531749+0000","last_active":"2023-11-24T08:01:46.537511+0000","last_peered":"2023-11-24T08:01:46.537511+0000","last_clean":"2023-11-24T08:01:46.537511+0000","last_became_active":"2023-11-24T08:01:45.531363+0000","last_became_peered":"2023-11-24T08:01:45.531363+0000","last_unstale":"2023-11-24T08:01:46.537511+0000","last_undegraded":"2023-11-24T08:01:46.537511+0000","last_fullsized":"2023-11-24T08:01:46.537511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:50:02.855378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.539450+0000","last_change":"2023-11-24T08:01:44.927262+0000","last_active":"2023-11-24T08:01:46.539450+0000","last_peered":"2023-11-24T08:01:46.539450+0000","last_clean":"2023-11-24T08:01:46.539450+0000","last_became_active":"2023-11-24T08:01:44.926962+0000","last_became_peered":"2023-11-24T08:01:44.926962+0000","last_unstale":"2023-11-24T08:01:46.539450+0000","last_undegraded":"2023-11-24T08:01:46.539450+0000","last_fullsized":"2023-11-24T08:01:46.539450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:15.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.511712+0000","last_change":"2023-11-24T08:01:45.529555+0000","last_active":"2023-11-24T08:01:46.511712+0000","last_peered":"2023-11-24T08:01:46.511712+0000","last_clean":"2023-11-24T08:01:46.511712+0000","last_became_active":"2023-11-24T08:01:45.528776+0000","last_became_peered":"2023-11-24T08:01:45.528776+0000","last_unstale":"2023-11-24T08:01:46.511712+0000","last_undegraded":"2023-11-24T08:01:46.511712+0000","last_fullsized":"2023-11-24T08:01:46.511712+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:20:02.018848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537482+0000","last_change":"2023-11-24T08:01:44.933631+0000","last_active":"2023-11-24T08:01:46.537482+0000","last_peered":"2023-11-24T08:01:46.537482+0000","last_clean":"2023-11-24T08:01:46.537482+0000","last_became_active":"2023-11-24T08:01:44.933329+0000","last_became_peered":"2023-11-24T08:01:44.933329+0000","last_unstale":"2023-11-24T08:01:46.537482+0000","last_undegraded":"2023-11-24T08:01:46.537482+0000","last_fullsized":"2023-11-24T08:01:46.537482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:26.154123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537231+0000","last_change":"2023-11-24T08:01:45.522503+0000","last_active":"2023-11-24T08:01:46.537231+0000","last_peered":"2023-11-24T08:01:46.537231+0000","last_clean":"2023-11-24T08:01:46.537231+0000","last_became_active":"2023-11-24T08:01:45.522026+0000","last_became_peered":"2023-11-24T08:01:45.522026+0000","last_unstale":"2023-11-24T08:01:46.537231+0000","last_undegraded":"2023-11-24T08:01:46.537231+0000","last_fullsized":"2023-11-24T08:01:46.537231+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:37:16.921524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.537966+0000","last_change":"2023-11-24T08:01:44.937766+0000","last_active":"2023-11-24T08:01:46.537966+0000","last_peered":"2023-11-24T08:01:46.537966+0000","last_clean":"2023-11-24T08:01:46.537966+0000","last_became_active":"2023-11-24T08:01:44.937438+0000","last_became_peered":"2023-11-24T08:01:44.937438+0000","last_unstale":"2023-11-24T08:01:46.537966+0000","last_undegraded":"2023-11-24T08:01:46.537966+0000","last_fullsized":"2023-11-24T08:01:46.537966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:36:22.573907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.508496+0000","last_change":"2023-11-24T08:01:45.533286+0000","last_active":"2023-11-24T08:01:46.508496+0000","last_peered":"2023-11-24T08:01:46.508496+0000","last_clean":"2023-11-24T08:01:46.508496+0000","last_became_active":"2023-11-24T08:01:45.533033+0000","last_became_peered":"2023-11-24T08:01:45.533033+0000","last_unstale":"2023-11-24T08:01:46.508496+0000","last_undegraded":"2023-11-24T08:01:46.508496+0000","last_fullsized":"2023-11-24T08:01:46.508496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:15:04.752537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536318+0000","last_change":"2023-11-24T08:01:44.934011+0000","last_active":"2023-11-24T08:01:46.536318+0000","last_peered":"2023-11-24T08:01:46.536318+0000","last_clean":"2023-11-24T08:01:46.536318+0000","last_became_active":"2023-11-24T08:01:44.933646+0000","last_became_peered":"2023-11-24T08:01:44.933646+0000","last_unstale":"2023-11-24T08:01:46.536318+0000","last_undegraded":"2023-11-24T08:01:46.536318+0000","last_fullsized":"2023-11-24T08:01:46.536318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:11:00.467866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.536077+0000","last_change":"2023-11-24T08:01:45.534982+0000","last_active":"2023-11-24T08:01:46.536077+0000","last_peered":"2023-11-24T08:01:46.536077+0000","last_clean":"2023-11-24T08:01:46.536077+0000","last_became_active":"2023-11-24T08:01:45.534603+0000","last_became_peered":"2023-11-24T08:01:45.534603+0000","last_unstale":"2023-11-24T08:01:46.536077+0000","last_undegraded":"2023-11-24T08:01:46.536077+0000","last_fullsized":"2023-11-24T08:01:46.536077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:03:27.168377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.508702+0000","last_change":"2023-11-24T08:01:44.943356+0000","last_active":"2023-11-24T08:01:46.508702+0000","last_peered":"2023-11-24T08:01:46.508702+0000","last_clean":"2023-11-24T08:01:46.508702+0000","last_became_active":"2023-11-24T08:01:44.943082+0000","last_became_peered":"2023-11-24T08:01:44.943082+0000","last_unstale":"2023-11-24T08:01:46.508702+0000","last_undegraded":"2023-11-24T08:01:46.508702+0000","last_fullsized":"2023-11-24T08:01:46.508702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:45:50.787305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513169+0000","last_change":"2023-11-24T08:01:45.537659+0000","last_active":"2023-11-24T08:01:46.513169+0000","last_peered":"2023-11-24T08:01:46.513169+0000","last_clean":"2023-11-24T08:01:46.513169+0000","last_became_active":"2023-11-24T08:01:45.537095+0000","last_became_peered":"2023-11-24T08:01:45.537095+0000","last_unstale":"2023-11-24T08:01:46.513169+0000","last_undegraded":"2023-11-24T08:01:46.513169+0000","last_fullsized":"2023-11-24T08:01:46.513169+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:44.888020+0000","last_clean_scrub_stamp":"2023-11-24T08:01:44.888020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:44:57.281514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T08:01:46.513649+0000","last_change":"2023-11-24T08:01:44.937751+0000","last_active":"2023-11-24T08:01:46.513649+0000","last_peered":"2023-11-24T08:01:46.513649+0000","last_clean":"2023-11-24T08:01:46.513649+0000","last_became_active":"2023-11-24T08:01:44.937455+0000","last_became_peered":"2023-11-24T08:01:44.937455+0000","last_unstale":"2023-11-24T08:01:46.513649+0000","last_undegraded":"2023-11-24T08:01:46.513649+0000","last_fullsized":"2023-11-24T08:01:46.513649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:01:43.873767+0000","last_clean_scrub_stamp":"2023-11-24T08:01:43.873767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:14:42.650085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-24T08:01:45.523208+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:01:45.523208+0000","last_peered":"2023-11-24T08:01:45.523208+0000","last_clean":"2023-11-24T08:01:45.523208+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:01:45.523208+0000","last_undegraded":"2023-11-24T08:01:45.523208+0000","last_fullsized":"2023-11-24T08:01:45.523208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":743312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.143,"15min":1.143},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.1699999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.012}]},{"osd":2,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5,"5min":1.5,"15min":1.5},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.2589999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.4219999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.29},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.6859999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":2.2210000000000001,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":1.01,"5min":1.01,"15min":1.01},"max":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.4710000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.571},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.756}]}]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.593}]},{"osd":1,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.194,"15min":1.194},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.597,"5min":2.597,"15min":2.597},"last":1.51}]},{"osd":2,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":2.7589999999999999,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.091},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"min":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"max":{"1min":2.831,"5min":2.831,"15min":2.831},"last":1.155}]},{"osd":3,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.431},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.6499999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":1.383,"15min":1.383},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":1.7669999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.7170000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.8220000000000001},{"interface":"front","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.8740000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.9590000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":397312,"data_stored":153526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.069,"15min":1.069},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.89500000000000002}]},{"osd":1,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.052,"15min":1.052},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.5149999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.204,"15min":1.204},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.321},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.0760000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.6259999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.2230000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.7189999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.7330000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.9570000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.6819999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:01:20 2023","interfaces":[{"interface":"back","average":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.8009999999999999},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.589}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":154488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.84399999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":1.6379999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.8440000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.224},{"interface":"front","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.4810000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.345},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":2.0630000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":2.2839999999999998},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":2.1440000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.921}]},{"osd":7,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":2.3300000000000001},{"interface":"front","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.746}]}]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.8040000000000003,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":1.278}]},{"osd":1,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":5.8460000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":6.0529999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":1.25}]},{"osd":3,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":6.0899999999999999,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":1.1399999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":6.306,"5min":6.306,"15min":6.306},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"max":{"1min":6.2160000000000002,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.571},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.589}]},{"osd":6,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":6.3470000000000004,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.4670000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:01:19 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":6.399,"5min":6.399,"15min":6.399},"last":1.3759999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542166,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":152958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.69099999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.357},{"interface":"front","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.1640000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.2809999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.518,"5min":1.518,"15min":1.518},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.617}]},{"osd":3,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.175}]},{"osd":5,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.53},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.073,"5min":2.073,"15min":2.073},"last":1.7050000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.2799999999999998,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.581}]},{"osd":7,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.488},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":3.0920000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.409}]}]},{"osd":1,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":154488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":3.3050000000000002,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":3.266,"5min":3.266,"15min":3.266},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":0.754},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":3.3610000000000002,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.95799999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.88600000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.367,"5min":4.367,"15min":4.367},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.4420000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.2609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.611,"15min":1.611},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":4.4900000000000002,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.53},{"interface":"front","average":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":3.4020000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.6120000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.694,"5min":1.694,"15min":1.694},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":4.4109999999999996,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.4970000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:01:18 2023","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":2.3140000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.728,"5min":1.728,"15min":1.728},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":4.452,"5min":4.452,"15min":4.452},"last":1.4359999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542165,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":743222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.96599999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.0249999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.454}]},{"osd":4,"last update":"Fri Nov 24 08:01:17 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.089},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"min":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.161}]},{"osd":5,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.526,"5min":1.526,"15min":1.526},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.839,"5min":2.839,"15min":2.839},"last":1.385},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"min":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.427}]},{"osd":6,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.232}]},{"osd":7,"last update":"Fri Nov 24 08:01:22 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.4140000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.506}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:01:50.875 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:01:50.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:01:51.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.124+0000 7f52dacd0640 1 Processor -- start 2023-11-24T08:01:51.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.125+0000 7f52dacd0640 1 -- start start 2023-11-24T08:01:51.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.126+0000 7f52dacd0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f52d415dd40 0x7f52d415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52dacd0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d415e6e0 con 0x7f52d4157dc0 2023-11-24T08:01:51.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52dacd0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d415ba40 con 0x7f52d415bed0 2023-11-24T08:01:51.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52dacd0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d41581a0 con 0x7f52d415dd40 2023-11-24T08:01:51.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52d8a6c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f52d4157dc0 0x7f52d4070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38456/0 (socket says 172.21.15.161:38456) 2023-11-24T08:01:51.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52d8a6c640 1 -- 172.21.15.161:0/612723003 learned_addr learned my addr 172.21.15.161:0/612723003 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430762574 0 0) 0x7f52d415e6e0 con 0x7f52d4157dc0 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c4003520 con 0x7f52d4157dc0 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.127+0000 7f52d3fff640 1 --2- 172.21.15.161:0/612723003 >> v2:172.21.15.175:3300/0 conn(0x7f52d415dd40 0x7f52d415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1355590905 0 0) 0x7f52c4003520 con 0x7f52d4157dc0 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 >> v2:172.21.15.175:3300/0 conn(0x7f52d415dd40 msgr2=0x7f52d415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 --2- 172.21.15.161:0/612723003 >> v2:172.21.15.175:3300/0 conn(0x7f52d415dd40 0x7f52d415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 >> v1:172.21.15.175:6789/0 conn(0x7f52d415bed0 legacy=0x7f52d415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d415eb10 con 0x7f52d4157dc0 2023-11-24T08:01:51.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f52c8001670 con 0x7f52d4157dc0 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 >> v1:172.21.15.161:6789/0 conn(0x7f52d4157dc0 legacy=0x7f52d4070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52c40039c0 0x7f52c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40047c0 0x7f52c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4005180 0x7f52c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d41581a0 con 0x7f52c40039c0 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400c080 con 0x7f52c4005180 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400c240 con 0x7f52c40047c0 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.128+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52c40039c0 0x7f52c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d8a6c640 1 -- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40047c0 msgr2=0x7f52c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40047c0 0x7f52c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d926d640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4005180 0x7f52c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d8a6c640 1 -- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4005180 msgr2=0x7f52c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:51.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52c4005180 0x7f52c400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d926d640 1 -- 172.21.15.161:0/612723003 reap_dead start 2023-11-24T08:01:51.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.129+0000 7f52d8a6c640 1 -- 172.21.15.161:0/612723003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4003520 con 0x7f52c40039c0 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.130+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52c40039c0 0x7f52c4003de0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c0e0 tx=0x7f52c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68924675945831f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.130+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8005ad0 con 0x7f52c40039c0 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.130+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8005c30 con 0x7f52c40039c0 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.130+0000 7f52d37fe640 1 -- 172.21.15.161:0/612723003 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c802ca50 con 0x7f52c40039c0 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.130+0000 7f52dacd0640 1 -- 172.21.15.161:0/612723003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52c40039c0 msgr2=0x7f52c4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.130+0000 7f52dacd0640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52c40039c0 0x7f52c4003de0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f52c800c0e0 tx=0x7f52c40057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.131+0000 7f52dacd0640 1 -- 172.21.15.161:0/612723003 shutdown_connections 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.131+0000 7f52dacd0640 1 --2- 172.21.15.161:0/612723003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52c40039c0 0x7f52c4003de0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.131+0000 7f52dacd0640 1 -- 172.21.15.161:0/612723003 >> 172.21.15.161:0/612723003 conn(0x7f52d40b0be0 msgr2=0x7f52d40b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.131+0000 7f52dacd0640 1 -- 172.21.15.161:0/612723003 shutdown_connections 2023-11-24T08:01:51.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.131+0000 7f52dacd0640 1 -- 172.21.15.161:0/612723003 wait complete. 2023-11-24T08:01:51.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.132+0000 7f52dacd0640 1 Processor -- start 2023-11-24T08:01:51.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.133+0000 7f52dacd0640 1 -- start start 2023-11-24T08:01:51.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52dacd0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40039c0 0x7f52d40b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52dacd0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52d4147680 0x7f52d40cea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52dacd0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 0x7f52d414e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52dacd0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d4147480 con 0x7f52d40cefd0 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52dacd0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40b3a40 con 0x7f52d4147680 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52dacd0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d40cf770 con 0x7f52c40039c0 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 0x7f52d414e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 0x7f52d414e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40132/0 (socket says 172.21.15.161:40132) 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 -- 172.21.15.161:0/3407869003 learned_addr learned my addr 172.21.15.161:0/3407869003 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40039c0 0x7f52d40b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d3fff640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52d4147680 0x7f52d40cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 -- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40039c0 msgr2=0x7f52d40b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40039c0 0x7f52d40b3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 -- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52d4147680 msgr2=0x7f52d40cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52d4147680 0x7f52d40cea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.134+0000 7f52d926d640 1 -- 172.21.15.161:0/3407869003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40cf490 con 0x7f52d40cefd0 2023-11-24T08:01:51.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.135+0000 7f52d926d640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 0x7f52d414e570 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d770 tx=0x7f52cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.135+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc003b70 con 0x7f52d40cefd0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.135+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc003cd0 con 0x7f52d40cefd0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.135+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc005290 con 0x7f52d40cefd0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.135+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d40cc8c0 con 0x7f52d40cefd0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.135+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d40cce80 con 0x7f52d40cefd0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.136+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d4067670 con 0x7f52d40cefd0 2023-11-24T08:01:51.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.137+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52cc0053f0 con 0x7f52d40cefd0 2023-11-24T08:01:51.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.138+0000 7f52d17fa640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52b806ae40 0x7f52b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.138+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52cc088f20 con 0x7f52d40cefd0 2023-11-24T08:01:51.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.139+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52b806ae40 0x7f52b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.140+0000 7f52d8a6c640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52b806ae40 0x7f52b806d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52c8034000 tx=0x7f52c8009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:51.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.143+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52cc054080 con 0x7f52d40cefd0 2023-11-24T08:01:51.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.398+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f52d40cb7f0 con 0x7f52d40cefd0 2023-11-24T08:01:51.405 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.402+0000 7f52d17fa640 1 -- 172.21.15.161:0/3407869003 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f52cc018020 con 0x7f52d40cefd0 2023-11-24T08:01:51.405 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-11-24T08:01:51.405 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA== 2023-11-24T08:01:51.405 INFO:teuthology.orchestra.run.smithi161.stdout: caps mds = "allow" 2023-11-24T08:01:51.405 INFO:teuthology.orchestra.run.smithi161.stdout: caps mon = "allow r" 2023-11-24T08:01:51.405 INFO:teuthology.orchestra.run.smithi161.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:01:51.406 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.0 2023-11-24T08:01:51.407 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52b806ae40 msgr2=0x7f52b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52b806ae40 0x7f52b806d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52c8034000 tx=0x7f52c8009030 comp rx=0 tx=0).stop 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 msgr2=0x7f52d414e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 0x7f52d414e570 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00d770 tx=0x7f52cc00dc30 comp rx=0 tx=0).stop 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 shutdown_connections 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f52b806ae40 0x7f52b806d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52d40cefd0 0x7f52d414e570 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f52d4147680 0x7f52d40cea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 --2- 172.21.15.161:0/3407869003 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f52c40039c0 0x7f52d40b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 >> 172.21.15.161:0/3407869003 conn(0x7f52d40b0be0 msgr2=0x7f52d4156350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:51.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 shutdown_connections 2023-11-24T08:01:51.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.405+0000 7f52dacd0640 1 -- 172.21.15.161:0/3407869003 wait complete. 2023-11-24T08:01:51.425 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:01:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.639+0000 7f12081ec640 1 Processor -- start 2023-11-24T08:01:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.640+0000 7f12081ec640 1 -- start start 2023-11-24T08:01:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.641+0000 7f12081ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f120013df80 0x7f120015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.641+0000 7f12081ec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f120013e360 0x7f12000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.641+0000 7f12081ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120015f9c0 0x7f12000cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.641+0000 7f12081ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120006c470 con 0x7f120013df80 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.641+0000 7f12081ec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120006c750 con 0x7f120013e360 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.641+0000 7f12081ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120006ca30 con 0x7f120015f9c0 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f120013df80 0x7f120015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f120013df80 0x7f120015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40146/0 (socket says 172.21.15.161:40146) 2023-11-24T08:01:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 -- 172.21.15.161:0/1623945744 learned_addr learned my addr 172.21.15.161:0/1623945744 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 -- 172.21.15.161:0/1623945744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120015f9c0 msgr2=0x7f12000cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 --2- 172.21.15.161:0/1623945744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120015f9c0 0x7f12000cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 -- 172.21.15.161:0/1623945744 >> v2:172.21.15.175:3300/0 conn(0x7f120013e360 msgr2=0x7f12000cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 --2- 172.21.15.161:0/1623945744 >> v2:172.21.15.175:3300/0 conn(0x7f120013e360 0x7f12000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.642+0000 7f1205f88640 1 -- 172.21.15.161:0/1623945744 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120006cd10 con 0x7f120013df80 2023-11-24T08:01:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.643+0000 7f1205f88640 1 --2- 172.21.15.161:0/1623945744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f120015bee0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f120006ded0 tx=0x7f11fc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5293f108131c1f9d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f1204f86640 1 -- 172.21.15.161:0/1623945744 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc031860 con 0x7f120013df80 2023-11-24T08:01:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f1204f86640 1 -- 172.21.15.161:0/1623945744 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc0319c0 con 0x7f120013df80 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f1204f86640 1 -- 172.21.15.161:0/1623945744 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc031d50 con 0x7f120013df80 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 -- 172.21.15.161:0/1623945744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 msgr2=0x7f120015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 --2- 172.21.15.161:0/1623945744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f120015bee0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f120006ded0 tx=0x7f11fc02b900 comp rx=0 tx=0).stop 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 -- 172.21.15.161:0/1623945744 shutdown_connections 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 --2- 172.21.15.161:0/1623945744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120015f9c0 0x7f12000cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 --2- 172.21.15.161:0/1623945744 >> v2:172.21.15.175:3300/0 conn(0x7f120013e360 0x7f12000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 --2- 172.21.15.161:0/1623945744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f120015bee0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 -- 172.21.15.161:0/1623945744 >> 172.21.15.161:0/1623945744 conn(0x7f120006a800 msgr2=0x7f120006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 -- 172.21.15.161:0/1623945744 shutdown_connections 2023-11-24T08:01:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.644+0000 7f12081ec640 1 -- 172.21.15.161:0/1623945744 wait complete. 2023-11-24T08:01:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.646+0000 7f12081ec640 1 Processor -- start 2023-11-24T08:01:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.646+0000 7f12081ec640 1 -- start start 2023-11-24T08:01:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f12081ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f1200070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f12081ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120013e360 0x7f1200139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f12081ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f120015f9c0 0x7f1200153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f12081ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120013a9b0 con 0x7f120013df80 2023-11-24T08:01:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f12081ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120013ac90 con 0x7f120015f9c0 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f12081ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120013af70 con 0x7f120013e360 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.647+0000 7f1205f88640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f1200070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f1200070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40158/0 (socket says 172.21.15.161:40158) 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 -- 172.21.15.161:0/1692846574 learned_addr learned my addr 172.21.15.161:0/1692846574 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 -- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120013e360 msgr2=0x7f1200139fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120013e360 0x7f1200139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 -- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f120015f9c0 msgr2=0x7f1200153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f120015f9c0 0x7f1200153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 -- 172.21.15.161:0/1692846574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0094d0 con 0x7f120013df80 2023-11-24T08:01:51.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.648+0000 7f1205f88640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f1200070f10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000c00 tx=0x7f11fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:51.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.649+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc03ad10 con 0x7f120013df80 2023-11-24T08:01:51.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.649+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc03ae70 con 0x7f120013df80 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.649+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc044610 con 0x7f120013df80 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.649+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120013b250 con 0x7f120013df80 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.649+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1200071450 con 0x7f120013df80 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.650+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1200071640 con 0x7f120013df80 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.651+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f11fc04d450 con 0x7f120013df80 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.652+0000 7f11f67fc640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f11e406ae40 0x7f11e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:51.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.652+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11fc0abcc0 con 0x7f120013df80 2023-11-24T08:01:51.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.652+0000 7f1205787640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f11e406ae40 0x7f11e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:51.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.653+0000 7f1205787640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f11e406ae40 0x7f11e406d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f120015b5b0 tx=0x7f11f0006c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:51.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.656+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11fc076d70 con 0x7f120013df80 2023-11-24T08:01:51.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.886+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12000675d0 con 0x7f120013df80 2023-11-24T08:01:51.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.887+0000 7f11f67fc640 1 -- 172.21.15.161:0/1692846574 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f11fc07a390 con 0x7f120013df80 2023-11-24T08:01:51.890 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:01:51.890 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:01:45.366812+0000","modified":"2023-11-24T08:01:48.419033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5175},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5175":{"gid":5175,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/1086564705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1086564705},{"type":"v1","addr":"172.21.15.175:6836","nonce":1086564705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:01:51.890 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 17 2023-11-24T08:01:51.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f11e406ae40 msgr2=0x7f11e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f11e406ae40 0x7f11e406d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f120015b5b0 tx=0x7f11f0006c90 comp rx=0 tx=0).stop 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 msgr2=0x7f1200070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f1200070f10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f11fc000c00 tx=0x7f11fc0046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 shutdown_connections 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f11e406ae40 0x7f11e406d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f120015f9c0 0x7f1200153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f120013e360 0x7f1200139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 --2- 172.21.15.161:0/1692846574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f120013df80 0x7f1200070f10 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:51.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 >> 172.21.15.161:0/1692846574 conn(0x7f120006a800 msgr2=0x7f120013e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:51.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 shutdown_connections 2023-11-24T08:01:51.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:51.890+0000 7f12081ec640 1 -- 172.21.15.161:0/1692846574 wait complete. 2023-11-24T08:01:52.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:01:45.366812+0000', 'modified': '2023-11-24T08:01:48.419033+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5175}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5175': {'gid': 5175, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.175:6836/1086564705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 1086564705}, {'type': 'v1', 'addr': '172.21.15.175:6836', 'nonce': 1086564705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:01:52.315 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:01:52.315 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T08:01:52.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.540+0000 7f275f59e640 1 Processor -- start 2023-11-24T08:01:52.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.541+0000 7f275f59e640 1 -- start start 2023-11-24T08:01:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.542+0000 7f275f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27601469e0 0x7f27600b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.542+0000 7f275f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f27600b3450 0x7f2760070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.542+0000 7f275f59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2760161970 con 0x7f2760145e10 2023-11-24T08:01:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.542+0000 7f275f59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27601461f0 con 0x7f27600b3450 2023-11-24T08:01:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.542+0000 7f275f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600b38e0 con 0x7f27601469e0 2023-11-24T08:01:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275e59c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2760145e10 0x7f27600ae0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38470/0 (socket says 172.21.15.161:38470) 2023-11-24T08:01:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275e59c640 1 -- 172.21.15.161:0/3703191734 learned_addr learned my addr 172.21.15.161:0/3703191734 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275ed9d640 1 --2- 172.21.15.161:0/3703191734 >> v2:172.21.15.161:3300/0 conn(0x7f27600b3450 0x7f2760070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f2757fff640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27601469e0 0x7f27600b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275dd9b640 1 -- 172.21.15.161:0/3703191734 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663507944 0 0) 0x7f2760161970 con 0x7f2760145e10 2023-11-24T08:01:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275dd9b640 1 -- 172.21.15.161:0/3703191734 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2740003520 con 0x7f2760145e10 2023-11-24T08:01:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275ed9d640 1 -- 172.21.15.161:0/3703191734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27601469e0 msgr2=0x7f27600b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275ed9d640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27601469e0 0x7f27600b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.543+0000 7f275ed9d640 1 -- 172.21.15.161:0/3703191734 >> v1:172.21.15.161:6789/0 conn(0x7f2760145e10 legacy=0x7f27600ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.544+0000 7f275ed9d640 1 -- 172.21.15.161:0/3703191734 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600ae7c0 con 0x7f27600b3450 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.544+0000 7f2757fff640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27601469e0 0x7f27600b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275ed9d640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27600b3450 0x7f2760070160 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2758009d90 tx=0x7f275802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae30a2513d28cfc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275dd9b640 1 -- 172.21.15.161:0/3703191734 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275802cc50 con 0x7f27600b3450 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275dd9b640 1 -- 172.21.15.161:0/3703191734 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275802cdb0 con 0x7f27600b3450 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275dd9b640 1 -- 172.21.15.161:0/3703191734 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758034660 con 0x7f27600b3450 2023-11-24T08:01:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275f59e640 1 -- 172.21.15.161:0/3703191734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27600b3450 msgr2=0x7f2760070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275f59e640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27600b3450 0x7f2760070160 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2758009d90 tx=0x7f275802bea0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.545+0000 7f275f59e640 1 -- 172.21.15.161:0/3703191734 shutdown_connections 2023-11-24T08:01:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.546+0000 7f275f59e640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27600b3450 0x7f2760070160 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.546+0000 7f275f59e640 1 --2- 172.21.15.161:0/3703191734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27601469e0 0x7f27600b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.546+0000 7f275f59e640 1 -- 172.21.15.161:0/3703191734 >> 172.21.15.161:0/3703191734 conn(0x7f27600b0b00 msgr2=0x7f27600b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.546+0000 7f275f59e640 1 -- 172.21.15.161:0/3703191734 shutdown_connections 2023-11-24T08:01:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.546+0000 7f275f59e640 1 -- 172.21.15.161:0/3703191734 wait complete. 2023-11-24T08:01:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.547+0000 7f275f59e640 1 Processor -- start 2023-11-24T08:01:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.547+0000 7f275f59e640 1 -- start start 2023-11-24T08:01:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.548+0000 7f275f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27600b3450 0x7f276013e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.548+0000 7f275f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2760145e10 0x7f27600c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.548+0000 7f275f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 0x7f27600afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.548+0000 7f275f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600ce7e0 con 0x7f27601469e0 2023-11-24T08:01:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.548+0000 7f275f59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276015e5f0 con 0x7f2760145e10 2023-11-24T08:01:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.548+0000 7f275f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276015d720 con 0x7f27600b3450 2023-11-24T08:01:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 0x7f27600afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 0x7f27600afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40170/0 (socket says 172.21.15.161:40170) 2023-11-24T08:01:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 -- 172.21.15.161:0/3153843258 learned_addr learned my addr 172.21.15.161:0/3153843258 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 -- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27600b3450 msgr2=0x7f276013e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27600b3450 0x7f276013e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 -- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2760145e10 msgr2=0x7f27600c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2760145e10 0x7f27600c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 -- 172.21.15.161:0/3153843258 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758009a70 con 0x7f27601469e0 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.549+0000 7f275ed9d640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 0x7f27600afac0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2758009eb0 tx=0x7f2758004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.550+0000 7f2756ffd640 1 -- 172.21.15.161:0/3153843258 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758040650 con 0x7f27601469e0 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.550+0000 7f2756ffd640 1 -- 172.21.15.161:0/3153843258 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27580407b0 con 0x7f27601469e0 2023-11-24T08:01:52.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.550+0000 7f2756ffd640 1 -- 172.21.15.161:0/3153843258 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758040b60 con 0x7f27601469e0 2023-11-24T08:01:52.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.550+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276015d9e0 con 0x7f27601469e0 2023-11-24T08:01:52.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.550+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276015dfa0 con 0x7f27601469e0 2023-11-24T08:01:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.552+0000 7f2756ffd640 1 -- 172.21.15.161:0/3153843258 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2758040cc0 con 0x7f27601469e0 2023-11-24T08:01:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.553+0000 7f2756ffd640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f274406ae40 0x7f274406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.553+0000 7f2756ffd640 1 -- 172.21.15.161:0/3153843258 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27580ac410 con 0x7f27601469e0 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.554+0000 7f275e59c640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f274406ae40 0x7f274406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.554+0000 7f2767b80740 1 Processor -- start 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.554+0000 7f2767b80740 1 -- start start 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f2767b80740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 0x55d9f9869450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9863d70 0x55d9f9868270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f98687b0 0x55d9f98ac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f2767b80740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f97c7880 con 0x55d9f9869070 2023-11-24T08:01:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f97d6ae0 con 0x55d9f9863d70 2023-11-24T08:01:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9f97d41d0 con 0x55d9f98687b0 2023-11-24T08:01:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f275e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 0x55d9f9869450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f275e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 0x55d9f9869450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40178/0 (socket says 172.21.15.161:40178) 2023-11-24T08:01:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.555+0000 7f275e59c640 1 -- 172.21.15.161:0/1765213147 learned_addr learned my addr 172.21.15.161:0/1765213147 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275ed9d640 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f98687b0 0x55d9f98ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 -- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f98687b0 msgr2=0x55d9f98ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f98687b0 0x55d9f98ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 -- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9863d70 msgr2=0x55d9f9868270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f2757fff640 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9863d70 0x55d9f9868270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9863d70 0x55d9f9868270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 -- 172.21.15.161:0/1765213147 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9f9797860 con 0x55d9f9869070 2023-11-24T08:01:52.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 0x55d9f9869450 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2750015610 tx=0x7f2750001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72770033fb8268b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f275e59c640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f274406ae40 0x7f274406d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f27600ae4e0 tx=0x7f2750007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f274ffff640 1 -- 172.21.15.161:0/1765213147 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500058b0 con 0x55d9f9869070 2023-11-24T08:01:52.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f274ffff640 1 -- 172.21.15.161:0/1765213147 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005a10 con 0x55d9f9869070 2023-11-24T08:01:52.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.556+0000 7f274ffff640 1 -- 172.21.15.161:0/1765213147 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750005dc0 con 0x55d9f9869070 2023-11-24T08:01:52.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 -- 172.21.15.161:0/1765213147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 msgr2=0x55d9f9869450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 0x55d9f9869450 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2750015610 tx=0x7f2750001150 comp rx=0 tx=0).stop 2023-11-24T08:01:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 -- 172.21.15.161:0/1765213147 shutdown_connections 2023-11-24T08:01:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f98687b0 0x55d9f98ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9863d70 0x55d9f9868270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 --2- 172.21.15.161:0/1765213147 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9869070 0x55d9f9869450 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 -- 172.21.15.161:0/1765213147 >> 172.21.15.161:0/1765213147 conn(0x55d9f982ac70 msgr2=0x55d9f98aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 -- 172.21.15.161:0/1765213147 shutdown_connections 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.557+0000 7f2767b80740 1 -- 172.21.15.161:0/1765213147 wait complete. 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.558+0000 7f2767b80740 1 -- start start 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.558+0000 7f2767b80740 1 Processor -- start 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f9884ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f97cfac0 con 0x55d9f98687b0 2023-11-24T08:01:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f976c2f0 con 0x55d9f9869070 2023-11-24T08:01:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9f9789c70 con 0x55d9f9863d70 2023-11-24T08:01:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2767b80740 10 client.0 _ll_register_callbacks cb 0x55d9f978e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:01:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.559+0000 7f2757fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40182/0 (socket says 172.21.15.161:40182) 2023-11-24T08:01:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 -- 172.21.15.161:0/366431379 learned_addr learned my addr 172.21.15.161:0/366431379 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 -- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 msgr2=0x55d9f9884ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f9884ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 -- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 msgr2=0x55d9f98ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f275ed9d640 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 -- 172.21.15.161:0/366431379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2740003520 con 0x55d9f98687b0 2023-11-24T08:01:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f2757fff640 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad4c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2748009e60 tx=0x7f274800f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740301ec12dc1176 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.560+0000 7f274d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f274d7fa640 1 -- 172.21.15.161:0/366431379 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748004020 con 0x55d9f98687b0 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f274d7fa640 1 -- 172.21.15.161:0/366431379 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2748004180 con 0x55d9f98687b0 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9f97c8aa0 con 0x55d9f98687b0 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f274d7fa640 1 -- 172.21.15.161:0/366431379 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2748004340 con 0x55d9f98687b0 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 10 client.5346 fetch_fsmap learned FSMap version 17 2023-11-24T08:01:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d9f97ce140 con 0x55d9f98687b0 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f274d7fa640 1 -- 172.21.15.161:0/366431379 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d9f97c8aa0 con 0x55d9f98687b0 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f274d7fa640 1 -- 172.21.15.161:0/366431379 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2748003610 con 0x55d9f98687b0 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 10 client.5346 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 10 client.5346 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 20 client.5346 populate_metadata read hostname 'smithi161' 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f98bf480 0x55d9f98afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 4 client.5346 mds_command: new command op to 5175 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:01:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.561+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 --> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9f97c87c0 con 0x55d9f98bf480 2023-11-24T08:01:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.562+0000 7f275e59c640 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f98bf480 0x55d9f98afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.563+0000 7f275e59c640 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f98bf480 0x55d9f98afc90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a876cd0afd46a02c server_cookie=1d6b7c2e819e10c5 in_seq=0 out_seq=0 2023-11-24T08:01:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.563+0000 7f274d7fa640 10 client.5346 ms_handle_connect on v2:172.21.15.175:6834/1086564705 2023-11-24T08:01:52.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f274d7fa640 1 -- 172.21.15.161:0/366431379 <== mds.0 v2:172.21.15.175:6834/1086564705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d9f97c87c0 con 0x55d9f98bf480 2023-11-24T08:01:52.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f274d7fa640 10 client.5346 handle_command_reply: tid=0 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 client.5346 shutdown 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 msgr2=0x55d9f98ad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad4c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2748009e60 tx=0x7f274800f5b0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 shutdown_connections 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f98bf480 0x55d9f98afc90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad4c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 --2- 172.21.15.161:0/366431379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f9884ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 >> 172.21.15.161:0/366431379 conn(0x55d9f982ac70 msgr2=0x55d9f9862dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f274d7fa640 0 client.5346 ms_handle_reset on v2:172.21.15.175:6834/1086564705 2023-11-24T08:01:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 shutdown_connections 2023-11-24T08:01:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.565+0000 7f2767b80740 1 -- 172.21.15.161:0/366431379 wait complete. 2023-11-24T08:01:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.566+0000 7f2767b80740 20 client.5346 trim_cache size 0 max 16384 2023-11-24T08:01:52.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.582+0000 7f2767b80740 1 Processor -- start 2023-11-24T08:01:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 -- start start 2023-11-24T08:01:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f98af670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f9532f20 con 0x55d9f98687b0 2023-11-24T08:01:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f98d1680 con 0x55d9f9869070 2023-11-24T08:01:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.583+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9f9862dd0 con 0x55d9f9863d70 2023-11-24T08:01:52.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40186/0 (socket says 172.21.15.161:40186) 2023-11-24T08:01:52.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 -- 172.21.15.161:0/4133582540 learned_addr learned my addr 172.21.15.161:0/4133582540 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:52.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f275ed9d640 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f275e59c640 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f98af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 -- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 msgr2=0x55d9f98af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f98af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 -- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 msgr2=0x55d9f98ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f2757fff640 1 -- 172.21.15.161:0/4133582540 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d9f976bb80 con 0x55d9f98687b0 2023-11-24T08:01:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.584+0000 7f275e59c640 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f98af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.585+0000 7f2757fff640 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2748000c00 tx=0x7f2748014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a8c241f233bd40 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.585+0000 7f2754ff9640 1 -- 172.21.15.161:0/4133582540 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748003ad0 con 0x55d9f98687b0 2023-11-24T08:01:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.585+0000 7f2754ff9640 1 -- 172.21.15.161:0/4133582540 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274800c030 con 0x55d9f98687b0 2023-11-24T08:01:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.585+0000 7f2754ff9640 1 -- 172.21.15.161:0/4133582540 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27480040c0 con 0x55d9f98687b0 2023-11-24T08:01:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.585+0000 7f2767b80740 1 -- 172.21.15.161:0/4133582540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 msgr2=0x55d9f98ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.585+0000 7f2767b80740 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad330 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2748000c00 tx=0x7f2748014000 comp rx=0 tx=0).stop 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 -- 172.21.15.161:0/4133582540 shutdown_connections 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f9869070 0x55d9f98ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f98687b0 0x55d9f98ad330 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 --2- 172.21.15.161:0/4133582540 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9863d70 0x55d9f98af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 -- 172.21.15.161:0/4133582540 >> 172.21.15.161:0/4133582540 conn(0x55d9f982ac70 msgr2=0x55d9f9884ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 -- 172.21.15.161:0/4133582540 shutdown_connections 2023-11-24T08:01:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 -- 172.21.15.161:0/4133582540 wait complete. 2023-11-24T08:01:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 -- start start 2023-11-24T08:01:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.586+0000 7f2767b80740 1 Processor -- start 2023-11-24T08:01:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.587+0000 7f2767b80740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 0x55d9f98abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.587+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f98687b0 0x55d9f98ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.587+0000 7f2767b80740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9869070 0x55d9f98ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.587+0000 7f2767b80740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f988d6e0 con 0x55d9f9863d70 2023-11-24T08:01:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.587+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9f99191c0 con 0x55d9f98687b0 2023-11-24T08:01:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.587+0000 7f2767b80740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9f988d1b0 con 0x55d9f9869070 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f2767b80740 10 client.0 _ll_register_callbacks cb 0x7f27480091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 0x55d9f98abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 0x55d9f98abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40190/0 (socket says 172.21.15.161:40190) 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 -- 172.21.15.161:0/2005841070 learned_addr learned my addr 172.21.15.161:0/2005841070 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f2757fff640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f98687b0 0x55d9f98ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275ed9d640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9869070 0x55d9f98ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 -- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9869070 msgr2=0x55d9f98ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9869070 0x55d9f98ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 -- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f98687b0 msgr2=0x55d9f98ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f98687b0 0x55d9f98ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 -- 172.21.15.161:0/2005841070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9f97ce140 con 0x55d9f9863d70 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f2757fff640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f98687b0 0x55d9f98ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f275e59c640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 0x55d9f98abb80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2750007b70 tx=0x7f2750010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eabfc13dfb6817d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.588+0000 7f274d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f274d7fa640 1 -- 172.21.15.161:0/2005841070 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750005d80 con 0x55d9f9863d70 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f274d7fa640 1 -- 172.21.15.161:0/2005841070 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2750007070 con 0x55d9f9863d70 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2750005a10 con 0x55d9f9863d70 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f274d7fa640 1 -- 172.21.15.161:0/2005841070 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2750007230 con 0x55d9f9863d70 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 10 client.5352 fetch_fsmap learned FSMap version 17 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d9f9791170 con 0x55d9f9863d70 2023-11-24T08:01:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f274d7fa640 1 -- 172.21.15.161:0/2005841070 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005a10 con 0x55d9f9863d70 2023-11-24T08:01:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f274d7fa640 1 -- 172.21.15.161:0/2005841070 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f27500075e0 con 0x55d9f9863d70 2023-11-24T08:01:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 10 client.5352 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T08:01:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 10 client.5352 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T08:01:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 20 client.5352 populate_metadata read hostname 'smithi161' 2023-11-24T08:01:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.589+0000 7f2767b80740 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f99183a0 0x55d9f9918780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.590+0000 7f2767b80740 4 client.5352 mds_command: new command op to 5175 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.590+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 --> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d9f94d06c0 con 0x55d9f99183a0 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.590+0000 7f2757fff640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f99183a0 0x55d9f9918780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.591+0000 7f2757fff640 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f99183a0 0x55d9f9918780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcd32c0124924bd0 server_cookie=635fac5d2edd180f in_seq=0 out_seq=0 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.591+0000 7f274d7fa640 10 client.5352 ms_handle_connect on v2:172.21.15.175:6834/1086564705 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.591+0000 7f274d7fa640 1 -- 172.21.15.161:0/2005841070 <== mds.0 v2:172.21.15.175:6834/1086564705 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d9f94d06c0 con 0x55d9f99183a0 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.591+0000 7f274d7fa640 10 client.5352 handle_command_reply: tid=0 2023-11-24T08:01:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.591+0000 7f2767b80740 1 client.5352 shutdown 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 msgr2=0x55d9f98abb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 0x55d9f98abb80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2750007b70 tx=0x7f2750010000 comp rx=0 tx=0).stop 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 shutdown_connections 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55d9f9869070 0x55d9f98ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:6834/1086564705,v1:172.21.15.175:6836/1086564705] conn(0x55d9f99183a0 0x55d9f9918780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55d9f98687b0 0x55d9f98ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 --2- 172.21.15.161:0/2005841070 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55d9f9863d70 0x55d9f98abb80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 >> 172.21.15.161:0/2005841070 conn(0x55d9f982ac70 msgr2=0x55d9f985f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f274d7fa640 0 client.5352 ms_handle_reset on v2:172.21.15.175:6834/1086564705 2023-11-24T08:01:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 shutdown_connections 2023-11-24T08:01:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 1 -- 172.21.15.161:0/2005841070 wait complete. 2023-11-24T08:01:52.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.592+0000 7f2767b80740 20 client.5352 trim_cache size 0 max 16384 2023-11-24T08:01:52.603 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:01:52.604 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "2e355083-a16f-42dd-a3ed-5276a3fda4f7", 2023-11-24T08:01:52.604 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2023-11-24T08:01:52.604 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 5175, 2023-11-24T08:01:52.604 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2023-11-24T08:01:52.604 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2023-11-24T08:01:52.604 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2023-11-24T08:01:52.605 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 6.6863063690000004, 2023-11-24T08:01:52.605 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 17, 2023-11-24T08:01:52.605 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 35, 2023-11-24T08:01:52.605 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 35, 2023-11-24T08:01:52.605 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 15.504051736999999 2023-11-24T08:01:52.605 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:01:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f274406ae40 msgr2=0x7f274406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f274406ae40 0x7f274406d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f27600ae4e0 tx=0x7f2750007930 comp rx=0 tx=0).stop 2023-11-24T08:01:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 msgr2=0x7f27600afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 0x7f27600afac0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2758009eb0 tx=0x7f2758004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 shutdown_connections 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f274406ae40 0x7f274406d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f27601469e0 0x7f27600afac0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2760145e10 0x7f27600c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 --2- 172.21.15.161:0/3153843258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f27600b3450 0x7f276013e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 >> 172.21.15.161:0/3153843258 conn(0x7f27600b0b00 msgr2=0x7f2760070160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 shutdown_connections 2023-11-24T08:01:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.593+0000 7f275f59e640 1 -- 172.21.15.161:0/3153843258 wait complete. 2023-11-24T08:01:52.612 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:01:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.812+0000 7fd4c3c7c640 1 Processor -- start 2023-11-24T08:01:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.812+0000 7fd4c3c7c640 1 -- start start 2023-11-24T08:01:52.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c3c7c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd4bc13df80 0x7fd4bc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c3c7c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4bc0cf9a0 0x7fd4bc0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c3c7c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc06c470 con 0x7fd4bc13e360 2023-11-24T08:01:52.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c3c7c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc06c750 con 0x7fd4bc0cf9a0 2023-11-24T08:01:52.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c3c7c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc06ca30 con 0x7fd4bc13df80 2023-11-24T08:01:52.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c2219640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd4bc0cf9a0 0x7fd4bc0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c1217640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd4bc13e360 0x7fd4bc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38480/0 (socket says 172.21.15.161:38480) 2023-11-24T08:01:52.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c1217640 1 -- 172.21.15.161:0/2065327730 learned_addr learned my addr 172.21.15.161:0/2065327730 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:52.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.814+0000 7fd4c1a18640 1 --2- 172.21.15.161:0/2065327730 >> v2:172.21.15.175:3300/0 conn(0x7fd4bc13df80 0x7fd4bc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.815+0000 7fd4c2219640 1 -- 172.21.15.161:0/2065327730 >> v2:172.21.15.175:3300/0 conn(0x7fd4bc13df80 msgr2=0x7fd4bc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.815+0000 7fd4c2219640 1 --2- 172.21.15.161:0/2065327730 >> v2:172.21.15.175:3300/0 conn(0x7fd4bc13df80 0x7fd4bc15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.815+0000 7fd4c2219640 1 -- 172.21.15.161:0/2065327730 >> v1:172.21.15.161:6789/0 conn(0x7fd4bc13e360 legacy=0x7fd4bc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.815+0000 7fd4c2219640 1 -- 172.21.15.161:0/2065327730 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc06cd10 con 0x7fd4bc0cf9a0 2023-11-24T08:01:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.815+0000 7fd4c1a18640 1 --2- 172.21.15.161:0/2065327730 >> v2:172.21.15.175:3300/0 conn(0x7fd4bc13df80 0x7fd4bc15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:01:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.816+0000 7fd4c2219640 1 --2- 172.21.15.161:0/2065327730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc0cd840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc072770 tx=0x7fd4b402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8a4d80b1a429a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.816+0000 7fd4c0a16640 1 -- 172.21.15.161:0/2065327730 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b402cc70 con 0x7fd4bc0cf9a0 2023-11-24T08:01:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.816+0000 7fd4c0a16640 1 -- 172.21.15.161:0/2065327730 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b402cdd0 con 0x7fd4bc0cf9a0 2023-11-24T08:01:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.816+0000 7fd4c0a16640 1 -- 172.21.15.161:0/2065327730 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4034660 con 0x7fd4bc0cf9a0 2023-11-24T08:01:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/2065327730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc0cf9a0 msgr2=0x7fd4bc0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/2065327730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc0cd840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc072770 tx=0x7fd4b402bec0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/2065327730 shutdown_connections 2023-11-24T08:01:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/2065327730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc0cd840 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/2065327730 >> v2:172.21.15.175:3300/0 conn(0x7fd4bc13df80 0x7fd4bc15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/2065327730 >> 172.21.15.161:0/2065327730 conn(0x7fd4bc06a800 msgr2=0x7fd4bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:52.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/2065327730 shutdown_connections 2023-11-24T08:01:52.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.817+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/2065327730 wait complete. 2023-11-24T08:01:52.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.819+0000 7fd4c3c7c640 1 Processor -- start 2023-11-24T08:01:52.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.819+0000 7fd4c3c7c640 1 -- start start 2023-11-24T08:01:52.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c3c7c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c3c7c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 0x7fd4bc13cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c3c7c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4bc13e360 0x7fd4bc0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c3c7c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc150ec0 con 0x7fd4bc13df80 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c3c7c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc13d4b0 con 0x7fd4bc0cf9a0 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c3c7c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc1510f0 con 0x7fd4bc13e360 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 0x7fd4bc13cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 0x7fd4bc13cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40212/0 (socket says 172.21.15.161:40212) 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 -- 172.21.15.161:0/1140113589 learned_addr learned my addr 172.21.15.161:0/1140113589 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 -- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4bc13e360 msgr2=0x7fd4bc0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c2219640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4bc13e360 0x7fd4bc0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1a18640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4bc13e360 0x7fd4bc0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 -- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4bc0cf9a0 msgr2=0x7fd4bc150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.820+0000 7fd4c1217640 1 -- 172.21.15.161:0/1140113589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009a70 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.821+0000 7fd4c1217640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 0x7fd4bc13cf70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00c500 tx=0x7fd4ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.821+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac005ce0 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.821+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac005e40 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.821+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac0072d0 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.821+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc1513d0 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.821+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc158cb0 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.822+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc0675d0 con 0x7fd4bc13df80 2023-11-24T08:01:52.827 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.823+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4ac0074f0 con 0x7fd4bc13df80 2023-11-24T08:01:52.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.824+0000 7fd4b27fc640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4a006ae40 0x7fd4a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:52.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.824+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4ac088a70 con 0x7fd4bc13df80 2023-11-24T08:01:52.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.825+0000 7fd4c1a18640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4a006ae40 0x7fd4a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:52.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.826+0000 7fd4c1a18640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4a006ae40 0x7fd4a006d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006fd0 tx=0x7fd4b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:52.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:52.828+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4ac053be0 con 0x7fd4bc13df80 2023-11-24T08:01:53.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.063+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd4bc06df00 con 0x7fd4bc13df80 2023-11-24T08:01:53.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.063+0000 7fd4b27fc640 1 -- 172.21.15.161:0/1140113589 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd4ac057200 con 0x7fd4bc13df80 2023-11-24T08:01:53.066 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:01:53.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4a006ae40 msgr2=0x7fd4a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:53.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4a006ae40 0x7fd4a006d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006fd0 tx=0x7fd4b8008040 comp rx=0 tx=0).stop 2023-11-24T08:01:53.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 msgr2=0x7fd4bc13cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:53.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 0x7fd4bc13cf70 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00c500 tx=0x7fd4ac00c9c0 comp rx=0 tx=0).stop 2023-11-24T08:01:53.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 shutdown_connections 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4a006ae40 0x7fd4a006d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd4bc13e360 0x7fd4bc0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd4bc13df80 0x7fd4bc13cf70 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 --2- 172.21.15.161:0/1140113589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd4bc0cf9a0 0x7fd4bc150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.066+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 >> 172.21.15.161:0/1140113589 conn(0x7fd4bc06a800 msgr2=0x7fd4bc154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.067+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 shutdown_connections 2023-11-24T08:01:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:53.067+0000 7fd4c3c7c640 1 -- 172.21.15.161:0/1140113589 wait complete. 2023-11-24T08:01:53.088 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:01:53.088 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:01:53.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-24T08:01:53.088 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:01:53.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:53.089 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:01:53.089 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:01:53.089 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:01:53.089 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:01:53.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.089 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-24T08:01:53.141 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:01:53.141 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:01:53.141 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:01:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:01:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.142 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:01:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:53.142 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-24T08:01:53.143 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:01:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:53.143 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-24T08:01:53.143 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42289sec preferred_lft 42289sec 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.144 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8039:e9ff:fe5c:58ac/64 scope link 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::f4:2aff:fe75:db23/64 scope link 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:01:53.145 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether ca:62:f1:ec:2f:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:01:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c862:f1ff:feec:2f57/64 scope link 2023-11-24T08:01:53.146 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:53.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.146 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:01:53.237 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-24T08:01:53.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.242 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-24T08:01:53.296 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-24T08:01:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:01:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:01:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:01:53.297 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:01:53.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.297 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:01:53.297 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:01:53.297 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:01:53.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:01:53.298 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:01:53.298 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:01:53.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.477 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:01:53.529 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:01:53.529 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:01:53.530 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:01:53.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-24T08:01:53.619 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T08:01:53.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:01:53.620 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:53.674 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:01:53.675 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:01:53.675 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:53.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:01:53.821 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:01:53.880 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:01:53.880 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:01:53.880 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:01:53.880 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:01:53.881 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:01:53.882 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:01:53.883 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:01:53.884 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:01:53.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:53.885 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:01:53.937 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:01:53.937 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T08:01:53.946 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:01:54.025 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:01:54.067 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:01:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:01:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:01:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:01:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:01:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:01:54.068 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:01:54.069 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:01:54.070 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:01:54.071 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:01:54.072 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:01:54.072 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:01:54.072 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:01:54.072 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:01:54.072 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:01:54.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:54.073 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:01:54.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:2023-11-24T08:01:54.126+0000 7f137f83a480 -1 init, newargv = 0x556a13cb51b0 newargc=15 2023-11-24T08:01:54.128 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[101730]: starting ceph client 2023-11-24T08:01:54.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[101730]: starting fuse 2023-11-24T08:01:54.160 INFO:teuthology.orchestra.run.smithi161.stdout:39 2023-11-24T08:01:54.160 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:01:54.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> import re 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> import os 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2023-11-24T08:01:54.161 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:01:54.162 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2023-11-24T08:01:54.163 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2023-11-24T08:01:54.163 DEBUG:teuthology.orchestra.run.smithi161:> return f 2023-11-24T08:01:54.163 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:01:54.163 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:01:54.163 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.0")) 2023-11-24T08:01:54.163 DEBUG:teuthology.orchestra.run.smithi161:> ' 2023-11-24T08:01:54.366 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.0.101730.asok 2023-11-24T08:01:54.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:01:54.383 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101730.asok 2023-11-24T08:01:54.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:54.383 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101730.asok status 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "0", 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2023-11-24T08:01:54.628 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "101730", 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 5367, 2023-11-24T08:01:54.629 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 5367 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:01:54.630 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:01:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2245831245 2023-11-24T08:01:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:01:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:01:54.631 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:01:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 2245831245 2023-11-24T08:01:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:01:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.5367 192.168.0.1:0/2245831245", 2023-11-24T08:01:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/2245831245", 2023-11-24T08:01:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2023-11-24T08:01:54.632 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 17, 2023-11-24T08:01:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 35, 2023-11-24T08:01:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:01:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2023-11-24T08:01:54.633 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2023-11-24T08:01:54.633 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:01:54.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:54.643 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2023-11-24T08:01:54.643 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:54.697 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2023-11-24T08:01:54.698 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:54.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:54.698 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:01:54.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:01:55.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:54.998+0000 7f98f5e51640 1 Processor -- start 2023-11-24T08:01:55.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:54.999+0000 7f98f5e51640 1 -- start start 2023-11-24T08:01:55.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98f5e51640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f98f00d3910 0x7f98f00d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:55.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98f5e51640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98f0160e10 0x7f98f00d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:55.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98f5e51640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f00d4160 con 0x7f98f00cfcf0 2023-11-24T08:01:55.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98f5e51640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f00ceff0 con 0x7f98f0160e10 2023-11-24T08:01:55.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98f5e51640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f00cf410 con 0x7f98f00d3910 2023-11-24T08:01:55.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98effff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98f0160e10 0x7f98f00d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:55.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98effff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f98f0160e10 0x7f98f00d1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40224/0 (socket says 172.21.15.161:40224) 2023-11-24T08:01:55.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.000+0000 7f98effff640 1 -- 172.21.15.161:0/2422353447 learned_addr learned my addr 172.21.15.161:0/2422353447 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:55.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98e7fff640 1 --2- 172.21.15.161:0/2422353447 >> v2:172.21.15.175:3300/0 conn(0x7f98f00d3910 0x7f98f00d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:55.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98effff640 1 -- 172.21.15.161:0/2422353447 >> v2:172.21.15.175:3300/0 conn(0x7f98f00d3910 msgr2=0x7f98f00d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:55.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98effff640 1 --2- 172.21.15.161:0/2422353447 >> v2:172.21.15.175:3300/0 conn(0x7f98f00d3910 0x7f98f00d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98effff640 1 -- 172.21.15.161:0/2422353447 >> v1:172.21.15.161:6789/0 conn(0x7f98f00cfcf0 legacy=0x7f98f0160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:55.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98effff640 1 -- 172.21.15.161:0/2422353447 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f00b2420 con 0x7f98f0160e10 2023-11-24T08:01:55.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98e7fff640 1 --2- 172.21.15.161:0/2422353447 >> v2:172.21.15.175:3300/0 conn(0x7f98f00d3910 0x7f98f00d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:55.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.001+0000 7f98eeffd640 1 -- 172.21.15.161:0/2422353447 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234782919 0 0) 0x7f98f00d4160 con 0x7f98f00cfcf0 2023-11-24T08:01:55.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.002+0000 7f98effff640 1 --2- 172.21.15.161:0/2422353447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f00d1640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f98f008b640 tx=0x7f98e802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2031dd57d2ae661d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.002+0000 7f98eeffd640 1 -- 172.21.15.161:0/2422353447 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e802ca70 con 0x7f98f0160e10 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.002+0000 7f98eeffd640 1 -- 172.21.15.161:0/2422353447 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e802cbd0 con 0x7f98f0160e10 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.002+0000 7f98eeffd640 1 -- 172.21.15.161:0/2422353447 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e80343f0 con 0x7f98f0160e10 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 -- 172.21.15.161:0/2422353447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 msgr2=0x7f98f00d1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 --2- 172.21.15.161:0/2422353447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f00d1640 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f98f008b640 tx=0x7f98e802bed0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 -- 172.21.15.161:0/2422353447 shutdown_connections 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 --2- 172.21.15.161:0/2422353447 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f00d1640 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 --2- 172.21.15.161:0/2422353447 >> v2:172.21.15.175:3300/0 conn(0x7f98f00d3910 0x7f98f00d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 -- 172.21.15.161:0/2422353447 >> 172.21.15.161:0/2422353447 conn(0x7f98f009c530 msgr2=0x7f98f00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:55.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 -- 172.21.15.161:0/2422353447 shutdown_connections 2023-11-24T08:01:55.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.003+0000 7f98f5e51640 1 -- 172.21.15.161:0/2422353447 wait complete. 2023-11-24T08:01:55.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.005+0000 7f98f5e51640 1 Processor -- start 2023-11-24T08:01:55.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.005+0000 7f98f5e51640 1 -- start start 2023-11-24T08:01:55.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98f5e51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f00cfcf0 0x7f98f00c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:55.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98f5e51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f00d3910 0x7f98f00b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:55.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98f5e51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f0154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:55.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98f5e51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00b7490 con 0x7f98f0160e10 2023-11-24T08:01:55.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98f5e51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0154d80 con 0x7f98f00cfcf0 2023-11-24T08:01:55.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98f5e51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f00b6810 con 0x7f98f00d3910 2023-11-24T08:01:55.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f0154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:55.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f0154840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40240/0 (socket says 172.21.15.161:40240) 2023-11-24T08:01:55.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 -- 172.21.15.161:0/455717160 learned_addr learned my addr 172.21.15.161:0/455717160 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:55.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 -- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f00d3910 msgr2=0x7f98f00b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:55.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f00d3910 0x7f98f00b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 -- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f00cfcf0 msgr2=0x7f98f00c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f00cfcf0 0x7f98f00c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.006+0000 7f98effff640 1 -- 172.21.15.161:0/455717160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8009b30 con 0x7f98f0160e10 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.007+0000 7f98effff640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f0154840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009e50 tx=0x7f98e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.007+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8009510 con 0x7f98f0160e10 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.007+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e803e450 con 0x7f98f0160e10 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.007+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e803e800 con 0x7f98f0160e10 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.007+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f00b6af0 con 0x7f98f0160e10 2023-11-24T08:01:55.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.007+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f00b70b0 con 0x7f98f0160e10 2023-11-24T08:01:55.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.008+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f00b75d0 con 0x7f98f0160e10 2023-11-24T08:01:55.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.009+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98e803e960 con 0x7f98f0160e10 2023-11-24T08:01:55.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.010+0000 7f98ecff9640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f98d006ae40 0x7f98d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:55.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.010+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98e80ac4e0 con 0x7f98f0160e10 2023-11-24T08:01:55.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.011+0000 7f98ef7fe640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f98d006ae40 0x7f98d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:55.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.012+0000 7f98ef7fe640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f98d006ae40 0x7f98d006d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001560 tx=0x7f98e0007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:55.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.015+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98f00b75d0 con 0x7f98f0160e10 2023-11-24T08:01:55.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.243+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98f00b75d0 con 0x7f98f0160e10 2023-11-24T08:01:55.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.244+0000 7f98ecff9640 1 -- 172.21.15.161:0/455717160 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98f00b75d0 con 0x7f98f0160e10 2023-11-24T08:01:55.246 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:01:55.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f98d006ae40 msgr2=0x7f98d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:55.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f98d006ae40 0x7f98d006d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98e0001560 tx=0x7f98e0007930 comp rx=0 tx=0).stop 2023-11-24T08:01:55.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 msgr2=0x7f98f0154840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:55.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f0154840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009e50 tx=0x7f98e8004a40 comp rx=0 tx=0).stop 2023-11-24T08:01:55.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 shutdown_connections 2023-11-24T08:01:55.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f98d006ae40 0x7f98d006d300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f98f0160e10 0x7f98f0154840 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f98f00d3910 0x7f98f00b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 --2- 172.21.15.161:0/455717160 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98f00cfcf0 0x7f98f00c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:55.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 >> 172.21.15.161:0/455717160 conn(0x7f98f009c530 msgr2=0x7f98f00ce050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:55.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 shutdown_connections 2023-11-24T08:01:55.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:55.246+0000 7f98f5e51640 1 -- 172.21.15.161:0/455717160 wait complete. 2023-11-24T08:01:55.265 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:01:55.266 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:01:55.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:55.267 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-24T08:01:55.328 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:01:55.328 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:01:55.328 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:01:55.328 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.329 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:01:55.329 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.329 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:01:55.329 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:55.329 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-24T08:01:55.329 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:01:55.330 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:55.330 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-24T08:01:55.330 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:01:55.330 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:55.330 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:01:55.331 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:55.331 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:01:55.331 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42293sec preferred_lft 42293sec 2023-11-24T08:01:55.331 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-24T08:01:55.331 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.332 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:01:55.332 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:01:55.332 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:01:55.332 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.332 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::aca0:d6ff:fe4f:fbed/64 scope link 2023-11-24T08:01:55.333 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::3004:f3ff:fea7:6a6b/64 scope link 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 7e:b6:55:83:e4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7cb6:55ff:fe83:e4c9/64 scope link 2023-11-24T08:01:55.334 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:01:55.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:55.335 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:01:55.429 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-24T08:01:55.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:55.433 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-24T08:01:55.490 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-24T08:01:55.491 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:01:55.491 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:01:55.491 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:01:55.491 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:01:55.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:55.492 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:01:55.492 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:01:55.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:01:55.492 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:01:55.493 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:01:55.493 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:01:55.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:55.679 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:01:55.732 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:01:55.732 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:01:55.733 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:01:55.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:55.734 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-11-24T08:01:55.826 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T08:01:55.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:01:55.827 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:55.882 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:01:55.883 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:01:55.883 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:55.934 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:01:56.028 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:01:56.086 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:01:56.087 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:01:56.088 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:01:56.088 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:01:56.088 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:01:56.088 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:01:56.088 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:01:56.088 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:01:56.089 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:01:56.089 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:01:56.089 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:01:56.089 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:01:56.089 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:01:56.089 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:01:56.090 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:01:56.090 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:01:56.090 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:01:56.090 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:01:56.091 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:01:56.091 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:01:56.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:56.092 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:01:56.144 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:01:56.144 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T08:01:56.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:01:56.227 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:01:56.271 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:01:56.271 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:01:56.271 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:01:56.271 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:01:56.272 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:01:56.272 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:01:56.272 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:01:56.272 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:01:56.272 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:01:56.273 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:01:56.273 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:01:56.273 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:01:56.273 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:01:56.273 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:01:56.273 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:01:56.274 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:01:56.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:56.276 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:01:56.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2023-11-24T08:01:56.334+0000 7f90c67ee480 -1 init, newargv = 0x555929008ed0 newargc=15 2023-11-24T08:01:56.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[95179]: starting ceph client 2023-11-24T08:01:56.346 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[95179]: starting fuse 2023-11-24T08:01:56.358 INFO:teuthology.orchestra.run.smithi175.stdout:39 2023-11-24T08:01:56.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:01:56.358 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-24T08:01:56.359 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:01:56.360 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2023-11-24T08:01:56.361 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-24T08:01:56.562 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.95179.asok 2023-11-24T08:01:56.567 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:01:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:01:56.580 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95179.asok 2023-11-24T08:01:56.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:56.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95179.asok status 2023-11-24T08:01:56.821 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "95179", 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:01:56.822 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4694, 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4694 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2021358579 2023-11-24T08:01:56.823 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2021358579 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4694 192.168.0.1:0/2021358579", 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/2021358579", 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-24T08:01:56.824 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 17, 2023-11-24T08:01:56.825 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 35, 2023-11-24T08:01:56.825 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:01:56.825 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-24T08:01:56.825 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-24T08:01:56.825 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-24T08:01:56.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:56.837 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-24T08:01:56.837 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:56.892 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-24T08:01:56.893 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:56.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:56.893 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:01:56.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:01:57.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.217+0000 7f4864389640 1 Processor -- start 2023-11-24T08:01:57.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.217+0000 7f4864389640 1 -- start start 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4864389640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f485c13e360 0x7f485c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4864389640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c15c5f0 con 0x7f485c13df80 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4864389640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c06c470 con 0x7f485c15f9c0 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4864389640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c06c750 con 0x7f485c13e360 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4861924640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f485c13e360 0x7f485c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4861924640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f485c13e360 0x7f485c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40254/0 (socket says 172.21.15.161:40254) 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4861924640 1 -- 172.21.15.161:0/880486297 learned_addr learned my addr 172.21.15.161:0/880486297 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:57.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.219+0000 7f4862125640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f485c13df80 0x7f485c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38484/0 (socket says 172.21.15.161:38484) 2023-11-24T08:01:57.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.220+0000 7f4861924640 1 -- 172.21.15.161:0/880486297 >> v1:172.21.15.175:6789/0 conn(0x7f485c15f9c0 legacy=0x7f485c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:57.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.220+0000 7f4861924640 1 -- 172.21.15.161:0/880486297 >> v1:172.21.15.161:6789/0 conn(0x7f485c13df80 legacy=0x7f485c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:57.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.220+0000 7f4861924640 1 -- 172.21.15.161:0/880486297 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c06ca30 con 0x7f485c13e360 2023-11-24T08:01:57.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.221+0000 7f4861924640 1 --2- 172.21.15.161:0/880486297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c13e360 0x7f485c0cf290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f484c009870 tx=0x7f484c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92184392a599e13f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:57.223 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.221+0000 7f4861123640 1 -- 172.21.15.161:0/880486297 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c030850 con 0x7f485c13e360 2023-11-24T08:01:57.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.221+0000 7f4861123640 1 -- 172.21.15.161:0/880486297 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c0309b0 con 0x7f485c13e360 2023-11-24T08:01:57.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.221+0000 7f4861123640 1 -- 172.21.15.161:0/880486297 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c030d40 con 0x7f485c13e360 2023-11-24T08:01:57.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 -- 172.21.15.161:0/880486297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c13e360 msgr2=0x7f485c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:57.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 --2- 172.21.15.161:0/880486297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c13e360 0x7f485c0cf290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f484c009870 tx=0x7f484c02b990 comp rx=0 tx=0).stop 2023-11-24T08:01:57.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 -- 172.21.15.161:0/880486297 shutdown_connections 2023-11-24T08:01:57.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 --2- 172.21.15.161:0/880486297 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c13e360 0x7f485c0cf290 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 -- 172.21.15.161:0/880486297 >> 172.21.15.161:0/880486297 conn(0x7f485c06a800 msgr2=0x7f485c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:57.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 -- 172.21.15.161:0/880486297 shutdown_connections 2023-11-24T08:01:57.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.222+0000 7f4864389640 1 -- 172.21.15.161:0/880486297 wait complete. 2023-11-24T08:01:57.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.224+0000 7f4864389640 1 Processor -- start 2023-11-24T08:01:57.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.224+0000 7f4864389640 1 -- start start 2023-11-24T08:01:57.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.225+0000 7f4864389640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f485c13df80 0x7f485c1f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.225+0000 7f4864389640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f485c13e360 0x7f485c1f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.225+0000 7f4864389640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 0x7f485c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.225+0000 7f4864389640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1f7a40 con 0x7f485c15f9c0 2023-11-24T08:01:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.225+0000 7f4864389640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c14ac50 con 0x7f485c13e360 2023-11-24T08:01:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.225+0000 7f4864389640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c14af30 con 0x7f485c13df80 2023-11-24T08:01:57.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 0x7f485c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:57.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 0x7f485c070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40264/0 (socket says 172.21.15.161:40264) 2023-11-24T08:01:57.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 -- 172.21.15.161:0/3911293951 learned_addr learned my addr 172.21.15.161:0/3911293951 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:57.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 -- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f485c13df80 msgr2=0x7f485c1f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:57.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f485c13df80 0x7f485c1f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 -- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f485c13e360 msgr2=0x7f485c1f7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:57.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f485c13e360 0x7f485c1f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 -- 172.21.15.161:0/3911293951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0094d0 con 0x7f485c15f9c0 2023-11-24T08:01:57.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4862926640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 0x7f485c070e70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f485400c700 tx=0x7f485400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:57.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.226+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400aa50 con 0x7f485c15f9c0 2023-11-24T08:01:57.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.227+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485400abb0 con 0x7f485c15f9c0 2023-11-24T08:01:57.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.227+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485400ce10 con 0x7f485c15f9c0 2023-11-24T08:01:57.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.227+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0713b0 con 0x7f485c15f9c0 2023-11-24T08:01:57.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.227+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c071960 con 0x7f485c15f9c0 2023-11-24T08:01:57.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.228+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c14e000 con 0x7f485c15f9c0 2023-11-24T08:01:57.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.229+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4854012420 con 0x7f485c15f9c0 2023-11-24T08:01:57.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.230+0000 7f4852ffd640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f484006ae70 0x7f484006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:57.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.230+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4854089b40 con 0x7f485c15f9c0 2023-11-24T08:01:57.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.230+0000 7f4862125640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f484006ae70 0x7f484006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:57.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.231+0000 7f4862125640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f484006ae70 0x7f484006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4858007fd0 tx=0x7f4858007980 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:57.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.234+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4854054be0 con 0x7f485c15f9c0 2023-11-24T08:01:57.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.467+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f485c14b070 con 0x7f485c15f9c0 2023-11-24T08:01:57.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.617+0000 7f4852ffd640 1 -- 172.21.15.161:0/3911293951 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f485c14b070 con 0x7f485c15f9c0 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f484006ae70 msgr2=0x7f484006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f484006ae70 0x7f484006d330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4858007fd0 tx=0x7f4858007980 comp rx=0 tx=0).stop 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 msgr2=0x7f485c070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 0x7f485c070e70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f485400c700 tx=0x7f485400cbc0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 shutdown_connections 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f484006ae70 0x7f484006d330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f485c15f9c0 0x7f485c070e70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f485c13e360 0x7f485c1f7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 --2- 172.21.15.161:0/3911293951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f485c13df80 0x7f485c1f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 >> 172.21.15.161:0/3911293951 conn(0x7f485c06a800 msgr2=0x7f485c15c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:57.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 shutdown_connections 2023-11-24T08:01:57.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:57.621+0000 7f4864389640 1 -- 172.21.15.161:0/3911293951 wait complete. 2023-11-24T08:01:57.833 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:01:58.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.057+0000 7fb0d759e640 1 Processor -- start 2023-11-24T08:01:58.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.057+0000 7fb0d759e640 1 -- start start 2023-11-24T08:01:58.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d815afb0 0x7fb0d813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d813fae0 0x7fb0d80b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d813ff00 con 0x7fb0d813cfa0 2023-11-24T08:01:58.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d80cdc40 con 0x7fb0d813fae0 2023-11-24T08:01:58.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d80cdec0 con 0x7fb0d815afb0 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d6d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d813fae0 0x7fb0d80b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d6d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb0d813fae0 0x7fb0d80b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40274/0 (socket says 172.21.15.161:40274) 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d6d9d640 1 -- 172.21.15.161:0/1914501751 learned_addr learned my addr 172.21.15.161:0/1914501751 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.059+0000 7fb0d5d9b640 1 --2- 172.21.15.161:0/1914501751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d815afb0 0x7fb0d813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.060+0000 7fb0d6d9d640 1 -- 172.21.15.161:0/1914501751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d815afb0 msgr2=0x7fb0d813f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.060+0000 7fb0d6d9d640 1 --2- 172.21.15.161:0/1914501751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d815afb0 0x7fb0d813f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.060+0000 7fb0d6d9d640 1 -- 172.21.15.161:0/1914501751 >> v1:172.21.15.175:6789/0 conn(0x7fb0d813cfa0 legacy=0x7fb0d80cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.060+0000 7fb0d6d9d640 1 -- 172.21.15.161:0/1914501751 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d80ce1a0 con 0x7fb0d813fae0 2023-11-24T08:01:58.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.061+0000 7fb0d6d9d640 1 --2- 172.21.15.161:0/1914501751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d80b2040 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000d150 tx=0x7fb0d002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f0198af67a2a51 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:58.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.061+0000 7fb0d559a640 1 -- 172.21.15.161:0/1914501751 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d002ea80 con 0x7fb0d813fae0 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.061+0000 7fb0d559a640 1 -- 172.21.15.161:0/1914501751 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d002ebe0 con 0x7fb0d813fae0 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.061+0000 7fb0d559a640 1 -- 172.21.15.161:0/1914501751 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0009600 con 0x7fb0d813fae0 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 -- 172.21.15.161:0/1914501751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 msgr2=0x7fb0d80b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1914501751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d80b2040 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000d150 tx=0x7fb0d002e0e0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 -- 172.21.15.161:0/1914501751 shutdown_connections 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1914501751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d80b2040 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1914501751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d815afb0 0x7fb0d813f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 -- 172.21.15.161:0/1914501751 >> 172.21.15.161:0/1914501751 conn(0x7fb0d806a800 msgr2=0x7fb0d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 -- 172.21.15.161:0/1914501751 shutdown_connections 2023-11-24T08:01:58.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.062+0000 7fb0d759e640 1 -- 172.21.15.161:0/1914501751 wait complete. 2023-11-24T08:01:58.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.064+0000 7fb0d759e640 1 Processor -- start 2023-11-24T08:01:58.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.064+0000 7fb0d759e640 1 -- start start 2023-11-24T08:01:58.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d813cfa0 0x7fb0d81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d8153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d815afb0 0x7fb0d813ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8155020 con 0x7fb0d813fae0 2023-11-24T08:01:58.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d8156920 con 0x7fb0d815afb0 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d81f7640 con 0x7fb0d813cfa0 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d8153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d8153ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40290/0 (socket says 172.21.15.161:40290) 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 -- 172.21.15.161:0/1068254015 learned_addr learned my addr 172.21.15.161:0/1068254015 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d659c640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d813cfa0 0x7fb0d81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 -- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d813cfa0 msgr2=0x7fb0d81563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d813cfa0 0x7fb0d81563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d6d9d640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d815afb0 0x7fb0d813ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 -- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d815afb0 msgr2=0x7fb0d813ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.065+0000 7fb0d5d9b640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d815afb0 0x7fb0d813ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0d5d9b640 1 -- 172.21.15.161:0/1068254015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d000bd40 con 0x7fb0d813fae0 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0d6d9d640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d815afb0 0x7fb0d813ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0d5d9b640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d8153ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00d620 tx=0x7fb0cc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00b620 con 0x7fb0d813fae0 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc00b780 con 0x7fb0d813fae0 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc00bb30 con 0x7fb0d813fae0 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d8154010 con 0x7fb0d813fae0 2023-11-24T08:01:58.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.066+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d81f6d10 con 0x7fb0d813fae0 2023-11-24T08:01:58.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.067+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d8067450 con 0x7fb0d813fae0 2023-11-24T08:01:58.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.068+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0cc00bc90 con 0x7fb0d813fae0 2023-11-24T08:01:58.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.069+0000 7fb0c6ffd640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb0b806ae40 0x7fb0b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.069+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0cc089af0 con 0x7fb0d813fae0 2023-11-24T08:01:58.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.070+0000 7fb0d659c640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb0b806ae40 0x7fb0b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.071+0000 7fb0d659c640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb0b806ae40 0x7fb0b806d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8000f60 tx=0x7fb0c8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:58.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.076+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0cc054b90 con 0x7fb0d813fae0 2023-11-24T08:01:58.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.287+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0d80ae4b0 con 0x7fb0b806ae40 2023-11-24T08:01:58.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.291+0000 7fb0c6ffd640 1 -- 172.21.15.161:0/1068254015 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb0d80ae4b0 con 0x7fb0b806ae40 2023-11-24T08:01:58.294 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:01:58.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:01:58.295 INFO:teuthology.orchestra.run.smithi161.stdout: "name": "cephfs" 2023-11-24T08:01:58.295 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:01:58.295 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:01:58.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb0b806ae40 msgr2=0x7fb0b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb0b806ae40 0x7fb0b806d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8000f60 tx=0x7fb0c8009040 comp rx=0 tx=0).stop 2023-11-24T08:01:58.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 msgr2=0x7fb0d8153ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d8153ad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00d620 tx=0x7fb0cc00dae0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 shutdown_connections 2023-11-24T08:01:58.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb0b806ae40 0x7fb0b806d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0d815afb0 0x7fb0d813ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb0d813fae0 0x7fb0d8153ad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 --2- 172.21.15.161:0/1068254015 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0d813cfa0 0x7fb0d81563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 >> 172.21.15.161:0/1068254015 conn(0x7fb0d806a800 msgr2=0x7fb0d80b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:58.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 shutdown_connections 2023-11-24T08:01:58.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.294+0000 7fb0d759e640 1 -- 172.21.15.161:0/1068254015 wait complete. 2023-11-24T08:01:58.314 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:01:58.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.513+0000 7ff1fd989640 1 Processor -- start 2023-11-24T08:01:58.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.513+0000 7ff1fd989640 1 -- start start 2023-11-24T08:01:58.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1fd989640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1fd989640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1f813e360 0x7ff1f80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1fd989640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f806c470 con 0x7ff1f815f9c0 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1fd989640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f806c750 con 0x7ff1f813e360 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1fd989640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f806ca30 con 0x7ff1f813df80 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1effff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1f813e360 0x7ff1f80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1effff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff1f813e360 0x7ff1f80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40296/0 (socket says 172.21.15.161:40296) 2023-11-24T08:01:58.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.515+0000 7ff1effff640 1 -- 172.21.15.161:0/2116222133 learned_addr learned my addr 172.21.15.161:0/2116222133 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:58.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.516+0000 7ff1f6ffd640 1 --2- 172.21.15.161:0/2116222133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.516+0000 7ff1effff640 1 -- 172.21.15.161:0/2116222133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 msgr2=0x7ff1f815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.516+0000 7ff1effff640 1 --2- 172.21.15.161:0/2116222133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.516+0000 7ff1effff640 1 -- 172.21.15.161:0/2116222133 >> v1:172.21.15.175:6789/0 conn(0x7ff1f815f9c0 legacy=0x7ff1f81408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.516+0000 7ff1effff640 1 -- 172.21.15.161:0/2116222133 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f806cd10 con 0x7ff1f813e360 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.517+0000 7ff1effff640 1 --2- 172.21.15.161:0/2116222133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80cf290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009870 tx=0x7ff1e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c7b3a134a9ad7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.517+0000 7ff1f67fc640 1 -- 172.21.15.161:0/2116222133 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0031640 con 0x7ff1f813e360 2023-11-24T08:01:58.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.517+0000 7ff1f67fc640 1 -- 172.21.15.161:0/2116222133 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e00317a0 con 0x7ff1f813e360 2023-11-24T08:01:58.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.517+0000 7ff1f67fc640 1 -- 172.21.15.161:0/2116222133 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0031b30 con 0x7ff1f813e360 2023-11-24T08:01:58.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 -- 172.21.15.161:0/2116222133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 msgr2=0x7ff1f80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 --2- 172.21.15.161:0/2116222133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80cf290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009870 tx=0x7ff1e002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 -- 172.21.15.161:0/2116222133 shutdown_connections 2023-11-24T08:01:58.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 --2- 172.21.15.161:0/2116222133 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80cf290 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 --2- 172.21.15.161:0/2116222133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 -- 172.21.15.161:0/2116222133 >> 172.21.15.161:0/2116222133 conn(0x7ff1f806a800 msgr2=0x7ff1f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:58.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 -- 172.21.15.161:0/2116222133 shutdown_connections 2023-11-24T08:01:58.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.518+0000 7ff1fd989640 1 -- 172.21.15.161:0/2116222133 wait complete. 2023-11-24T08:01:58.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.520+0000 7ff1fd989640 1 Processor -- start 2023-11-24T08:01:58.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.521+0000 7ff1fd989640 1 -- start start 2023-11-24T08:01:58.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1fd989640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f80b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1fd989640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1fd989640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f815f9c0 0x7ff1f81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1fd989640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81f4040 con 0x7ff1f813e360 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1fd989640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81f4320 con 0x7ff1f815f9c0 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1fd989640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81f4600 con 0x7ff1f813df80 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40310/0 (socket says 172.21.15.161:40310) 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 -- 172.21.15.161:0/183979732 learned_addr learned my addr 172.21.15.161:0/183979732 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 -- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 msgr2=0x7ff1f80b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f80b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 -- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f815f9c0 msgr2=0x7ff1f81502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f815f9c0 0x7ff1f81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.522+0000 7ff1effff640 1 -- 172.21.15.161:0/183979732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e00094d0 con 0x7ff1f813e360 2023-11-24T08:01:58.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.523+0000 7ff1effff640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80b3360 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009870 tx=0x7ff1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:58.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.523+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e003ac60 con 0x7ff1f813e360 2023-11-24T08:01:58.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.523+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e003ade0 con 0x7ff1f813e360 2023-11-24T08:01:58.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.523+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f8070f10 con 0x7ff1f813e360 2023-11-24T08:01:58.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.523+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0044630 con 0x7ff1f813e360 2023-11-24T08:01:58.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.523+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f814ac00 con 0x7ff1f813e360 2023-11-24T08:01:58.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.524+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8150fa0 con 0x7ff1f813e360 2023-11-24T08:01:58.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.525+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1e002f050 con 0x7ff1f813e360 2023-11-24T08:01:58.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.526+0000 7ff1f4ff9640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff1d806ae70 0x7ff1d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:58.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.526+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1e00ab7d0 con 0x7ff1f813e360 2023-11-24T08:01:58.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.527+0000 7ff1f6ffd640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff1d806ae70 0x7ff1d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:58.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.528+0000 7ff1f6ffd640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff1d806ae70 0x7ff1d806d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800a810 tx=0x7ff1e8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:58.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.530+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1e0076870 con 0x7ff1f813e360 2023-11-24T08:01:58.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.721+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff1f8071120 con 0x7ff1f813e360 2023-11-24T08:01:58.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.722+0000 7ff1f4ff9640 1 -- 172.21.15.161:0/183979732 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff1e0032040 con 0x7ff1f813e360 2023-11-24T08:01:58.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff1d806ae70 msgr2=0x7ff1d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff1d806ae70 0x7ff1d806d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800a810 tx=0x7ff1e8008040 comp rx=0 tx=0).stop 2023-11-24T08:01:58.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 msgr2=0x7ff1f80b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:58.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80b3360 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009870 tx=0x7ff1e00046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 shutdown_connections 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff1d806ae70 0x7ff1d806d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff1f815f9c0 0x7ff1f81502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1f813e360 0x7ff1f80b3360 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 --2- 172.21.15.161:0/183979732 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1f813df80 0x7ff1f80b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 >> 172.21.15.161:0/183979732 conn(0x7ff1f806a800 msgr2=0x7ff1f815d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 shutdown_connections 2023-11-24T08:01:58.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:58.725+0000 7ff1fd989640 1 -- 172.21.15.161:0/183979732 wait complete. 2023-11-24T08:01:58.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:58.747 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp9990/subvol5414) 2023-11-24T08:01:58.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:58.860 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2023-11-24T08:01:58.914 INFO:teuthology.orchestra.run.smithi161.stdout:cephfs_data 2023-11-24T08:01:58.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:01:58.915 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp9990/subvol5414) 2023-11-24T08:01:59.028 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:01:59.029 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp9990/subvol5414/.meta 2023-11-24T08:01:59.143 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol5414 subvol_grp9990 2023-11-24T08:01:59.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.405+0000 7ff5a539e640 1 Processor -- start 2023-11-24T08:01:59.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.406+0000 7ff5a539e640 1 -- start start 2023-11-24T08:01:59.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.407+0000 7ff5a539e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a00b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.407+0000 7ff5a539e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff5a00d0f40 0x7ff5a00d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.407+0000 7ff5a539e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a00d0a10 con 0x7ff5a0160920 2023-11-24T08:01:59.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.407+0000 7ff5a539e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a00cf080 con 0x7ff5a00d0f40 2023-11-24T08:01:59.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.407+0000 7ff5a539e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00c6be0 con 0x7ff5a00d0100 2023-11-24T08:01:59.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.408+0000 7ff59f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a00b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.408+0000 7ff59f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a00b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:47430/0 (socket says 172.21.15.161:47430) 2023-11-24T08:01:59.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.408+0000 7ff5a4b9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff5a00d0f40 0x7ff5a00d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.408+0000 7ff59f7fe640 1 -- 172.21.15.161:0/656064466 learned_addr learned my addr 172.21.15.161:0/656064466 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:59.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.408+0000 7ff59ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff5a0160920 0x7ff5a00cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:60034/0 (socket says 172.21.15.161:60034) 2023-11-24T08:01:59.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.409+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 msgr2=0x7ff5a00b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:59.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.409+0000 7ff5a4b9d640 1 --2- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a00b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.409+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/656064466 >> v1:172.21.15.175:6789/0 conn(0x7ff5a0160920 legacy=0x7ff5a00cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.409+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/656064466 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a00ce7e0 con 0x7ff5a00d0f40 2023-11-24T08:01:59.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.410+0000 7ff5a4b9d640 1 --2- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00d13f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff5980097a0 tx=0x7ff59802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f5a46b5e248467b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:59.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.411+0000 7ff59effd640 1 -- 172.21.15.161:0/656064466 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59802d040 con 0x7ff5a00d0f40 2023-11-24T08:01:59.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.411+0000 7ff59effd640 1 -- 172.21.15.161:0/656064466 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598031810 con 0x7ff5a00d0f40 2023-11-24T08:01:59.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.411+0000 7ff59effd640 1 -- 172.21.15.161:0/656064466 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598031ba0 con 0x7ff5a00d0f40 2023-11-24T08:01:59.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 -- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 msgr2=0x7ff5a00d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 --2- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00d13f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff5980097a0 tx=0x7ff59802b8b0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 -- 172.21.15.161:0/656064466 shutdown_connections 2023-11-24T08:01:59.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 --2- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00d13f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 --2- 172.21.15.161:0/656064466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a00b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 -- 172.21.15.161:0/656064466 >> 172.21.15.161:0/656064466 conn(0x7ff5a00d3090 msgr2=0x7ff5a00d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:59.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 -- 172.21.15.161:0/656064466 shutdown_connections 2023-11-24T08:01:59.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.412+0000 7ff5a539e640 1 -- 172.21.15.161:0/656064466 wait complete. 2023-11-24T08:01:59.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.414+0000 7ff5a539e640 1 Processor -- start 2023-11-24T08:01:59.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.414+0000 7ff5a539e640 1 -- start start 2023-11-24T08:01:59.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a539e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a01f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a539e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00b7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a539e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 0x7ff5a0153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a539e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01f30b0 con 0x7ff5a0160920 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a539e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a00b8700 con 0x7ff5a00d0f40 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a539e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a01f4050 con 0x7ff5a00d0100 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a4b9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 0x7ff5a0153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a4b9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 0x7ff5a0153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40316/0 (socket says 172.21.15.161:40316) 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/1361865220 learned_addr learned my addr 172.21.15.161:0/1361865220 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff59ffff640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a01f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.415+0000 7ff59f7fe640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00b7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 msgr2=0x7ff5a01f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a4b9d640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a01f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 msgr2=0x7ff5a00b7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a4b9d640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00b7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a4b9d640 1 -- 172.21.15.161:0/1361865220 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598009400 con 0x7ff5a0160920 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a4b9d640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 0x7ff5a0153a50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff5980098c0 tx=0x7ff5980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59803ac60 con 0x7ff5a0160920 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59803ade0 con 0x7ff5a0160920 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598044630 con 0x7ff5a0160920 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a01f3bc0 con 0x7ff5a0160920 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.416+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a01f3290 con 0x7ff5a0160920 2023-11-24T08:01:59.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.418+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a01f3d50 con 0x7ff5a0160920 2023-11-24T08:01:59.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.418+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff598044790 con 0x7ff5a0160920 2023-11-24T08:01:59.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.419+0000 7ff59cff9640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58006ae70 0x7ff58006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.420+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5980aba10 con 0x7ff5a0160920 2023-11-24T08:01:59.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.420+0000 7ff59ffff640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58006ae70 0x7ff58006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.421+0000 7ff59ffff640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58006ae70 0x7ff58006d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff588000f60 tx=0x7ff588007cc0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:59.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.424+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff598076b40 con 0x7ff5a0160920 2023-11-24T08:01:59.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.644+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol5414", "group_name": "subvol_grp9990", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5a0160d00 con 0x7ff58006ae70 2023-11-24T08:01:59.657 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:01:59.655+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:01:59.657 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:01:59.655+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:01:59.657 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:01:59.655+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:01:59.657 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:01:59.655+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:01:59.657 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:01:59.655+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:01:59.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.736+0000 7ff59cff9640 1 -- 172.21.15.161:0/1361865220 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7ff5880074e0 con 0x7ff58006ae70 2023-11-24T08:01:59.739 INFO:teuthology.orchestra.run.smithi161.stdout:/volumes/subvol_grp9990/subvol5414 2023-11-24T08:01:59.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58006ae70 msgr2=0x7ff58006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58006ae70 0x7ff58006d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff588000f60 tx=0x7ff588007cc0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 msgr2=0x7ff5a0153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 0x7ff5a0153a50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff5980098c0 tx=0x7ff5980046c0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 shutdown_connections 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff58006ae70 0x7ff58006d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff5a0160920 0x7ff5a0153a50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5a00d0f40 0x7ff5a00b7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 --2- 172.21.15.161:0/1361865220 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5a00d0100 0x7ff5a01f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 >> 172.21.15.161:0/1361865220 conn(0x7ff5a00d3090 msgr2=0x7ff5a00b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:59.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 shutdown_connections 2023-11-24T08:01:59.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.739+0000 7ff5a539e640 1 -- 172.21.15.161:0/1361865220 wait complete. 2023-11-24T08:01:59.763 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol5414 subvol_grp9990 2023-11-24T08:01:59.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.979+0000 7f77dd50a640 1 Processor -- start 2023-11-24T08:01:59.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.979+0000 7f77dd50a640 1 -- start start 2023-11-24T08:01:59.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.981+0000 7f77dd50a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 0x7f77d80b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.981+0000 7f77dd50a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d806cea0 con 0x7f77d80cd240 2023-11-24T08:01:59.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.981+0000 7f77dd50a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d806cbc0 con 0x7f77d809a170 2023-11-24T08:01:59.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.981+0000 7f77dd50a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d806f350 con 0x7f77d806c6b0 2023-11-24T08:01:59.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.981+0000 7f77d6ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f77d80cd240 0x7f77d8099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38494/0 (socket says 172.21.15.161:38494) 2023-11-24T08:01:59.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.981+0000 7f77d6ffd640 1 -- 172.21.15.161:0/3713283647 learned_addr learned my addr 172.21.15.161:0/3713283647 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:01:59.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d77fe640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 0x7f77d80b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256996555 0 0) 0x7f77d806cea0 con 0x7f77d80cd240 2023-11-24T08:01:59.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77c4003520 con 0x7f77d80cd240 2023-11-24T08:01:59.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931351693 0 0) 0x7f77c4003520 con 0x7f77d80cd240 2023-11-24T08:01:59.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 msgr2=0x7f77d80b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:59.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 0x7f77d80b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 >> v1:172.21.15.175:6789/0 conn(0x7f77d809a170 legacy=0x7f77d80cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d806f630 con 0x7f77d80cd240 2023-11-24T08:01:59.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f77c80019f0 con 0x7f77d80cd240 2023-11-24T08:01:59.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 >> v1:172.21.15.161:6789/0 conn(0x7f77d80cd240 legacy=0x7f77d8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40039a0 0x7f77c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c40047c0 0x7f77c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 0x7f77c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d806f350 con 0x7f77c40047c0 2023-11-24T08:01:59.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c400ba30 con 0x7f77c40039a0 2023-11-24T08:01:59.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.982+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c400bbf0 con 0x7f77d806c6b0 2023-11-24T08:01:59.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c40047c0 0x7f77c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77d6ffd640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40039a0 0x7f77c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77ce7fc640 1 -- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 msgr2=0x7f77c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:59.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77d806c6b0 0x7f77c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77ce7fc640 1 -- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40039a0 msgr2=0x7f77c4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77c40039a0 0x7f77c4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.983+0000 7f77ce7fc640 1 -- 172.21.15.161:0/3713283647 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4003520 con 0x7f77c40047c0 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.984+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c40047c0 0x7f77c4004c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f77c0001720 tx=0x7f77c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef968f0f4ce06dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.984+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00052d0 con 0x7f77c40047c0 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.984+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c002e050 con 0x7f77c40047c0 2023-11-24T08:01:59.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.984+0000 7f77d67fc640 1 -- 172.21.15.161:0/3713283647 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00035f0 con 0x7f77c40047c0 2023-11-24T08:01:59.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77dd50a640 1 -- 172.21.15.161:0/3713283647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c40047c0 msgr2=0x7f77c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77dd50a640 1 --2- 172.21.15.161:0/3713283647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77c40047c0 0x7f77c4004c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f77c0001720 tx=0x7f77c40057f0 comp rx=0 tx=0).stop 2023-11-24T08:01:59.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77d77fe640 1 -- 172.21.15.161:0/3713283647 reap_dead start 2023-11-24T08:01:59.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77dd50a640 1 -- 172.21.15.161:0/3713283647 shutdown_connections 2023-11-24T08:01:59.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77dd50a640 1 -- 172.21.15.161:0/3713283647 >> 172.21.15.161:0/3713283647 conn(0x7f77d80b2d00 msgr2=0x7f77d80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:01:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77dd50a640 1 -- 172.21.15.161:0/3713283647 shutdown_connections 2023-11-24T08:01:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.985+0000 7f77dd50a640 1 -- 172.21.15.161:0/3713283647 wait complete. 2023-11-24T08:01:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.987+0000 7f77dd50a640 1 Processor -- start 2023-11-24T08:01:59.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.987+0000 7f77dd50a640 1 -- start start 2023-11-24T08:01:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77dd50a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77c40047c0 0x7f77d8154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77dd50a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 0x7f77d80b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77dd50a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d80b3650 0x7f77d80c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:01:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77dd50a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b3ad0 con 0x7f77d80c75f0 2023-11-24T08:01:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77dd50a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b4fe0 con 0x7f77d80b3650 2023-11-24T08:01:59.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77dd50a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d80b43d0 con 0x7f77c40047c0 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77ce7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 0x7f77d80b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77ce7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 0x7f77d80b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40334/0 (socket says 172.21.15.161:40334) 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.988+0000 7f77ce7fc640 1 -- 172.21.15.161:0/2585024374 learned_addr learned my addr 172.21.15.161:0/2585024374 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77d6ffd640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77c40047c0 0x7f77d8154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77d77fe640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d80b3650 0x7f77d80c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77ce7fc640 1 -- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77c40047c0 msgr2=0x7f77d8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:01:59.999 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77c40047c0 0x7f77d8154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:00.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77ce7fc640 1 -- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d80b3650 msgr2=0x7f77d80c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:00.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d80b3650 0x7f77d80c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:00.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77ce7fc640 1 -- 172.21.15.161:0/2585024374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d80b46b0 con 0x7f77d80c75f0 2023-11-24T08:02:00.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77ce7fc640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 0x7f77d80b3110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f77c0008fd0 tx=0x7f77c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:00.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.989+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00076c0 con 0x7f77d80c75f0 2023-11-24T08:02:00.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.990+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0000ed0 con 0x7f77d80c75f0 2023-11-24T08:02:00.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.990+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d80b4990 con 0x7f77d80c75f0 2023-11-24T08:02:00.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.990+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0006c00 con 0x7f77d80c75f0 2023-11-24T08:02:00.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.990+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d80c71c0 con 0x7f77d80c75f0 2023-11-24T08:02:00.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.991+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d80b3a30 con 0x7f77d80c75f0 2023-11-24T08:02:00.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.992+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77c00035f0 con 0x7f77d80c75f0 2023-11-24T08:02:00.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.993+0000 7f77cffff640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f77b806ae70 0x7f77b806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:00.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.993+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77c00ab380 con 0x7f77d80c75f0 2023-11-24T08:02:00.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.993+0000 7f77d6ffd640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f77b806ae70 0x7f77b806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:00.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.995+0000 7f77d6ffd640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f77b806ae70 0x7f77b806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77c8002230 tx=0x7f77c8002100 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:00.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:01:59.997+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77c0076430 con 0x7f77d80c75f0 2023-11-24T08:02:00.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.214+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol5414", "group_name": "subvol_grp9990", "target": ["mon-mgr", ""]}) v1 -- 0x7f77d80cd620 con 0x7f77b806ae70 2023-11-24T08:02:00.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.225+0000 7f77cffff640 1 -- 172.21.15.161:0/2585024374 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f77c8001250 con 0x7f77b806ae70 2023-11-24T08:02:00.228 INFO:teuthology.orchestra.run.smithi161.stdout:/volumes/subvol_grp9990/subvol5414 2023-11-24T08:02:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f77b806ae70 msgr2=0x7f77b806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f77b806ae70 0x7f77b806d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77c8002230 tx=0x7f77c8002100 comp rx=0 tx=0).stop 2023-11-24T08:02:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 msgr2=0x7f77d80b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:00.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 0x7f77d80b3110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f77c0008fd0 tx=0x7f77c0001120 comp rx=0 tx=0).stop 2023-11-24T08:02:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 shutdown_connections 2023-11-24T08:02:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f77b806ae70 0x7f77b806d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77d80b3650 0x7f77d80c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77d80c75f0 0x7f77d80b3110 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:00.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 --2- 172.21.15.161:0/2585024374 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77c40047c0 0x7f77d8154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:00.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 >> 172.21.15.161:0/2585024374 conn(0x7f77d80b2d00 msgr2=0x7f77d80733f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:00.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.227+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 shutdown_connections 2023-11-24T08:02:00.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:00.228+0000 7f77dd50a640 1 -- 172.21.15.161:0/2585024374 wait complete. 2023-11-24T08:02:00.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:00.249 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/cca35638aa4c6a5616a400988157d239.meta) 2023-11-24T08:02:02.106 INFO:teuthology.orchestra.run.smithi161.stdout:[GLOBAL] 2023-11-24T08:02:02.106 INFO:teuthology.orchestra.run.smithi161.stdout:version = 1 2023-11-24T08:02:02.107 INFO:teuthology.orchestra.run.smithi161.stdout:type = subvolume 2023-11-24T08:02:02.107 INFO:teuthology.orchestra.run.smithi161.stdout:path = /volumes/subvol_grp9990/subvol5414 2023-11-24T08:02:02.107 INFO:teuthology.orchestra.run.smithi161.stdout:state = complete 2023-11-24T08:02:02.107 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:02.112 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol5414 subvol_grp9990 2023-11-24T08:02:02.337 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.335+0000 7fc0d1f4c640 1 Processor -- start 2023-11-24T08:02:02.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.335+0000 7fc0d1f4c640 1 -- start start 2023-11-24T08:02:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.337+0000 7fc0d1f4c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0cc15e3b0 0x7fc0cc164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.337+0000 7fc0d1f4c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc0b1ee0 con 0x7fc0cc143ae0 2023-11-24T08:02:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.337+0000 7fc0d1f4c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc0b2780 con 0x7fc0cc0cf9a0 2023-11-24T08:02:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.337+0000 7fc0d1f4c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc15e990 con 0x7fc0cc15e3b0 2023-11-24T08:02:02.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.337+0000 7fc0cb7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc0cc143ae0 0x7fc0cc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34540/0 (socket says 172.21.15.161:34540) 2023-11-24T08:02:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.337+0000 7fc0cb7fe640 1 -- 172.21.15.161:0/3397522653 learned_addr learned my addr 172.21.15.161:0/3397522653 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771351004 0 0) 0x7fc0cc0b1ee0 con 0x7fc0cc143ae0 2023-11-24T08:02:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0ac005730 con 0x7fc0cc143ae0 2023-11-24T08:02:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0cbfff640 1 --2- 172.21.15.161:0/3397522653 >> v2:172.21.15.175:3300/0 conn(0x7fc0cc15e3b0 0x7fc0cc164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3915395979 0 0) 0x7fc0ac005730 con 0x7fc0cc143ae0 2023-11-24T08:02:02.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 >> v2:172.21.15.175:3300/0 conn(0x7fc0cc15e3b0 msgr2=0x7fc0cc164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:02.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 --2- 172.21.15.161:0/3397522653 >> v2:172.21.15.175:3300/0 conn(0x7fc0cc15e3b0 0x7fc0cc164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 >> v1:172.21.15.175:6789/0 conn(0x7fc0cc0cf9a0 legacy=0x7fc0cc15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:02.347 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0b2130 con 0x7fc0cc143ae0 2023-11-24T08:02:02.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc0bc001670 con 0x7fc0cc143ae0 2023-11-24T08:02:02.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 >> v1:172.21.15.161:6789/0 conn(0x7fc0cc143ae0 legacy=0x7fc0cc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0ac005b80 0x7fc0ac005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac0064e0 0x7fc0ac0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0ac007190 0x7fc0ac00ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc15e990 con 0x7fc0ac005b80 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0104d0 con 0x7fc0ac0064e0 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.338+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac010690 con 0x7fc0ac007190 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0ac005b80 0x7fc0ac005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cb7fe640 1 -- 172.21.15.161:0/3397522653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0ac007190 msgr2=0x7fc0ac00ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0ac007190 0x7fc0ac00ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cb7fe640 1 -- 172.21.15.161:0/3397522653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac0064e0 msgr2=0x7fc0ac0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac0064e0 0x7fc0ac0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cb7fe640 1 -- 172.21.15.161:0/3397522653 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac005730 con 0x7fc0ac005b80 2023-11-24T08:02:02.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.339+0000 7fc0cbfff640 1 -- 172.21.15.161:0/3397522653 reap_dead start 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.340+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0ac005b80 0x7fc0ac005fa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c240 tx=0x7fc0ac007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed7a93cc5f28a84 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.340+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc005ad0 con 0x7fc0ac005b80 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0bc005c50 con 0x7fc0ac005b80 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0ca7fc640 1 -- 172.21.15.161:0/3397522653 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc02c8b0 con 0x7fc0ac005b80 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/3397522653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0ac005b80 msgr2=0x7fc0ac005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0ac005b80 0x7fc0ac005fa0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc00c240 tx=0x7fc0ac007a00 comp rx=0 tx=0).stop 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/3397522653 shutdown_connections 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/3397522653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0ac005b80 0x7fc0ac005fa0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/3397522653 >> 172.21.15.161:0/3397522653 conn(0x7fc0cc06a800 msgr2=0x7fc0cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:02.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/3397522653 shutdown_connections 2023-11-24T08:02:02.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.341+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/3397522653 wait complete. 2023-11-24T08:02:02.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.343+0000 7fc0d1f4c640 1 Processor -- start 2023-11-24T08:02:02.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.343+0000 7fc0d1f4c640 1 -- start start 2023-11-24T08:02:02.353 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0d1f4c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac005b80 0x7fc0cc159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0d1f4c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 0x7fc0cc0aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0d1f4c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc15a4e0 0x7fc0cc15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0d1f4c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc15aed0 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0d1f4c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc12f910 con 0x7fc0ac005b80 2023-11-24T08:02:02.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0d1f4c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0af610 con 0x7fc0cc15a4e0 2023-11-24T08:02:02.354 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0caffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 0x7fc0cc0aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0caffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 0x7fc0cc0aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53264/0 (socket says 172.21.15.161:53264) 2023-11-24T08:02:02.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.344+0000 7fc0caffd640 1 -- 172.21.15.161:0/1804200868 learned_addr learned my addr 172.21.15.161:0/1804200868 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:02.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0cbfff640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc15a4e0 0x7fc0cc15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac005b80 0x7fc0cc159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0caffd640 1 -- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc15a4e0 msgr2=0x7fc0cc15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0caffd640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc15a4e0 0x7fc0cc15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0caffd640 1 -- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac005b80 msgr2=0x7fc0cc159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0caffd640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac005b80 0x7fc0cc159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0caffd640 1 -- 172.21.15.161:0/1804200868 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0af8f0 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.356 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0cbfff640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc15a4e0 0x7fc0cc15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:02.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0caffd640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 0x7fc0cc0aefd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400c7d0 tx=0x7fc0b400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:02.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4003b70 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4003cf0 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc12f5a0 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.345+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b400aa30 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.346+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc0ad3e0 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.347+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc12f400 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.347+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fc0b400ab90 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.348+0000 7fc0c3fff640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0b006af00 0x7fc0b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.348+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0b4089390 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.349+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0b006af00 0x7fc0b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.350+0000 7fc0cb7fe640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0b006af00 0x7fc0b006d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc034000 tx=0x7fc0bc009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:02.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.353+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0cc12f400 con 0x7fc0cc0aeb50 2023-11-24T08:02:02.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.571+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol5414", "group_name": "subvol_grp9990", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0cc15e0a0 con 0x7fc0b006af00 2023-11-24T08:02:02.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.611+0000 7fc0c3fff640 1 -- 172.21.15.161:0/1804200868 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc0cc15e0a0 con 0x7fc0b006af00 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0b006af00 msgr2=0x7fc0b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0b006af00 0x7fc0b006d3c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc034000 tx=0x7fc0bc009030 comp rx=0 tx=0).stop 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 msgr2=0x7fc0cc0aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 0x7fc0cc0aefd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400c7d0 tx=0x7fc0b400cc90 comp rx=0 tx=0).stop 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 shutdown_connections 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0b006af00 0x7fc0b006d3c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0cc15a4e0 0x7fc0cc15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0cc0aeb50 0x7fc0cc0aefd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 --2- 172.21.15.161:0/1804200868 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0ac005b80 0x7fc0cc159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 >> 172.21.15.161:0/1804200868 conn(0x7fc0cc06a800 msgr2=0x7fc0cc15bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:02.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 shutdown_connections 2023-11-24T08:02:02.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.614+0000 7fc0d1f4c640 1 -- 172.21.15.161:0/1804200868 wait complete. 2023-11-24T08:02:02.624 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.622+0000 7f17d9019640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.624 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.622+0000 7f17d9019640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.624 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.622+0000 7f17d9019640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.625 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.622+0000 7f17d9019640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.625 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.622+0000 7f17d9019640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:02.637 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-11-24T08:02:02.649 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.646+0000 7f17d8017640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.649 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.646+0000 7f17d8017640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.649 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.646+0000 7f17d8017640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.649 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.647+0000 7f17d8017640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.649 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:02:02.647+0000 7f17d8017640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:02:02.699 INFO:teuthology.orchestra.run.smithi161.stdout:2 2023-11-24T08:02:02.700 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp9990 2023-11-24T08:02:02.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.913+0000 7fc153fa9640 1 Processor -- start 2023-11-24T08:02:02.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.913+0000 7fc153fa9640 1 -- start start 2023-11-24T08:02:02.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc153fa9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc14c13df80 0x7fc14c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc153fa9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc14c13e360 0x7fc14c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc153fa9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc14c06c470 con 0x7fc14c15f9c0 2023-11-24T08:02:02.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc153fa9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c06c750 con 0x7fc14c13e360 2023-11-24T08:02:02.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc153fa9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc14c06ca30 con 0x7fc14c13df80 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc151544640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc14c13e360 0x7fc14c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc151544640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc14c13e360 0x7fc14c0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53278/0 (socket says 172.21.15.161:53278) 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.915+0000 7fc151544640 1 -- 172.21.15.161:0/1306994712 learned_addr learned my addr 172.21.15.161:0/1306994712 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.916+0000 7fc151544640 1 -- 172.21.15.161:0/1306994712 >> v2:172.21.15.175:3300/0 conn(0x7fc14c13df80 msgr2=0x7fc14c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.916+0000 7fc151544640 1 --2- 172.21.15.161:0/1306994712 >> v2:172.21.15.175:3300/0 conn(0x7fc14c13df80 0x7fc14c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.916+0000 7fc151544640 1 -- 172.21.15.161:0/1306994712 >> v1:172.21.15.161:6789/0 conn(0x7fc14c15f9c0 legacy=0x7fc14c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.916+0000 7fc151544640 1 -- 172.21.15.161:0/1306994712 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14c06cd10 con 0x7fc14c13e360 2023-11-24T08:02:02.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.916+0000 7fc150d43640 1 -- 172.21.15.161:0/1306994712 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409512164 0 0) 0x7fc14c06c470 con 0x7fc14c15f9c0 2023-11-24T08:02:02.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.917+0000 7fc151544640 1 --2- 172.21.15.161:0/1306994712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c0cf290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc14c072770 tx=0x7fc13c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457367a0a16463bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:02.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.917+0000 7fc150d43640 1 -- 172.21.15.161:0/1306994712 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c030860 con 0x7fc14c13e360 2023-11-24T08:02:02.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.917+0000 7fc150d43640 1 -- 172.21.15.161:0/1306994712 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c0309c0 con 0x7fc14c13e360 2023-11-24T08:02:02.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.917+0000 7fc150d43640 1 -- 172.21.15.161:0/1306994712 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c030d50 con 0x7fc14c13e360 2023-11-24T08:02:02.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 -- 172.21.15.161:0/1306994712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 msgr2=0x7fc14c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1306994712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c0cf290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc14c072770 tx=0x7fc13c02b9a0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 -- 172.21.15.161:0/1306994712 shutdown_connections 2023-11-24T08:02:02.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1306994712 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c0cf290 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1306994712 >> v2:172.21.15.175:3300/0 conn(0x7fc14c13df80 0x7fc14c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 -- 172.21.15.161:0/1306994712 >> 172.21.15.161:0/1306994712 conn(0x7fc14c06a800 msgr2=0x7fc14c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:02.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 -- 172.21.15.161:0/1306994712 shutdown_connections 2023-11-24T08:02:02.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.918+0000 7fc153fa9640 1 -- 172.21.15.161:0/1306994712 wait complete. 2023-11-24T08:02:02.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.920+0000 7fc153fa9640 1 Processor -- start 2023-11-24T08:02:02.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.920+0000 7fc153fa9640 1 -- start start 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc153fa9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc14c13df80 0x7fc14c133690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc153fa9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc153fa9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14c15f9c0 0x7fc14c1f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc153fa9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c14ca20 con 0x7fc14c13e360 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc153fa9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c14be10 con 0x7fc14c15f9c0 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc153fa9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc14c14c0f0 con 0x7fc14c13df80 2023-11-24T08:02:02.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc151544640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc151544640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53292/0 (socket says 172.21.15.161:53292) 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.921+0000 7fc151544640 1 -- 172.21.15.161:0/1433481335 learned_addr learned my addr 172.21.15.161:0/1433481335 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151d45640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc14c13df80 0x7fc14c133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc152546640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14c15f9c0 0x7fc14c1f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151544640 1 -- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc14c13df80 msgr2=0x7fc14c133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151544640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc14c13df80 0x7fc14c133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151544640 1 -- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14c15f9c0 msgr2=0x7fc14c1f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151544640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14c15f9c0 0x7fc14c1f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151544640 1 -- 172.21.15.161:0/1433481335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13c0094d0 con 0x7fc14c13e360 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc152546640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14c15f9c0 0x7fc14c1f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151d45640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc14c13df80 0x7fc14c133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:02.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc151544640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c150bd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0090b0 tx=0x7fc13c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:02.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c03e040 con 0x7fc14c13e360 2023-11-24T08:02:02.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c039d50 con 0x7fc14c13e360 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.922+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc13c004270 con 0x7fc14c13e360 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.923+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc14c14c3d0 con 0x7fc14c13e360 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.923+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc14c133bd0 con 0x7fc14c13e360 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.924+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14c14cb90 con 0x7fc14c13e360 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.925+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7fc13c0043d0 con 0x7fc14c13e360 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.925+0000 7fc1427fc640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc13006aed0 0x7fc13006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:02.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.926+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc13c0abe80 con 0x7fc14c13e360 2023-11-24T08:02:02.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.926+0000 7fc151d45640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc13006aed0 0x7fc13006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:02.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.927+0000 7fc151d45640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc13006aed0 0x7fc13006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc14800a870 tx=0x7fc148008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:02.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:02.930+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc13c076d30 con 0x7fc14c13e360 2023-11-24T08:02:03.148 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.145+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp9990", "target": ["mon-mgr", ""]}) v1 -- 0x7fc14c0ce850 con 0x7fc13006aed0 2023-11-24T08:02:03.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.156+0000 7fc1427fc640 1 -- 172.21.15.161:0/1433481335 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc14800adf0 con 0x7fc13006aed0 2023-11-24T08:02:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc13006aed0 msgr2=0x7fc13006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc13006aed0 0x7fc13006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc14800a870 tx=0x7fc148008040 comp rx=0 tx=0).stop 2023-11-24T08:02:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 msgr2=0x7fc14c150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c150bd0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc13c0090b0 tx=0x7fc13c004730 comp rx=0 tx=0).stop 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 shutdown_connections 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc13006aed0 0x7fc13006d390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc14c15f9c0 0x7fc14c1f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc14c13e360 0x7fc14c150bd0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 --2- 172.21.15.161:0/1433481335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc14c13df80 0x7fc14c133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 >> 172.21.15.161:0/1433481335 conn(0x7fc14c06a800 msgr2=0x7fc14c15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 shutdown_connections 2023-11-24T08:02:03.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.159+0000 7fc153fa9640 1 -- 172.21.15.161:0/1433481335 wait complete. 2023-11-24T08:02:03.179 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:02:03.179 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:02:03.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:02:03.418 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:02:03.419 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:02:03.419 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:03.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:03.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.698+0000 7f0683b90640 1 Processor -- start 2023-11-24T08:02:03.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.698+0000 7f0683b90640 1 -- start start 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.699+0000 7f0683b90640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f067c13e360 0x7f067c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.699+0000 7f0683b90640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c15c5f0 con 0x7f067c13df80 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.699+0000 7f0683b90640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f067c06c470 con 0x7f067c15f9c0 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.699+0000 7f0683b90640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067c06c750 con 0x7f067c13e360 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068192c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f067c13df80 0x7f067c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34554/0 (socket says 172.21.15.161:34554) 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068192c640 1 -- 172.21.15.161:0/340306772 learned_addr learned my addr 172.21.15.161:0/340306772 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:03.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068112b640 1 --2- 172.21.15.161:0/340306772 >> v2:172.21.15.161:3300/0 conn(0x7f067c13e360 0x7f067c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:03.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068092a640 1 -- 172.21.15.161:0/340306772 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885712440 0 0) 0x7f067c15c5f0 con 0x7f067c13df80 2023-11-24T08:02:03.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068092a640 1 -- 172.21.15.161:0/340306772 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0668003520 con 0x7f067c13df80 2023-11-24T08:02:03.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068112b640 1 -- 172.21.15.161:0/340306772 >> v1:172.21.15.175:6789/0 conn(0x7f067c15f9c0 legacy=0x7f067c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:03.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068112b640 1 -- 172.21.15.161:0/340306772 >> v1:172.21.15.161:6789/0 conn(0x7f067c13df80 legacy=0x7f067c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.703 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.700+0000 7f068112b640 1 -- 172.21.15.161:0/340306772 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c06ca30 con 0x7f067c13e360 2023-11-24T08:02:03.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.701+0000 7f068112b640 1 --2- 172.21.15.161:0/340306772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0cf290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f066c0097a0 tx=0x7f066c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d5031afc2d830d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:03.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f068092a640 1 -- 172.21.15.161:0/340306772 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c031830 con 0x7f067c13e360 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f068092a640 1 -- 172.21.15.161:0/340306772 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c031990 con 0x7f067c13e360 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f068092a640 1 -- 172.21.15.161:0/340306772 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c031d20 con 0x7f067c13e360 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 -- 172.21.15.161:0/340306772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 msgr2=0x7f067c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 --2- 172.21.15.161:0/340306772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0cf290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f066c0097a0 tx=0x7f066c02b8d0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 -- 172.21.15.161:0/340306772 shutdown_connections 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 --2- 172.21.15.161:0/340306772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0cf290 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 -- 172.21.15.161:0/340306772 >> 172.21.15.161:0/340306772 conn(0x7f067c06a800 msgr2=0x7f067c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 -- 172.21.15.161:0/340306772 shutdown_connections 2023-11-24T08:02:03.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.702+0000 7f0683b90640 1 -- 172.21.15.161:0/340306772 wait complete. 2023-11-24T08:02:03.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.704+0000 7f0683b90640 1 Processor -- start 2023-11-24T08:02:03.706 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.704+0000 7f0683b90640 1 -- start start 2023-11-24T08:02:03.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f0683b90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f067c13df80 0x7f067c13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f0683b90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f0683b90640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c15f9c0 0x7f067c0b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f0683b90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0b1ca0 con 0x7f067c13e360 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f0683b90640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0b2500 con 0x7f067c15f9c0 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f0683b90640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067c0b40b0 con 0x7f067c13df80 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f068112b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f068112b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53306/0 (socket says 172.21.15.161:53306) 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.705+0000 7f068112b640 1 -- 172.21.15.161:0/1793998713 learned_addr learned my addr 172.21.15.161:0/1793998713 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068212d640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c15f9c0 0x7f067c0b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:03.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068192c640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f067c13df80 0x7f067c13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068112b640 1 -- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f067c13df80 msgr2=0x7f067c13a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068112b640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f067c13df80 0x7f067c13a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068112b640 1 -- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c15f9c0 msgr2=0x7f067c0b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068112b640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c15f9c0 0x7f067c0b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068112b640 1 -- 172.21.15.161:0/1793998713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c009400 con 0x7f067c13e360 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.706+0000 7f068112b640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0b3580 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f066c0098c0 tx=0x7f066c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.707+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c03a6f0 con 0x7f067c13e360 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.707+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066c03a870 con 0x7f067c13e360 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.707+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066c03ac20 con 0x7f067c13e360 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.707+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f067c0b1eb0 con 0x7f067c13e360 2023-11-24T08:02:03.710 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.707+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067c13ad00 con 0x7f067c13e360 2023-11-24T08:02:03.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.708+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f067c0b2670 con 0x7f067c13e360 2023-11-24T08:02:03.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.709+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f066c030380 con 0x7f067c13e360 2023-11-24T08:02:03.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.710+0000 7f06727fc640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f066006aed0 0x7f066006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:03.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.710+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f066c0ab070 con 0x7f067c13e360 2023-11-24T08:02:03.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.710+0000 7f068192c640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f066006aed0 0x7f066006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:03.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.711+0000 7f068192c640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f066006aed0 0x7f066006d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0678005880 tx=0x7f0678009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:03.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.714+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f066c0760b0 con 0x7f067c13e360 2023-11-24T08:02:03.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.908+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f067c0675d0 con 0x7f067c13e360 2023-11-24T08:02:03.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.910+0000 7f06727fc640 1 -- 172.21.15.161:0/1793998713 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f066c0796d0 con 0x7f067c13e360 2023-11-24T08:02:03.914 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:03.915 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:03.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.912+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f066006aed0 msgr2=0x7f066006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.912+0000 7f0683b90640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f066006aed0 0x7f066006d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0678005880 tx=0x7f0678009040 comp rx=0 tx=0).stop 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.912+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 msgr2=0x7f067c0b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.912+0000 7f0683b90640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0b3580 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f066c0098c0 tx=0x7f066c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 shutdown_connections 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f066006aed0 0x7f066006d390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f067c15f9c0 0x7f067c0b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f067c13e360 0x7f067c0b3580 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 --2- 172.21.15.161:0/1793998713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f067c13df80 0x7f067c13a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:03.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 >> 172.21.15.161:0/1793998713 conn(0x7f067c06a800 msgr2=0x7f067c0706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:03.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 shutdown_connections 2023-11-24T08:02:03.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:03.913+0000 7f0683b90640 1 -- 172.21.15.161:0/1793998713 wait complete. 2023-11-24T08:02:03.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:01:43.282420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:01:44.380572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:03.933 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:04.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.148+0000 7f7de8002640 1 Processor -- start 2023-11-24T08:02:04.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.148+0000 7f7de8002640 1 -- start start 2023-11-24T08:02:04.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de8002640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de00cd240 0x7f7de00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de8002640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de006cea0 con 0x7f7de006c6b0 2023-11-24T08:02:04.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de8002640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de006cbc0 con 0x7f7de009a170 2023-11-24T08:02:04.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de8002640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de006f350 con 0x7f7de00cd240 2023-11-24T08:02:04.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de5d9e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de00cd240 0x7f7de00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de5d9e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7de00cd240 0x7f7de00b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53316/0 (socket says 172.21.15.161:53316) 2023-11-24T08:02:04.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.150+0000 7f7de5d9e640 1 -- 172.21.15.161:0/4172259143 learned_addr learned my addr 172.21.15.161:0/4172259143 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.151+0000 7f7de5d9e640 1 -- 172.21.15.161:0/4172259143 >> v1:172.21.15.175:6789/0 conn(0x7f7de009a170 legacy=0x7f7de00cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.151+0000 7f7de5d9e640 1 -- 172.21.15.161:0/4172259143 >> v1:172.21.15.161:6789/0 conn(0x7f7de006c6b0 legacy=0x7f7de0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.151+0000 7f7de5d9e640 1 -- 172.21.15.161:0/4172259143 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de006f630 con 0x7f7de00cd240 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.152+0000 7f7de5d9e640 1 --2- 172.21.15.161:0/4172259143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00b3820 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009870 tx=0x7f7ddc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbfa3d6603e8bd5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.152+0000 7f7de4d9c640 1 -- 172.21.15.161:0/4172259143 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc030860 con 0x7f7de00cd240 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.152+0000 7f7de4d9c640 1 -- 172.21.15.161:0/4172259143 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0309c0 con 0x7f7de00cd240 2023-11-24T08:02:04.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.152+0000 7f7de4d9c640 1 -- 172.21.15.161:0/4172259143 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc030d50 con 0x7f7de00cd240 2023-11-24T08:02:04.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 -- 172.21.15.161:0/4172259143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 msgr2=0x7f7de00b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 --2- 172.21.15.161:0/4172259143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00b3820 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009870 tx=0x7f7ddc02b9a0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 -- 172.21.15.161:0/4172259143 shutdown_connections 2023-11-24T08:02:04.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 --2- 172.21.15.161:0/4172259143 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00b3820 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 -- 172.21.15.161:0/4172259143 >> 172.21.15.161:0/4172259143 conn(0x7f7de00b2d00 msgr2=0x7f7de00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:04.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 -- 172.21.15.161:0/4172259143 shutdown_connections 2023-11-24T08:02:04.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.153+0000 7f7de8002640 1 -- 172.21.15.161:0/4172259143 wait complete. 2023-11-24T08:02:04.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.155+0000 7f7de8002640 1 Processor -- start 2023-11-24T08:02:04.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.155+0000 7f7de8002640 1 -- start start 2023-11-24T08:02:04.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.156+0000 7f7de8002640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de006c6b0 0x7f7de01f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.156+0000 7f7de8002640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de009a170 0x7f7de00c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.156+0000 7f7de8002640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.156+0000 7f7de8002640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de0145c60 con 0x7f7de00cd240 2023-11-24T08:02:04.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.156+0000 7f7de8002640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de01f3290 con 0x7f7de006c6b0 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.156+0000 7f7de8002640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de015fe10 con 0x7f7de009a170 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53322/0 (socket says 172.21.15.161:53322) 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 -- 172.21.15.161:0/2158794283 learned_addr learned my addr 172.21.15.161:0/2158794283 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de5d9e640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de006c6b0 0x7f7de01f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de559d640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de009a170 0x7f7de00c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 -- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de009a170 msgr2=0x7f7de00c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de009a170 0x7f7de00c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 -- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de006c6b0 msgr2=0x7f7de01f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de006c6b0 0x7f7de01f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 -- 172.21.15.161:0/2158794283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc0094d0 con 0x7f7de00cd240 2023-11-24T08:02:04.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de5d9e640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de006c6b0 0x7f7de01f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:04.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.157+0000 7f7de659f640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00c5240 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c780 tx=0x7f7dd800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:04.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.158+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8003d80 con 0x7f7de00cd240 2023-11-24T08:02:04.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.158+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd800ce30 con 0x7f7de00cd240 2023-11-24T08:02:04.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.158+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de01600f0 con 0x7f7de00cd240 2023-11-24T08:02:04.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.158+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80052b0 con 0x7f7de00cd240 2023-11-24T08:02:04.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.158+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de01458f0 con 0x7f7de00cd240 2023-11-24T08:02:04.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.159+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de0073d90 con 0x7f7de00cd240 2023-11-24T08:02:04.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.160+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f7dd8005410 con 0x7f7de00cd240 2023-11-24T08:02:04.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.161+0000 7f7dd67fc640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7dc406aed0 0x7f7dc406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.161+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7dd8088fc0 con 0x7f7de00cd240 2023-11-24T08:02:04.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.162+0000 7f7de5d9e640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7dc406aed0 0x7f7dc406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.163+0000 7f7de5d9e640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7dc406aed0 0x7f7dc406d390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc036000 tx=0x7f7ddc03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:04.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.165+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7dd8053ef0 con 0x7f7de00cd240 2023-11-24T08:02:04.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.356+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7de00675d0 con 0x7f7de00cd240 2023-11-24T08:02:04.359 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.357+0000 7f7dd67fc640 1 -- 172.21.15.161:0/2158794283 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7dd8017030 con 0x7f7de00cd240 2023-11-24T08:02:04.359 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:04.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.359+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7dc406aed0 msgr2=0x7f7dc406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.359+0000 7f7de8002640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7dc406aed0 0x7f7dc406d390 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc036000 tx=0x7f7ddc03b040 comp rx=0 tx=0).stop 2023-11-24T08:02:04.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.359+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 msgr2=0x7f7de00c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.359+0000 7f7de8002640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00c5240 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c780 tx=0x7f7dd800cc40 comp rx=0 tx=0).stop 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 shutdown_connections 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7dc406aed0 0x7f7dc406d390 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7de00cd240 0x7f7de00c5240 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de009a170 0x7f7de00c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 --2- 172.21.15.161:0/2158794283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de006c6b0 0x7f7de01f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 >> 172.21.15.161:0/2158794283 conn(0x7f7de00b2d00 msgr2=0x7f7de00b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 shutdown_connections 2023-11-24T08:02:04.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.360+0000 7f7de8002640 1 -- 172.21.15.161:0/2158794283 wait complete. 2023-11-24T08:02:04.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:02:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.592+0000 7f0163fff640 1 Processor -- start 2023-11-24T08:02:04.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.592+0000 7f0163fff640 1 -- start start 2023-11-24T08:02:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f0163fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01640ccb50 0x7f0164070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f0163fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f016415bf10 0x7f0164143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f0163fff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016415f4e0 con 0x7f01640adf20 2023-11-24T08:02:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f0163fff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016415f970 con 0x7f01640ccb50 2023-11-24T08:02:04.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f0163fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016415c3c0 con 0x7f016415bf10 2023-11-24T08:02:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f01627fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01640ccb50 0x7f0164070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.594+0000 7f01637fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f016415bf10 0x7f0164143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f01637fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f016415bf10 0x7f0164143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:52018/0 (socket says 172.21.15.161:52018) 2023-11-24T08:02:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f01637fe640 1 -- 172.21.15.161:0/852850694 learned_addr learned my addr 172.21.15.161:0/852850694 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f0162ffd640 1 --1- 172.21.15.161:0/852850694 >> v1:172.21.15.175:6789/0 conn(0x7f01640adf20 0x7f01640cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:55728/0 (socket says 172.21.15.161:55728) 2023-11-24T08:02:04.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f01627fc640 1 -- 172.21.15.161:0/852850694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f016415bf10 msgr2=0x7f0164143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:04.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f01627fc640 1 --2- 172.21.15.161:0/852850694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f016415bf10 0x7f0164143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f01627fc640 1 -- 172.21.15.161:0/852850694 >> v1:172.21.15.175:6789/0 conn(0x7f01640adf20 legacy=0x7f01640cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.595+0000 7f01627fc640 1 -- 172.21.15.161:0/852850694 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0164071130 con 0x7f01640ccb50 2023-11-24T08:02:04.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.596+0000 7f01627fc640 1 --2- 172.21.15.161:0/852850694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640ccb50 0x7f0164070a30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390567b13fa08b99 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:04.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.596+0000 7f0161ffb640 1 -- 172.21.15.161:0/852850694 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158031780 con 0x7f01640ccb50 2023-11-24T08:02:04.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.596+0000 7f0161ffb640 1 -- 172.21.15.161:0/852850694 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01580318e0 con 0x7f01640ccb50 2023-11-24T08:02:04.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.596+0000 7f0161ffb640 1 -- 172.21.15.161:0/852850694 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158031c70 con 0x7f01640ccb50 2023-11-24T08:02:04.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 -- 172.21.15.161:0/852850694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640ccb50 msgr2=0x7f0164070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 --2- 172.21.15.161:0/852850694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640ccb50 0x7f0164070a30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f01580097a0 tx=0x7f015802b820 comp rx=0 tx=0).stop 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 -- 172.21.15.161:0/852850694 shutdown_connections 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 --2- 172.21.15.161:0/852850694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f016415bf10 0x7f0164143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 --2- 172.21.15.161:0/852850694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640ccb50 0x7f0164070a30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 -- 172.21.15.161:0/852850694 >> 172.21.15.161:0/852850694 conn(0x7f016406a7d0 msgr2=0x7f016406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 -- 172.21.15.161:0/852850694 shutdown_connections 2023-11-24T08:02:04.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.597+0000 7f0163fff640 1 -- 172.21.15.161:0/852850694 wait complete. 2023-11-24T08:02:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.599+0000 7f0163fff640 1 Processor -- start 2023-11-24T08:02:04.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.599+0000 7f0163fff640 1 -- start start 2023-11-24T08:02:04.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0163fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 0x7f01640cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0163fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01640ccb50 0x7f0164135fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0163fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016415bf10 0x7f01641f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0163fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01640cb200 con 0x7f01640adf20 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0163fff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01640b3040 con 0x7f016415bf10 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0163fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0164136510 con 0x7f01640ccb50 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0162ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 0x7f01640cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.600+0000 7f0162ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 0x7f01640cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53344/0 (socket says 172.21.15.161:53344) 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 -- 172.21.15.161:0/4232320610 learned_addr learned my addr 172.21.15.161:0/4232320610 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f01627fc640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01640ccb50 0x7f0164135fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f01637fe640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016415bf10 0x7f01641f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 -- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01640ccb50 msgr2=0x7f0164135fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01640ccb50 0x7f0164135fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 -- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016415bf10 msgr2=0x7f01641f6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016415bf10 0x7f01641f6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 -- 172.21.15.161:0/4232320610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0158009400 con 0x7f01640adf20 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f01637fe640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016415bf10 0x7f01641f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.601+0000 7f0162ffd640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 0x7f01640cacc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f015400c500 tx=0x7f015400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.602+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0154007500 con 0x7f01640adf20 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.602+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0154007660 con 0x7f01640adf20 2023-11-24T08:02:04.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.602+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01540049e0 con 0x7f01640adf20 2023-11-24T08:02:04.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.602+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01640b2430 con 0x7f01640adf20 2023-11-24T08:02:04.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.602+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01640b29f0 con 0x7f01640adf20 2023-11-24T08:02:04.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.603+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0164067450 con 0x7f01640adf20 2023-11-24T08:02:04.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.604+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f0154004c00 con 0x7f01640adf20 2023-11-24T08:02:04.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.605+0000 7f014bfff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f015006aed0 0x7f015006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:04.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.605+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01540887a0 con 0x7f01640adf20 2023-11-24T08:02:04.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.606+0000 7f01627fc640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f015006aed0 0x7f015006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:04.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.607+0000 7f01627fc640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f015006aed0 0x7f015006d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0158036000 tx=0x7f015803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:04.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.610+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01540538a0 con 0x7f01640adf20 2023-11-24T08:02:04.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.801+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0164067ce0 con 0x7f01640adf20 2023-11-24T08:02:04.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.801+0000 7f014bfff640 1 -- 172.21.15.161:0/4232320610 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0154056ec0 con 0x7f01640adf20 2023-11-24T08:02:04.804 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:02:04.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f015006aed0 msgr2=0x7f015006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f015006aed0 0x7f015006d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0158036000 tx=0x7f015803d040 comp rx=0 tx=0).stop 2023-11-24T08:02:04.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 msgr2=0x7f01640cacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:04.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 0x7f01640cacc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f015400c500 tx=0x7f015400c9c0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 shutdown_connections 2023-11-24T08:02:04.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f015006aed0 0x7f015006d390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f016415bf10 0x7f01641f6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01640ccb50 0x7f0164135fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 --2- 172.21.15.161:0/4232320610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01640adf20 0x7f01640cacc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 >> 172.21.15.161:0/4232320610 conn(0x7f016406a7d0 msgr2=0x7f01640713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 shutdown_connections 2023-11-24T08:02:04.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:04.804+0000 7f0163fff640 1 -- 172.21.15.161:0/4232320610 wait complete. 2023-11-24T08:02:04.824 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:02:05.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.031+0000 7f0fba7a5640 1 Processor -- start 2023-11-24T08:02:05.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.031+0000 7f0fba7a5640 1 -- start start 2023-11-24T08:02:05.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.033+0000 7f0fba7a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 0x7f0fb40b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.033+0000 7f0fba7a5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40d1c60 con 0x7f0fb415d4b0 2023-11-24T08:02:05.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.033+0000 7f0fba7a5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40b2730 con 0x7f0fb40cf9a0 2023-11-24T08:02:05.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.033+0000 7f0fba7a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40d1ec0 con 0x7f0fb40cfde0 2023-11-24T08:02:05.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.033+0000 7f0fb97a3640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0fb415d4b0 0x7f0fb40d1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34570/0 (socket says 172.21.15.161:34570) 2023-11-24T08:02:05.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.033+0000 7f0fb97a3640 1 -- 172.21.15.161:0/2040958061 learned_addr learned my addr 172.21.15.161:0/2040958061 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:05.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fb9fa4640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 0x7f0fb40b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362601462 0 0) 0x7f0fb40d1c60 con 0x7f0fb415d4b0 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f9c003520 con 0x7f0fb415d4b0 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 234243932 0 0) 0x7f0f9c003520 con 0x7f0fb415d4b0 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 msgr2=0x7f0fb40b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 0x7f0fb40b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 >> v1:172.21.15.175:6789/0 conn(0x7f0fb40cf9a0 legacy=0x7f0fb40b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40b29d0 con 0x7f0fb415d4b0 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0fa4001670 con 0x7f0fb415d4b0 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 >> v1:172.21.15.161:6789/0 conn(0x7f0fb415d4b0 legacy=0x7f0fb40d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0039a0 0x7f0f9c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0f9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 0x7f0f9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40d1ec0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c00ba90 con 0x7f0f9c0039a0 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.034+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c00bc50 con 0x7f0fb40cfde0 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0f9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb97a3640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0039a0 0x7f0f9c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb9fa4640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 0x7f0f9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb8fa2640 1 -- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 msgr2=0x7f0f9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb40cfde0 0x7f0f9c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb8fa2640 1 -- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0039a0 msgr2=0x7f0f9c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:05.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f9c0039a0 0x7f0f9c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.035+0000 7f0fb8fa2640 1 -- 172.21.15.161:0/2040958061 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c003520 con 0x7f0f9c0047c0 2023-11-24T08:02:05.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.036+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0f9c004c40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001720 tx=0x7f0f9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28809893837e929 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:05.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.036+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00052d0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.036+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb002e050 con 0x7f0f9c0047c0 2023-11-24T08:02:05.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.036+0000 7f0fabfff640 1 -- 172.21.15.161:0/2040958061 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00035f0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fba7a5640 1 -- 172.21.15.161:0/2040958061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 msgr2=0x7f0f9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/2040958061 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0f9c004c40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0001720 tx=0x7f0f9c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fb9fa4640 1 -- 172.21.15.161:0/2040958061 reap_dead start 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fba7a5640 1 -- 172.21.15.161:0/2040958061 shutdown_connections 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fba7a5640 1 -- 172.21.15.161:0/2040958061 >> 172.21.15.161:0/2040958061 conn(0x7f0fb40d3000 msgr2=0x7f0fb40d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fba7a5640 1 -- 172.21.15.161:0/2040958061 shutdown_connections 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.037+0000 7f0fba7a5640 1 -- 172.21.15.161:0/2040958061 wait complete. 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.039+0000 7f0fba7a5640 1 Processor -- start 2023-11-24T08:02:05.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.039+0000 7f0fba7a5640 1 -- start start 2023-11-24T08:02:05.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fba7a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0fb41f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fba7a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb409cce0 0x7f0fb40cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fba7a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb409d160 0x7f0fb40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fba7a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb409e340 con 0x7f0f9c0047c0 2023-11-24T08:02:05.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fba7a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb409d730 con 0x7f0fb409d160 2023-11-24T08:02:05.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fba7a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb409da10 con 0x7f0fb409cce0 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fb97a3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0fb41f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fb97a3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0fb41f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53374/0 (socket says 172.21.15.161:53374) 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.040+0000 7f0fb97a3640 1 -- 172.21.15.161:0/1278864169 learned_addr learned my addr 172.21.15.161:0/1278864169 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb409cce0 0x7f0fb40cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb97a3640 1 -- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb409cce0 msgr2=0x7f0fb40cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb97a3640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb409cce0 0x7f0fb40cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb97a3640 1 -- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb409d160 msgr2=0x7f0fb40cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb97a3640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb409d160 0x7f0fb40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb97a3640 1 -- 172.21.15.161:0/1278864169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb409dcf0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fb97a3640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0fb41f2b40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e730 tx=0x7f0fa400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:05.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400c640 con 0x7f0f9c0047c0 2023-11-24T08:02:05.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400c7a0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400cb50 con 0x7f0f9c0047c0 2023-11-24T08:02:05.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb409dfd0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.041+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb4157b10 con 0x7f0f9c0047c0 2023-11-24T08:02:05.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.043+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb40b16c0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.044+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f0fa401d460 con 0x7f0f9c0047c0 2023-11-24T08:02:05.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.044+0000 7f0fa9ffb640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006aed0 0x7f0fa006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.045+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fa4089700 con 0x7f0f9c0047c0 2023-11-24T08:02:05.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.045+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006aed0 0x7f0fa006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.046+0000 7f0fb8fa2640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006aed0 0x7f0fa006d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0033000 tx=0x7f0fb0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:05.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.050+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0fa40547d0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.245+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fb4067450 con 0x7f0f9c0047c0 2023-11-24T08:02:05.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.246+0000 7f0fa9ffb640 1 -- 172.21.15.161:0/1278864169 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fa4057df0 con 0x7f0f9c0047c0 2023-11-24T08:02:05.248 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:02:05.250 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.248+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006aed0 msgr2=0x7f0fa006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.248+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006aed0 0x7f0fa006d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0033000 tx=0x7f0fb0009030 comp rx=0 tx=0).stop 2023-11-24T08:02:05.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.248+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 msgr2=0x7f0fb41f2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.248+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0fb41f2b40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e730 tx=0x7f0fa400ebf0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 shutdown_connections 2023-11-24T08:02:05.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0fa006aed0 0x7f0fa006d390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0fb409d160 0x7f0fb40cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0fb409cce0 0x7f0fb40cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 --2- 172.21.15.161:0/1278864169 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f9c0047c0 0x7f0fb41f2b40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 >> 172.21.15.161:0/1278864169 conn(0x7f0fb40d3000 msgr2=0x7f0fb40b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:05.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 shutdown_connections 2023-11-24T08:02:05.253 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.249+0000 7f0fba7a5640 1 -- 172.21.15.161:0/1278864169 wait complete. 2023-11-24T08:02:05.270 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:02:05.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.484+0000 7f31ee597640 1 Processor -- start 2023-11-24T08:02:05.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.484+0000 7f31ee597640 1 -- start start 2023-11-24T08:02:05.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.486+0000 7f31ee597640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 0x7f31e815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.486+0000 7f31ee597640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e8070c40 con 0x7f31e80ae5a0 2023-11-24T08:02:05.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.486+0000 7f31ee597640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e806c470 con 0x7f31e80b3ae0 2023-11-24T08:02:05.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.486+0000 7f31ee597640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8071450 con 0x7f31e80cf9a0 2023-11-24T08:02:05.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.486+0000 7f31e7fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f31e80ae5a0 0x7f31e806cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34584/0 (socket says 172.21.15.161:34584) 2023-11-24T08:02:05.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.486+0000 7f31e7fff640 1 -- 172.21.15.161:0/1985784981 learned_addr learned my addr 172.21.15.161:0/1985784981 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31ecb34640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 0x7f31e815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453452369 0 0) 0x7f31e8070c40 con 0x7f31e80ae5a0 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d4003520 con 0x7f31e80ae5a0 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2609393184 0 0) 0x7f31d4003520 con 0x7f31e80ae5a0 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 msgr2=0x7f31e815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 0x7f31e815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 >> v1:172.21.15.175:6789/0 conn(0x7f31e80b3ae0 legacy=0x7f31e80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e806c750 con 0x7f31e80ae5a0 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f31d8001670 con 0x7f31e80ae5a0 2023-11-24T08:02:05.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 >> v1:172.21.15.161:6789/0 conn(0x7f31e80ae5a0 legacy=0x7f31e806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.487+0000 7f31e77fe640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d40039a0 0x7f31d4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31e77fe640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31d4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31e77fe640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 0x7f31d4005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8071450 con 0x7f31d4004350 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d400b9b0 con 0x7f31d40039a0 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d400bb70 con 0x7f31e80cf9a0 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31dffff640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31d4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31e7fff640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d40039a0 0x7f31d4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31dffff640 1 -- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 msgr2=0x7f31d4005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31dffff640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e80cf9a0 0x7f31d4005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31dffff640 1 -- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d40039a0 msgr2=0x7f31d4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:05.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31dffff640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31d40039a0 0x7f31d4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.488+0000 7f31dffff640 1 -- 172.21.15.161:0/1985784981 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4003520 con 0x7f31d4004350 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.489+0000 7f31dffff640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31d4004820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f31d0001860 tx=0x7f31d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885b78f9b95afc08 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0033410 con 0x7f31d4004350 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d0033590 con 0x7f31d4004350 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31e77fe640 1 -- 172.21.15.161:0/1985784981 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d0033940 con 0x7f31d4004350 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ee597640 1 -- 172.21.15.161:0/1985784981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 msgr2=0x7f31d4004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ee597640 1 --2- 172.21.15.161:0/1985784981 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31d4004820 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f31d0001860 tx=0x7f31d40057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ecb34640 1 -- 172.21.15.161:0/1985784981 reap_dead start 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ee597640 1 -- 172.21.15.161:0/1985784981 shutdown_connections 2023-11-24T08:02:05.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ee597640 1 -- 172.21.15.161:0/1985784981 >> 172.21.15.161:0/1985784981 conn(0x7f31e806a800 msgr2=0x7f31e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:05.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ee597640 1 -- 172.21.15.161:0/1985784981 shutdown_connections 2023-11-24T08:02:05.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.490+0000 7f31ee597640 1 -- 172.21.15.161:0/1985784981 wait complete. 2023-11-24T08:02:05.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.492+0000 7f31ee597640 1 Processor -- start 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.492+0000 7f31ee597640 1 -- start start 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31ee597640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31e8156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31ee597640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e8158e00 0x7f31e80c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31ee597640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8157b90 0x7f31e80cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31ee597640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e815bdd0 con 0x7f31d4004350 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31ee597640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e815b4c0 con 0x7f31e8157b90 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31ee597640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e8157130 con 0x7f31e8158e00 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31e8156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31e7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31e8156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53392/0 (socket says 172.21.15.161:53392) 2023-11-24T08:02:05.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.493+0000 7f31e7fff640 1 -- 172.21.15.161:0/2291159744 learned_addr learned my addr 172.21.15.161:0/2291159744 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31ecb34640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8157b90 0x7f31e80cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31dffff640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e8158e00 0x7f31e80c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e7fff640 1 -- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e8158e00 msgr2=0x7f31e80c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e7fff640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e8158e00 0x7f31e80c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e7fff640 1 -- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8157b90 msgr2=0x7f31e80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e7fff640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8157b90 0x7f31e80cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e7fff640 1 -- 172.21.15.161:0/2291159744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80c4390 con 0x7f31d4004350 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e7fff640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31e8156bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e810 tx=0x7f31d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800c8d0 con 0x7f31d4004350 2023-11-24T08:02:05.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800ca50 con 0x7f31d4004350 2023-11-24T08:02:05.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800ce00 con 0x7f31d4004350 2023-11-24T08:02:05.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.494+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e8159370 con 0x7f31d4004350 2023-11-24T08:02:05.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.495+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e815b9f0 con 0x7f31d4004350 2023-11-24T08:02:05.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.496+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e80675d0 con 0x7f31d4004350 2023-11-24T08:02:05.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.497+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 6) v1 ==== 89282+0+0 (secure 0 0 0) 0x7f31d8012380 con 0x7f31d4004350 2023-11-24T08:02:05.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.498+0000 7f31e57fa640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31c806af00 0x7f31c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:05.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.498+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31d8088d90 con 0x7f31d4004350 2023-11-24T08:02:05.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.498+0000 7f31dffff640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31c806af00 0x7f31c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:05.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.499+0000 7f31dffff640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31c806af00 0x7f31c806d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31d0035000 tx=0x7f31d0009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:05.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.502+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31d8053ee0 con 0x7f31d4004350 2023-11-24T08:02:05.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.516+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f31d80542b0 con 0x7f31d4004350 2023-11-24T08:02:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.711+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31e815afa0 con 0x7f31d4004350 2023-11-24T08:02:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.712+0000 7f31e57fa640 1 -- 172.21.15.161:0/2291159744 <== mon.0 v2:172.21.15.161:3300/0 8 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31d8019020 con 0x7f31d4004350 2023-11-24T08:02:05.714 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:02:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31c806af00 msgr2=0x7f31c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31c806af00 0x7f31c806d3c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31d0035000 tx=0x7f31d0009030 comp rx=0 tx=0).stop 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 msgr2=0x7f31e8156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31e8156bf0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e810 tx=0x7f31d800ecd0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 shutdown_connections 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31c806af00 0x7f31c806d3c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31e8157b90 0x7f31e80cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31e8158e00 0x7f31e80c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 --2- 172.21.15.161:0/2291159744 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31d4004350 0x7f31e8156bf0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 >> 172.21.15.161:0/2291159744 conn(0x7f31e806a800 msgr2=0x7f31e80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 shutdown_connections 2023-11-24T08:02:05.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:05.715+0000 7f31ee597640 1 -- 172.21.15.161:0/2291159744 wait complete. 2023-11-24T08:02:05.736 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2023-11-24T08:02:05.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:05.736 DEBUG:teuthology.orchestra.run.smithi161:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:05.813 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[101730]: fuse finished with error 0 and tester_r 0 2023-11-24T08:02:05.818 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:02:05.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:05.818 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:02:05.926 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:02:05.926 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:05.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:06.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.152+0000 7f9a82d8a640 1 Processor -- start 2023-11-24T08:02:06.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.152+0000 7f9a82d8a640 1 -- start start 2023-11-24T08:02:06.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.154+0000 7f9a82d8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 0x7f9a7c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.154+0000 7f9a82d8a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a7c13e360 0x7f9a7c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.154+0000 7f9a82d8a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c06c470 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.154+0000 7f9a82d8a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c06c750 con 0x7f9a7c13e360 2023-11-24T08:02:06.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.154+0000 7f9a82d8a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c06ca30 con 0x7f9a7c13df80 2023-11-24T08:02:06.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a80b26640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 0x7f9a7c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a80b26640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 0x7f9a7c15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:52096/0 (socket says 172.21.15.161:52096) 2023-11-24T08:02:06.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a80b26640 1 -- 172.21.15.161:0/3180585598 learned_addr learned my addr 172.21.15.161:0/3180585598 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:06.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a7bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9a7c13e360 0x7f9a7c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a7bfff640 1 -- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 msgr2=0x7f9a7c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:06.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a7bfff640 1 --2- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 0x7f9a7c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a7bfff640 1 -- 172.21.15.161:0/3180585598 >> v1:172.21.15.175:6789/0 conn(0x7f9a7c15f9c0 legacy=0x7f9a7c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a7bfff640 1 -- 172.21.15.161:0/3180585598 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c06cd10 con 0x7f9a7c13e360 2023-11-24T08:02:06.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.155+0000 7f9a80b26640 1 --2- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 0x7f9a7c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:02:06.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.157+0000 7f9a7bfff640 1 --2- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13e360 0x7f9a7c0cf290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a680097a0 tx=0x7f9a6802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5cd7a88131cc12b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:06.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a7b7fe640 1 -- 172.21.15.161:0/3180585598 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6802d040 con 0x7f9a7c13e360 2023-11-24T08:02:06.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a7b7fe640 1 -- 172.21.15.161:0/3180585598 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a68031810 con 0x7f9a7c13e360 2023-11-24T08:02:06.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a7b7fe640 1 -- 172.21.15.161:0/3180585598 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68031ba0 con 0x7f9a7c13e360 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 -- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13e360 msgr2=0x7f9a7c0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13e360 0x7f9a7c0cf290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a680097a0 tx=0x7f9a6802b8b0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 -- 172.21.15.161:0/3180585598 shutdown_connections 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13e360 0x7f9a7c0cf290 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/3180585598 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13df80 0x7f9a7c15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 -- 172.21.15.161:0/3180585598 >> 172.21.15.161:0/3180585598 conn(0x7f9a7c06a800 msgr2=0x7f9a7c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.158+0000 7f9a82d8a640 1 -- 172.21.15.161:0/3180585598 shutdown_connections 2023-11-24T08:02:06.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.159+0000 7f9a82d8a640 1 -- 172.21.15.161:0/3180585598 wait complete. 2023-11-24T08:02:06.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.160+0000 7f9a82d8a640 1 Processor -- start 2023-11-24T08:02:06.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.160+0000 7f9a82d8a640 1 -- start start 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.161+0000 7f9a82d8a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13df80 0x7f9a7c13ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.161+0000 7f9a82d8a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13e360 0x7f9a7c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.161+0000 7f9a82d8a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 0x7f9a7c1f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.161+0000 7f9a82d8a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c14bda0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.161+0000 7f9a82d8a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c14c080 con 0x7f9a7c13df80 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.161+0000 7f9a82d8a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c14c360 con 0x7f9a7c13e360 2023-11-24T08:02:06.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 0x7f9a7c1f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 0x7f9a7c1f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53404/0 (socket says 172.21.15.161:53404) 2023-11-24T08:02:06.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 -- 172.21.15.161:0/502540994 learned_addr learned my addr 172.21.15.161:0/502540994 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:06.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a80b26640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13df80 0x7f9a7c13ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a7bfff640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13e360 0x7f9a7c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 -- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13e360 msgr2=0x7f9a7c150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13e360 0x7f9a7c150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 -- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13df80 msgr2=0x7f9a7c13ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13df80 0x7f9a7c13ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 -- 172.21.15.161:0/502540994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a700094d0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a80b26640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13df80 0x7f9a7c13ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.162+0000 7f9a81327640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 0x7f9a7c1f10a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c7a0 tx=0x7f9a7400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.163+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74003b70 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.163+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74003cf0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.163+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a68009400 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.163+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74003ea0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.163+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c14c920 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.164+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c0675d0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.165+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9a7400aa90 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.166+0000 7f9a797fa640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a6006b020 0x7f9a6006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.166+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a740896c0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.166+0000 7f9a80b26640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a6006b020 0x7f9a6006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.167+0000 7f9a80b26640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a6006b020 0x7f9a6006d4e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009bb0 tx=0x7f9a70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:06.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.170+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a74054580 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.361+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a7c06dee0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.363+0000 7f9a797fa640 1 -- 172.21.15.161:0/502540994 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f9a74057ba0 con 0x7f9a7c15f9c0 2023-11-24T08:02:06.365 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:06.366 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:06.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a6006b020 msgr2=0x7f9a6006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a6006b020 0x7f9a6006d4e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009bb0 tx=0x7f9a70008040 comp rx=0 tx=0).stop 2023-11-24T08:02:06.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 msgr2=0x7f9a7c1f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 0x7f9a7c1f10a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c7a0 tx=0x7f9a7400cc60 comp rx=0 tx=0).stop 2023-11-24T08:02:06.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 shutdown_connections 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a6006b020 0x7f9a6006d4e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a7c15f9c0 0x7f9a7c1f10a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a7c13e360 0x7f9a7c150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 --2- 172.21.15.161:0/502540994 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a7c13df80 0x7f9a7c13ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 >> 172.21.15.161:0/502540994 conn(0x7f9a7c06a800 msgr2=0x7f9a7c153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 shutdown_connections 2023-11-24T08:02:06.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.365+0000 7f9a82d8a640 1 -- 172.21.15.161:0/502540994 wait complete. 2023-11-24T08:02:06.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:01:43.282420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:01:44.380572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:06.387 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:06.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.609+0000 7fd7c9ab4640 1 Processor -- start 2023-11-24T08:02:06.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.609+0000 7fd7c9ab4640 1 -- start start 2023-11-24T08:02:06.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c9ab4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 0x7fd7c4164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c9ab4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40b1ee0 con 0x7fd7c4143ae0 2023-11-24T08:02:06.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c9ab4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7c40b2780 con 0x7fd7c40cf9a0 2023-11-24T08:02:06.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c9ab4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c415e990 con 0x7fd7c415e3b0 2023-11-24T08:02:06.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c37fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd7c4143ae0 0x7fd7c40cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34586/0 (socket says 172.21.15.161:34586) 2023-11-24T08:02:06.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c37fe640 1 -- 172.21.15.161:0/3663974725 learned_addr learned my addr 172.21.15.161:0/3663974725 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:06.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c3fff640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 0x7fd7c4164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.611+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241061484 0 0) 0x7fd7c40b1ee0 con 0x7fd7c4143ae0 2023-11-24T08:02:06.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b0003520 con 0x7fd7c4143ae0 2023-11-24T08:02:06.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2220146434 0 0) 0x7fd7b0003520 con 0x7fd7c4143ae0 2023-11-24T08:02:06.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 msgr2=0x7fd7c4164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:06.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 0x7fd7c4164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 >> v1:172.21.15.175:6789/0 conn(0x7fd7c40cf9a0 legacy=0x7fd7c415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c40b2130 con 0x7fd7c4143ae0 2023-11-24T08:02:06.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fd7b4001670 con 0x7fd7c4143ae0 2023-11-24T08:02:06.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 >> v1:172.21.15.161:6789/0 conn(0x7fd7c4143ae0 legacy=0x7fd7c40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 0x7fd7b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7b0004d00 0x7fd7b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c415e990 con 0x7fd7b0003f20 2023-11-24T08:02:06.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b000ba60 con 0x7fd7b0004d00 2023-11-24T08:02:06.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b000de30 con 0x7fd7c415e3b0 2023-11-24T08:02:06.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.612+0000 7fd7bbfff640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7c37fe640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 0x7fd7b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7c3fff640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7b0004d00 0x7fd7b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7bbfff640 1 -- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 msgr2=0x7fd7b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:06.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7bbfff640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415e3b0 0x7fd7b00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7bbfff640 1 -- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7b0004d00 msgr2=0x7fd7b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:06.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7bbfff640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7b0004d00 0x7fd7b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.613+0000 7fd7bbfff640 1 -- 172.21.15.161:0/3663974725 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b0003520 con 0x7fd7b0003f20 2023-11-24T08:02:06.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.614+0000 7fd7bbfff640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7b00047c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001750 tx=0x7fd7b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29730fc45c54ca1e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:06.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.614+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0052d0 con 0x7fd7b0003f20 2023-11-24T08:02:06.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.614+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac02e050 con 0x7fd7b0003f20 2023-11-24T08:02:06.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.614+0000 7fd7c2ffd640 1 -- 172.21.15.161:0/3663974725 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac003830 con 0x7fd7b0003f20 2023-11-24T08:02:06.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/3663974725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 msgr2=0x7fd7b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/3663974725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7b00047c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac001750 tx=0x7fd7b00057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c3fff640 1 -- 172.21.15.161:0/3663974725 reap_dead start 2023-11-24T08:02:06.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/3663974725 shutdown_connections 2023-11-24T08:02:06.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/3663974725 >> 172.21.15.161:0/3663974725 conn(0x7fd7c406a800 msgr2=0x7fd7c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:06.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/3663974725 shutdown_connections 2023-11-24T08:02:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.615+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/3663974725 wait complete. 2023-11-24T08:02:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.617+0000 7fd7c9ab4640 1 Processor -- start 2023-11-24T08:02:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.617+0000 7fd7c9ab4640 1 -- start start 2023-11-24T08:02:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c9ab4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7c415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c9ab4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c413d890 0x7fd7c4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c9ab4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415ce10 0x7fd7c415d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c9ab4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c415c980 con 0x7fd7b0003f20 2023-11-24T08:02:06.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c9ab4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c415bd70 con 0x7fd7c413d890 2023-11-24T08:02:06.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c9ab4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c415c050 con 0x7fd7c415ce10 2023-11-24T08:02:06.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7c415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7c415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53420/0 (socket says 172.21.15.161:53420) 2023-11-24T08:02:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.618+0000 7fd7c37fe640 1 -- 172.21.15.161:0/663241764 learned_addr learned my addr 172.21.15.161:0/663241764 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c37fe640 1 -- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415ce10 msgr2=0x7fd7c415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c37fe640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415ce10 0x7fd7c415d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c37fe640 1 -- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c413d890 msgr2=0x7fd7c4159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c37fe640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c413d890 0x7fd7c4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c37fe640 1 -- 172.21.15.161:0/663241764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c415c330 con 0x7fd7b0003f20 2023-11-24T08:02:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c37fe640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7c415b790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400e7f0 tx=0x7fd7b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400eea0 con 0x7fd7b0003f20 2023-11-24T08:02:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b400c7f0 con 0x7fd7b0003f20 2023-11-24T08:02:06.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b400cb60 con 0x7fd7b0003f20 2023-11-24T08:02:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c415c610 con 0x7fd7b0003f20 2023-11-24T08:02:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.619+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c413dd10 con 0x7fd7b0003f20 2023-11-24T08:02:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.621+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c406c3f0 con 0x7fd7b0003f20 2023-11-24T08:02:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.621+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd7b400ccc0 con 0x7fd7b0003f20 2023-11-24T08:02:06.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.622+0000 7fd7c0ff9640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd7a406b020 0x7fd7a406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:06.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.622+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7b4089890 con 0x7fd7b0003f20 2023-11-24T08:02:06.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.623+0000 7fd7bbfff640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd7a406b020 0x7fd7a406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.624+0000 7fd7bbfff640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd7a406b020 0x7fd7a406d4e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac033000 tx=0x7fd7ac02f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:06.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.627+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7b4054620 con 0x7fd7b0003f20 2023-11-24T08:02:06.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.818+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7c40675d0 con 0x7fd7b0003f20 2023-11-24T08:02:06.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.819+0000 7fd7c0ff9640 1 -- 172.21.15.161:0/663241764 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7b405e020 con 0x7fd7b0003f20 2023-11-24T08:02:06.821 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:06.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.821+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd7a406b020 msgr2=0x7fd7a406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.821+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd7a406b020 0x7fd7a406d4e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac033000 tx=0x7fd7ac02f000 comp rx=0 tx=0).stop 2023-11-24T08:02:06.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.821+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 msgr2=0x7fd7c415b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.821+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7c415b790 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400e7f0 tx=0x7fd7b400ecb0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 shutdown_connections 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd7a406b020 0x7fd7a406d4e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7c415ce10 0x7fd7c415d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7c413d890 0x7fd7c4159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 --2- 172.21.15.161:0/663241764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7b0003f20 0x7fd7c415b790 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 >> 172.21.15.161:0/663241764 conn(0x7fd7c406a800 msgr2=0x7fd7c40aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 shutdown_connections 2023-11-24T08:02:06.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:06.822+0000 7fd7c9ab4640 1 -- 172.21.15.161:0/663241764 wait complete. 2023-11-24T08:02:06.842 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:02:07.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.057+0000 7faecc305640 1 Processor -- start 2023-11-24T08:02:07.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.058+0000 7faecc305640 1 -- start start 2023-11-24T08:02:07.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.059+0000 7faecc305640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faec406aaf0 0x7faec40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.059+0000 7faecc305640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec40cfcc0 con 0x7faec4144c60 2023-11-24T08:02:07.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.059+0000 7faecc305640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec4071a20 con 0x7faec40cc940 2023-11-24T08:02:07.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.059+0000 7faecc305640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec40ccd80 con 0x7faec406aaf0 2023-11-24T08:02:07.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.059+0000 7faeca0a1640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faec4144c60 0x7faec406e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34596/0 (socket says 172.21.15.161:34596) 2023-11-24T08:02:07.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.059+0000 7faeca0a1640 1 -- 172.21.15.161:0/960007214 learned_addr learned my addr 172.21.15.161:0/960007214 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:07.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.060+0000 7faeca8a2640 1 --2- 172.21.15.161:0/960007214 >> v2:172.21.15.161:3300/0 conn(0x7faec406aaf0 0x7faec40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.060+0000 7faec909f640 1 -- 172.21.15.161:0/960007214 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313457241 0 0) 0x7faec0001110 con 0x7faec4144c60 2023-11-24T08:02:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.060+0000 7faec909f640 1 -- 172.21.15.161:0/960007214 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb0003520 con 0x7faec4144c60 2023-11-24T08:02:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.060+0000 7faeca8a2640 1 -- 172.21.15.161:0/960007214 >> v1:172.21.15.175:6789/0 conn(0x7faec40cc940 legacy=0x7faec406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.060+0000 7faeca8a2640 1 -- 172.21.15.161:0/960007214 >> v1:172.21.15.161:6789/0 conn(0x7faec4144c60 legacy=0x7faec406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.060+0000 7faeca8a2640 1 -- 172.21.15.161:0/960007214 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec406eef0 con 0x7faec406aaf0 2023-11-24T08:02:07.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.061+0000 7faeca8a2640 1 --2- 172.21.15.161:0/960007214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec40cf780 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faebc009d90 tx=0x7faebc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4130beccc9f8601 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.061+0000 7faec909f640 1 -- 172.21.15.161:0/960007214 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc02cc60 con 0x7faec406aaf0 2023-11-24T08:02:07.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.061+0000 7faec909f640 1 -- 172.21.15.161:0/960007214 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc02cdc0 con 0x7faec406aaf0 2023-11-24T08:02:07.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.061+0000 7faec909f640 1 -- 172.21.15.161:0/960007214 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc034660 con 0x7faec406aaf0 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 -- 172.21.15.161:0/960007214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 msgr2=0x7faec40cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 --2- 172.21.15.161:0/960007214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec40cf780 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faebc009d90 tx=0x7faebc02beb0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 -- 172.21.15.161:0/960007214 shutdown_connections 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 --2- 172.21.15.161:0/960007214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec40cf780 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 -- 172.21.15.161:0/960007214 >> 172.21.15.161:0/960007214 conn(0x7faec40cfef0 msgr2=0x7faec40d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 -- 172.21.15.161:0/960007214 shutdown_connections 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.062+0000 7faecc305640 1 -- 172.21.15.161:0/960007214 wait complete. 2023-11-24T08:02:07.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.064+0000 7faecc305640 1 Processor -- start 2023-11-24T08:02:07.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.064+0000 7faecc305640 1 -- start start 2023-11-24T08:02:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faecc305640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec4138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faecc305640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec40cc940 0x7faec40cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faecc305640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec4144c60 0x7faec413cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faecc305640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec41f34a0 con 0x7faec406aaf0 2023-11-24T08:02:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faecc305640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec40cbc30 con 0x7faec40cc940 2023-11-24T08:02:07.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faecc305640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec4141790 con 0x7faec4144c60 2023-11-24T08:02:07.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faeca0a1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec4138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faeca0a1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec4138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53440/0 (socket says 172.21.15.161:53440) 2023-11-24T08:02:07.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.065+0000 7faeca0a1640 1 -- 172.21.15.161:0/3196359538 learned_addr learned my addr 172.21.15.161:0/3196359538 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faec98a0640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec40cc940 0x7faec40cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faeca0a1640 1 -- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec4144c60 msgr2=0x7faec413cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faeca0a1640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec4144c60 0x7faec413cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faeca0a1640 1 -- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec40cc940 msgr2=0x7faec40cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faeca0a1640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec40cc940 0x7faec40cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faeca0a1640 1 -- 172.21.15.161:0/3196359538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc009a70 con 0x7faec406aaf0 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faeca0a1640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec4138a10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faec000c420 tx=0x7faec000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0005ce0 con 0x7faec406aaf0 2023-11-24T08:02:07.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0005e40 con 0x7faec406aaf0 2023-11-24T08:02:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00072f0 con 0x7faec406aaf0 2023-11-24T08:02:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec4141a70 con 0x7faec406aaf0 2023-11-24T08:02:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.066+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec4142030 con 0x7faec406aaf0 2023-11-24T08:02:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.067+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec40675d0 con 0x7faec406aaf0 2023-11-24T08:02:07.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.068+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faec0007510 con 0x7faec406aaf0 2023-11-24T08:02:07.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.069+0000 7faebaffd640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faea806aff0 0x7faea806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.069+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faec0088dd0 con 0x7faec406aaf0 2023-11-24T08:02:07.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.070+0000 7faec98a0640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faea806aff0 0x7faea806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.071+0000 7faec98a0640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faea806aff0 0x7faea806d4b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faec40cc1b0 tx=0x7faeb4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.073+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faec0053bf0 con 0x7faec406aaf0 2023-11-24T08:02:07.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.269+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faec40cfcc0 con 0x7faec406aaf0 2023-11-24T08:02:07.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.270+0000 7faebaffd640 1 -- 172.21.15.161:0/3196359538 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7faec40cfcc0 con 0x7faec406aaf0 2023-11-24T08:02:07.272 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:02:07.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faea806aff0 msgr2=0x7faea806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faea806aff0 0x7faea806d4b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faec40cc1b0 tx=0x7faeb4009040 comp rx=0 tx=0).stop 2023-11-24T08:02:07.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 msgr2=0x7faec4138a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec4138a10 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faec000c420 tx=0x7faec000c8e0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 shutdown_connections 2023-11-24T08:02:07.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faea806aff0 0x7faea806d4b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.272+0000 7faecc305640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faec4144c60 0x7faec413cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.273+0000 7faecc305640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faec40cc940 0x7faec40cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.273+0000 7faecc305640 1 --2- 172.21.15.161:0/3196359538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faec406aaf0 0x7faec4138a10 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.273+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 >> 172.21.15.161:0/3196359538 conn(0x7faec40cfef0 msgr2=0x7faec406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:07.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.273+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 shutdown_connections 2023-11-24T08:02:07.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.273+0000 7faecc305640 1 -- 172.21.15.161:0/3196359538 wait complete. 2023-11-24T08:02:07.293 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:02:07.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.496+0000 7fe1ffcad640 1 Processor -- start 2023-11-24T08:02:07.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.496+0000 7fe1ffcad640 1 -- start start 2023-11-24T08:02:07.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1ffcad640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe1f8143ae0 0x7fe1f80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1ffcad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 0x7fe1f80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1ffcad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f80cfc30 con 0x7fe1f80cf7d0 2023-11-24T08:02:07.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1ffcad640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f80b1ee0 con 0x7fe1f8143ae0 2023-11-24T08:02:07.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1ffcad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80b2780 con 0x7fe1f815e3b0 2023-11-24T08:02:07.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1fd248640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe1f80cf7d0 0x7fe1f815dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34606/0 (socket says 172.21.15.161:34606) 2023-11-24T08:02:07.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1fd248640 1 -- 172.21.15.161:0/257257804 learned_addr learned my addr 172.21.15.161:0/257257804 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1fda49640 1 --2- 172.21.15.161:0/257257804 >> v2:172.21.15.175:3300/0 conn(0x7fe1f8143ae0 0x7fe1f80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.498+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 0x7fe1f80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292833815 0 0) 0x7fe1f80cfc30 con 0x7fe1f80cf7d0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e4005730 con 0x7fe1f80cf7d0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1518841285 0 0) 0x7fe1e4005730 con 0x7fe1f80cf7d0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 msgr2=0x7fe1f80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 0x7fe1f80702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 >> v2:172.21.15.175:3300/0 conn(0x7fe1f8143ae0 msgr2=0x7fe1f80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 --2- 172.21.15.161:0/257257804 >> v2:172.21.15.175:3300/0 conn(0x7fe1f8143ae0 0x7fe1f80cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f815e990 con 0x7fe1f80cf7d0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fe1e8001670 con 0x7fe1f80cf7d0 2023-11-24T08:02:07.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 >> v1:172.21.15.161:6789/0 conn(0x7fe1f80cf7d0 legacy=0x7fe1f815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e4005b80 0x7fe1e4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 0x7fe1e40069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e4006f10 0x7fe1e4007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80b1ee0 con 0x7fe1e4006f10 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f80b2780 con 0x7fe1e4005b80 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.499+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e400db90 con 0x7fe1f815e3b0 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e4006f10 0x7fe1e4007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fda49640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e4005b80 0x7fe1e4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fe24a640 1 -- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 msgr2=0x7fe1e40069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f815e3b0 0x7fe1e40069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fe24a640 1 -- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e4005b80 msgr2=0x7fe1e4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:07.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1e4005b80 0x7fe1e4005fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.500+0000 7fe1fe24a640 1 -- 172.21.15.161:0/257257804 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4005730 con 0x7fe1e4006f10 2023-11-24T08:02:07.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.501+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e4006f10 0x7fe1e4007390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000e170 tx=0x7fe1e4007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2278bbb03ef1f788 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.501+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f002cc20 con 0x7fe1e4006f10 2023-11-24T08:02:07.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.501+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f000f040 con 0x7fe1e4006f10 2023-11-24T08:02:07.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.501+0000 7fe1fca47640 1 -- 172.21.15.161:0/257257804 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0034440 con 0x7fe1e4006f10 2023-11-24T08:02:07.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1ffcad640 1 -- 172.21.15.161:0/257257804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e4006f10 msgr2=0x7fe1e4007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/257257804 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1e4006f10 0x7fe1e4007390 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000e170 tx=0x7fe1e4007a00 comp rx=0 tx=0).stop 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1fe24a640 1 -- 172.21.15.161:0/257257804 reap_dead start 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1ffcad640 1 -- 172.21.15.161:0/257257804 shutdown_connections 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1ffcad640 1 -- 172.21.15.161:0/257257804 >> 172.21.15.161:0/257257804 conn(0x7fe1f806a800 msgr2=0x7fe1f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1ffcad640 1 -- 172.21.15.161:0/257257804 shutdown_connections 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.502+0000 7fe1ffcad640 1 -- 172.21.15.161:0/257257804 wait complete. 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.504+0000 7fe1ffcad640 1 Processor -- start 2023-11-24T08:02:07.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.504+0000 7fe1ffcad640 1 -- start start 2023-11-24T08:02:07.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1ffcad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8159740 0x7fe1f813c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1ffcad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8141600 0x7fe1f80c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1ffcad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 0x7fe1f813db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1ffcad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f813e090 con 0x7fe1f813d6d0 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1ffcad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f813cb40 con 0x7fe1f8141600 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1ffcad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f815a040 con 0x7fe1f8159740 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1fe24a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 0x7fe1f813db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1fe24a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 0x7fe1f813db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53464/0 (socket says 172.21.15.161:53464) 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.505+0000 7fe1fe24a640 1 -- 172.21.15.161:0/692678337 learned_addr learned my addr 172.21.15.161:0/692678337 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fd248640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8141600 0x7fe1f80c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fe24a640 1 -- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8159740 msgr2=0x7fe1f813c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fda49640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8159740 0x7fe1f813c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8159740 0x7fe1f813c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fe24a640 1 -- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8141600 msgr2=0x7fe1f80c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8141600 0x7fe1f80c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fe24a640 1 -- 172.21.15.161:0/692678337 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f80c9a20 con 0x7fe1f813d6d0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1fe24a640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 0x7fe1f813db50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000e170 tx=0x7fe1f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0034cd0 con 0x7fe1f813d6d0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0034e30 con 0x7fe1f813d6d0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f813c860 con 0x7fe1f813d6d0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.506+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0003bd0 con 0x7fe1f813d6d0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.507+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f813f1c0 con 0x7fe1f813d6d0 2023-11-24T08:02:07.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.508+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f813ed40 con 0x7fe1f813d6d0 2023-11-24T08:02:07.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.509+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe1f0003d30 con 0x7fe1f813d6d0 2023-11-24T08:02:07.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.509+0000 7fe1ee7fc640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe1dc06aff0 0x7fe1dc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.510+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1f00ab100 con 0x7fe1f813d6d0 2023-11-24T08:02:07.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.510+0000 7fe1fda49640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe1dc06aff0 0x7fe1dc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.511+0000 7fe1fda49640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe1dc06aff0 0x7fe1dc06d4b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009990 tx=0x7fe1f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.514+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1f813ed40 con 0x7fe1f813d6d0 2023-11-24T08:02:07.708 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.706+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1f813ed40 con 0x7fe1f813d6d0 2023-11-24T08:02:07.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.707+0000 7fe1ee7fc640 1 -- 172.21.15.161:0/692678337 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe1f813ed40 con 0x7fe1f813d6d0 2023-11-24T08:02:07.709 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:02:07.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe1dc06aff0 msgr2=0x7fe1dc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe1dc06aff0 0x7fe1dc06d4b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009990 tx=0x7fe1f4008040 comp rx=0 tx=0).stop 2023-11-24T08:02:07.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 msgr2=0x7fe1f813db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 0x7fe1f813db50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000e170 tx=0x7fe1f0009750 comp rx=0 tx=0).stop 2023-11-24T08:02:07.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 shutdown_connections 2023-11-24T08:02:07.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe1dc06aff0 0x7fe1dc06d4b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe1f813d6d0 0x7fe1f813db50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe1f8141600 0x7fe1f80c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 --2- 172.21.15.161:0/692678337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1f8159740 0x7fe1f813c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 >> 172.21.15.161:0/692678337 conn(0x7fe1f806a800 msgr2=0x7fe1f8142d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:07.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.709+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 shutdown_connections 2023-11-24T08:02:07.712 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.710+0000 7fe1ffcad640 1 -- 172.21.15.161:0/692678337 wait complete. 2023-11-24T08:02:07.731 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:02:07.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.933+0000 7f81fc6e5640 1 Processor -- start 2023-11-24T08:02:07.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.933+0000 7f81fc6e5640 1 -- start start 2023-11-24T08:02:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.935+0000 7f81fc6e5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f81f40cf9a0 0x7f81f4070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.935+0000 7f81fc6e5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81f4070ea0 0x7f81f40cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.935+0000 7f81fc6e5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f4071690 con 0x7f81f414b2c0 2023-11-24T08:02:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.935+0000 7f81fc6e5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f414b6a0 con 0x7f81f40cf9a0 2023-11-24T08:02:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.935+0000 7f81fc6e5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f4071970 con 0x7f81f4070ea0 2023-11-24T08:02:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f81f40cf9a0 0x7f81f4070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f81f40cf9a0 0x7f81f4070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53472/0 (socket says 172.21.15.161:53472) 2023-11-24T08:02:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 -- 172.21.15.161:0/1337843076 learned_addr learned my addr 172.21.15.161:0/1337843076 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81fac82640 1 --2- 172.21.15.161:0/1337843076 >> v2:172.21.15.175:3300/0 conn(0x7f81f4070ea0 0x7f81f40cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 -- 172.21.15.161:0/1337843076 >> v2:172.21.15.175:3300/0 conn(0x7f81f4070ea0 msgr2=0x7f81f40cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:07.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 --2- 172.21.15.161:0/1337843076 >> v2:172.21.15.175:3300/0 conn(0x7f81f4070ea0 0x7f81f40cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 -- 172.21.15.161:0/1337843076 >> v1:172.21.15.175:6789/0 conn(0x7f81f414b2c0 legacy=0x7f81f40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.936+0000 7f81f9c80640 1 -- 172.21.15.161:0/1337843076 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f4071c50 con 0x7f81f40cf9a0 2023-11-24T08:02:07.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.937+0000 7f81f9c80640 1 --2- 172.21.15.161:0/1337843076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f40cf9a0 0x7f81f4070960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f81f4165330 tx=0x7f81e402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be509d12c3b0f0e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.937+0000 7f81f947f640 1 -- 172.21.15.161:0/1337843076 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4030860 con 0x7f81f40cf9a0 2023-11-24T08:02:07.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81f947f640 1 -- 172.21.15.161:0/1337843076 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40309c0 con 0x7f81f40cf9a0 2023-11-24T08:02:07.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81f947f640 1 -- 172.21.15.161:0/1337843076 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4030d50 con 0x7f81f40cf9a0 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1337843076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f40cf9a0 msgr2=0x7f81f4070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1337843076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f40cf9a0 0x7f81f4070960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f81f4165330 tx=0x7f81e402b9a0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1337843076 shutdown_connections 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1337843076 >> v2:172.21.15.175:3300/0 conn(0x7f81f4070ea0 0x7f81f40cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1337843076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f40cf9a0 0x7f81f4070960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1337843076 >> 172.21.15.161:0/1337843076 conn(0x7f81f406a800 msgr2=0x7f81f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1337843076 shutdown_connections 2023-11-24T08:02:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.938+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1337843076 wait complete. 2023-11-24T08:02:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.940+0000 7f81fc6e5640 1 Processor -- start 2023-11-24T08:02:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.940+0000 7f81fc6e5640 1 -- start start 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fc6e5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 0x7f81f415f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fc6e5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f40cf9a0 0x7f81f41646b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fc6e5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81f414b2c0 0x7f81f4141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fc6e5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f413f9e0 con 0x7f81f4070ea0 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fc6e5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f413fcc0 con 0x7f81f40cf9a0 2023-11-24T08:02:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fc6e5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f413ffa0 con 0x7f81f414b2c0 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fa481640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 0x7f81f415f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fa481640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 0x7f81f415f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53482/0 (socket says 172.21.15.161:53482) 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fa481640 1 -- 172.21.15.161:0/1571461972 learned_addr learned my addr 172.21.15.161:0/1571461972 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81f9c80640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f40cf9a0 0x7f81f41646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.941+0000 7f81fac82640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81f414b2c0 0x7f81f4141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fa481640 1 -- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81f414b2c0 msgr2=0x7f81f4141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fa481640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81f414b2c0 0x7f81f4141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fa481640 1 -- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f40cf9a0 msgr2=0x7f81f41646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fa481640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f40cf9a0 0x7f81f41646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fa481640 1 -- 172.21.15.161:0/1571461972 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40094d0 con 0x7f81f4070ea0 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fac82640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81f414b2c0 0x7f81f4141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fa481640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 0x7f81f415f520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c400 tx=0x7f81f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00052d0 con 0x7f81f4070ea0 2023-11-24T08:02:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f0005430 con 0x7f81f4070ea0 2023-11-24T08:02:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f4140280 con 0x7f81f4070ea0 2023-11-24T08:02:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0003830 con 0x7f81f4070ea0 2023-11-24T08:02:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.942+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f415fa60 con 0x7f81f4070ea0 2023-11-24T08:02:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.943+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f40675d0 con 0x7f81f4070ea0 2023-11-24T08:02:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.944+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f81f0003990 con 0x7f81f4070ea0 2023-11-24T08:02:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.945+0000 7f81eaffd640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81d806b020 0x7f81d806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.945+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81f0088e60 con 0x7f81f4070ea0 2023-11-24T08:02:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.946+0000 7f81f9c80640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81d806b020 0x7f81d806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.947+0000 7f81f9c80640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81d806b020 0x7f81d806d4e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f81e4036000 tx=0x7f81e4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:07.949+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81f0053c80 con 0x7f81f4070ea0 2023-11-24T08:02:08.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.151+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81f40cf670 con 0x7f81f4070ea0 2023-11-24T08:02:08.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.152+0000 7f81eaffd640 1 -- 172.21.15.161:0/1571461972 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81f00572a0 con 0x7f81f4070ea0 2023-11-24T08:02:08.154 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81d806b020 msgr2=0x7f81d806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81d806b020 0x7f81d806d4e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f81e4036000 tx=0x7f81e4008030 comp rx=0 tx=0).stop 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 msgr2=0x7f81f415f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 0x7f81f415f520 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c400 tx=0x7f81f000c8c0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 shutdown_connections 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81d806b020 0x7f81d806d4e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81f414b2c0 0x7f81f4141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81f40cf9a0 0x7f81f41646b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 --2- 172.21.15.161:0/1571461972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f81f4070ea0 0x7f81f415f520 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 >> 172.21.15.161:0/1571461972 conn(0x7f81f406a800 msgr2=0x7f81f4146340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:08.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 shutdown_connections 2023-11-24T08:02:08.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.154+0000 7f81fc6e5640 1 -- 172.21.15.161:0/1571461972 wait complete. 2023-11-24T08:02:08.174 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-24T08:02:08.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:08.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:08.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[95179]: fuse finished with error 0 and tester_r 0 2023-11-24T08:02:08.279 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:02:08.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:08.279 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:02:08.337 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:02:08.337 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:08.394 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:02:08.394 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:02:08.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:08.395 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:02:08.448 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T08:02:08.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:02:08.449 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:02:08.450 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:08.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:02:08.509 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:02:08.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:08.510 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:02:08.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:02:08.565 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T08:02:08.566 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:08.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.789+0000 7f01b44e7640 1 Processor -- start 2023-11-24T08:02:08.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.789+0000 7f01b44e7640 1 -- start start 2023-11-24T08:02:08.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.790+0000 7f01b44e7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01ac15d610 0x7f01ac0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:08.792 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.790+0000 7f01b44e7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0b3400 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.790+0000 7f01b44e7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ac0b27f0 con 0x7f01ac0ced60 2023-11-24T08:02:08.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.790+0000 7f01b44e7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ac0d1390 con 0x7f01ac15d610 2023-11-24T08:02:08.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2283640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01ac15d610 0x7f01ac0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:08.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2a84640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f01ac0d1ef0 0x7f01ac0b3890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34620/0 (socket says 172.21.15.161:34620) 2023-11-24T08:02:08.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2a84640 1 -- 172.21.15.161:0/1024778110 learned_addr learned my addr 172.21.15.161:0/1024778110 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:08.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2283640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01ac15d610 0x7f01ac0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53496/0 (socket says 172.21.15.161:53496) 2023-11-24T08:02:08.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2283640 1 -- 172.21.15.161:0/1024778110 >> v1:172.21.15.175:6789/0 conn(0x7f01ac0ced60 legacy=0x7f01ac0d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:08.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2283640 1 -- 172.21.15.161:0/1024778110 >> v1:172.21.15.161:6789/0 conn(0x7f01ac0d1ef0 legacy=0x7f01ac0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:08.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b1281640 1 -- 172.21.15.161:0/1024778110 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373474928 0 0) 0x7f01ac0b3400 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.791+0000 7f01b2283640 1 -- 172.21.15.161:0/1024778110 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac0b2ad0 con 0x7f01ac15d610 2023-11-24T08:02:08.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.792+0000 7f01b2283640 1 --2- 172.21.15.161:0/1024778110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac15d610 0x7f01ac0ce820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f01a80097a0 tx=0x7f01a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430858de25e49587 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:08.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b1281640 1 -- 172.21.15.161:0/1024778110 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8031830 con 0x7f01ac15d610 2023-11-24T08:02:08.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b1281640 1 -- 172.21.15.161:0/1024778110 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a8031990 con 0x7f01ac15d610 2023-11-24T08:02:08.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b1281640 1 -- 172.21.15.161:0/1024778110 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8031d20 con 0x7f01ac15d610 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 -- 172.21.15.161:0/1024778110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac15d610 msgr2=0x7f01ac0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 --2- 172.21.15.161:0/1024778110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac15d610 0x7f01ac0ce820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f01a80097a0 tx=0x7f01a802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 -- 172.21.15.161:0/1024778110 shutdown_connections 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 --2- 172.21.15.161:0/1024778110 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac15d610 0x7f01ac0ce820 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 -- 172.21.15.161:0/1024778110 >> 172.21.15.161:0/1024778110 conn(0x7f01ac09c540 msgr2=0x7f01ac0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 -- 172.21.15.161:0/1024778110 shutdown_connections 2023-11-24T08:02:08.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.793+0000 7f01b44e7640 1 -- 172.21.15.161:0/1024778110 wait complete. 2023-11-24T08:02:08.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.795+0000 7f01b44e7640 1 Processor -- start 2023-11-24T08:02:08.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.795+0000 7f01b44e7640 1 -- start start 2023-11-24T08:02:08.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b44e7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01ac0ced60 0x7f01ac0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:08.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b44e7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 0x7f01ac14a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:08.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b44e7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01ac15d610 0x7f01ac160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:08.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b44e7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac0b7840 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b44e7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac14aac0 con 0x7f01ac0ced60 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b44e7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ac15ee20 con 0x7f01ac15d610 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b1a82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 0x7f01ac14a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b1a82640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 0x7f01ac14a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53508/0 (socket says 172.21.15.161:53508) 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.796+0000 7f01b1a82640 1 -- 172.21.15.161:0/3020420069 learned_addr learned my addr 172.21.15.161:0/3020420069 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b2283640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01ac0ced60 0x7f01ac0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b1a82640 1 -- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01ac15d610 msgr2=0x7f01ac160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b1a82640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01ac15d610 0x7f01ac160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b1a82640 1 -- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01ac0ced60 msgr2=0x7f01ac0b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b1a82640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01ac0ced60 0x7f01ac0b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b1a82640 1 -- 172.21.15.161:0/3020420069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8009400 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b1a82640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 0x7f01ac14a580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c410 tx=0x7f019c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:08.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c0035f0 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c003750 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c003b40 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.797+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ac15f0e0 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.798+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ac15f6a0 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.799+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ac0675d0 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.800+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f019c003ca0 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.800+0000 7f01a2ffd640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f019006aff0 0x7f019006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:08.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.801+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f019c088be0 con 0x7f01ac0d1ef0 2023-11-24T08:02:08.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.801+0000 7f01b2283640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f019006aff0 0x7f019006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:08.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.802+0000 7f01b2283640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f019006aff0 0x7f019006d4b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01a8036000 tx=0x7f01a803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:08.807 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:08.805+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f019c053970 con 0x7f01ac0d1ef0 2023-11-24T08:02:09.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.034+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01ac0d2c30 con 0x7f01ac0d1ef0 2023-11-24T08:02:09.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.035+0000 7f01a2ffd640 1 -- 172.21.15.161:0/3020420069 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f019c056f90 con 0x7f01ac0d1ef0 2023-11-24T08:02:09.039 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:09.039 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:01:45.366812+0000","modified":"2023-11-24T08:01:48.419033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5175},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5175":{"gid":5175,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/1086564705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1086564705},{"type":"v1","addr":"172.21.15.175:6836","nonce":1086564705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:02:09.039 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 18 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f019006aff0 msgr2=0x7f019006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f019006aff0 0x7f019006d4b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f01a8036000 tx=0x7f01a803c040 comp rx=0 tx=0).stop 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 msgr2=0x7f01ac14a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 0x7f01ac14a580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c410 tx=0x7f019c00c8d0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 shutdown_connections 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f019006aff0 0x7f019006d4b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f01ac15d610 0x7f01ac160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01ac0d1ef0 0x7f01ac14a580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 --2- 172.21.15.161:0/3020420069 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f01ac0ced60 0x7f01ac0b8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 >> 172.21.15.161:0/3020420069 conn(0x7f01ac09c540 msgr2=0x7f01ac0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:09.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 shutdown_connections 2023-11-24T08:02:09.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.038+0000 7f01b44e7640 1 -- 172.21.15.161:0/3020420069 wait complete. 2023-11-24T08:02:09.061 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:09.224 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:02:09.233 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:02:09.271 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.269+0000 7fb2640c9640 1 Processor -- start 2023-11-24T08:02:09.272 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.270+0000 7fb2640c9640 1 -- start start 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb2640c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c143ae0 0x7fb25c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb2640c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb25c0cf7d0 0x7fb25c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb2640c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb25c0cfc30 con 0x7fb25c15e1e0 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb2640c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb25c0b1ee0 con 0x7fb25c0cf7d0 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb2640c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c0b2780 con 0x7fb25c143ae0 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb261664640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb25c0cf7d0 0x7fb25c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb261664640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb25c0cf7d0 0x7fb25c15dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53522/0 (socket says 172.21.15.161:53522) 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb261664640 1 -- 172.21.15.161:0/2968655360 learned_addr learned my addr 172.21.15.161:0/2968655360 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.271+0000 7fb261e65640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c143ae0 0x7fb25c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.272+0000 7fb261664640 1 -- 172.21.15.161:0/2968655360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c143ae0 msgr2=0x7fb25c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:09.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.272+0000 7fb261664640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c143ae0 0x7fb25c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.272+0000 7fb261664640 1 -- 172.21.15.161:0/2968655360 >> v1:172.21.15.175:6789/0 conn(0x7fb25c15e1e0 legacy=0x7fb25c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.272+0000 7fb261664640 1 -- 172.21.15.161:0/2968655360 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c15e990 con 0x7fb25c0cf7d0 2023-11-24T08:02:09.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.272+0000 7fb261e65640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c143ae0 0x7fb25c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:09.275 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.274+0000 7fb261664640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c15dca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009870 tx=0x7fb24c02db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aa78e5fb24c0dcf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:09.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.274+0000 7fb260e63640 1 -- 172.21.15.161:0/2968655360 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c02e940 con 0x7fb25c0cf7d0 2023-11-24T08:02:09.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.274+0000 7fb260e63640 1 -- 172.21.15.161:0/2968655360 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c02eaa0 con 0x7fb25c0cf7d0 2023-11-24T08:02:09.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.274+0000 7fb260e63640 1 -- 172.21.15.161:0/2968655360 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c02ee30 con 0x7fb25c0cf7d0 2023-11-24T08:02:09.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 -- 172.21.15.161:0/2968655360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c0cf7d0 msgr2=0x7fb25c15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c15dca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb24c009870 tx=0x7fb24c02db90 comp rx=0 tx=0).stop 2023-11-24T08:02:09.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 -- 172.21.15.161:0/2968655360 shutdown_connections 2023-11-24T08:02:09.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c15dca0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 --2- 172.21.15.161:0/2968655360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c143ae0 0x7fb25c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 -- 172.21.15.161:0/2968655360 >> 172.21.15.161:0/2968655360 conn(0x7fb25c06a800 msgr2=0x7fb25c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:09.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 -- 172.21.15.161:0/2968655360 shutdown_connections 2023-11-24T08:02:09.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.275+0000 7fb2640c9640 1 -- 172.21.15.161:0/2968655360 wait complete. 2023-11-24T08:02:09.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.276+0000 7fb2640c9640 1 Processor -- start 2023-11-24T08:02:09.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.277+0000 7fb2640c9640 1 -- start start 2023-11-24T08:02:09.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb2640c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb2640c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 0x7fb25c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb2640c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c15e1e0 0x7fb25c1f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb2640c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c13a690 con 0x7fb25c143ae0 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb2640c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c1f6e50 con 0x7fb25c0cf7d0 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb2640c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c1f7130 con 0x7fb25c15e1e0 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 0x7fb25c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 0x7fb25c0cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53530/0 (socket says 172.21.15.161:53530) 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 -- 172.21.15.161:0/3102539473 learned_addr learned my addr 172.21.15.161:0/3102539473 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261e65640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb262666640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c15e1e0 0x7fb25c1f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 -- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c15e1e0 msgr2=0x7fb25c1f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c15e1e0 0x7fb25c1f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 -- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb25c0cf7d0 msgr2=0x7fb25c137400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c137400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261664640 1 -- 172.21.15.161:0/3102539473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0094d0 con 0x7fb25c143ae0 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.278+0000 7fb261e65640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.279+0000 7fb261664640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 0x7fb25c0cb150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000c00 tx=0x7fb24c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.279+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c041640 con 0x7fb25c143ae0 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.279+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c0417a0 con 0x7fb25c143ae0 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.279+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c041b50 con 0x7fb25c143ae0 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.279+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c136920 con 0x7fb25c143ae0 2023-11-24T08:02:09.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.279+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c136ee0 con 0x7fb25c143ae0 2023-11-24T08:02:09.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.280+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c0675d0 con 0x7fb25c143ae0 2023-11-24T08:02:09.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.281+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb24c03e3f0 con 0x7fb25c143ae0 2023-11-24T08:02:09.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.282+0000 7fb2527fc640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb24006aff0 0x7fb24006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.282+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb24c0abc20 con 0x7fb25c143ae0 2023-11-24T08:02:09.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.283+0000 7fb261e65640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb24006aff0 0x7fb24006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.284+0000 7fb261e65640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb24006aff0 0x7fb24006d4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb258006fd0 tx=0x7fb258008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:09.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.286+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb24c076a50 con 0x7fb25c143ae0 2023-11-24T08:02:09.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.479+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb25c142fb0 con 0x7fb25c143ae0 2023-11-24T08:02:09.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.482+0000 7fb2527fc640 1 -- 172.21.15.161:0/3102539473 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fb24c046020 con 0x7fb25c143ae0 2023-11-24T08:02:09.484 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:09.485 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:09.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb24006aff0 msgr2=0x7fb24006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb24006aff0 0x7fb24006d4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb258006fd0 tx=0x7fb258008040 comp rx=0 tx=0).stop 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 msgr2=0x7fb25c0cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 0x7fb25c0cb150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb24c000c00 tx=0x7fb24c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 shutdown_connections 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb24006aff0 0x7fb24006d4b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb25c15e1e0 0x7fb25c1f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb25c143ae0 0x7fb25c0cb150 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 --2- 172.21.15.161:0/3102539473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb25c0cf7d0 0x7fb25c137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 >> 172.21.15.161:0/3102539473 conn(0x7fb25c06a800 msgr2=0x7fb25c15b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 shutdown_connections 2023-11-24T08:02:09.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.485+0000 7fb2640c9640 1 -- 172.21.15.161:0/3102539473 wait complete. 2023-11-24T08:02:09.506 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:01:43.282420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:01:44.380572+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:09.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.715+0000 7f82e1659640 1 Processor -- start 2023-11-24T08:02:09.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.715+0000 7f82e1659640 1 -- start start 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e1659640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82dc0adf20 0x7f82dc070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e1659640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82dc15bf10 0x7f82dc0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e1659640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc0cc980 0x7f82dc143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e1659640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc15f970 con 0x7f82dc15bf10 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e1659640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82dc15f4e0 con 0x7f82dc0adf20 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e1659640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc0cce10 con 0x7f82dc0cc980 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82d3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82dc15bf10 0x7f82dc0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82d3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82dc15bf10 0x7f82dc0cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53538/0 (socket says 172.21.15.161:53538) 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82d3fff640 1 -- 172.21.15.161:0/3890149105 learned_addr learned my addr 172.21.15.161:0/3890149105 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82dbfff640 1 --2- 172.21.15.161:0/3890149105 >> v2:172.21.15.175:3300/0 conn(0x7f82dc0adf20 0x7f82dc070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.717+0000 7f82e0e58640 1 --2- 172.21.15.161:0/3890149105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc0cc980 0x7f82dc143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.718+0000 7f82d3fff640 1 -- 172.21.15.161:0/3890149105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc0cc980 msgr2=0x7f82dc143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:09.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.718+0000 7f82d3fff640 1 --2- 172.21.15.161:0/3890149105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc0cc980 0x7f82dc143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.718+0000 7f82d3fff640 1 -- 172.21.15.161:0/3890149105 >> v2:172.21.15.175:3300/0 conn(0x7f82dc0adf20 msgr2=0x7f82dc070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:09.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.718+0000 7f82d3fff640 1 --2- 172.21.15.161:0/3890149105 >> v2:172.21.15.175:3300/0 conn(0x7f82dc0adf20 0x7f82dc070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.718+0000 7f82d3fff640 1 -- 172.21.15.161:0/3890149105 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82dc071130 con 0x7f82dc15bf10 2023-11-24T08:02:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.719+0000 7f82d3fff640 1 --2- 172.21.15.161:0/3890149105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc15bf10 0x7f82dc0cc440 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0b4150 tx=0x7f82c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc4eac04b0fcf10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.719+0000 7f82db7fe640 1 -- 172.21.15.161:0/3890149105 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40317e0 con 0x7f82dc15bf10 2023-11-24T08:02:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.719+0000 7f82db7fe640 1 -- 172.21.15.161:0/3890149105 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4031940 con 0x7f82dc15bf10 2023-11-24T08:02:09.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.719+0000 7f82db7fe640 1 -- 172.21.15.161:0/3890149105 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4031cd0 con 0x7f82dc15bf10 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 -- 172.21.15.161:0/3890149105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc15bf10 msgr2=0x7f82dc0cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 --2- 172.21.15.161:0/3890149105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc15bf10 0x7f82dc0cc440 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0b4150 tx=0x7f82c402b880 comp rx=0 tx=0).stop 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 -- 172.21.15.161:0/3890149105 shutdown_connections 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 --2- 172.21.15.161:0/3890149105 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc0cc980 0x7f82dc143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 --2- 172.21.15.161:0/3890149105 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc15bf10 0x7f82dc0cc440 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 --2- 172.21.15.161:0/3890149105 >> v2:172.21.15.175:3300/0 conn(0x7f82dc0adf20 0x7f82dc070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 -- 172.21.15.161:0/3890149105 >> 172.21.15.161:0/3890149105 conn(0x7f82dc06a7d0 msgr2=0x7f82dc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 -- 172.21.15.161:0/3890149105 shutdown_connections 2023-11-24T08:02:09.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.720+0000 7f82e1659640 1 -- 172.21.15.161:0/3890149105 wait complete. 2023-11-24T08:02:09.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.723+0000 7f82e1659640 1 Processor -- start 2023-11-24T08:02:09.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.723+0000 7f82e1659640 1 -- start start 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82e1659640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82dc0adf20 0x7f82dc13f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82e1659640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 0x7f82dc13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82e1659640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc15bf10 0x7f82dc13b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82e1659640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc142a50 con 0x7f82dc0cc980 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82e1659640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc152880 con 0x7f82dc0adf20 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82e1659640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc142490 con 0x7f82dc15bf10 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82d3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 0x7f82dc13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82d3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 0x7f82dc13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53544/0 (socket says 172.21.15.161:53544) 2023-11-24T08:02:09.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.724+0000 7f82d3fff640 1 -- 172.21.15.161:0/1676239815 learned_addr learned my addr 172.21.15.161:0/1676239815 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:09.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82dbfff640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82dc0adf20 0x7f82dc13f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d3fff640 1 -- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc15bf10 msgr2=0x7f82dc13b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d3fff640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc15bf10 0x7f82dc13b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d3fff640 1 -- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82dc0adf20 msgr2=0x7f82dc13f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d3fff640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82dc0adf20 0x7f82dc13f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d3fff640 1 -- 172.21.15.161:0/1676239815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40094d0 con 0x7f82dc0cc980 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d3fff640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 0x7f82dc13aca0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f82c40090b0 tx=0x7f82c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.725+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4032880 con 0x7f82dc0cc980 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.726+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c4032a00 con 0x7f82dc0cc980 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.726+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4032db0 con 0x7f82dc0cc980 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.726+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc142770 con 0x7f82dc0cc980 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.726+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc150350 con 0x7f82dc0cc980 2023-11-24T08:02:09.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.727+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc14fed0 con 0x7f82dc0cc980 2023-11-24T08:02:09.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.728+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f82c403b3f0 con 0x7f82dc0cc980 2023-11-24T08:02:09.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.729+0000 7f82d97fa640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f82bc06aff0 0x7f82bc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:09.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.729+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82c40abe00 con 0x7f82dc0cc980 2023-11-24T08:02:09.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.730+0000 7f82dbfff640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f82bc06aff0 0x7f82bc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:09.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.731+0000 7f82dbfff640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f82bc06aff0 0x7f82bc06d4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82cc006fd0 tx=0x7f82cc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:09.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.733+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82dc14fed0 con 0x7f82dc0cc980 2023-11-24T08:02:09.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.927+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82dc14fed0 con 0x7f82dc0cc980 2023-11-24T08:02:09.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.928+0000 7f82d97fa640 1 -- 172.21.15.161:0/1676239815 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82dc14fed0 con 0x7f82dc0cc980 2023-11-24T08:02:09.930 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.930+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f82bc06aff0 msgr2=0x7f82bc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.930+0000 7f82e1659640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f82bc06aff0 0x7f82bc06d4b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f82cc006fd0 tx=0x7f82cc008040 comp rx=0 tx=0).stop 2023-11-24T08:02:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.930+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 msgr2=0x7f82dc13aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.930+0000 7f82e1659640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 0x7f82dc13aca0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f82c40090b0 tx=0x7f82c40046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 shutdown_connections 2023-11-24T08:02:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f82bc06aff0 0x7f82bc06d4b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82dc15bf10 0x7f82dc13b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82dc0cc980 0x7f82dc13aca0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 --2- 172.21.15.161:0/1676239815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82dc0adf20 0x7f82dc13f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 >> 172.21.15.161:0/1676239815 conn(0x7f82dc06a7d0 msgr2=0x7f82dc0cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 shutdown_connections 2023-11-24T08:02:09.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:09.931+0000 7f82e1659640 1 -- 172.21.15.161:0/1676239815 wait complete. 2023-11-24T08:02:09.952 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:02:10.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.165+0000 7f7c74a2c640 1 Processor -- start 2023-11-24T08:02:10.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.165+0000 7f7c74a2c640 1 -- start start 2023-11-24T08:02:10.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c74a2c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c700adf20 0x7f7c70070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c74a2c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7c700ccb50 0x7f7c70143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c74a2c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7015f4e0 con 0x7f7c7015bf10 2023-11-24T08:02:10.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c74a2c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7015f970 con 0x7f7c700ccb50 2023-11-24T08:02:10.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c74a2c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c70071130 con 0x7f7c700adf20 2023-11-24T08:02:10.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c6f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7c700ccb50 0x7f7c70143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c67fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7c7015bf10 0x7f7c700cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34634/0 (socket says 172.21.15.161:34634) 2023-11-24T08:02:10.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.167+0000 7f7c67fff640 1 -- 172.21.15.161:0/1323341468 learned_addr learned my addr 172.21.15.161:0/1323341468 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:10.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.168+0000 7f7c6ed9d640 1 --2- 172.21.15.161:0/1323341468 >> v2:172.21.15.175:3300/0 conn(0x7f7c700adf20 0x7f7c70070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.168+0000 7f7c6f59e640 1 -- 172.21.15.161:0/1323341468 >> v2:172.21.15.175:3300/0 conn(0x7f7c700adf20 msgr2=0x7f7c70070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:10.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.168+0000 7f7c6f59e640 1 --2- 172.21.15.161:0/1323341468 >> v2:172.21.15.175:3300/0 conn(0x7f7c700adf20 0x7f7c70070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.168+0000 7f7c6f59e640 1 -- 172.21.15.161:0/1323341468 >> v1:172.21.15.161:6789/0 conn(0x7f7c7015bf10 legacy=0x7f7c700cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.168+0000 7f7c6f59e640 1 -- 172.21.15.161:0/1323341468 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7015c390 con 0x7f7c700ccb50 2023-11-24T08:02:10.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.168+0000 7f7c6e59c640 1 -- 172.21.15.161:0/1323341468 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820760968 0 0) 0x7f7c7015f4e0 con 0x7f7c7015bf10 2023-11-24T08:02:10.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.169+0000 7f7c6f59e640 1 --2- 172.21.15.161:0/1323341468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700ccb50 0x7f7c70143d30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7c700b4150 tx=0x7f7c6802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e2921a8e453811 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.169+0000 7f7c6e59c640 1 -- 172.21.15.161:0/1323341468 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6802cbf0 con 0x7f7c700ccb50 2023-11-24T08:02:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.169+0000 7f7c6e59c640 1 -- 172.21.15.161:0/1323341468 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6802cd50 con 0x7f7c700ccb50 2023-11-24T08:02:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.169+0000 7f7c6e59c640 1 -- 172.21.15.161:0/1323341468 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68034660 con 0x7f7c700ccb50 2023-11-24T08:02:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1323341468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700ccb50 msgr2=0x7f7c70143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1323341468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700ccb50 0x7f7c70143d30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7c700b4150 tx=0x7f7c6802be40 comp rx=0 tx=0).stop 2023-11-24T08:02:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1323341468 shutdown_connections 2023-11-24T08:02:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1323341468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700ccb50 0x7f7c70143d30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1323341468 >> v2:172.21.15.175:3300/0 conn(0x7f7c700adf20 0x7f7c70070a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1323341468 >> 172.21.15.161:0/1323341468 conn(0x7f7c7006a7d0 msgr2=0x7f7c7006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1323341468 shutdown_connections 2023-11-24T08:02:10.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.170+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1323341468 wait complete. 2023-11-24T08:02:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.172+0000 7f7c74a2c640 1 Processor -- start 2023-11-24T08:02:10.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.172+0000 7f7c74a2c640 1 -- start start 2023-11-24T08:02:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c74a2c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 0x7f7c70140b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c74a2c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c700ccb50 0x7f7c7015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c74a2c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c7015bf10 0x7f7c7015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c74a2c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015ae40 con 0x7f7c700adf20 2023-11-24T08:02:10.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c74a2c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700ab5b0 con 0x7f7c700ccb50 2023-11-24T08:02:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c74a2c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700aa510 con 0x7f7c7015bf10 2023-11-24T08:02:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c6ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 0x7f7c70140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c6ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 0x7f7c70140b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53576/0 (socket says 172.21.15.161:53576) 2023-11-24T08:02:10.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.173+0000 7f7c6ed9d640 1 -- 172.21.15.161:0/1650462140 learned_addr learned my addr 172.21.15.161:0/1650462140 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c6ed9d640 1 -- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c7015bf10 msgr2=0x7f7c7015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c6ed9d640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c7015bf10 0x7f7c7015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c67fff640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c700ccb50 0x7f7c7015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c6ed9d640 1 -- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c700ccb50 msgr2=0x7f7c7015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c6ed9d640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c700ccb50 0x7f7c7015a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c6ed9d640 1 -- 172.21.15.161:0/1650462140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68009a70 con 0x7f7c700adf20 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c6ed9d640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 0x7f7c70140b10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000d800 tx=0x7f7c6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:10.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000b6c0 con 0x7f7c700adf20 2023-11-24T08:02:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000b820 con 0x7f7c700adf20 2023-11-24T08:02:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6000bbb0 con 0x7f7c700adf20 2023-11-24T08:02:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.174+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c700aa7f0 con 0x7f7c700adf20 2023-11-24T08:02:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.175+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c700aadb0 con 0x7f7c700adf20 2023-11-24T08:02:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.176+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c70067450 con 0x7f7c700adf20 2023-11-24T08:02:10.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.177+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7c6000bd10 con 0x7f7c700adf20 2023-11-24T08:02:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.178+0000 7f7c677fe640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c5006aff0 0x7f7c5006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.178+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c60089f70 con 0x7f7c700adf20 2023-11-24T08:02:10.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.179+0000 7f7c67fff640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c5006aff0 0x7f7c5006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.180+0000 7f7c67fff640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c5006aff0 0x7f7c5006d4b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c700c41e0 tx=0x7f7c58009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:10.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.182+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c60054d00 con 0x7f7c700adf20 2023-11-24T08:02:10.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.371+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c700cdba0 con 0x7f7c700adf20 2023-11-24T08:02:10.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.372+0000 7f7c677fe640 1 -- 172.21.15.161:0/1650462140 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c60058320 con 0x7f7c700adf20 2023-11-24T08:02:10.375 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c5006aff0 msgr2=0x7f7c5006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c5006aff0 0x7f7c5006d4b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c700c41e0 tx=0x7f7c58009040 comp rx=0 tx=0).stop 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 msgr2=0x7f7c70140b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 0x7f7c70140b10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000d800 tx=0x7f7c6000dcc0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 shutdown_connections 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c5006aff0 0x7f7c5006d4b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c7015bf10 0x7f7c7015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c700ccb50 0x7f7c7015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 --2- 172.21.15.161:0/1650462140 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c700adf20 0x7f7c70140b10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 >> 172.21.15.161:0/1650462140 conn(0x7f7c7006a7d0 msgr2=0x7f7c7006abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:10.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 shutdown_connections 2023-11-24T08:02:10.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.375+0000 7f7c74a2c640 1 -- 172.21.15.161:0/1650462140 wait complete. 2023-11-24T08:02:10.396 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:02:10.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.615+0000 7f820359e640 1 Processor -- start 2023-11-24T08:02:10.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.615+0000 7f820359e640 1 -- start start 2023-11-24T08:02:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.616+0000 7f820359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8204070a30 0x7f820415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f820359e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820415f4e0 con 0x7f82040ccb50 2023-11-24T08:02:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f820359e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8204070ea0 con 0x7f82040adf20 2023-11-24T08:02:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f820359e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820415c450 con 0x7f8204070a30 2023-11-24T08:02:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f81fbfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f82040ccb50 0x7f8204143d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34650/0 (socket says 172.21.15.161:34650) 2023-11-24T08:02:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f81fbfff640 1 -- 172.21.15.161:0/3898912494 learned_addr learned my addr 172.21.15.161:0/3898912494 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f8202d9d640 1 --2- 172.21.15.161:0/3898912494 >> v2:172.21.15.161:3300/0 conn(0x7f8204070a30 0x7f820415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f8201d9b640 1 -- 172.21.15.161:0/3898912494 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699757813 0 0) 0x7f820415f4e0 con 0x7f82040ccb50 2023-11-24T08:02:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f8201d9b640 1 -- 172.21.15.161:0/3898912494 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f0003520 con 0x7f82040ccb50 2023-11-24T08:02:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f8202d9d640 1 -- 172.21.15.161:0/3898912494 >> v1:172.21.15.175:6789/0 conn(0x7f82040adf20 legacy=0x7f82040cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.617+0000 7f8202d9d640 1 -- 172.21.15.161:0/3898912494 >> v1:172.21.15.161:6789/0 conn(0x7f82040ccb50 legacy=0x7f8204143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.618+0000 7f8202d9d640 1 -- 172.21.15.161:0/3898912494 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8204071130 con 0x7f8204070a30 2023-11-24T08:02:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.619+0000 7f8202d9d640 1 --2- 172.21.15.161:0/3898912494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f820415bf10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009d90 tx=0x7f81fc02bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8257f7cbb13d1491 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.619+0000 7f8201d9b640 1 -- 172.21.15.161:0/3898912494 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc02cc70 con 0x7f8204070a30 2023-11-24T08:02:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.619+0000 7f8201d9b640 1 -- 172.21.15.161:0/3898912494 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc02cdd0 con 0x7f8204070a30 2023-11-24T08:02:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.619+0000 7f8201d9b640 1 -- 172.21.15.161:0/3898912494 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc034660 con 0x7f8204070a30 2023-11-24T08:02:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.619+0000 7f820359e640 1 -- 172.21.15.161:0/3898912494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 msgr2=0x7f820415bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.619+0000 7f820359e640 1 --2- 172.21.15.161:0/3898912494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f820415bf10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009d90 tx=0x7f81fc02bec0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.620+0000 7f820359e640 1 -- 172.21.15.161:0/3898912494 shutdown_connections 2023-11-24T08:02:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.620+0000 7f820359e640 1 --2- 172.21.15.161:0/3898912494 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f820415bf10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.620+0000 7f820359e640 1 -- 172.21.15.161:0/3898912494 >> 172.21.15.161:0/3898912494 conn(0x7f820406a7d0 msgr2=0x7f820406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.620+0000 7f820359e640 1 -- 172.21.15.161:0/3898912494 shutdown_connections 2023-11-24T08:02:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.620+0000 7f820359e640 1 -- 172.21.15.161:0/3898912494 wait complete. 2023-11-24T08:02:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.621+0000 7f820359e640 1 Processor -- start 2023-11-24T08:02:10.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.622+0000 7f820359e640 1 -- start start 2023-11-24T08:02:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f82040b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82040adf20 0x7f8204141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82040ccb50 0x7f82040cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8204133680 con 0x7f8204070a30 2023-11-24T08:02:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820359e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040b2e80 con 0x7f82040ccb50 2023-11-24T08:02:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040b3160 con 0x7f82040adf20 2023-11-24T08:02:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f82040b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f82040b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53596/0 (socket says 172.21.15.161:53596) 2023-11-24T08:02:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 -- 172.21.15.161:0/2896230121 learned_addr learned my addr 172.21.15.161:0/2896230121 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 -- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82040adf20 msgr2=0x7f8204141bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82040adf20 0x7f8204141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 -- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82040ccb50 msgr2=0x7f82040cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82040ccb50 0x7f82040cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.623+0000 7f820259c640 1 -- 172.21.15.161:0/2896230121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009a70 con 0x7f8204070a30 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.624+0000 7f820259c640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f82040b28a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c450 tx=0x7f81f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.624+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40052d0 con 0x7f8204070a30 2023-11-24T08:02:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.624+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4005430 con 0x7f8204070a30 2023-11-24T08:02:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.624+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4012870 con 0x7f8204070a30 2023-11-24T08:02:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.624+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82040b3440 con 0x7f8204070a30 2023-11-24T08:02:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.624+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82040b3720 con 0x7f8204070a30 2023-11-24T08:02:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.625+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8204067450 con 0x7f8204070a30 2023-11-24T08:02:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.626+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f81f40129d0 con 0x7f8204070a30 2023-11-24T08:02:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.627+0000 7f81faffd640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81e406aff0 0x7f81e406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.627+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81f4089470 con 0x7f8204070a30 2023-11-24T08:02:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.628+0000 7f81fbfff640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81e406aff0 0x7f81e406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.628+0000 7f81fbfff640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81e406aff0 0x7f81e406d4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f82041f6240 tx=0x7f81ec007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:10.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.631+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81f40542a0 con 0x7f8204070a30 2023-11-24T08:02:10.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.826+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82040c4ad0 con 0x7f8204070a30 2023-11-24T08:02:10.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.827+0000 7f81faffd640 1 -- 172.21.15.161:0/2896230121 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81f40578c0 con 0x7f8204070a30 2023-11-24T08:02:10.829 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:02:10.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81e406aff0 msgr2=0x7f81e406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81e406aff0 0x7f81e406d4b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f82041f6240 tx=0x7f81ec007930 comp rx=0 tx=0).stop 2023-11-24T08:02:10.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 msgr2=0x7f82040b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f82040b28a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c450 tx=0x7f81f400c910 comp rx=0 tx=0).stop 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 shutdown_connections 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f81e406aff0 0x7f81e406d4b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82040ccb50 0x7f82040cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82040adf20 0x7f8204141bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 --2- 172.21.15.161:0/2896230121 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8204070a30 0x7f82040b28a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 >> 172.21.15.161:0/2896230121 conn(0x7f820406a7d0 msgr2=0x7f82041444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 shutdown_connections 2023-11-24T08:02:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:10.830+0000 7f820359e640 1 -- 172.21.15.161:0/2896230121 wait complete. 2023-11-24T08:02:10.853 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.069+0000 7f9452ab4640 1 Processor -- start 2023-11-24T08:02:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.069+0000 7f9452ab4640 1 -- start start 2023-11-24T08:02:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9452ab4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f944c159590 0x7f944c070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9452ab4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c0ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9452ab4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f944c071790 con 0x7f944c0cd220 2023-11-24T08:02:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9452ab4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f944c071100 con 0x7f944c159590 2023-11-24T08:02:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9452ab4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c070860 con 0x7f944c0b3c20 2023-11-24T08:02:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f944c159590 0x7f944c070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f944c159590 0x7f944c070160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39198/0 (socket says 172.21.15.161:39198) 2023-11-24T08:02:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 -- 172.21.15.161:0/265035479 learned_addr learned my addr 172.21.15.161:0/265035479 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f94512b1640 1 --2- 172.21.15.161:0/265035479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c0ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 -- 172.21.15.161:0/265035479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 msgr2=0x7f944c0ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 --2- 172.21.15.161:0/265035479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c0ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 -- 172.21.15.161:0/265035479 >> v1:172.21.15.175:6789/0 conn(0x7f944c0cd220 legacy=0x7f944c06d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.071+0000 7f9451ab2640 1 -- 172.21.15.161:0/265035479 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c070b40 con 0x7f944c159590 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.072+0000 7f9451ab2640 1 --2- 172.21.15.161:0/265035479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c070160 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9440009870 tx=0x7f944002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbcab7ae049af6b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.072+0000 7f9450ab0640 1 -- 172.21.15.161:0/265035479 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94400317c0 con 0x7f944c159590 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.072+0000 7f9450ab0640 1 -- 172.21.15.161:0/265035479 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9440031920 con 0x7f944c159590 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.072+0000 7f9450ab0640 1 -- 172.21.15.161:0/265035479 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9440031cb0 con 0x7f944c159590 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 -- 172.21.15.161:0/265035479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 msgr2=0x7f944c070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 --2- 172.21.15.161:0/265035479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c070160 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9440009870 tx=0x7f944002b860 comp rx=0 tx=0).stop 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 -- 172.21.15.161:0/265035479 shutdown_connections 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 --2- 172.21.15.161:0/265035479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 --2- 172.21.15.161:0/265035479 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c070160 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 -- 172.21.15.161:0/265035479 >> 172.21.15.161:0/265035479 conn(0x7f944c06a800 msgr2=0x7f944c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 -- 172.21.15.161:0/265035479 shutdown_connections 2023-11-24T08:02:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.073+0000 7f9452ab4640 1 -- 172.21.15.161:0/265035479 wait complete. 2023-11-24T08:02:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.075+0000 7f9452ab4640 1 Processor -- start 2023-11-24T08:02:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.075+0000 7f9452ab4640 1 -- start start 2023-11-24T08:02:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9452ab4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9452ab4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f944c0cd220 0x7f944c1f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9452ab4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9452ab4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1404e0 con 0x7f944c159590 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9452ab4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944c1407c0 con 0x7f944c0cd220 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9452ab4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944c140aa0 con 0x7f944c0b3c20 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c14f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39204/0 (socket says 172.21.15.161:39204) 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 -- 172.21.15.161:0/361068996 learned_addr learned my addr 172.21.15.161:0/361068996 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94512b1640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f944c0cd220 0x7f944c1f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9451ab2640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 -- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 msgr2=0x7f944c143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 -- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f944c0cd220 msgr2=0x7f944c1f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f944c0cd220 0x7f944c1f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f94522b3640 1 -- 172.21.15.161:0/361068996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94400094d0 con 0x7f944c159590 2023-11-24T08:02:11.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.076+0000 7f9451ab2640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:11.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.077+0000 7f94522b3640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c14f3a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f944400c410 tx=0x7f944400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.077+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444011790 con 0x7f944c159590 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.077+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94440118f0 con 0x7f944c159590 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.077+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444011ce0 con 0x7f944c159590 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.077+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944c140d80 con 0x7f944c159590 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.077+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f944c1f2e60 con 0x7f944c159590 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.078+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944c1412a0 con 0x7f944c159590 2023-11-24T08:02:11.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.079+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f944401c460 con 0x7f944c159590 2023-11-24T08:02:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.080+0000 7f943e7fc640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f943006aff0 0x7f943006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.080+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9444089670 con 0x7f944c159590 2023-11-24T08:02:11.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.081+0000 7f9451ab2640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f943006aff0 0x7f943006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.082+0000 7f9451ab2640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f943006aff0 0x7f943006d4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9440036000 tx=0x7f944003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.084+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f944c1412a0 con 0x7f944c159590 2023-11-24T08:02:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.308+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f944c1412a0 con 0x7f944c159590 2023-11-24T08:02:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.309+0000 7f943e7fc640 1 -- 172.21.15.161:0/361068996 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f944c1412a0 con 0x7f944c159590 2023-11-24T08:02:11.311 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:11.311 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:01:45.366812+0000","modified":"2023-11-24T08:01:48.419033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5175},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5175":{"gid":5175,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/1086564705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1086564705},{"type":"v1","addr":"172.21.15.175:6836","nonce":1086564705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:02:11.311 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 18 2023-11-24T08:02:11.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f943006aff0 msgr2=0x7f943006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f943006aff0 0x7f943006d4b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9440036000 tx=0x7f944003d040 comp rx=0 tx=0).stop 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 msgr2=0x7f944c14f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c14f3a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f944400c410 tx=0x7f944400c8d0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 shutdown_connections 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f943006aff0 0x7f943006d4b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f944c159590 0x7f944c14f3a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.311+0000 7f9452ab4640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f944c0cd220 0x7f944c1f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.312+0000 7f9452ab4640 1 --2- 172.21.15.161:0/361068996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f944c0b3c20 0x7f944c143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.312+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 >> 172.21.15.161:0/361068996 conn(0x7f944c06a800 msgr2=0x7f944c0ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:11.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.312+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 shutdown_connections 2023-11-24T08:02:11.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.312+0000 7f9452ab4640 1 -- 172.21.15.161:0/361068996 wait complete. 2023-11-24T08:02:11.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:11.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.540+0000 7f7e9930d640 1 Processor -- start 2023-11-24T08:02:11.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.540+0000 7f7e9930d640 1 -- start start 2023-11-24T08:02:11.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e9930d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7e94160920 0x7f7e940b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e9930d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e940cf9f0 0x7f7e940cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e9930d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e9930d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940d03e0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e9930d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e940d0a10 con 0x7f7e94160920 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e9930d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940cf080 con 0x7f7e94161010 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e937fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e940cf9f0 0x7f7e940cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e937fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e940cf9f0 0x7f7e940cfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39208/0 (socket says 172.21.15.161:39208) 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e937fe640 1 -- 172.21.15.161:0/501601569 learned_addr learned my addr 172.21.15.161:0/501601569 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e93fff640 1 --2- 172.21.15.161:0/501601569 >> v2:172.21.15.175:3300/0 conn(0x7f7e94160920 0x7f7e940b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.541+0000 7f7e98b0c640 1 --2- 172.21.15.161:0/501601569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.542+0000 7f7e937fe640 1 -- 172.21.15.161:0/501601569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 msgr2=0x7f7e941614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.542+0000 7f7e937fe640 1 --2- 172.21.15.161:0/501601569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941614a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.542+0000 7f7e937fe640 1 -- 172.21.15.161:0/501601569 >> v2:172.21.15.175:3300/0 conn(0x7f7e94160920 msgr2=0x7f7e940b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.542+0000 7f7e937fe640 1 --2- 172.21.15.161:0/501601569 >> v2:172.21.15.175:3300/0 conn(0x7f7e94160920 0x7f7e940b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.542+0000 7f7e937fe640 1 -- 172.21.15.161:0/501601569 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e940c6be0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.543+0000 7f7e937fe640 1 --2- 172.21.15.161:0/501601569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940cfea0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e9408c060 tx=0x7f7e8802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b9eceecdff8e9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.543+0000 7f7e92ffd640 1 -- 172.21.15.161:0/501601569 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88031870 con 0x7f7e940cf9f0 2023-11-24T08:02:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.543+0000 7f7e92ffd640 1 -- 172.21.15.161:0/501601569 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e880319d0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.543+0000 7f7e92ffd640 1 -- 172.21.15.161:0/501601569 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e88031d60 con 0x7f7e940cf9f0 2023-11-24T08:02:11.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 -- 172.21.15.161:0/501601569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 msgr2=0x7f7e940cfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 --2- 172.21.15.161:0/501601569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940cfea0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7e9408c060 tx=0x7f7e8802b910 comp rx=0 tx=0).stop 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 -- 172.21.15.161:0/501601569 shutdown_connections 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 --2- 172.21.15.161:0/501601569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 --2- 172.21.15.161:0/501601569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940cfea0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 --2- 172.21.15.161:0/501601569 >> v2:172.21.15.175:3300/0 conn(0x7f7e94160920 0x7f7e940b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 -- 172.21.15.161:0/501601569 >> 172.21.15.161:0/501601569 conn(0x7f7e940d3090 msgr2=0x7f7e940d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 -- 172.21.15.161:0/501601569 shutdown_connections 2023-11-24T08:02:11.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.544+0000 7f7e9930d640 1 -- 172.21.15.161:0/501601569 wait complete. 2023-11-24T08:02:11.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.546+0000 7f7e9930d640 1 Processor -- start 2023-11-24T08:02:11.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.546+0000 7f7e9930d640 1 -- start start 2023-11-24T08:02:11.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e9930d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e9930d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e94160920 0x7f7e94155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e9930d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e9930d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94155a60 con 0x7f7e940cf9f0 2023-11-24T08:02:11.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e9930d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940cb380 con 0x7f7e94160920 2023-11-24T08:02:11.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e9930d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e940c7a20 con 0x7f7e94161010 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39214/0 (socket says 172.21.15.161:39214) 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 -- 172.21.15.161:0/815512470 learned_addr learned my addr 172.21.15.161:0/815512470 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 -- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 msgr2=0x7f7e941548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 -- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e94160920 msgr2=0x7f7e94155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e94160920 0x7f7e94155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 -- 172.21.15.161:0/815512470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880094d0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.547+0000 7f7e93fff640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940c7320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400d800 tx=0x7f7e8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.548+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840096a0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.548+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e84009800 con 0x7f7e940cf9f0 2023-11-24T08:02:11.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.548+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e84009990 con 0x7f7e940cf9f0 2023-11-24T08:02:11.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.548+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e940c7d00 con 0x7f7e940cf9f0 2023-11-24T08:02:11.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.548+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e940cb5d0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.549+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e94067450 con 0x7f7e940cf9f0 2023-11-24T08:02:11.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.550+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7e84009af0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.551+0000 7f7e90ff9640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e8006aff0 0x7f7e8006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.551+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e84089df0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.551+0000 7f7e937fe640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e8006aff0 0x7f7e8006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.553+0000 7f7e937fe640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e8006aff0 0x7f7e8006d4b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e88036000 tx=0x7f7e88030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.555+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e84054c10 con 0x7f7e940cf9f0 2023-11-24T08:02:11.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.744+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e9408c7e0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.747+0000 7f7e90ff9640 1 -- 172.21.15.161:0/815512470 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f7e8400b3a0 con 0x7f7e940cf9f0 2023-11-24T08:02:11.749 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:11.749 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.749+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e8006aff0 msgr2=0x7f7e8006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.749+0000 7f7e9930d640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e8006aff0 0x7f7e8006d4b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7e88036000 tx=0x7f7e88030000 comp rx=0 tx=0).stop 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.749+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 msgr2=0x7f7e940c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.749+0000 7f7e9930d640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940c7320 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7e8400d800 tx=0x7f7e8400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 shutdown_connections 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7e8006aff0 0x7f7e8006d4b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e94161010 0x7f7e941548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e94160920 0x7f7e94155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 --2- 172.21.15.161:0/815512470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e940cf9f0 0x7f7e940c7320 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 >> 172.21.15.161:0/815512470 conn(0x7f7e940d3090 msgr2=0x7f7e940cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 shutdown_connections 2023-11-24T08:02:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.750+0000 7f7e9930d640 1 -- 172.21.15.161:0/815512470 wait complete. 2023-11-24T08:02:11.770 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:02:11.771 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:11.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.971+0000 7fac93368640 1 Processor -- start 2023-11-24T08:02:11.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.971+0000 7fac93368640 1 -- start start 2023-11-24T08:02:11.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac93368640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac8c13df80 0x7fac8c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac93368640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c06c470 con 0x7fac8c13e360 2023-11-24T08:02:11.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac93368640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c06c750 con 0x7fac8c0cf9a0 2023-11-24T08:02:11.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac93368640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c06ca30 con 0x7fac8c13df80 2023-11-24T08:02:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac90903640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fac8c13e360 0x7fac8c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50544/0 (socket says 172.21.15.161:50544) 2023-11-24T08:02:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac90903640 1 -- 172.21.15.161:0/3135375866 learned_addr learned my addr 172.21.15.161:0/3135375866 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.973+0000 7fac91104640 1 --2- 172.21.15.161:0/3135375866 >> v2:172.21.15.175:3300/0 conn(0x7fac8c13df80 0x7fac8c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979214948 0 0) 0x7fac8c06c470 con 0x7fac8c13e360 2023-11-24T08:02:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac78003520 con 0x7fac8c13e360 2023-11-24T08:02:11.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227483288 0 0) 0x7fac78003520 con 0x7fac8c13e360 2023-11-24T08:02:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 >> v2:172.21.15.175:3300/0 conn(0x7fac8c13df80 msgr2=0x7fac8c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 --2- 172.21.15.161:0/3135375866 >> v2:172.21.15.175:3300/0 conn(0x7fac8c13df80 0x7fac8c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 >> v1:172.21.15.175:6789/0 conn(0x7fac8c0cf9a0 legacy=0x7fac8c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c06cd10 con 0x7fac8c13e360 2023-11-24T08:02:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fac7c001670 con 0x7fac8c13e360 2023-11-24T08:02:11.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 >> v1:172.21.15.161:6789/0 conn(0x7fac8c13e360 legacy=0x7fac8c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac78003970 0x7fac78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac780047c0 0x7fac78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac78005180 0x7fac7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c06ca30 con 0x7fac78005180 2023-11-24T08:02:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7800c020 con 0x7fac78003970 2023-11-24T08:02:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7800c1e0 con 0x7fac780047c0 2023-11-24T08:02:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.974+0000 7fac91905640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac78005180 0x7fac7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac90903640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac780047c0 0x7fac78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac91104640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac78003970 0x7fac78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac91905640 1 -- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac780047c0 msgr2=0x7fac78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac91905640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac780047c0 0x7fac78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac91905640 1 -- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac78003970 msgr2=0x7fac78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:11.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac91905640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac78003970 0x7fac78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.975+0000 7fac91905640 1 -- 172.21.15.161:0/3135375866 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac78003520 con 0x7fac78005180 2023-11-24T08:02:11.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.976+0000 7fac91905640 1 -- 172.21.15.161:0/3135375866 reap_dead start 2023-11-24T08:02:11.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.976+0000 7fac91905640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac78005180 0x7fac7800b980 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fac84001e20 tx=0x7fac780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596c21d8ae95360d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.976+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84003b70 con 0x7fac78005180 2023-11-24T08:02:11.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.976+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84003cd0 con 0x7fac78005180 2023-11-24T08:02:11.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.976+0000 7fac83fff640 1 -- 172.21.15.161:0/3135375866 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84005310 con 0x7fac78005180 2023-11-24T08:02:11.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 -- 172.21.15.161:0/3135375866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac78005180 msgr2=0x7fac7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac78005180 0x7fac7800b980 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fac84001e20 tx=0x7fac780057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 -- 172.21.15.161:0/3135375866 shutdown_connections 2023-11-24T08:02:11.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 --2- 172.21.15.161:0/3135375866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac78005180 0x7fac7800b980 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 -- 172.21.15.161:0/3135375866 >> 172.21.15.161:0/3135375866 conn(0x7fac8c06a800 msgr2=0x7fac8c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 -- 172.21.15.161:0/3135375866 shutdown_connections 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.977+0000 7fac93368640 1 -- 172.21.15.161:0/3135375866 wait complete. 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.979+0000 7fac93368640 1 Processor -- start 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.979+0000 7fac93368640 1 -- start start 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac93368640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac78005180 0x7fac8c152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac93368640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c0add00 0x7fac8c13d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac93368640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 0x7fac8c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac93368640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c0acd70 con 0x7fac8c0ad200 2023-11-24T08:02:11.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac93368640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c1533f0 con 0x7fac8c0add00 2023-11-24T08:02:11.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac93368640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c152e30 con 0x7fac78005180 2023-11-24T08:02:11.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 0x7fac8c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 0x7fac8c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39222/0 (socket says 172.21.15.161:39222) 2023-11-24T08:02:11.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 -- 172.21.15.161:0/305423867 learned_addr learned my addr 172.21.15.161:0/305423867 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91104640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac78005180 0x7fac8c152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac90903640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c0add00 0x7fac8c13d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 -- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac78005180 msgr2=0x7fac8c152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac78005180 0x7fac8c152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 -- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c0add00 msgr2=0x7fac8c13d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c0add00 0x7fac8c13d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:11.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91905640 1 -- 172.21.15.161:0/305423867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c153110 con 0x7fac8c0ad200 2023-11-24T08:02:11.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.981+0000 7fac91104640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac78005180 0x7fac8c152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:11.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.982+0000 7fac91905640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 0x7fac8c0b2cf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fac8402c040 tx=0x7fac840014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.982+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac84006d50 con 0x7fac8c0ad200 2023-11-24T08:02:11.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.982+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac84007030 con 0x7fac8c0ad200 2023-11-24T08:02:11.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.982+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac840073a0 con 0x7fac8c0ad200 2023-11-24T08:02:11.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.982+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c0aca00 con 0x7fac8c0ad200 2023-11-24T08:02:11.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.982+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c13dc70 con 0x7fac8c0ad200 2023-11-24T08:02:11.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.983+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c0acf20 con 0x7fac8c0ad200 2023-11-24T08:02:11.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.984+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fac84007500 con 0x7fac8c0ad200 2023-11-24T08:02:11.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.985+0000 7fac81ffb640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac7006b020 0x7fac7006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:11.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.985+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac840ab660 con 0x7fac8c0ad200 2023-11-24T08:02:11.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.986+0000 7fac91104640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac7006b020 0x7fac7006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:11.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.987+0000 7fac91104640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac7006b020 0x7fac7006d4e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac88009980 tx=0x7fac88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:11.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:11.990+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac8c0acf20 con 0x7fac8c0ad200 2023-11-24T08:02:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.206+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac8c0675d0 con 0x7fac8c0ad200 2023-11-24T08:02:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.207+0000 7fac81ffb640 1 -- 172.21.15.161:0/305423867 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fac84076420 con 0x7fac8c0ad200 2023-11-24T08:02:12.208 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:12.208 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:01:45.366812+0000","modified":"2023-11-24T08:01:48.419033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5175},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5175":{"gid":5175,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/1086564705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1086564705},{"type":"v1","addr":"172.21.15.175:6836","nonce":1086564705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:02:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 18 2023-11-24T08:02:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac7006b020 msgr2=0x7fac7006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac7006b020 0x7fac7006d4e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fac88009980 tx=0x7fac88008040 comp rx=0 tx=0).stop 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 msgr2=0x7fac8c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 0x7fac8c0b2cf0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fac8402c040 tx=0x7fac840014a0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 shutdown_connections 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fac7006b020 0x7fac7006d4e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fac8c0ad200 0x7fac8c0b2cf0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac8c0add00 0x7fac8c13d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 --2- 172.21.15.161:0/305423867 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac78005180 0x7fac8c152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 >> 172.21.15.161:0/305423867 conn(0x7fac8c06a800 msgr2=0x7fac8c15d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.209+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 shutdown_connections 2023-11-24T08:02:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.210+0000 7fac93368640 1 -- 172.21.15.161:0/305423867 wait complete. 2023-11-24T08:02:12.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:12.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.435+0000 7f37ed0da640 1 Processor -- start 2023-11-24T08:02:12.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.435+0000 7f37ed0da640 1 -- start start 2023-11-24T08:02:12.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37ed0da640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f37e80b3ae0 0x7f37e815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37ed0da640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f37e80cf290 0x7f37e80cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37ed0da640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e8070c40 con 0x7f37e80ae5a0 2023-11-24T08:02:12.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37ed0da640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e8071450 con 0x7f37e80cf290 2023-11-24T08:02:12.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37ed0da640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e80cfc60 con 0x7f37e80b3ae0 2023-11-24T08:02:12.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37e759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f37e80cf290 0x7f37e80cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37e759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f37e80cf290 0x7f37e80cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39224/0 (socket says 172.21.15.161:39224) 2023-11-24T08:02:12.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.437+0000 7f37e759e640 1 -- 172.21.15.161:0/593334722 learned_addr learned my addr 172.21.15.161:0/593334722 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:12.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.438+0000 7f37e659c640 1 --2- 172.21.15.161:0/593334722 >> v2:172.21.15.175:3300/0 conn(0x7f37e80b3ae0 0x7f37e815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.438+0000 7f37e759e640 1 -- 172.21.15.161:0/593334722 >> v2:172.21.15.175:3300/0 conn(0x7f37e80b3ae0 msgr2=0x7f37e815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:12.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.438+0000 7f37e759e640 1 --2- 172.21.15.161:0/593334722 >> v2:172.21.15.175:3300/0 conn(0x7f37e80b3ae0 0x7f37e815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.438+0000 7f37e759e640 1 -- 172.21.15.161:0/593334722 >> v1:172.21.15.175:6789/0 conn(0x7f37e80ae5a0 legacy=0x7f37e806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:12.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.438+0000 7f37e759e640 1 -- 172.21.15.161:0/593334722 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e806c470 con 0x7f37e80cf290 2023-11-24T08:02:12.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.439+0000 7f37e759e640 1 --2- 172.21.15.161:0/593334722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cf720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cfea0 tx=0x7f37e002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14840cc980f19d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:12.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.439+0000 7f37e5d9b640 1 -- 172.21.15.161:0/593334722 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e002cb10 con 0x7f37e80cf290 2023-11-24T08:02:12.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.439+0000 7f37e5d9b640 1 -- 172.21.15.161:0/593334722 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e002cc70 con 0x7f37e80cf290 2023-11-24T08:02:12.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.439+0000 7f37e5d9b640 1 -- 172.21.15.161:0/593334722 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e00343f0 con 0x7f37e80cf290 2023-11-24T08:02:12.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 -- 172.21.15.161:0/593334722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 msgr2=0x7f37e80cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 --2- 172.21.15.161:0/593334722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cf720 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f37e80cfea0 tx=0x7f37e002bf70 comp rx=0 tx=0).stop 2023-11-24T08:02:12.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 -- 172.21.15.161:0/593334722 shutdown_connections 2023-11-24T08:02:12.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 --2- 172.21.15.161:0/593334722 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cf720 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 --2- 172.21.15.161:0/593334722 >> v2:172.21.15.175:3300/0 conn(0x7f37e80b3ae0 0x7f37e815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 -- 172.21.15.161:0/593334722 >> 172.21.15.161:0/593334722 conn(0x7f37e806a800 msgr2=0x7f37e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:12.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 -- 172.21.15.161:0/593334722 shutdown_connections 2023-11-24T08:02:12.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.440+0000 7f37ed0da640 1 -- 172.21.15.161:0/593334722 wait complete. 2023-11-24T08:02:12.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.442+0000 7f37ed0da640 1 Processor -- start 2023-11-24T08:02:12.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.442+0000 7f37ed0da640 1 -- start start 2023-11-24T08:02:12.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37ed0da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37e80ae5a0 0x7f37e814f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37ed0da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37e80b3ae0 0x7f37e8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37ed0da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37ed0da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8151d30 con 0x7f37e80cf290 2023-11-24T08:02:12.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37ed0da640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8153710 con 0x7f37e80b3ae0 2023-11-24T08:02:12.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37ed0da640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8157fe0 con 0x7f37e80ae5a0 2023-11-24T08:02:12.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37e759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37e759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39240/0 (socket says 172.21.15.161:39240) 2023-11-24T08:02:12.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37e759e640 1 -- 172.21.15.161:0/3118641559 learned_addr learned my addr 172.21.15.161:0/3118641559 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:12.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37e6d9d640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37e80ae5a0 0x7f37e814f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.444+0000 7f37e659c640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37e80b3ae0 0x7f37e8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37e759e640 1 -- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37e80ae5a0 msgr2=0x7f37e814f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37e759e640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37e80ae5a0 0x7f37e814f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37e759e640 1 -- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37e80b3ae0 msgr2=0x7f37e8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37e759e640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37e80b3ae0 0x7f37e8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37e759e640 1 -- 172.21.15.161:0/3118641559 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0009b30 con 0x7f37e80cf290 2023-11-24T08:02:12.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37e759e640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cb8a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f37e002c580 tx=0x7f37e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:12.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0009510 con 0x7f37e80cf290 2023-11-24T08:02:12.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e003e450 con 0x7f37e80cf290 2023-11-24T08:02:12.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e003e7e0 con 0x7f37e80cf290 2023-11-24T08:02:12.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e8153430 con 0x7f37e80cf290 2023-11-24T08:02:12.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.445+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e8158560 con 0x7f37e80cf290 2023-11-24T08:02:12.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.447+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8158750 con 0x7f37e80cf290 2023-11-24T08:02:12.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.448+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f37e003e940 con 0x7f37e80cf290 2023-11-24T08:02:12.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.448+0000 7f37cf7fe640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37d406aff0 0x7f37d406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.449+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37e00ac690 con 0x7f37e80cf290 2023-11-24T08:02:12.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.449+0000 7f37e6d9d640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37d406aff0 0x7f37d406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.450+0000 7f37e6d9d640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37d406aff0 0x7f37d406d4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007fd0 tx=0x7f37d8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:12.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.454+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37e00774c0 con 0x7f37e80cf290 2023-11-24T08:02:12.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.684+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37e80675d0 con 0x7f37e80cf290 2023-11-24T08:02:12.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.685+0000 7f37cf7fe640 1 -- 172.21.15.161:0/3118641559 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f37e0033e80 con 0x7f37e80cf290 2023-11-24T08:02:12.687 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:12.687 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:01:45.366812+0000","modified":"2023-11-24T08:01:48.419033+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5175},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5175":{"gid":5175,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.175:6836/1086564705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1086564705},{"type":"v1","addr":"172.21.15.175:6836","nonce":1086564705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T08:02:12.687 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 18 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37d406aff0 msgr2=0x7f37d406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37d406aff0 0x7f37d406d4b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007fd0 tx=0x7f37d8009040 comp rx=0 tx=0).stop 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 msgr2=0x7f37e80cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cb8a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f37e002c580 tx=0x7f37e0004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 shutdown_connections 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f37d406aff0 0x7f37d406d4b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f37e80cf290 0x7f37e80cb8a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f37e80b3ae0 0x7f37e8152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 --2- 172.21.15.161:0/3118641559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37e80ae5a0 0x7f37e814f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.688+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 >> 172.21.15.161:0/3118641559 conn(0x7f37e806a800 msgr2=0x7f37e80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:12.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.689+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 shutdown_connections 2023-11-24T08:02:12.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.689+0000 7f37ed0da640 1 -- 172.21.15.161:0/3118641559 wait complete. 2023-11-24T08:02:12.709 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.922+0000 7f4ea2039640 1 Processor -- start 2023-11-24T08:02:12.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.922+0000 7f4ea2039640 1 -- start start 2023-11-24T08:02:12.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.923+0000 7f4ea2039640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e9c13cfa0 0x7f4e9c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.923+0000 7f4ea2039640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.923+0000 7f4ea2039640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9c0cdec0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.923+0000 7f4ea2039640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9c0ce1a0 con 0x7f4e9c13cfa0 2023-11-24T08:02:12.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.923+0000 7f4ea2039640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c0ce480 con 0x7f4e9c0cd530 2023-11-24T08:02:12.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1838640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4e9c0cd9b0 0x7f4e9c15d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50548/0 (socket says 172.21.15.161:50548) 2023-11-24T08:02:12.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1838640 1 -- 172.21.15.161:0/1522542972 learned_addr learned my addr 172.21.15.161:0/1522542972 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:12.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1037640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4e9c13cfa0 0x7f4e9c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1037640 1 -- 172.21.15.161:0/1522542972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 msgr2=0x7f4e9c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:12.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea0836640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1037640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4e93fff640 1 -- 172.21.15.161:0/1522542972 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510732752 0 0) 0x7f4e9c0cdec0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1037640 1 -- 172.21.15.161:0/1522542972 >> v1:172.21.15.161:6789/0 conn(0x7f4e9c0cd9b0 legacy=0x7f4e9c15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea1037640 1 -- 172.21.15.161:0/1522542972 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0ce760 con 0x7f4e9c13cfa0 2023-11-24T08:02:12.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.924+0000 7f4ea0836640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.925+0000 7f4ea1037640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c15afb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097a0 tx=0x7f4e9802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9011a755adbd7e89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:12.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4e93fff640 1 -- 172.21.15.161:0/1522542972 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98031780 con 0x7f4e9c13cfa0 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4e93fff640 1 -- 172.21.15.161:0/1522542972 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e980318e0 con 0x7f4e9c13cfa0 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4e93fff640 1 -- 172.21.15.161:0/1522542972 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98031c70 con 0x7f4e9c13cfa0 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 -- 172.21.15.161:0/1522542972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c13cfa0 msgr2=0x7f4e9c15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c15afb0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4e980097a0 tx=0x7f4e9802b820 comp rx=0 tx=0).stop 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 -- 172.21.15.161:0/1522542972 shutdown_connections 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 --2- 172.21.15.161:0/1522542972 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c15afb0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 -- 172.21.15.161:0/1522542972 >> 172.21.15.161:0/1522542972 conn(0x7f4e9c06a800 msgr2=0x7f4e9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 -- 172.21.15.161:0/1522542972 shutdown_connections 2023-11-24T08:02:12.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.926+0000 7f4ea2039640 1 -- 172.21.15.161:0/1522542972 wait complete. 2023-11-24T08:02:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.928+0000 7f4ea2039640 1 Processor -- start 2023-11-24T08:02:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.928+0000 7f4ea2039640 1 -- start start 2023-11-24T08:02:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea2039640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea2039640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 0x7f4e9c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea2039640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c14df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea2039640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1f47f0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea2039640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1f4a90 con 0x7f4e9c13cfa0 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea2039640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c1f4d70 con 0x7f4e9c0cd530 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea0836640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 0x7f4e9c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea0836640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 0x7f4e9c14da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39256/0 (socket says 172.21.15.161:39256) 2023-11-24T08:02:12.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.929+0000 7f4ea0836640 1 -- 172.21.15.161:0/2915832334 learned_addr learned my addr 172.21.15.161:0/2915832334 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea1037640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea0836640 1 -- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 msgr2=0x7f4e9c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea0836640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c14ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea1838640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c14df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea0836640 1 -- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e9c13cfa0 msgr2=0x7f4e9c14df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea0836640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c14df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:12.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea0836640 1 -- 172.21.15.161:0/2915832334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e98009400 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea0836640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 0x7f4e9c14da20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c7f0 tx=0x7f4e8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c00cea0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8c004230 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e9c1f5050 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.930+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8c007830 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.931+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9c14b050 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.932+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9c14b1e0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.933+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4e8c007990 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.934+0000 7f4e91ffb640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e8006aff0 0x7f4e8006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:12.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.934+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e8c089940 con 0x7f4e9c0cd9b0 2023-11-24T08:02:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.934+0000 7f4ea1037640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e8006aff0 0x7f4e8006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:12.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.936+0000 7f4ea1037640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e8006aff0 0x7f4e8006d4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e98036000 tx=0x7f4e9803d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:12.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:12.938+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e9c14b1e0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:13.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.134+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e9c14b1e0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:13.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.136+0000 7f4e91ffb640 1 -- 172.21.15.161:0/2915832334 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f4e9c14b1e0 con 0x7f4e9c0cd9b0 2023-11-24T08:02:13.137 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:13.137 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":35,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:01:46.499474+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:01:43.282420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T08:01:44.380572+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:13.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e8006aff0 msgr2=0x7f4e8006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e8006aff0 0x7f4e8006d4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4e98036000 tx=0x7f4e9803d040 comp rx=0 tx=0).stop 2023-11-24T08:02:13.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 msgr2=0x7f4e9c14da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 0x7f4e9c14da20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c00c7f0 tx=0x7f4e8c00ccb0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 shutdown_connections 2023-11-24T08:02:13.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e8006aff0 0x7f4e8006d4b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e9c13cfa0 0x7f4e9c14df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e9c0cd9b0 0x7f4e9c14da20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 --2- 172.21.15.161:0/2915832334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e9c0cd530 0x7f4e9c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 >> 172.21.15.161:0/2915832334 conn(0x7f4e9c06a800 msgr2=0x7f4e9c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 shutdown_connections 2023-11-24T08:02:13.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.138+0000 7f4ea2039640 1 -- 172.21.15.161:0/2915832334 wait complete. 2023-11-24T08:02:13.159 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:02:13.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.374+0000 7fc84f59e640 1 Processor -- start 2023-11-24T08:02:13.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.375+0000 7fc84f59e640 1 -- start start 2023-11-24T08:02:13.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc850160920 0x7fc8500b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc850161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84f59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8500d0a10 con 0x7fc8500cf9f0 2023-11-24T08:02:13.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84f59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8500d0330 con 0x7fc850160920 2023-11-24T08:02:13.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500d1f50 con 0x7fc8500cfea0 2023-11-24T08:02:13.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84dd9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc8500cf9f0 0x7fc850161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50552/0 (socket says 172.21.15.161:50552) 2023-11-24T08:02:13.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84dd9b640 1 -- 172.21.15.161:0/3328834669 learned_addr learned my addr 172.21.15.161:0/3328834669 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.376+0000 7fc84e59c640 1 --2- 172.21.15.161:0/3328834669 >> v2:172.21.15.161:3300/0 conn(0x7fc850160920 0x7fc8500b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.377+0000 7fc84ed9d640 1 --2- 172.21.15.161:0/3328834669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc850161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.377+0000 7fc84e59c640 1 -- 172.21.15.161:0/3328834669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 msgr2=0x7fc850161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.377+0000 7fc84e59c640 1 --2- 172.21.15.161:0/3328834669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc850161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.377+0000 7fc84e59c640 1 -- 172.21.15.161:0/3328834669 >> v1:172.21.15.161:6789/0 conn(0x7fc8500cf9f0 legacy=0x7fc850161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.377+0000 7fc84e59c640 1 -- 172.21.15.161:0/3328834669 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500cf080 con 0x7fc850160920 2023-11-24T08:02:13.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.378+0000 7fc84e59c640 1 --2- 172.21.15.161:0/3328834669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc850160920 0x7fc8500b3f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc8400097a0 tx=0x7fc84002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fccfed757aab589 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:13.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.378+0000 7fc84d59a640 1 -- 172.21.15.161:0/3328834669 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84002d040 con 0x7fc850160920 2023-11-24T08:02:13.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.378+0000 7fc84d59a640 1 -- 172.21.15.161:0/3328834669 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840031810 con 0x7fc850160920 2023-11-24T08:02:13.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.378+0000 7fc84d59a640 1 -- 172.21.15.161:0/3328834669 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc840031ba0 con 0x7fc850160920 2023-11-24T08:02:13.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 -- 172.21.15.161:0/3328834669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc850160920 msgr2=0x7fc8500b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 --2- 172.21.15.161:0/3328834669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc850160920 0x7fc8500b3f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc8400097a0 tx=0x7fc84002b8b0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 -- 172.21.15.161:0/3328834669 shutdown_connections 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 --2- 172.21.15.161:0/3328834669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc850161720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 --2- 172.21.15.161:0/3328834669 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc850160920 0x7fc8500b3f30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 -- 172.21.15.161:0/3328834669 >> 172.21.15.161:0/3328834669 conn(0x7fc8500d3090 msgr2=0x7fc8500d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 -- 172.21.15.161:0/3328834669 shutdown_connections 2023-11-24T08:02:13.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.379+0000 7fc84f59e640 1 -- 172.21.15.161:0/3328834669 wait complete. 2023-11-24T08:02:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.381+0000 7fc84f59e640 1 Processor -- start 2023-11-24T08:02:13.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.381+0000 7fc84f59e640 1 -- start start 2023-11-24T08:02:13.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 0x7fc8501513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc8500c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850160920 0x7fc8500c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500ccfc0 con 0x7fc8500cf9f0 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84f59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500cc3b0 con 0x7fc850160920 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500cc690 con 0x7fc8500cfea0 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 0x7fc8501513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 0x7fc8501513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39280/0 (socket says 172.21.15.161:39280) 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.382+0000 7fc84e59c640 1 -- 172.21.15.161:0/675393342 learned_addr learned my addr 172.21.15.161:0/675393342 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84e59c640 1 -- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 msgr2=0x7fc8500c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84e59c640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc8500c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84e59c640 1 -- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850160920 msgr2=0x7fc8500c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84e59c640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850160920 0x7fc8500c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84e59c640 1 -- 172.21.15.161:0/675393342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc840009400 con 0x7fc8500cf9f0 2023-11-24T08:02:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84e59c640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 0x7fc8501513e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc8400098c0 tx=0x7fc8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:13.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84003ad60 con 0x7fc8500cf9f0 2023-11-24T08:02:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc840044400 con 0x7fc8500cf9f0 2023-11-24T08:02:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8400447b0 con 0x7fc8500cf9f0 2023-11-24T08:02:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8500cc970 con 0x7fc8500cf9f0 2023-11-24T08:02:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.383+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc850151920 con 0x7fc8500cf9f0 2023-11-24T08:02:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.385+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc850151ae0 con 0x7fc8500cf9f0 2023-11-24T08:02:13.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.385+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc84004d440 con 0x7fc8500cf9f0 2023-11-24T08:02:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.386+0000 7fc846ffd640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc83006aff0 0x7fc83006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.386+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8400abe30 con 0x7fc8500cf9f0 2023-11-24T08:02:13.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.387+0000 7fc84dd9b640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc83006aff0 0x7fc83006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.388+0000 7fc84dd9b640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc83006aff0 0x7fc83006d4b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc8501f6460 tx=0x7fc838007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:13.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.391+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc840076bd0 con 0x7fc8500cf9f0 2023-11-24T08:02:13.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.617+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc850067450 con 0x7fc8500cf9f0 2023-11-24T08:02:13.619 INFO:tasks.ceph.mon.a.smithi161.stderr:2023-11-24T08:02:13.618+0000 7f2aa1f75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:02:13.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.621+0000 7fc846ffd640 1 -- 172.21.15.161:0/675393342 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc840035090 con 0x7fc8500cf9f0 2023-11-24T08:02:13.622 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:02:13.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc83006aff0 msgr2=0x7fc83006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc83006aff0 0x7fc83006d4b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc8501f6460 tx=0x7fc838007a40 comp rx=0 tx=0).stop 2023-11-24T08:02:13.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 msgr2=0x7fc8501513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 0x7fc8501513e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc8400098c0 tx=0x7fc8400046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 shutdown_connections 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc83006aff0 0x7fc83006d4b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc850160920 0x7fc8500c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8500cfea0 0x7fc8500c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 --2- 172.21.15.161:0/675393342 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8500cf9f0 0x7fc8501513e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 >> 172.21.15.161:0/675393342 conn(0x7fc8500d3090 msgr2=0x7fc8501613e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:13.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.624+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 shutdown_connections 2023-11-24T08:02:13.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.625+0000 7fc84f59e640 1 -- 172.21.15.161:0/675393342 wait complete. 2023-11-24T08:02:13.644 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:02:13.756 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-24T08:02:13.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.847+0000 7f43c8a83640 1 Processor -- start 2023-11-24T08:02:13.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.847+0000 7f43c8a83640 1 -- start start 2023-11-24T08:02:13.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c8a83640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f43c406a3e0 0x7f43c40ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c8a83640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43c40d0b60 0x7f43c40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c8a83640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c4071de0 con 0x7f43c406a7c0 2023-11-24T08:02:13.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c8a83640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40af320 con 0x7f43c406a3e0 2023-11-24T08:02:13.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c8a83640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c4072030 con 0x7f43c40d0b60 2023-11-24T08:02:13.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c259c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f43c406a3e0 0x7f43c40ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c2d9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f43c406a7c0 0x7f43c406f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50554/0 (socket says 172.21.15.161:50554) 2023-11-24T08:02:13.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.849+0000 7f43c2d9d640 1 -- 172.21.15.161:0/60383732 learned_addr learned my addr 172.21.15.161:0/60383732 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:13.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43b9d9b640 1 --2- 172.21.15.161:0/60383732 >> v2:172.21.15.175:3300/0 conn(0x7f43c40d0b60 0x7f43c40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43c1d9b640 1 -- 172.21.15.161:0/60383732 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357107346 0 0) 0x7f43c4071de0 con 0x7f43c406a7c0 2023-11-24T08:02:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43c1d9b640 1 -- 172.21.15.161:0/60383732 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b0003520 con 0x7f43c406a7c0 2023-11-24T08:02:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43c259c640 1 -- 172.21.15.161:0/60383732 >> v2:172.21.15.175:3300/0 conn(0x7f43c40d0b60 msgr2=0x7f43c40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43c259c640 1 --2- 172.21.15.161:0/60383732 >> v2:172.21.15.175:3300/0 conn(0x7f43c40d0b60 0x7f43c40aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43c259c640 1 -- 172.21.15.161:0/60383732 >> v1:172.21.15.161:6789/0 conn(0x7f43c406a7c0 legacy=0x7f43c406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.852 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.850+0000 7f43c259c640 1 -- 172.21.15.161:0/60383732 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4072310 con 0x7f43c406a3e0 2023-11-24T08:02:13.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.851+0000 7f43c259c640 1 --2- 172.21.15.161:0/60383732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c40ac8d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f43c40b6120 tx=0x7f43b402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26459932ad83caa7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.851+0000 7f43c1d9b640 1 -- 172.21.15.161:0/60383732 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b402cc80 con 0x7f43c406a3e0 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.851+0000 7f43c1d9b640 1 -- 172.21.15.161:0/60383732 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b402cde0 con 0x7f43c406a3e0 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.851+0000 7f43c1d9b640 1 -- 172.21.15.161:0/60383732 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4034660 con 0x7f43c406a3e0 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 -- 172.21.15.161:0/60383732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 msgr2=0x7f43c40ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 --2- 172.21.15.161:0/60383732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c40ac8d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f43c40b6120 tx=0x7f43b402bed0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 -- 172.21.15.161:0/60383732 shutdown_connections 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 --2- 172.21.15.161:0/60383732 >> v2:172.21.15.175:3300/0 conn(0x7f43c40d0b60 0x7f43c40aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 --2- 172.21.15.161:0/60383732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c40ac8d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 -- 172.21.15.161:0/60383732 >> 172.21.15.161:0/60383732 conn(0x7f43c40cfef0 msgr2=0x7f43c40d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 -- 172.21.15.161:0/60383732 shutdown_connections 2023-11-24T08:02:13.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.852+0000 7f43c8a83640 1 -- 172.21.15.161:0/60383732 wait complete. 2023-11-24T08:02:13.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.854+0000 7f43c8a83640 1 Processor -- start 2023-11-24T08:02:13.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.854+0000 7f43c8a83640 1 -- start start 2023-11-24T08:02:13.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c8a83640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c41e8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c8a83640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c406a7c0 0x7f43c4154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c8a83640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c40d0b60 0x7f43c415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c8a83640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41e2580 con 0x7f43c406a3e0 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c8a83640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41f2f70 con 0x7f43c40d0b60 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c8a83640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41e9370 con 0x7f43c406a7c0 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c41e8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c41e8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39298/0 (socket says 172.21.15.161:39298) 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 -- 172.21.15.161:0/1111522977 learned_addr learned my addr 172.21.15.161:0/1111522977 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 -- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c406a7c0 msgr2=0x7f43c4154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c406a7c0 0x7f43c4154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 -- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c40d0b60 msgr2=0x7f43c415c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:13.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c40d0b60 0x7f43c415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:13.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.855+0000 7f43c259c640 1 -- 172.21.15.161:0/1111522977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4009a70 con 0x7f43c406a3e0 2023-11-24T08:02:13.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.856+0000 7f43c259c640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c41e8e30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f43b4037040 tx=0x7f43b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:13.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.856+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b403e610 con 0x7f43c406a3e0 2023-11-24T08:02:13.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.856+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b403e770 con 0x7f43c406a3e0 2023-11-24T08:02:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.856+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b403eb20 con 0x7f43c406a3e0 2023-11-24T08:02:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.856+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c4154c10 con 0x7f43c406a3e0 2023-11-24T08:02:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.856+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c41551d0 con 0x7f43c406a3e0 2023-11-24T08:02:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.857+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c41f3100 con 0x7f43c406a3e0 2023-11-24T08:02:13.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.858+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f43b403b050 con 0x7f43c406a3e0 2023-11-24T08:02:13.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.859+0000 7f43bb7fe640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43a406b020 0x7f43a406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:13.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.859+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f43b40ac320 con 0x7f43c406a3e0 2023-11-24T08:02:13.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.860+0000 7f43b9d9b640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43a406b020 0x7f43a406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:13.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.861+0000 7f43b9d9b640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43a406b020 0x7f43a406d4e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f43c40b04d0 tx=0x7f43ac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:13.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:13.864+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43b4077080 con 0x7f43c406a3e0 2023-11-24T08:02:14.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.093+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43c40675d0 con 0x7f43c406a3e0 2023-11-24T08:02:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.722+0000 7f43bb7fe640 1 -- 172.21.15.161:0/1111522977 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43b4009450 con 0x7f43c406a3e0 2023-11-24T08:02:14.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43a406b020 msgr2=0x7f43a406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:14.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43a406b020 0x7f43a406d4e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f43c40b04d0 tx=0x7f43ac008040 comp rx=0 tx=0).stop 2023-11-24T08:02:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 msgr2=0x7f43c41e8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c41e8e30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f43b4037040 tx=0x7f43b4004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 shutdown_connections 2023-11-24T08:02:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f43a406b020 0x7f43a406d4e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43c40d0b60 0x7f43c415c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43c406a7c0 0x7f43c4154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 --2- 172.21.15.161:0/1111522977 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43c406a3e0 0x7f43c41e8e30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 >> 172.21.15.161:0/1111522977 conn(0x7f43c40cfef0 msgr2=0x7f43c40b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.725+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 shutdown_connections 2023-11-24T08:02:14.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.726+0000 7f43c8a83640 1 -- 172.21.15.161:0/1111522977 wait complete. 2023-11-24T08:02:14.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:02:14.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.948+0000 7faf67015640 1 Processor -- start 2023-11-24T08:02:14.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.949+0000 7faf67015640 1 -- start start 2023-11-24T08:02:14.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.950+0000 7faf67015640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf6013df80 0x7faf6015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:14.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.950+0000 7faf67015640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013e360 0x7faf600cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:14.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.950+0000 7faf67015640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf6006c470 con 0x7faf6015f9c0 2023-11-24T08:02:14.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.950+0000 7faf67015640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6006c750 con 0x7faf6013df80 2023-11-24T08:02:14.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.950+0000 7faf67015640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6006ca30 con 0x7faf6013e360 2023-11-24T08:02:14.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf64db1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf6013df80 0x7faf6015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:14.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf655b2640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faf6015f9c0 0x7faf601408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50564/0 (socket says 172.21.15.161:50564) 2023-11-24T08:02:14.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf655b2640 1 -- 172.21.15.161:0/970412277 learned_addr learned my addr 172.21.15.161:0/970412277 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:14.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf5ffff640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013e360 0x7faf600cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:14.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf64db1640 1 -- 172.21.15.161:0/970412277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013e360 msgr2=0x7faf600cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf64db1640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013e360 0x7faf600cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf64db1640 1 -- 172.21.15.161:0/970412277 >> v1:172.21.15.161:6789/0 conn(0x7faf6015f9c0 legacy=0x7faf601408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf64db1640 1 -- 172.21.15.161:0/970412277 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6006cd10 con 0x7faf6013df80 2023-11-24T08:02:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.951+0000 7faf5ffff640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013e360 0x7faf600cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.952+0000 7faf64db1640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6013df80 0x7faf6015bee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faf540097a0 tx=0x7faf5402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6eed11c960dd72a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:14.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf5f7fe640 1 -- 172.21.15.161:0/970412277 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5402d040 con 0x7faf6013df80 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf5f7fe640 1 -- 172.21.15.161:0/970412277 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf54031810 con 0x7faf6013df80 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf5f7fe640 1 -- 172.21.15.161:0/970412277 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf54031ba0 con 0x7faf6013df80 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 -- 172.21.15.161:0/970412277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6013df80 msgr2=0x7faf6015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6013df80 0x7faf6015bee0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7faf540097a0 tx=0x7faf5402b8b0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 -- 172.21.15.161:0/970412277 shutdown_connections 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013e360 0x7faf600cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 --2- 172.21.15.161:0/970412277 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6013df80 0x7faf6015bee0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 -- 172.21.15.161:0/970412277 >> 172.21.15.161:0/970412277 conn(0x7faf6006a800 msgr2=0x7faf6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:14.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 -- 172.21.15.161:0/970412277 shutdown_connections 2023-11-24T08:02:14.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.953+0000 7faf67015640 1 -- 172.21.15.161:0/970412277 wait complete. 2023-11-24T08:02:14.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.955+0000 7faf67015640 1 Processor -- start 2023-11-24T08:02:14.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.955+0000 7faf67015640 1 -- start start 2023-11-24T08:02:14.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf67015640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013df80 0x7faf6014d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:14.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf67015640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6013e360 0x7faf60071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:14.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf67015640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 0x7faf601356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:14.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf67015640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60135bf0 con 0x7faf6015f9c0 2023-11-24T08:02:14.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf67015640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6014bf20 con 0x7faf6013e360 2023-11-24T08:02:14.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf67015640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf60071400 con 0x7faf6013df80 2023-11-24T08:02:14.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.956+0000 7faf655b2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 0x7faf601356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 0x7faf601356b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39314/0 (socket says 172.21.15.161:39314) 2023-11-24T08:02:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 -- 172.21.15.161:0/4085820107 learned_addr learned my addr 172.21.15.161:0/4085820107 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf64db1640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013df80 0x7faf6014d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf5ffff640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6013e360 0x7faf60071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 -- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013df80 msgr2=0x7faf6014d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013df80 0x7faf6014d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 -- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6013e360 msgr2=0x7faf60071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6013e360 0x7faf60071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 -- 172.21.15.161:0/4085820107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf54009400 con 0x7faf6015f9c0 2023-11-24T08:02:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf5ffff640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6013e360 0x7faf60071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf655b2640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 0x7faf601356b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf5800cbc0 tx=0x7faf5800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800ad40 con 0x7faf6015f9c0 2023-11-24T08:02:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58012400 con 0x7faf6015f9c0 2023-11-24T08:02:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf600716e0 con 0x7faf6015f9c0 2023-11-24T08:02:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.957+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5800aea0 con 0x7faf6015f9c0 2023-11-24T08:02:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.958+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6014c200 con 0x7faf6015f9c0 2023-11-24T08:02:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.959+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60071c00 con 0x7faf6015f9c0 2023-11-24T08:02:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.960+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faf58007070 con 0x7faf6015f9c0 2023-11-24T08:02:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.961+0000 7faf5d7fa640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf4406aff0 0x7faf4406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.961+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7faf58089840 con 0x7faf6015f9c0 2023-11-24T08:02:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.962+0000 7faf64db1640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf4406aff0 0x7faf4406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.963+0000 7faf64db1640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf4406aff0 0x7faf4406d4b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf54036000 tx=0x7faf5403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:14.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:14.966+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf60071c00 con 0x7faf6015f9c0 2023-11-24T08:02:15.157 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.156+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf60071c00 con 0x7faf6015f9c0 2023-11-24T08:02:15.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.746+0000 7faf5d7fa640 1 -- 172.21.15.161:0/4085820107 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf60071c00 con 0x7faf6015f9c0 2023-11-24T08:02:15.747 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:02:15.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf4406aff0 msgr2=0x7faf4406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:15.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf4406aff0 0x7faf4406d4b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf54036000 tx=0x7faf5403c040 comp rx=0 tx=0).stop 2023-11-24T08:02:15.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 msgr2=0x7faf601356b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 0x7faf601356b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7faf5800cbc0 tx=0x7faf5800a430 comp rx=0 tx=0).stop 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 shutdown_connections 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf4406aff0 0x7faf4406d4b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf6015f9c0 0x7faf601356b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf6013e360 0x7faf60071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 --2- 172.21.15.161:0/4085820107 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf6013df80 0x7faf6014d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.749+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 >> 172.21.15.161:0/4085820107 conn(0x7faf6006a800 msgr2=0x7faf6015c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:15.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.750+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 shutdown_connections 2023-11-24T08:02:15.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.750+0000 7faf67015640 1 -- 172.21.15.161:0/4085820107 wait complete. 2023-11-24T08:02:15.774 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:02:15.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.979+0000 7f4e75f1d640 1 Processor -- start 2023-11-24T08:02:15.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.979+0000 7f4e75f1d640 1 -- start start 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.980+0000 7f4e75f1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 0x7f4e7015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e75f1d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e7015e1e0 0x7f4e700702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e75f1d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e700b1ee0 con 0x7f4e70143ae0 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e75f1d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e700b2780 con 0x7f4e7015e1e0 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e75f1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7015e990 con 0x7f4e700cf9a0 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e6f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4e70143ae0 0x7f4e700cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50566/0 (socket says 172.21.15.161:50566) 2023-11-24T08:02:15.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e6f7fe640 1 -- 172.21.15.161:0/3218750885 learned_addr learned my addr 172.21.15.161:0/3218750885 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e6effd640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 0x7f4e7015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490166873 0 0) 0x7f4e700b1ee0 con 0x7f4e70143ae0 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.981+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e58003520 con 0x7f4e70143ae0 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6ffff640 1 --2- 172.21.15.161:0/3218750885 >> v2:172.21.15.175:3300/0 conn(0x7f4e7015e1e0 0x7f4e700702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2624158581 0 0) 0x7f4e58003520 con 0x7f4e70143ae0 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 msgr2=0x7f4e7015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 0x7f4e7015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 >> v2:172.21.15.175:3300/0 conn(0x7f4e7015e1e0 msgr2=0x7f4e700702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 --2- 172.21.15.161:0/3218750885 >> v2:172.21.15.175:3300/0 conn(0x7f4e7015e1e0 0x7f4e700702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e700b2130 con 0x7f4e70143ae0 2023-11-24T08:02:15.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f4e60001670 con 0x7f4e70143ae0 2023-11-24T08:02:15.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 >> v1:172.21.15.161:6789/0 conn(0x7f4e70143ae0 legacy=0x7f4e700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:15.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 0x7f4e58003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e58004d00 0x7f4e58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700b2780 con 0x7f4e58003f40 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7015e990 con 0x7f4e58004d00 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5800dc40 con 0x7f4e700cf9a0 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6effd640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.982+0000 7f4e6ffff640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e58004d00 0x7f4e58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6effd640 1 -- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 msgr2=0x7f4e58003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6f7fe640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 0x7f4e58003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6effd640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e700cf9a0 0x7f4e58003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6effd640 1 -- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e58004d00 msgr2=0x7f4e58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6effd640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e58004d00 0x7f4e58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6effd640 1 -- 172.21.15.161:0/3218750885 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58003520 con 0x7f4e58003f40 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.983+0000 7f4e6ffff640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e58004d00 0x7f4e58005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.984+0000 7f4e6effd640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e580047c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009ac0 tx=0x7f4e580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce90b30ac17584e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.984+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6402c6b0 con 0x7f4e58003f40 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.984+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6402c810 con 0x7f4e58003f40 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.984+0000 7f4e6e7fc640 1 -- 172.21.15.161:0/3218750885 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6402cba0 con 0x7f4e58003f40 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e75f1d640 1 -- 172.21.15.161:0/3218750885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 msgr2=0x7f4e580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/3218750885 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e580047c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009ac0 tx=0x7f4e580057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e6ffff640 1 -- 172.21.15.161:0/3218750885 reap_dead start 2023-11-24T08:02:15.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e75f1d640 1 -- 172.21.15.161:0/3218750885 shutdown_connections 2023-11-24T08:02:15.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e75f1d640 1 -- 172.21.15.161:0/3218750885 >> 172.21.15.161:0/3218750885 conn(0x7f4e7006a800 msgr2=0x7f4e7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:15.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e75f1d640 1 -- 172.21.15.161:0/3218750885 shutdown_connections 2023-11-24T08:02:15.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.985+0000 7f4e75f1d640 1 -- 172.21.15.161:0/3218750885 wait complete. 2023-11-24T08:02:15.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.987+0000 7f4e75f1d640 1 Processor -- start 2023-11-24T08:02:15.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.987+0000 7f4e75f1d640 1 -- start start 2023-11-24T08:02:15.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e75f1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e700ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e75f1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7006ac50 0x7f4e701410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e75f1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701415e0 0x7f4e700c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e75f1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700adcb0 con 0x7f4e58003f40 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e75f1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7006b0b0 con 0x7f4e701415e0 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e75f1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e70141e20 con 0x7f4e7006ac50 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e6f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e700ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e6f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e700ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39338/0 (socket says 172.21.15.161:39338) 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e6f7fe640 1 -- 172.21.15.161:0/2082887600 learned_addr learned my addr 172.21.15.161:0/2082887600 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e6effd640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7006ac50 0x7f4e701410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e6ffff640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701415e0 0x7f4e700c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.988+0000 7f4e6f7fe640 1 -- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7006ac50 msgr2=0x7f4e701410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:15.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e6f7fe640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7006ac50 0x7f4e701410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e6f7fe640 1 -- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701415e0 msgr2=0x7f4e700c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:15.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e6f7fe640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701415e0 0x7f4e700c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:15.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e6f7fe640 1 -- 172.21.15.161:0/2082887600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e701402d0 con 0x7f4e58003f40 2023-11-24T08:02:15.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e6ffff640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701415e0 0x7f4e700c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:15.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e6f7fe640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e700ae140 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000d8e0 tx=0x7f4e6000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:15.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600074e0 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60007640 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e700ad380 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60004a20 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.989+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e700ad940 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.990+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e700675d0 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.991+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4e60004b80 con 0x7f4e58003f40 2023-11-24T08:02:15.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.992+0000 7f4e57fff640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e5c06aff0 0x7f4e5c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:15.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.992+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f4e600896d0 con 0x7f4e58003f40 2023-11-24T08:02:15.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.993+0000 7f4e6effd640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e5c06aff0 0x7f4e5c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:15.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.994+0000 7f4e6effd640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e5c06aff0 0x7f4e5c06d4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4e64036000 tx=0x7f4e64030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:15.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:15.997+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e600544b0 con 0x7f4e58003f40 2023-11-24T08:02:16.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.187+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4e7006b3f0 con 0x7f4e58003f40 2023-11-24T08:02:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.758+0000 7f4e57fff640 1 -- 172.21.15.161:0/2082887600 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4e60057ad0 con 0x7f4e58003f40 2023-11-24T08:02:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.761+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e5c06aff0 msgr2=0x7f4e5c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.761+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e5c06aff0 0x7f4e5c06d4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4e64036000 tx=0x7f4e64030000 comp rx=0 tx=0).stop 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.761+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 msgr2=0x7f4e700ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.761+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e700ae140 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000d8e0 tx=0x7f4e6000dda0 comp rx=0 tx=0).stop 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 shutdown_connections 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e5c06aff0 0x7f4e5c06d4b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e701415e0 0x7f4e700c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7006ac50 0x7f4e701410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 --2- 172.21.15.161:0/2082887600 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e58003f40 0x7f4e700ae140 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:16.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 >> 172.21.15.161:0/2082887600 conn(0x7f4e7006a800 msgr2=0x7f4e700aec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:16.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 shutdown_connections 2023-11-24T08:02:16.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.762+0000 7f4e75f1d640 1 -- 172.21.15.161:0/2082887600 wait complete. 2023-11-24T08:02:16.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:02:17.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.999+0000 7f2b65659640 1 Processor -- start 2023-11-24T08:02:17.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:16.999+0000 7f2b65659640 1 -- start start 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b65659640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b60143810 0x7f2b60071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b65659640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b6015d770 0x7f2b6015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b65659640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6015e140 con 0x7f2b600ae170 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b65659640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b60143bf0 con 0x7f2b6015d770 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b65659640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6006c730 con 0x7f2b60143810 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b64e58640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b6015d770 0x7f2b6015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b57fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2b600ae170 0x7f2b6015e8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50578/0 (socket says 172.21.15.161:50578) 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b57fff640 1 -- 172.21.15.161:0/1908195078 learned_addr learned my addr 172.21.15.161:0/1908195078 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.001+0000 7f2b64e58640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b6015d770 0x7f2b6015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39340/0 (socket says 172.21.15.161:39340) 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.002+0000 7f2b5ffff640 1 --2- 172.21.15.161:0/1908195078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b60143810 0x7f2b60071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.002+0000 7f2b64e58640 1 -- 172.21.15.161:0/1908195078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b60143810 msgr2=0x7f2b60071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.002+0000 7f2b64e58640 1 --2- 172.21.15.161:0/1908195078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b60143810 0x7f2b60071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.002+0000 7f2b64e58640 1 -- 172.21.15.161:0/1908195078 >> v1:172.21.15.161:6789/0 conn(0x7f2b600ae170 legacy=0x7f2b6015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.002+0000 7f2b64e58640 1 -- 172.21.15.161:0/1908195078 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600ae5f0 con 0x7f2b6015d770 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.003+0000 7f2b64e58640 1 --2- 172.21.15.161:0/1908195078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b6015d770 0x7f2b6015dc00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009d90 tx=0x7f2b5802bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03214ad0f1142ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:17.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b5f7fe640 1 -- 172.21.15.161:0/1908195078 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5802cb40 con 0x7f2b6015d770 2023-11-24T08:02:17.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b5f7fe640 1 -- 172.21.15.161:0/1908195078 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5802cca0 con 0x7f2b6015d770 2023-11-24T08:02:17.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b5f7fe640 1 -- 172.21.15.161:0/1908195078 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58034660 con 0x7f2b6015d770 2023-11-24T08:02:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 -- 172.21.15.161:0/1908195078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b6015d770 msgr2=0x7f2b6015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 --2- 172.21.15.161:0/1908195078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b6015d770 0x7f2b6015dc00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009d90 tx=0x7f2b5802bd90 comp rx=0 tx=0).stop 2023-11-24T08:02:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 -- 172.21.15.161:0/1908195078 shutdown_connections 2023-11-24T08:02:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 --2- 172.21.15.161:0/1908195078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b6015d770 0x7f2b6015dc00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 --2- 172.21.15.161:0/1908195078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b60143810 0x7f2b60071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 -- 172.21.15.161:0/1908195078 >> 172.21.15.161:0/1908195078 conn(0x7f2b6006a7d0 msgr2=0x7f2b6006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:17.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 -- 172.21.15.161:0/1908195078 shutdown_connections 2023-11-24T08:02:17.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.004+0000 7f2b65659640 1 -- 172.21.15.161:0/1908195078 wait complete. 2023-11-24T08:02:17.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.006+0000 7f2b65659640 1 Processor -- start 2023-11-24T08:02:17.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.006+0000 7f2b65659640 1 -- start start 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b65659640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 0x7f2b6015bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b65659640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b60143810 0x7f2b600cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b65659640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b6015d770 0x7f2b6013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b65659640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600cc2a0 con 0x7f2b600ae170 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b65659640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6015c290 con 0x7f2b60143810 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b65659640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600cbce0 con 0x7f2b6015d770 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.007+0000 7f2b5ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 0x7f2b6015bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 0x7f2b6015bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39350/0 (socket says 172.21.15.161:39350) 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 -- 172.21.15.161:0/455171869 learned_addr learned my addr 172.21.15.161:0/455171869 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:17.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 -- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b6015d770 msgr2=0x7f2b6013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b6015d770 0x7f2b6013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 -- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b60143810 msgr2=0x7f2b600cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b60143810 0x7f2b600cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 -- 172.21.15.161:0/455171869 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58009a70 con 0x7f2b600ae170 2023-11-24T08:02:17.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.008+0000 7f2b5ffff640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 0x7f2b6015bd50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000c7f0 tx=0x7f2b5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:17.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.009+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50004220 con 0x7f2b600ae170 2023-11-24T08:02:17.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.009+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500043a0 con 0x7f2b600ae170 2023-11-24T08:02:17.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.009+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50007860 con 0x7f2b600ae170 2023-11-24T08:02:17.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.009+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b600cbfc0 con 0x7f2b600ae170 2023-11-24T08:02:17.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.009+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6015b830 con 0x7f2b600ae170 2023-11-24T08:02:17.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.010+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6015ba50 con 0x7f2b600ae170 2023-11-24T08:02:17.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.011+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2b50007bd0 con 0x7f2b600ae170 2023-11-24T08:02:17.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.012+0000 7f2b5d7fa640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b4006aff0 0x7f2b4006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.012+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2b50089770 con 0x7f2b600ae170 2023-11-24T08:02:17.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.013+0000 7f2b57fff640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b4006aff0 0x7f2b4006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.014+0000 7f2b57fff640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b4006aff0 0x7f2b4006d4b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2b600b3b10 tx=0x7f2b48007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:17.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.017+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b50054730 con 0x7f2b600ae170 2023-11-24T08:02:17.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.207+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2b60067450 con 0x7f2b600ae170 2023-11-24T08:02:17.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.215+0000 7f2b5d7fa640 1 -- 172.21.15.161:0/455171869 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2b50057d50 con 0x7f2b600ae170 2023-11-24T08:02:17.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.217+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b4006aff0 msgr2=0x7f2b4006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.217+0000 7f2b65659640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b4006aff0 0x7f2b4006d4b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2b600b3b10 tx=0x7f2b48007a40 comp rx=0 tx=0).stop 2023-11-24T08:02:17.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 msgr2=0x7f2b6015bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 0x7f2b6015bd50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2b5000c7f0 tx=0x7f2b5000ccb0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 shutdown_connections 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b4006aff0 0x7f2b4006d4b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b6015d770 0x7f2b6013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b60143810 0x7f2b600cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 --2- 172.21.15.161:0/455171869 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b600ae170 0x7f2b6015bd50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 >> 172.21.15.161:0/455171869 conn(0x7f2b6006a7d0 msgr2=0x7f2b60070950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 shutdown_connections 2023-11-24T08:02:17.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.218+0000 7f2b65659640 1 -- 172.21.15.161:0/455171869 wait complete. 2023-11-24T08:02:17.238 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:02:17.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.450+0000 7f2e97333640 1 Processor -- start 2023-11-24T08:02:17.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.450+0000 7f2e97333640 1 -- start start 2023-11-24T08:02:17.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.452+0000 7f2e97333640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2e9013e360 0x7f2e900cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.452+0000 7f2e97333640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9015c5f0 con 0x7f2e9013df80 2023-11-24T08:02:17.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.452+0000 7f2e97333640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9006c470 con 0x7f2e9015f9c0 2023-11-24T08:02:17.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.452+0000 7f2e97333640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9006c750 con 0x7f2e9013e360 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.452+0000 7f2e950cf640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2e9013df80 0x7f2e9015bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50590/0 (socket says 172.21.15.161:50590) 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.452+0000 7f2e950cf640 1 -- 172.21.15.161:0/1308458695 learned_addr learned my addr 172.21.15.161:0/1308458695 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867923002 0 0) 0x7f2e9015c5f0 con 0x7f2e9013df80 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7c003520 con 0x7f2e9013df80 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e948ce640 1 --2- 172.21.15.161:0/1308458695 >> v2:172.21.15.175:3300/0 conn(0x7f2e9013e360 0x7f2e900cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 391093441 0 0) 0x7f2e7c003520 con 0x7f2e9013df80 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 >> v2:172.21.15.175:3300/0 conn(0x7f2e9013e360 msgr2=0x7f2e900cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 --2- 172.21.15.161:0/1308458695 >> v2:172.21.15.175:3300/0 conn(0x7f2e9013e360 0x7f2e900cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 >> v1:172.21.15.175:6789/0 conn(0x7f2e9015f9c0 legacy=0x7f2e900cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9006ca30 con 0x7f2e9013df80 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f2e8c001690 con 0x7f2e9013df80 2023-11-24T08:02:17.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 >> v1:172.21.15.161:6789/0 conn(0x7f2e9013df80 legacy=0x7f2e9015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e7c0039c0 0x7f2e7c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e7c0047c0 0x7f2e7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9006c750 con 0x7f2e7c0051d0 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c00c120 con 0x7f2e7c0047c0 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c00c2e0 con 0x7f2e7c0039c0 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.453+0000 7f2e958d0640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.454+0000 7f2e950cf640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e7c0039c0 0x7f2e7c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.454+0000 7f2e958d0640 1 -- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e7c0039c0 msgr2=0x7f2e7c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.454+0000 7f2e958d0640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e7c0039c0 0x7f2e7c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.454+0000 7f2e958d0640 1 -- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e7c0047c0 msgr2=0x7f2e7c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:17.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.454+0000 7f2e958d0640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e7c0047c0 0x7f2e7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.454+0000 7f2e958d0640 1 -- 172.21.15.161:0/1308458695 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c003520 con 0x7f2e7c0051d0 2023-11-24T08:02:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.455+0000 7f2e958d0640 1 -- 172.21.15.161:0/1308458695 reap_dead start 2023-11-24T08:02:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.455+0000 7f2e958d0640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e7c00b980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2e88001e20 tx=0x7f2e7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e3980a7499a871 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.455+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003b70 con 0x7f2e7c0051d0 2023-11-24T08:02:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.455+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88003cd0 con 0x7f2e7c0051d0 2023-11-24T08:02:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.455+0000 7f2e87fff640 1 -- 172.21.15.161:0/1308458695 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880052f0 con 0x7f2e7c0051d0 2023-11-24T08:02:17.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 -- 172.21.15.161:0/1308458695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 msgr2=0x7f2e7c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e7c00b980 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2e88001e20 tx=0x7f2e7c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 -- 172.21.15.161:0/1308458695 shutdown_connections 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 --2- 172.21.15.161:0/1308458695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e7c00b980 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 -- 172.21.15.161:0/1308458695 >> 172.21.15.161:0/1308458695 conn(0x7f2e9006a800 msgr2=0x7f2e9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 -- 172.21.15.161:0/1308458695 shutdown_connections 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.456+0000 7f2e97333640 1 -- 172.21.15.161:0/1308458695 wait complete. 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.458+0000 7f2e97333640 1 Processor -- start 2023-11-24T08:02:17.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.458+0000 7f2e97333640 1 -- start start 2023-11-24T08:02:17.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e97333640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e900af460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e97333640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9013d130 0x7f2e900af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e97333640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e90151ed0 0x7f2e90152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e97333640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90153840 con 0x7f2e7c0051d0 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e97333640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90152bc0 con 0x7f2e9013d130 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e97333640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e90152ea0 con 0x7f2e90151ed0 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e950cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e900af460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e950cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e900af460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39372/0 (socket says 172.21.15.161:39372) 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.459+0000 7f2e950cf640 1 -- 172.21.15.161:0/602875505 learned_addr learned my addr 172.21.15.161:0/602875505 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e958d0640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e90151ed0 0x7f2e90152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e950cf640 1 -- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e90151ed0 msgr2=0x7f2e90152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e950cf640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e90151ed0 0x7f2e90152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e950cf640 1 -- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9013d130 msgr2=0x7f2e900af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e948ce640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9013d130 0x7f2e900af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e950cf640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9013d130 0x7f2e900af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e950cf640 1 -- 172.21.15.161:0/602875505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e90153180 con 0x7f2e7c0051d0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e950cf640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e900af460 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e730 tx=0x7f2e8c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00c6c0 con 0x7f2e7c0051d0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00c820 con 0x7f2e7c0051d0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e90153460 con 0x7f2e7c0051d0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.460+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00cbd0 con 0x7f2e7c0051d0 2023-11-24T08:02:17.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.461+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e90153c60 con 0x7f2e7c0051d0 2023-11-24T08:02:17.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.462+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e900675d0 con 0x7f2e7c0051d0 2023-11-24T08:02:17.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.463+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2e8c00cd30 con 0x7f2e7c0051d0 2023-11-24T08:02:17.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.464+0000 7f2e85ffb640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e7406b020 0x7f2e7406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:17.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.464+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2e8c089170 con 0x7f2e7c0051d0 2023-11-24T08:02:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.464+0000 7f2e948ce640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e7406b020 0x7f2e7406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:17.466 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.466+0000 7f2e948ce640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e7406b020 0x7f2e7406d4e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e80006a90 tx=0x7f2e80008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:17.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.468+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e8c054330 con 0x7f2e7c0051d0 2023-11-24T08:02:17.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.734+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f2e90153ab0 con 0x7f2e7c0051d0 2023-11-24T08:02:17.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.761+0000 7f2e85ffb640 1 -- 172.21.15.161:0/602875505 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v125) v1 ==== 158+0+0 (secure 0 0 0) 0x7f2e8c057950 con 0x7f2e7c0051d0 2023-11-24T08:02:17.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e7406b020 msgr2=0x7f2e7406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e7406b020 0x7f2e7406d4e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2e80006a90 tx=0x7f2e80008040 comp rx=0 tx=0).stop 2023-11-24T08:02:17.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 msgr2=0x7f2e900af460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:17.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e900af460 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e730 tx=0x7f2e8c00ebf0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 shutdown_connections 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2e7406b020 0x7f2e7406d4e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2e90151ed0 0x7f2e90152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9013d130 0x7f2e900af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 --2- 172.21.15.161:0/602875505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e7c0051d0 0x7f2e900af460 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 >> 172.21.15.161:0/602875505 conn(0x7f2e9006a800 msgr2=0x7f2e90070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 shutdown_connections 2023-11-24T08:02:17.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:17.764+0000 7f2e97333640 1 -- 172.21.15.161:0/602875505 wait complete. 2023-11-24T08:02:17.785 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2023-11-24T08:02:17.786 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:02:17.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:18.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.005+0000 7feed722d640 1 Processor -- start 2023-11-24T08:02:18.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.005+0000 7feed722d640 1 -- start start 2023-11-24T08:02:18.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.006+0000 7feed722d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 0x7feed00b3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.006+0000 7feed722d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00cf1c0 con 0x7feed0160f80 2023-11-24T08:02:18.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.006+0000 7feed722d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00d0de0 con 0x7feed00ce8f0 2023-11-24T08:02:18.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.006+0000 7feed722d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00d10c0 con 0x7feed00ced30 2023-11-24T08:02:18.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feed4fc9640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7feed0160f80 0x7feed0161360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:50602/0 (socket says 172.21.15.161:50602) 2023-11-24T08:02:18.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feed4fc9640 1 -- 172.21.15.161:0/3204128944 learned_addr learned my addr 172.21.15.161:0/3204128944 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feed57ca640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 0x7feed00b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831253011 0 0) 0x7feec4001110 con 0x7feed0160f80 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec0003520 con 0x7feed0160f80 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18623619 0 0) 0x7feec0003520 con 0x7feed0160f80 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 msgr2=0x7feed00b3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feecf7fe640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 0x7feed00b3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.007+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 >> v1:172.21.15.175:6789/0 conn(0x7feed00ce8f0 legacy=0x7feed00b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00d13a0 con 0x7feed0160f80 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7feec4001800 con 0x7feed0160f80 2023-11-24T08:02:18.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 >> v1:172.21.15.161:6789/0 conn(0x7feed0160f80 legacy=0x7feed0161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 0x7feec00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0003f70 0x7feec00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feec0004d00 0x7feec0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00d10c0 con 0x7feec0004d00 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec000bac0 con 0x7feec0003f70 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec000bc80 con 0x7feed00ced30 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed57ca640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feec0004d00 0x7feec0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed4fc9640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 0x7feec00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed57ca640 1 -- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 msgr2=0x7feec00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed57ca640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00ced30 0x7feec00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed57ca640 1 -- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0003f70 msgr2=0x7feec00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feecffff640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0003f70 0x7feec00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed57ca640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0003f70 0x7feec00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.008+0000 7feed57ca640 1 -- 172.21.15.161:0/3204128944 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec0003520 con 0x7feec0004d00 2023-11-24T08:02:18.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.009+0000 7feed57ca640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feec0004d00 0x7feec0005180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7feec8009fc0 tx=0x7feec00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ff0dcb69cceed1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec802cc20 con 0x7feec0004d00 2023-11-24T08:02:18.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec800f040 con 0x7feec0004d00 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feecf7fe640 1 -- 172.21.15.161:0/3204128944 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8034440 con 0x7feec0004d00 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed722d640 1 -- 172.21.15.161:0/3204128944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feec0004d00 msgr2=0x7feec0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed722d640 1 --2- 172.21.15.161:0/3204128944 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feec0004d00 0x7feec0005180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7feec8009fc0 tx=0x7feec00057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed57ca640 1 -- 172.21.15.161:0/3204128944 reap_dead start 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed722d640 1 -- 172.21.15.161:0/3204128944 shutdown_connections 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed722d640 1 -- 172.21.15.161:0/3204128944 >> 172.21.15.161:0/3204128944 conn(0x7feed009c550 msgr2=0x7feed00d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed722d640 1 -- 172.21.15.161:0/3204128944 shutdown_connections 2023-11-24T08:02:18.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.010+0000 7feed722d640 1 -- 172.21.15.161:0/3204128944 wait complete. 2023-11-24T08:02:18.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.012+0000 7feed722d640 1 Processor -- start 2023-11-24T08:02:18.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.012+0000 7feed722d640 1 -- start start 2023-11-24T08:02:18.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.013+0000 7feed722d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0004d00 0x7feed0155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.013+0000 7feed722d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00afe40 0x7feed00b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.013+0000 7feed722d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 0x7feed00c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.013+0000 7feed722d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00b0800 con 0x7feed00c6d40 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.013+0000 7feed722d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed00c7700 con 0x7feec0004d00 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.013+0000 7feed722d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed0155ef0 con 0x7feed00afe40 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 0x7feed00c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 0x7feed00c71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39394/0 (socket says 172.21.15.161:39394) 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 -- 172.21.15.161:0/1758221344 learned_addr learned my addr 172.21.15.161:0/1758221344 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feecffff640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00afe40 0x7feed00b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed4fc9640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0004d00 0x7feed0155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 -- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00afe40 msgr2=0x7feed00b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00afe40 0x7feed00b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 -- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0004d00 msgr2=0x7feed0155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0004d00 0x7feed0155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 -- 172.21.15.161:0/1758221344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00b1610 con 0x7feed00c6d40 2023-11-24T08:02:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feecffff640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00afe40 0x7feed00b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:18.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed4fc9640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0004d00 0x7feed0155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.014+0000 7feed57ca640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 0x7feed00c71c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feec8037040 tx=0x7feec8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.015+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8034cd0 con 0x7feed00c6d40 2023-11-24T08:02:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.015+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8034e30 con 0x7feed00c6d40 2023-11-24T08:02:18.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.015+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed00cd140 con 0x7feed00c6d40 2023-11-24T08:02:18.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.015+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8003bd0 con 0x7feed00c6d40 2023-11-24T08:02:18.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.015+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed00b0ce0 con 0x7feed00c6d40 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.016+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00b17a0 con 0x7feed00c6d40 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.017+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7feec8003d30 con 0x7feed00c6d40 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.018+0000 7feecd7fa640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406aff0 0x7feeb406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.018+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feec80aaf00 con 0x7feed00c6d40 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.018+0000 7feed4fc9640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406aff0 0x7feeb406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.019+0000 7feed4fc9640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406aff0 0x7feeb406d4b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feec4001050 tx=0x7feec4001110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.022+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feec8076040 con 0x7feed00c6d40 2023-11-24T08:02:18.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.214+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feed00675d0 con 0x7feed00c6d40 2023-11-24T08:02:18.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.216+0000 7feecd7fa640 1 -- 172.21.15.161:0/1758221344 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13012 (secure 0 0 0) 0x7feec8045090 con 0x7feed00c6d40 2023-11-24T08:02:18.217 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:18.218 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":38,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:16.747021+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6836/1086564705":"2023-11-25T08:02:13.618195+0000","172.21.15.175:6834/1086564705":"2023-11-25T08:02:13.618195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:18.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.218+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406aff0 msgr2=0x7feeb406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.218+0000 7feed722d640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406aff0 0x7feeb406d4b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feec4001050 tx=0x7feec4001110 comp rx=0 tx=0).stop 2023-11-24T08:02:18.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 msgr2=0x7feed00c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 0x7feed00c71c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feec8037040 tx=0x7feec8009750 comp rx=0 tx=0).stop 2023-11-24T08:02:18.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 shutdown_connections 2023-11-24T08:02:18.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7feeb406aff0 0x7feeb406d4b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7feed00c6d40 0x7feed00c71c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feed00afe40 0x7feed00b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 --2- 172.21.15.161:0/1758221344 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feec0004d00 0x7feed0155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 >> 172.21.15.161:0/1758221344 conn(0x7feed009c550 msgr2=0x7feed006b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:18.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 shutdown_connections 2023-11-24T08:02:18.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.219+0000 7feed722d640 1 -- 172.21.15.161:0/1758221344 wait complete. 2023-11-24T08:02:18.242 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:18.242 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:18.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.442+0000 7f05678cf640 1 Processor -- start 2023-11-24T08:02:18.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.442+0000 7f05678cf640 1 -- start start 2023-11-24T08:02:18.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.444+0000 7f05678cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f056013df80 0x7f056015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.444+0000 7f05678cf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05600cf9a0 0x7f05600cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.444+0000 7f05678cf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056006c470 con 0x7f056013e360 2023-11-24T08:02:18.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.444+0000 7f05678cf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056006c750 con 0x7f056013df80 2023-11-24T08:02:18.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.444+0000 7f05678cf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056006ca30 con 0x7f05600cf9a0 2023-11-24T08:02:18.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f056013df80 0x7f056015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f056013df80 0x7f056015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39406/0 (socket says 172.21.15.161:39406) 2023-11-24T08:02:18.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 -- 172.21.15.161:0/3540998720 learned_addr learned my addr 172.21.15.161:0/3540998720 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:18.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f0565e6c640 1 --2- 172.21.15.161:0/3540998720 >> v2:172.21.15.175:3300/0 conn(0x7f05600cf9a0 0x7f05600cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 -- 172.21.15.161:0/3540998720 >> v2:172.21.15.175:3300/0 conn(0x7f05600cf9a0 msgr2=0x7f05600cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:18.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 --2- 172.21.15.161:0/3540998720 >> v2:172.21.15.175:3300/0 conn(0x7f05600cf9a0 0x7f05600cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 -- 172.21.15.161:0/3540998720 >> v1:172.21.15.175:6789/0 conn(0x7f056013e360 legacy=0x7f05600cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.445+0000 7f056566b640 1 -- 172.21.15.161:0/3540998720 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056006cd10 con 0x7f056013df80 2023-11-24T08:02:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.447+0000 7f056566b640 1 --2- 172.21.15.161:0/3540998720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f056013df80 0x7f056015bee0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f05600ccb10 tx=0x7f055c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4390507ce0e84563 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.447+0000 7f0557fff640 1 -- 172.21.15.161:0/3540998720 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c030860 con 0x7f056013df80 2023-11-24T08:02:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f0557fff640 1 -- 172.21.15.161:0/3540998720 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0309c0 con 0x7f056013df80 2023-11-24T08:02:18.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f0557fff640 1 -- 172.21.15.161:0/3540998720 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c030d50 con 0x7f056013df80 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 -- 172.21.15.161:0/3540998720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f056013df80 msgr2=0x7f056015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 --2- 172.21.15.161:0/3540998720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f056013df80 0x7f056015bee0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f05600ccb10 tx=0x7f055c02b9a0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 -- 172.21.15.161:0/3540998720 shutdown_connections 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 --2- 172.21.15.161:0/3540998720 >> v2:172.21.15.175:3300/0 conn(0x7f05600cf9a0 0x7f05600cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 --2- 172.21.15.161:0/3540998720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f056013df80 0x7f056015bee0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 -- 172.21.15.161:0/3540998720 >> 172.21.15.161:0/3540998720 conn(0x7f056006a800 msgr2=0x7f056006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.448+0000 7f05678cf640 1 -- 172.21.15.161:0/3540998720 shutdown_connections 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.449+0000 7f05678cf640 1 -- 172.21.15.161:0/3540998720 wait complete. 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.450+0000 7f05678cf640 1 Processor -- start 2023-11-24T08:02:18.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.450+0000 7f05678cf640 1 -- start start 2023-11-24T08:02:18.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.451+0000 7f05678cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 0x7f0560153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.451+0000 7f05678cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056013df80 0x7f056015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.451+0000 7f05678cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f056013e360 0x7f05600a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.451+0000 7f05678cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056015ac90 con 0x7f05600cf9a0 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.451+0000 7f05678cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05601575b0 con 0x7f056013df80 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.451+0000 7f05678cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056015a9b0 con 0x7f056013e360 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 0x7f0560153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 0x7f0560153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39418/0 (socket says 172.21.15.161:39418) 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 -- 172.21.15.161:0/872182681 learned_addr learned my addr 172.21.15.161:0/872182681 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 -- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f056013e360 msgr2=0x7f05600a9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f0564e6a640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056013df80 0x7f056015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f0565e6c640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f056013e360 0x7f05600a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.455 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f056013e360 0x7f05600a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 -- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056013df80 msgr2=0x7f056015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056013df80 0x7f056015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f056566b640 1 -- 172.21.15.161:0/872182681 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0094d0 con 0x7f05600cf9a0 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.452+0000 7f0564e6a640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056013df80 0x7f056015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.453+0000 7f056566b640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 0x7f0560153270 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f055c02b9e0 tx=0x7f055c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.453+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c039c90 con 0x7f05600cf9a0 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.453+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c039e10 con 0x7f05600cf9a0 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.453+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0560156f60 con 0x7f05600cf9a0 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.453+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c043640 con 0x7f05600cf9a0 2023-11-24T08:02:18.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.453+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05601537b0 con 0x7f05600cf9a0 2023-11-24T08:02:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.454+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0560156dc0 con 0x7f05600cf9a0 2023-11-24T08:02:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.455+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f055c0437a0 con 0x7f05600cf9a0 2023-11-24T08:02:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.456+0000 7f0555ffb640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f054406aff0 0x7f054406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.456+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f055c03e070 con 0x7f05600cf9a0 2023-11-24T08:02:18.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.457+0000 7f0564e6a640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f054406aff0 0x7f054406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.458+0000 7f0564e6a640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f054406aff0 0x7f054406d4b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f05600ae200 tx=0x7f0550009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.460+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0560156dc0 con 0x7f05600cf9a0 2023-11-24T08:02:18.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.650+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0560156dc0 con 0x7f05600cf9a0 2023-11-24T08:02:18.652 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.651+0000 7f0555ffb640 1 -- 172.21.15.161:0/872182681 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0560156dc0 con 0x7f05600cf9a0 2023-11-24T08:02:18.652 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:18.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f054406aff0 msgr2=0x7f054406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f054406aff0 0x7f054406d4b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f05600ae200 tx=0x7f0550009040 comp rx=0 tx=0).stop 2023-11-24T08:02:18.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 msgr2=0x7f0560153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 0x7f0560153270 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f055c02b9e0 tx=0x7f055c004730 comp rx=0 tx=0).stop 2023-11-24T08:02:18.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 shutdown_connections 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f054406aff0 0x7f054406d4b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f056013e360 0x7f05600a9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f056013df80 0x7f056015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 --2- 172.21.15.161:0/872182681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05600cf9a0 0x7f0560153270 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 >> 172.21.15.161:0/872182681 conn(0x7f056006a800 msgr2=0x7f056006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 shutdown_connections 2023-11-24T08:02:18.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.654+0000 7f05678cf640 1 -- 172.21.15.161:0/872182681 wait complete. 2023-11-24T08:02:18.673 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T08:02:18.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.888+0000 7fd7a87a5640 1 Processor -- start 2023-11-24T08:02:18.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.888+0000 7fd7a87a5640 1 -- start start 2023-11-24T08:02:18.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.890+0000 7fd7a87a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 0x7fd7a00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.890+0000 7fd7a87a5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd7a00cf7d0 0x7fd7a015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.890+0000 7fd7a87a5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a00cfc30 con 0x7fd7a015e1e0 2023-11-24T08:02:18.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.890+0000 7fd7a87a5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a00b1ee0 con 0x7fd7a00cf7d0 2023-11-24T08:02:18.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.890+0000 7fd7a87a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00b2780 con 0x7fd7a0143ae0 2023-11-24T08:02:18.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.890+0000 7fd7a6541640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 0x7fd7a00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a6541640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 0x7fd7a00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:54734/0 (socket says 172.21.15.161:54734) 2023-11-24T08:02:18.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a6541640 1 -- 172.21.15.161:0/1331218451 learned_addr learned my addr 172.21.15.161:0/1331218451 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:18.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a5d40640 1 --2- 172.21.15.161:0/1331218451 >> v2:172.21.15.175:3300/0 conn(0x7fd7a00cf7d0 0x7fd7a015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a6541640 1 -- 172.21.15.161:0/1331218451 >> v2:172.21.15.175:3300/0 conn(0x7fd7a00cf7d0 msgr2=0x7fd7a015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:18.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a6541640 1 --2- 172.21.15.161:0/1331218451 >> v2:172.21.15.175:3300/0 conn(0x7fd7a00cf7d0 0x7fd7a015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a6541640 1 -- 172.21.15.161:0/1331218451 >> v1:172.21.15.175:6789/0 conn(0x7fd7a015e1e0 legacy=0x7fd7a015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.891+0000 7fd7a6541640 1 -- 172.21.15.161:0/1331218451 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a015e990 con 0x7fd7a0143ae0 2023-11-24T08:02:18.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.893+0000 7fd7a6541640 1 --2- 172.21.15.161:0/1331218451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 0x7fd7a00cf290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd794009e50 tx=0x7fd79402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2bdda6c31b463e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.893+0000 7fd7a553f640 1 -- 172.21.15.161:0/1331218451 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79402cb00 con 0x7fd7a0143ae0 2023-11-24T08:02:18.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.893+0000 7fd7a553f640 1 -- 172.21.15.161:0/1331218451 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79402cc60 con 0x7fd7a0143ae0 2023-11-24T08:02:18.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.893+0000 7fd7a553f640 1 -- 172.21.15.161:0/1331218451 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7940343f0 con 0x7fd7a0143ae0 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 -- 172.21.15.161:0/1331218451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 msgr2=0x7fd7a00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/1331218451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 0x7fd7a00cf290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd794009e50 tx=0x7fd79402bf60 comp rx=0 tx=0).stop 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 -- 172.21.15.161:0/1331218451 shutdown_connections 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/1331218451 >> v2:172.21.15.175:3300/0 conn(0x7fd7a00cf7d0 0x7fd7a015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/1331218451 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a0143ae0 0x7fd7a00cf290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 -- 172.21.15.161:0/1331218451 >> 172.21.15.161:0/1331218451 conn(0x7fd7a006a800 msgr2=0x7fd7a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:18.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 -- 172.21.15.161:0/1331218451 shutdown_connections 2023-11-24T08:02:18.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.894+0000 7fd7a87a5640 1 -- 172.21.15.161:0/1331218451 wait complete. 2023-11-24T08:02:18.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.896+0000 7fd7a87a5640 1 Processor -- start 2023-11-24T08:02:18.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.896+0000 7fd7a87a5640 1 -- start start 2023-11-24T08:02:18.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a87a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a00cf7d0 0x7fd7a01597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a87a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a0143ae0 0x7fd7a00c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a87a5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 0x7fd7a015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a87a5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00ad510 con 0x7fd7a015e1e0 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a87a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00ac8d0 con 0x7fd7a0143ae0 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a87a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00acb70 con 0x7fd7a00cf7d0 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a6d42640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 0x7fd7a015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a6d42640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 0x7fd7a015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39420/0 (socket says 172.21.15.161:39420) 2023-11-24T08:02:18.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.897+0000 7fd7a6d42640 1 -- 172.21.15.161:0/147354776 learned_addr learned my addr 172.21.15.161:0/147354776 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6541640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a00cf7d0 0x7fd7a01597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a5d40640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a0143ae0 0x7fd7a00c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6d42640 1 -- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a00cf7d0 msgr2=0x7fd7a01597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6d42640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a00cf7d0 0x7fd7a01597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6d42640 1 -- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a0143ae0 msgr2=0x7fd7a00c4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6d42640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a0143ae0 0x7fd7a00c4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6d42640 1 -- 172.21.15.161:0/147354776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd794009b30 con 0x7fd7a015e1e0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a6d42640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 0x7fd7a015c6b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c390 tx=0x7fd79800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7980052d0 con 0x7fd7a015e1e0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd798005430 con 0x7fd7a015e1e0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd798003810 con 0x7fd7a015e1e0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.898+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a00ace50 con 0x7fd7a015e1e0 2023-11-24T08:02:18.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.899+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a0159d10 con 0x7fd7a015e1e0 2023-11-24T08:02:18.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.900+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a00b2bf0 con 0x7fd7a015e1e0 2023-11-24T08:02:18.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.901+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd798003970 con 0x7fd7a015e1e0 2023-11-24T08:02:18.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.902+0000 7fd79effd640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd78406aff0 0x7fd78406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:18.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.902+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd798088b30 con 0x7fd7a015e1e0 2023-11-24T08:02:18.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.903+0000 7fd7a6541640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd78406aff0 0x7fd78406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:18.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.904+0000 7fd7a6541640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd78406aff0 0x7fd78406d4b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd794035000 tx=0x7fd794030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:18.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:18.907+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd7a00b2bf0 con 0x7fd7a015e1e0 2023-11-24T08:02:19.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.168+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7fd7a00b2bf0 con 0x7fd7a015e1e0 2023-11-24T08:02:19.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.773+0000 7fd79effd640 1 -- 172.21.15.161:0/147354776 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v127) v1 ==== 143+0+0 (secure 0 0 0) 0x7fd7a00b2bf0 con 0x7fd7a015e1e0 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.776+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd78406aff0 msgr2=0x7fd78406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.776+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd78406aff0 0x7fd78406d4b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd794035000 tx=0x7fd794030000 comp rx=0 tx=0).stop 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.776+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 msgr2=0x7fd7a015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.776+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 0x7fd7a015c6b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd79800c390 tx=0x7fd79800c850 comp rx=0 tx=0).stop 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 shutdown_connections 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd78406aff0 0x7fd78406d4b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:19.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd7a015e1e0 0x7fd7a015c6b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:19.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd7a0143ae0 0x7fd7a00c4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:19.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 --2- 172.21.15.161:0/147354776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd7a00cf7d0 0x7fd7a01597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:19.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 >> 172.21.15.161:0/147354776 conn(0x7fd7a006a800 msgr2=0x7fd7a00702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:19.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 shutdown_connections 2023-11-24T08:02:19.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:19.777+0000 7fd7a87a5640 1 -- 172.21.15.161:0/147354776 wait complete. 2023-11-24T08:02:19.801 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:02:20.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.015+0000 7fe6d6452640 1 Processor -- start 2023-11-24T08:02:20.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.015+0000 7fe6d6452640 1 -- start start 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.016+0000 7fe6d6452640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6d013cda0 0x7fe6d015da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d6452640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe6d00ce0c0 0x7fe6d0070b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d6452640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00ce4f0 con 0x7fe6d015dfa0 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d6452640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00700f0 con 0x7fe6d013cda0 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d6452640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d015e3e0 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6d013cda0 0x7fe6d015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe6d013cda0 0x7fe6d015da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39430/0 (socket says 172.21.15.161:39430) 2023-11-24T08:02:20.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 -- 172.21.15.161:0/1581370187 learned_addr learned my addr 172.21.15.161:0/1581370187 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:20.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 -- 172.21.15.161:0/1581370187 >> v2:172.21.15.175:3300/0 conn(0x7fe6d00ce0c0 msgr2=0x7fe6d0070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:20.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 --2- 172.21.15.161:0/1581370187 >> v2:172.21.15.175:3300/0 conn(0x7fe6d00ce0c0 0x7fe6d0070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 -- 172.21.15.161:0/1581370187 >> v1:172.21.15.175:6789/0 conn(0x7fe6d015dfa0 legacy=0x7fe6d00cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:20.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.017+0000 7fe6d5450640 1 -- 172.21.15.161:0/1581370187 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00ce720 con 0x7fe6d013cda0 2023-11-24T08:02:20.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.019+0000 7fe6d5450640 1 --2- 172.21.15.161:0/1581370187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d013cda0 0x7fe6d015da60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00aea90 tx=0x7fe6c002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fa7723cd60564e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:20.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.019+0000 7fe6cffff640 1 -- 172.21.15.161:0/1581370187 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c002ec00 con 0x7fe6d013cda0 2023-11-24T08:02:20.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.019+0000 7fe6cffff640 1 -- 172.21.15.161:0/1581370187 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c002ed60 con 0x7fe6d013cda0 2023-11-24T08:02:20.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.019+0000 7fe6cffff640 1 -- 172.21.15.161:0/1581370187 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0036610 con 0x7fe6d013cda0 2023-11-24T08:02:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 -- 172.21.15.161:0/1581370187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d013cda0 msgr2=0x7fe6d015da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 --2- 172.21.15.161:0/1581370187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d013cda0 0x7fe6d015da60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00aea90 tx=0x7fe6c002e060 comp rx=0 tx=0).stop 2023-11-24T08:02:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 -- 172.21.15.161:0/1581370187 shutdown_connections 2023-11-24T08:02:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 --2- 172.21.15.161:0/1581370187 >> v2:172.21.15.175:3300/0 conn(0x7fe6d00ce0c0 0x7fe6d0070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 --2- 172.21.15.161:0/1581370187 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d013cda0 0x7fe6d015da60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 -- 172.21.15.161:0/1581370187 >> 172.21.15.161:0/1581370187 conn(0x7fe6d006a3e0 msgr2=0x7fe6d006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 -- 172.21.15.161:0/1581370187 shutdown_connections 2023-11-24T08:02:20.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.020+0000 7fe6d6452640 1 -- 172.21.15.161:0/1581370187 wait complete. 2023-11-24T08:02:20.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.022+0000 7fe6d6452640 1 Processor -- start 2023-11-24T08:02:20.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.022+0000 7fe6d6452640 1 -- start start 2023-11-24T08:02:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d6452640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 0x7fe6d013eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d6452640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d013cda0 0x7fe6d013b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d6452640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d015dfa0 0x7fe6d0139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d6452640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d013dae0 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d6452640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d013ddc0 con 0x7fe6d013cda0 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d6452640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d013e0a0 con 0x7fe6d015dfa0 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 0x7fe6d013eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 0x7fe6d013eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39432/0 (socket says 172.21.15.161:39432) 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 -- 172.21.15.161:0/267543776 learned_addr learned my addr 172.21.15.161:0/267543776 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 -- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d015dfa0 msgr2=0x7fe6d0139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d015dfa0 0x7fe6d0139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 -- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d013cda0 msgr2=0x7fe6d013b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d013cda0 0x7fe6d013b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.023+0000 7fe6d5450640 1 -- 172.21.15.161:0/267543776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009b30 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.024+0000 7fe6d5450640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 0x7fe6d013eb80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00093e0 tx=0x7fe6c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:20.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.024+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c002ec00 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.024+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c003f470 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.024+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c003f800 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.024+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d013e380 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.024+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d013bd80 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.025+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d013e8a0 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.026+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe6c003f960 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.027+0000 7fe6cdffb640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6bc06aff0 0x7fe6bc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.027+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe6c00abfa0 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.028+0000 7fe6d4c4f640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6bc06aff0 0x7fe6bc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.029+0000 7fe6d4c4f640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6bc06aff0 0x7fe6bc06d4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0157ba0 tx=0x7fe6c4007990 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:20.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.032+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe6c00dee90 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.223+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe6d0067450 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.230+0000 7fe6cdffb640 1 -- 172.21.15.161:0/267543776 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6d013e8a0 con 0x7fe6d00ce0c0 2023-11-24T08:02:20.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6bc06aff0 msgr2=0x7fe6bc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6bc06aff0 0x7fe6bc06d4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0157ba0 tx=0x7fe6c4007990 comp rx=0 tx=0).stop 2023-11-24T08:02:20.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 msgr2=0x7fe6d013eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 0x7fe6d013eb80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe6c00093e0 tx=0x7fe6c0004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 shutdown_connections 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6bc06aff0 0x7fe6bc06d4b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe6d015dfa0 0x7fe6d0139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe6d013cda0 0x7fe6d013b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 --2- 172.21.15.161:0/267543776 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe6d00ce0c0 0x7fe6d013eb80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 >> 172.21.15.161:0/267543776 conn(0x7fe6d006a3e0 msgr2=0x7fe6d015c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 shutdown_connections 2023-11-24T08:02:20.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.233+0000 7fe6d6452640 1 -- 172.21.15.161:0/267543776 wait complete. 2023-11-24T08:02:20.253 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:02:20.253 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:02:20.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:02:20.481 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:02:20.482 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:02:20.482 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:20.541 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:02:20.541 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:02:20.541 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:20.600 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:02:20.600 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:02:20.600 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:20.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:02:20.660 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:02:20.661 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:20.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:02:20.721 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:02:20.721 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:20.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.944+0000 7f8b6559e640 1 Processor -- start 2023-11-24T08:02:20.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.944+0000 7f8b6559e640 1 -- start start 2023-11-24T08:02:20.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b6559e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b600cc990 0x7f8b6006d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b6559e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60070e50 con 0x7f8b60143c40 2023-11-24T08:02:20.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b6559e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60144020 con 0x7f8b600cc500 2023-11-24T08:02:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b6559e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600723c0 con 0x7f8b600cc990 2023-11-24T08:02:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b5ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8b60143c40 0x7f8b60071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60882/0 (socket says 172.21.15.161:60882) 2023-11-24T08:02:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b5ffff640 1 -- 172.21.15.161:0/3562483139 learned_addr learned my addr 172.21.15.161:0/3562483139 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.946+0000 7f8b64d9d640 1 --2- 172.21.15.161:0/3562483139 >> v2:172.21.15.161:3300/0 conn(0x7f8b600cc990 0x7f8b6006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.947+0000 7f8b64d9d640 1 -- 172.21.15.161:0/3562483139 >> v1:172.21.15.175:6789/0 conn(0x7f8b600cc500 legacy=0x7f8b6006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.947+0000 7f8b5f7fe640 1 -- 172.21.15.161:0/3562483139 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814008470 0 0) 0x7f8b60070e50 con 0x7f8b60143c40 2023-11-24T08:02:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.947+0000 7f8b64d9d640 1 -- 172.21.15.161:0/3562483139 >> v1:172.21.15.161:6789/0 conn(0x7f8b60143c40 legacy=0x7f8b60071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.947+0000 7f8b64d9d640 1 -- 172.21.15.161:0/3562483139 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60071e00 con 0x7f8b600cc990 2023-11-24T08:02:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.948+0000 7f8b64d9d640 1 --2- 172.21.15.161:0/3562483139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6006d870 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d90 tx=0x7f8b5802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3419f5c95847e17d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.948+0000 7f8b5f7fe640 1 -- 172.21.15.161:0/3562483139 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5802cbd0 con 0x7f8b600cc990 2023-11-24T08:02:20.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.948+0000 7f8b5f7fe640 1 -- 172.21.15.161:0/3562483139 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5802cd30 con 0x7f8b600cc990 2023-11-24T08:02:20.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.948+0000 7f8b5f7fe640 1 -- 172.21.15.161:0/3562483139 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5802cea0 con 0x7f8b600cc990 2023-11-24T08:02:20.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 -- 172.21.15.161:0/3562483139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 msgr2=0x7f8b6006d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3562483139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6006d870 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009d90 tx=0x7f8b5802be20 comp rx=0 tx=0).stop 2023-11-24T08:02:20.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 -- 172.21.15.161:0/3562483139 shutdown_connections 2023-11-24T08:02:20.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3562483139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6006d870 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 -- 172.21.15.161:0/3562483139 >> 172.21.15.161:0/3562483139 conn(0x7f8b6006a800 msgr2=0x7f8b6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:20.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 -- 172.21.15.161:0/3562483139 shutdown_connections 2023-11-24T08:02:20.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.949+0000 7f8b6559e640 1 -- 172.21.15.161:0/3562483139 wait complete. 2023-11-24T08:02:20.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.951+0000 7f8b6559e640 1 Processor -- start 2023-11-24T08:02:20.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.951+0000 7f8b6559e640 1 -- start start 2023-11-24T08:02:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.952+0000 7f8b6559e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b600cc500 0x7f8b6013b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b6559e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6013d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b6559e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b60143c40 0x7f8b600b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b6559e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013c1e0 con 0x7f8b600cc990 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b6559e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013dd10 con 0x7f8b600cc500 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b6559e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6013c430 con 0x7f8b60143c40 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6013d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6013d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45654/0 (socket says 172.21.15.161:45654) 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 -- 172.21.15.161:0/3751245481 learned_addr learned my addr 172.21.15.161:0/3751245481 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b5ffff640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b600cc500 0x7f8b6013b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 -- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b60143c40 msgr2=0x7f8b600b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b60143c40 0x7f8b600b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 -- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b600cc500 msgr2=0x7f8b6013b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b600cc500 0x7f8b6013b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:20.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.953+0000 7f8b57fff640 1 -- 172.21.15.161:0/3751245481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009a70 con 0x7f8b600cc990 2023-11-24T08:02:20.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.954+0000 7f8b57fff640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6013d3c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c430 tx=0x7f8b4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:20.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.954+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48011790 con 0x7f8b600cc990 2023-11-24T08:02:20.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.954+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480118f0 con 0x7f8b600cc990 2023-11-24T08:02:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.954+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48011ce0 con 0x7f8b600cc990 2023-11-24T08:02:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.954+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b6013c710 con 0x7f8b600cc990 2023-11-24T08:02:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.954+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6013bcd0 con 0x7f8b600cc990 2023-11-24T08:02:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.955+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b601410a0 con 0x7f8b600cc990 2023-11-24T08:02:20.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.956+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8b4801c460 con 0x7f8b600cc990 2023-11-24T08:02:20.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.957+0000 7f8b5d7fa640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b4006aff0 0x7f8b4006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:20.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.957+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8b48089600 con 0x7f8b600cc990 2023-11-24T08:02:20.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.958+0000 7f8b5ffff640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b4006aff0 0x7f8b4006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:20.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.959+0000 7f8b5ffff640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b4006aff0 0x7f8b4006d4b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f60 tx=0x7f8b50007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:20.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:20.961+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b48054720 con 0x7f8b600cc990 2023-11-24T08:02:21.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.188+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b6013cc30 con 0x7f8b600cc990 2023-11-24T08:02:21.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.189+0000 7f8b5d7fa640 1 -- 172.21.15.161:0/3751245481 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f8b6013cc30 con 0x7f8b600cc990 2023-11-24T08:02:21.191 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:21.191 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4233535375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":4233535375},{"type":"v1","addr":"172.21.15.161:6835","nonce":4233535375}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4634,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/98821404","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6835","nonce":98821404},{"type":"v1","addr":"172.21.15.175:6837","nonce":98821404}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5017,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6836/2710944529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2710944529},{"type":"v1","addr":"172.21.15.175:6836","nonce":2710944529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5160,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/169495829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":169495829},{"type":"v1","addr":"172.21.15.161:6834","nonce":169495829}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[]} 2023-11-24T08:02:21.191 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 20 2023-11-24T08:02:21.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b4006aff0 msgr2=0x7f8b4006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:21.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b4006aff0 0x7f8b4006d4b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000f60 tx=0x7f8b50007c00 comp rx=0 tx=0).stop 2023-11-24T08:02:21.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 msgr2=0x7f8b6013d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:21.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6013d3c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c430 tx=0x7f8b4800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 shutdown_connections 2023-11-24T08:02:21.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b4006aff0 0x7f8b4006d4b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b60143c40 0x7f8b600b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b600cc990 0x7f8b6013d3c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 --2- 172.21.15.161:0/3751245481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b600cc500 0x7f8b6013b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.192+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 >> 172.21.15.161:0/3751245481 conn(0x7f8b6006a800 msgr2=0x7f8b6006d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:21.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.193+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 shutdown_connections 2023-11-24T08:02:21.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.193+0000 7f8b6559e640 1 -- 172.21.15.161:0/3751245481 wait complete. 2023-11-24T08:02:21.211 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:02:21.211 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:02:21.211 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:02:21.212 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:02:21.212 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:02:21.212 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:02:21.212 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:02:21.212 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:02:21.212 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:02:21.213 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:02:21.213 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:02:21.213 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:02:21.213 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:02:21.213 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:02:21.213 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:02:21.213 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:02:21.229 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:02:21.229 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:02:21.230 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:02:21.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:02:21.233 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:02:21.233 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:02:21.235 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:02:21.235 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:02:21.278 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:02:21.278 DEBUG:teuthology.parallel:result is None 2023-11-24T08:02:21.281 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:02:21.282 DEBUG:teuthology.parallel:result is None 2023-11-24T08:02:21.285 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:02:21.285 DEBUG:teuthology.parallel:result is None 2023-11-24T08:02:21.289 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:02:21.289 DEBUG:teuthology.parallel:result is None 2023-11-24T08:02:21.289 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:02:21.437 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2023-11-24T08:02:21.439 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-11-24T08:02:21.442 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-24T08:02:21.454 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-24T08:02:21.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.477+0000 7fbee6be5640 1 Processor -- start 2023-11-24T08:02:21.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.478+0000 7fbee6be5640 1 -- start start 2023-11-24T08:02:21.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee6be5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbee00b3ae0 0x7fbee015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:21.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee6be5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbee00cf290 0x7fbee00cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:21.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee6be5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee0070c40 con 0x7fbee00ae5a0 2023-11-24T08:02:21.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee6be5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee0071450 con 0x7fbee00cf290 2023-11-24T08:02:21.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee6be5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee00cfc60 con 0x7fbee00b3ae0 2023-11-24T08:02:21.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee4981640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbee00ae5a0 0x7fbee006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60900/0 (socket says 172.21.15.161:60900) 2023-11-24T08:02:21.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee4981640 1 -- 172.21.15.161:0/181144367 learned_addr learned my addr 172.21.15.161:0/181144367 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:21.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbee5182640 1 --2- 172.21.15.161:0/181144367 >> v2:172.21.15.161:3300/0 conn(0x7fbee00cf290 0x7fbee00cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:21.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.479+0000 7fbedffff640 1 --2- 172.21.15.161:0/181144367 >> v2:172.21.15.175:3300/0 conn(0x7fbee00b3ae0 0x7fbee015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:21.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbedf7fe640 1 -- 172.21.15.161:0/181144367 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476973018 0 0) 0x7fbee0070c40 con 0x7fbee00ae5a0 2023-11-24T08:02:21.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbedf7fe640 1 -- 172.21.15.161:0/181144367 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed0003520 con 0x7fbee00ae5a0 2023-11-24T08:02:21.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbee5182640 1 -- 172.21.15.161:0/181144367 >> v2:172.21.15.175:3300/0 conn(0x7fbee00b3ae0 msgr2=0x7fbee015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:21.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbee5182640 1 --2- 172.21.15.161:0/181144367 >> v2:172.21.15.175:3300/0 conn(0x7fbee00b3ae0 0x7fbee015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbee5182640 1 -- 172.21.15.161:0/181144367 >> v1:172.21.15.161:6789/0 conn(0x7fbee00ae5a0 legacy=0x7fbee006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:21.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbee5182640 1 -- 172.21.15.161:0/181144367 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee006c470 con 0x7fbee00cf290 2023-11-24T08:02:21.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.480+0000 7fbedffff640 1 --2- 172.21.15.161:0/181144367 >> v2:172.21.15.175:3300/0 conn(0x7fbee00b3ae0 0x7fbee015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:02:21.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.481+0000 7fbee5182640 1 --2- 172.21.15.161:0/181144367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00cf290 0x7fbee00cf720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbee00cfea0 tx=0x7fbed802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5fc26cfa2c334ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:21.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.481+0000 7fbedf7fe640 1 -- 172.21.15.161:0/181144367 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed802cd10 con 0x7fbee00cf290 2023-11-24T08:02:21.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.481+0000 7fbedf7fe640 1 -- 172.21.15.161:0/181144367 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed802ce70 con 0x7fbee00cf290 2023-11-24T08:02:21.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.481+0000 7fbedf7fe640 1 -- 172.21.15.161:0/181144367 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8034640 con 0x7fbee00cf290 2023-11-24T08:02:21.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 -- 172.21.15.161:0/181144367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00cf290 msgr2=0x7fbee00cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:21.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 --2- 172.21.15.161:0/181144367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00cf290 0x7fbee00cf720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbee00cfea0 tx=0x7fbed802bf60 comp rx=0 tx=0).stop 2023-11-24T08:02:21.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 -- 172.21.15.161:0/181144367 shutdown_connections 2023-11-24T08:02:21.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 --2- 172.21.15.161:0/181144367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00cf290 0x7fbee00cf720 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 --2- 172.21.15.161:0/181144367 >> v2:172.21.15.175:3300/0 conn(0x7fbee00b3ae0 0x7fbee015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 -- 172.21.15.161:0/181144367 >> 172.21.15.161:0/181144367 conn(0x7fbee006a800 msgr2=0x7fbee006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:21.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 -- 172.21.15.161:0/181144367 shutdown_connections 2023-11-24T08:02:21.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.482+0000 7fbee6be5640 1 -- 172.21.15.161:0/181144367 wait complete. 2023-11-24T08:02:21.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.484+0000 7fbee6be5640 1 Processor -- start 2023-11-24T08:02:21.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.484+0000 7fbee6be5640 1 -- start start 2023-11-24T08:02:21.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee6be5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee00ae5a0 0x7fbee014de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee6be5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 0x7fbee0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee6be5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbee00cf290 0x7fbee0158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee6be5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee013c3b0 con 0x7fbee00b3ae0 2023-11-24T08:02:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee6be5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee015eb50 con 0x7fbee00ae5a0 2023-11-24T08:02:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee6be5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee014e350 con 0x7fbee00cf290 2023-11-24T08:02:21.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 0x7fbee0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 0x7fbee0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45706/0 (socket says 172.21.15.161:45706) 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 -- 172.21.15.161:0/456073635 learned_addr learned my addr 172.21.15.161:0/456073635 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee4981640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee00ae5a0 0x7fbee014de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee5182640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbee00cf290 0x7fbee0158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 -- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbee00cf290 msgr2=0x7fbee0158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbee00cf290 0x7fbee0158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 -- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee00ae5a0 msgr2=0x7fbee014de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee00ae5a0 0x7fbee014de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbedffff640 1 -- 172.21.15.161:0/456073635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009400 con 0x7fbee00b3ae0 2023-11-24T08:02:21.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.485+0000 7fbee4981640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee00ae5a0 0x7fbee014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.486+0000 7fbedffff640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 0x7fbee0157f10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00ec10 tx=0x7fbecc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.486+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc009760 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.486+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00cc30 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.486+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed8009a70 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.486+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc013470 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.486+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee013c600 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.487+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee00675d0 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.488+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbecc0135d0 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.489+0000 7fbedd7fa640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbec406b020 0x7fbec406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.489+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbecc0899c0 con 0x7fbee00b3ae0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.490+0000 7fbee4981640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbec406b020 0x7fbec406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:21.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.490+0000 7fbee4981640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbec406b020 0x7fbec406d4e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbed40011e0 tx=0x7fbed4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:21.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.493+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbecc054a50 con 0x7fbee00b3ae0 2023-11-24T08:02:21.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:21.695+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbee00708d0 con 0x7fbee00b3ae0 2023-11-24T08:02:22.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.816+0000 7fbedd7fa640 1 -- 172.21.15.161:0/456073635 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbecc058070 con 0x7fbee00b3ae0 2023-11-24T08:02:22.818 INFO:teuthology.orchestra.run.smithi161.stderr: removed all blocklist entries 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbec406b020 msgr2=0x7fbec406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbec406b020 0x7fbec406d4e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbed40011e0 tx=0x7fbed4009040 comp rx=0 tx=0).stop 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 msgr2=0x7fbee0157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 0x7fbee0157f10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00ec10 tx=0x7fbecc00c520 comp rx=0 tx=0).stop 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 shutdown_connections 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbec406b020 0x7fbec406d4e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbee00cf290 0x7fbee0158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbee00b3ae0 0x7fbee0157f10 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 --2- 172.21.15.161:0/456073635 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbee00ae5a0 0x7fbee014de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:22.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 >> 172.21.15.161:0/456073635 conn(0x7fbee006a800 msgr2=0x7fbee015a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:22.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 shutdown_connections 2023-11-24T08:02:22.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:22.820+0000 7fbee6be5640 1 -- 172.21.15.161:0/456073635 wait complete. 2023-11-24T08:02:22.841 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:02:23.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.050+0000 7ff82b6cf640 1 Processor -- start 2023-11-24T08:02:23.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.050+0000 7ff82b6cf640 1 -- start start 2023-11-24T08:02:23.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.051+0000 7ff82b6cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82413df80 0x7ff82415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.051+0000 7ff82b6cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff82413e360 0x7ff8240cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.051+0000 7ff82b6cf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff82415f9c0 0x7ff8240cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.051+0000 7ff82b6cf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82406c470 con 0x7ff82413e360 2023-11-24T08:02:23.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.051+0000 7ff82b6cf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff82406c750 con 0x7ff82415f9c0 2023-11-24T08:02:23.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.051+0000 7ff82b6cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82406ca30 con 0x7ff82413df80 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff82413e360 0x7ff8240cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff82413e360 0x7ff8240cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45716/0 (socket says 172.21.15.161:45716) 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 -- 172.21.15.161:0/2475801970 learned_addr learned my addr 172.21.15.161:0/2475801970 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff82946b640 1 --2- 172.21.15.161:0/2475801970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82413df80 0x7ff82415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 -- 172.21.15.161:0/2475801970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82413df80 msgr2=0x7ff82415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 --2- 172.21.15.161:0/2475801970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82413df80 0x7ff82415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 -- 172.21.15.161:0/2475801970 >> v2:172.21.15.175:3300/0 conn(0x7ff82415f9c0 msgr2=0x7ff8240cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:23.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 --2- 172.21.15.161:0/2475801970 >> v2:172.21.15.175:3300/0 conn(0x7ff82415f9c0 0x7ff8240cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.052+0000 7ff828c6a640 1 -- 172.21.15.161:0/2475801970 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82406cd10 con 0x7ff82413e360 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.053+0000 7ff828c6a640 1 --2- 172.21.15.161:0/2475801970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413e360 0x7ff8240cf290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff82406e6d0 tx=0x7ff81402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28161d14e7845f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff81bfff640 1 -- 172.21.15.161:0/2475801970 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814031870 con 0x7ff82413e360 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff81bfff640 1 -- 172.21.15.161:0/2475801970 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8140319d0 con 0x7ff82413e360 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff81bfff640 1 -- 172.21.15.161:0/2475801970 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff814031d60 con 0x7ff82413e360 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 -- 172.21.15.161:0/2475801970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413e360 msgr2=0x7ff8240cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/2475801970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413e360 0x7ff8240cf290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff82406e6d0 tx=0x7ff81402b910 comp rx=0 tx=0).stop 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 -- 172.21.15.161:0/2475801970 shutdown_connections 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/2475801970 >> v2:172.21.15.175:3300/0 conn(0x7ff82415f9c0 0x7ff8240cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/2475801970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413e360 0x7ff8240cf290 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/2475801970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82413df80 0x7ff82415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 -- 172.21.15.161:0/2475801970 >> 172.21.15.161:0/2475801970 conn(0x7ff82406a800 msgr2=0x7ff82406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:23.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 -- 172.21.15.161:0/2475801970 shutdown_connections 2023-11-24T08:02:23.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.054+0000 7ff82b6cf640 1 -- 172.21.15.161:0/2475801970 wait complete. 2023-11-24T08:02:23.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.056+0000 7ff82b6cf640 1 Processor -- start 2023-11-24T08:02:23.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.056+0000 7ff82b6cf640 1 -- start start 2023-11-24T08:02:23.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82b6cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 0x7ff824070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82b6cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff82413e360 0x7ff824154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82b6cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82415f9c0 0x7ff8240b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82b6cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240aaa50 con 0x7ff82413df80 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82b6cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff824071210 con 0x7ff82413e360 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82b6cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240a8880 con 0x7ff82415f9c0 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82946b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 0x7ff824070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82946b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 0x7ff824070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45730/0 (socket says 172.21.15.161:45730) 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.057+0000 7ff82946b640 1 -- 172.21.15.161:0/1549919157 learned_addr learned my addr 172.21.15.161:0/1549919157 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82946b640 1 -- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82415f9c0 msgr2=0x7ff8240b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82946b640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82415f9c0 0x7ff8240b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82946b640 1 -- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff82413e360 msgr2=0x7ff824154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82946b640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff82413e360 0x7ff824154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82946b640 1 -- 172.21.15.161:0/1549919157 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8140094d0 con 0x7ff82413df80 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82946b640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 0x7ff824070cd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d5f0 tx=0x7ff82000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8200125f0 con 0x7ff82413df80 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff820012750 con 0x7ff82413df80 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8240a8b60 con 0x7ff82413df80 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820012b00 con 0x7ff82413df80 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.058+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8240a8ef0 con 0x7ff82413df80 2023-11-24T08:02:23.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.059+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8240675d0 con 0x7ff82413df80 2023-11-24T08:02:23.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.060+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff820012c60 con 0x7ff82413df80 2023-11-24T08:02:23.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.061+0000 7ff819ffb640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff80806b020 0x7ff80806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.061+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff820089b40 con 0x7ff82413df80 2023-11-24T08:02:23.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.062+0000 7ff828c6a640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff80806b020 0x7ff80806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.063+0000 7ff828c6a640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff80806b020 0x7ff80806d4e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff814036000 tx=0x7ff814030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:23.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.065+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff820054c20 con 0x7ff82413df80 2023-11-24T08:02:23.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.322+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff82406df00 con 0x7ff82413df80 2023-11-24T08:02:23.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.323+0000 7ff819ffb640 1 -- 172.21.15.161:0/1549919157 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff820058240 con 0x7ff82413df80 2023-11-24T08:02:23.324 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:23.324 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:02:23.324 INFO:teuthology.orchestra.run.smithi161.stdout: "auth_dump": [ 2023-11-24T08:02:23.324 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.a", 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlHD6tGhAAHgfwFnLRAnZJYkP/R6LkDA==", 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.325 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.b", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlhwvbARAAhTRWPeXbP0Z85pAw4aEhzw==", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.c", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlBOzLKxAAodBeIc6gxGOmd7u2xqJcNQ==", 2023-11-24T08:02:23.326 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.d", 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2Blgdy3EhAATujalM2qKRTbZsSDt9Klkg==", 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.327 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.0", 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWV2BlYGGZDRAAw5WGhgWYIelaXgs35FbP6Q==", 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.328 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.1", 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDZV2Bl7LRAJxAA/0jx7Tz254+nQpLEHq0DHw==", 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.2", 2023-11-24T08:02:23.329 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDdV2BlGxntAxAAlq53dwY33JyEdL1bA4A4qg==", 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.3", 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDgV2BleVHNHBAA5WTP8GdbwtsQqAQGlBltKA==", 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.330 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.4", 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDnV2BlnBePIRAAiBKoHmbq5RakHSkloIHXiA==", 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.331 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.5", 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDqV2BlPvd0KxAA0NN6x6VMmoheCO+k1+9Pqw==", 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.332 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.6", 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDtV2Bl93CTNBAAQciFc0K2H/YECC3VtUaz6A==", 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.333 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.7", 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDxV2Bl4WVOEhAA05ppVcoEr6QDrGDWYMXoWQ==", 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:02:23.334 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.0", 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA==", 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow r", 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.335 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.1", 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlsuSyNxAAzKRQWIED6Y00//mN8k2A2A==", 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.2", 2023-11-24T08:02:23.336 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlbNQdLRAAgt8XlhFRtS6ykHldSR/mTg==", 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.337 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.3", 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDSV2BlFoFzBhAATWeUEX1fhVTvj03CuGTO/w==", 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.admin", 2023-11-24T08:02:23.338 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDPV2BlOyC4DhAASM/sLxsmWpuy+0JqHTr6xw==", 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.x", 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlaY9ADhAA3F3uUt8RpzSr7R2IgBLQYA==", 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.339 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.y", 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlNxTcABAApZPsFQs537yAkIv0IJhzOg==", 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:02:23.340 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:02:23.341 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-11-24T08:02:23.341 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:02:23.341 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.341 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:23.341 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2023-11-24T08:02:23.341 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:02:23.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff80806b020 msgr2=0x7ff80806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff80806b020 0x7ff80806d4e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff814036000 tx=0x7ff814030000 comp rx=0 tx=0).stop 2023-11-24T08:02:23.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 msgr2=0x7ff824070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 0x7ff824070cd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff82000d5f0 tx=0x7ff82000dab0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 shutdown_connections 2023-11-24T08:02:23.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff80806b020 0x7ff80806d4e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff82415f9c0 0x7ff8240b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff82413e360 0x7ff824154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 --2- 172.21.15.161:0/1549919157 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff82413df80 0x7ff824070cd0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 >> 172.21.15.161:0/1549919157 conn(0x7ff82406a800 msgr2=0x7ff8240cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:23.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 shutdown_connections 2023-11-24T08:02:23.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.326+0000 7ff82b6cf640 1 -- 172.21.15.161:0/1549919157 wait complete. 2023-11-24T08:02:23.346 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:23.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.546+0000 7fc491dec640 1 Processor -- start 2023-11-24T08:02:23.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.546+0000 7fc491dec640 1 -- start start 2023-11-24T08:02:23.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.547+0000 7fc491dec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc48c0cf9a0 0x7fc48c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.547+0000 7fc491dec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0b1ee0 con 0x7fc48c143ae0 2023-11-24T08:02:23.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.547+0000 7fc491dec640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c0b2780 con 0x7fc48c15e1e0 2023-11-24T08:02:23.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.547+0000 7fc491dec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c15e990 con 0x7fc48c0cf9a0 2023-11-24T08:02:23.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.548+0000 7fc48b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc48c143ae0 0x7fc48c0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60908/0 (socket says 172.21.15.161:60908) 2023-11-24T08:02:23.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.548+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2901301383 learned_addr learned my addr 172.21.15.161:0/2901301383 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:23.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.548+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832414324 0 0) 0x7fc48c0b1ee0 con 0x7fc48c143ae0 2023-11-24T08:02:23.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.548+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc478003520 con 0x7fc48c143ae0 2023-11-24T08:02:23.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.548+0000 7fc48affd640 1 --2- 172.21.15.161:0/2901301383 >> v2:172.21.15.175:3300/0 conn(0x7fc48c0cf9a0 0x7fc48c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2976741384 0 0) 0x7fc478003520 con 0x7fc48c143ae0 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 >> v2:172.21.15.175:3300/0 conn(0x7fc48c0cf9a0 msgr2=0x7fc48c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 --2- 172.21.15.161:0/2901301383 >> v2:172.21.15.175:3300/0 conn(0x7fc48c0cf9a0 0x7fc48c15dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 >> v1:172.21.15.175:6789/0 conn(0x7fc48c15e1e0 legacy=0x7fc48c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0b2130 con 0x7fc48c143ae0 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc47c001670 con 0x7fc48c143ae0 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 >> v1:172.21.15.161:6789/0 conn(0x7fc48c143ae0 legacy=0x7fc48c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc478003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4780047c0 0x7fc478004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc478005180 0x7fc47800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15e990 con 0x7fc4780039c0 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47800c080 con 0x7fc4780047c0 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47800c240 con 0x7fc478005180 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.549+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc478003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc478005180 msgr2=0x7fc47800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:23.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc478005180 0x7fc47800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4780047c0 msgr2=0x7fc478004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48affd640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4780047c0 0x7fc478004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4780047c0 0x7fc478004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2901301383 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478003520 con 0x7fc4780039c0 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.550+0000 7fc48bfff640 1 -- 172.21.15.161:0/2901301383 reap_dead start 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.551+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc478003de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00c0e0 tx=0x7fc4780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b879f8bd3d8da9b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.551+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c005ad0 con 0x7fc4780039c0 2023-11-24T08:02:23.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.551+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c005c50 con 0x7fc4780039c0 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.551+0000 7fc48a7fc640 1 -- 172.21.15.161:0/2901301383 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c02c810 con 0x7fc4780039c0 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 -- 172.21.15.161:0/2901301383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 msgr2=0x7fc478003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc478003de0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00c0e0 tx=0x7fc4780057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 -- 172.21.15.161:0/2901301383 shutdown_connections 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 --2- 172.21.15.161:0/2901301383 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc478003de0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 -- 172.21.15.161:0/2901301383 >> 172.21.15.161:0/2901301383 conn(0x7fc48c06a800 msgr2=0x7fc48c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:23.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 -- 172.21.15.161:0/2901301383 shutdown_connections 2023-11-24T08:02:23.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.552+0000 7fc491dec640 1 -- 172.21.15.161:0/2901301383 wait complete. 2023-11-24T08:02:23.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.554+0000 7fc491dec640 1 Processor -- start 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.554+0000 7fc491dec640 1 -- start start 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc491dec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc48c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc491dec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc48c1f70b0 0x7fc48c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc491dec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c159ed0 0x7fc48c0ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc491dec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0cec60 con 0x7fc4780039c0 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc491dec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0ce980 con 0x7fc48c159ed0 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc491dec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c1f65d0 con 0x7fc48c1f70b0 2023-11-24T08:02:23.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc48b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc48c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc48b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc48c152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45740/0 (socket says 172.21.15.161:45740) 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2618526966 learned_addr learned my addr 172.21.15.161:0/2618526966 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc48affd640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc48c1f70b0 0x7fc48c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.555+0000 7fc48bfff640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c159ed0 0x7fc48c0ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc48c1f70b0 msgr2=0x7fc48c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc48c1f70b0 0x7fc48c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c159ed0 msgr2=0x7fc48c0ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c159ed0 0x7fc48c0ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc48b7fe640 1 -- 172.21.15.161:0/2618526966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c1f68b0 con 0x7fc4780039c0 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc48b7fe640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc48c152770 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc47c000c00 tx=0x7fc47c02e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c03c040 con 0x7fc4780039c0 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c02cce0 con 0x7fc4780039c0 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0072b0 con 0x7fc4780039c0 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c152cb0 con 0x7fc4780039c0 2023-11-24T08:02:23.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.556+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c0adf90 con 0x7fc4780039c0 2023-11-24T08:02:23.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.557+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c1f6a40 con 0x7fc4780039c0 2023-11-24T08:02:23.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.558+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc47c032070 con 0x7fc4780039c0 2023-11-24T08:02:23.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.559+0000 7fc483fff640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46c06b020 0x7fc46c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:23.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.559+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc47c0aaa30 con 0x7fc4780039c0 2023-11-24T08:02:23.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.560+0000 7fc48affd640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46c06b020 0x7fc46c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:23.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.561+0000 7fc48affd640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46c06b020 0x7fc46c06d4e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fd0 tx=0x7fc47400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:23.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.564+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc47c075ba0 con 0x7fc4780039c0 2023-11-24T08:02:23.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.757+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48c06d810 con 0x7fc4780039c0 2023-11-24T08:02:23.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.759+0000 7fc483fff640 1 -- 172.21.15.161:0/2618526966 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12881 (secure 0 0 0) 0x7fc47c0791c0 con 0x7fc4780039c0 2023-11-24T08:02:23.760 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:23.760 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":43,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:22.812175+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:23.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.761+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46c06b020 msgr2=0x7fc46c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.761+0000 7fc491dec640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46c06b020 0x7fc46c06d4e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc474009fd0 tx=0x7fc47400b040 comp rx=0 tx=0).stop 2023-11-24T08:02:23.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 msgr2=0x7fc48c152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:23.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc48c152770 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc47c000c00 tx=0x7fc47c02e070 comp rx=0 tx=0).stop 2023-11-24T08:02:23.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 shutdown_connections 2023-11-24T08:02:23.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46c06b020 0x7fc46c06d4e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48c159ed0 0x7fc48c0ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc48c1f70b0 0x7fc48c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 --2- 172.21.15.161:0/2618526966 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc4780039c0 0x7fc48c152770 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:23.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 >> 172.21.15.161:0/2618526966 conn(0x7fc48c06a800 msgr2=0x7fc48c0cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:23.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 shutdown_connections 2023-11-24T08:02:23.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.762+0000 7fc491dec640 1 -- 172.21.15.161:0/2618526966 wait complete. 2023-11-24T08:02:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:23.783 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:24.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.999+0000 7f1f7adb3640 1 Processor -- start 2023-11-24T08:02:24.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:23.999+0000 7f1f7adb3640 1 -- start start 2023-11-24T08:02:24.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.000+0000 7f1f7adb3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f740ccb50 0x7f1f74070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.000+0000 7f1f7adb3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f74143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.000+0000 7f1f7adb3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7415f4e0 con 0x7f1f740adf20 2023-11-24T08:02:24.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.000+0000 7f1f7adb3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7415f970 con 0x7f1f740ccb50 2023-11-24T08:02:24.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.000+0000 7f1f7adb3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7415c3c0 con 0x7f1f7415bf10 2023-11-24T08:02:24.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f740ccb50 0x7f1f74070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f740ccb50 0x7f1f74070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45756/0 (socket says 172.21.15.161:45756) 2023-11-24T08:02:24.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 -- 172.21.15.161:0/3586082868 learned_addr learned my addr 172.21.15.161:0/3586082868 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:24.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f7a5b2640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f74143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 -- 172.21.15.161:0/3586082868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 msgr2=0x7f1f74143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:24.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f74143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 -- 172.21.15.161:0/3586082868 >> v1:172.21.15.161:6789/0 conn(0x7f1f740adf20 legacy=0x7f1f740cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f795b0640 1 -- 172.21.15.161:0/3586082868 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74071130 con 0x7f1f740ccb50 2023-11-24T08:02:24.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f7a5b2640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f74143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:24.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.001+0000 7f1f78daf640 1 -- 172.21.15.161:0/3586082868 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639275447 0 0) 0x7f1f7415f4e0 con 0x7f1f740adf20 2023-11-24T08:02:24.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.003+0000 7f1f795b0640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f74070a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009870 tx=0x7f1f6402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9613e9439248db6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.003+0000 7f1f78daf640 1 -- 172.21.15.161:0/3586082868 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64031640 con 0x7f1f740ccb50 2023-11-24T08:02:24.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.003+0000 7f1f78daf640 1 -- 172.21.15.161:0/3586082868 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f640317a0 con 0x7f1f740ccb50 2023-11-24T08:02:24.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.003+0000 7f1f78daf640 1 -- 172.21.15.161:0/3586082868 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64031b30 con 0x7f1f740ccb50 2023-11-24T08:02:24.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 -- 172.21.15.161:0/3586082868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 msgr2=0x7f1f74070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f74070a30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009870 tx=0x7f1f6402b8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 -- 172.21.15.161:0/3586082868 shutdown_connections 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f74143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/3586082868 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f74070a30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 -- 172.21.15.161:0/3586082868 >> 172.21.15.161:0/3586082868 conn(0x7f1f7406a7d0 msgr2=0x7f1f7406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 -- 172.21.15.161:0/3586082868 shutdown_connections 2023-11-24T08:02:24.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.004+0000 7f1f7adb3640 1 -- 172.21.15.161:0/3586082868 wait complete. 2023-11-24T08:02:24.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.006+0000 7f1f7adb3640 1 Processor -- start 2023-11-24T08:02:24.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.006+0000 7f1f7adb3640 1 -- start start 2023-11-24T08:02:24.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7adb3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f740adf20 0x7f1f7415a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7adb3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f740c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7adb3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f7406c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7adb3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740c5fe0 con 0x7f1f740ccb50 2023-11-24T08:02:24.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7adb3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7415aec0 con 0x7f1f740adf20 2023-11-24T08:02:24.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7adb3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740c53d0 con 0x7f1f7415bf10 2023-11-24T08:02:24.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f740c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f740c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45760/0 (socket says 172.21.15.161:45760) 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 -- 172.21.15.161:0/1200763296 learned_addr learned my addr 172.21.15.161:0/1200763296 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f79db1640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f740adf20 0x7f1f7415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7a5b2640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f7406c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 -- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 msgr2=0x7f1f7406c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f7406c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 -- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f740adf20 msgr2=0x7f1f7415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f740adf20 0x7f1f7415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f795b0640 1 -- 172.21.15.161:0/1200763296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f640094d0 con 0x7f1f740ccb50 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f7a5b2640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f7406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:24.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.007+0000 7f1f79db1640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f740adf20 0x7f1f7415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.008+0000 7f1f795b0640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f740c4950 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000c00 tx=0x7f1f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.008+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64004230 con 0x7f1f740ccb50 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.008+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f64004390 con 0x7f1f740ccb50 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.008+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6403baa0 con 0x7f1f740ccb50 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.008+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f740c56b0 con 0x7f1f740ccb50 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.008+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f740c5c70 con 0x7f1f740ccb50 2023-11-24T08:02:24.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.009+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f740c5e30 con 0x7f1f740ccb50 2023-11-24T08:02:24.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.010+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1f64043070 con 0x7f1f740ccb50 2023-11-24T08:02:24.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.011+0000 7f1f6a7fc640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f5806aff0 0x7f1f5806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.011+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1f640ab4a0 con 0x7f1f740ccb50 2023-11-24T08:02:24.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.012+0000 7f1f79db1640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f5806aff0 0x7f1f5806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.013+0000 7f1f79db1640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f5806aff0 0x7f1f5806d4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1f70000f60 tx=0x7f1f70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.016+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f640763e0 con 0x7f1f740ccb50 2023-11-24T08:02:24.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.209+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f740c6120 con 0x7f1f740ccb50 2023-11-24T08:02:24.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.210+0000 7f1f6a7fc640 1 -- 172.21.15.161:0/1200763296 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f740c6120 con 0x7f1f740ccb50 2023-11-24T08:02:24.211 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f5806aff0 msgr2=0x7f1f5806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f5806aff0 0x7f1f5806d4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1f70000f60 tx=0x7f1f70009040 comp rx=0 tx=0).stop 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 msgr2=0x7f1f740c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f740c4950 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1f64000c00 tx=0x7f1f640046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 shutdown_connections 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f5806aff0 0x7f1f5806d4b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f7415bf10 0x7f1f7406c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f740ccb50 0x7f1f740c4950 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 --2- 172.21.15.161:0/1200763296 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f740adf20 0x7f1f7415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 >> 172.21.15.161:0/1200763296 conn(0x7f1f7406a7d0 msgr2=0x7f1f7415b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:24.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 shutdown_connections 2023-11-24T08:02:24.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.213+0000 7f1f7adb3640 1 -- 172.21.15.161:0/1200763296 wait complete. 2023-11-24T08:02:24.232 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:02:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.439+0000 7f9b119a9640 1 Processor -- start 2023-11-24T08:02:24.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.439+0000 7f9b119a9640 1 -- start start 2023-11-24T08:02:24.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.440+0000 7f9b119a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c143ae0 0x7f9b0c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.440+0000 7f9b119a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b0c0cf7d0 0x7f9b0c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.440+0000 7f9b119a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0c0cfc30 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.440+0000 7f9b119a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c0b1ee0 con 0x7f9b0c0cf7d0 2023-11-24T08:02:24.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.440+0000 7f9b119a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0b2780 con 0x7f9b0c143ae0 2023-11-24T08:02:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b0c0cf7d0 0x7f9b0c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9b0c0cf7d0 0x7f9b0c15dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45762/0 (socket says 172.21.15.161:45762) 2023-11-24T08:02:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 -- 172.21.15.161:0/2738856317 learned_addr learned my addr 172.21.15.161:0/2738856317 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0affd640 1 --2- 172.21.15.161:0/2738856317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c143ae0 0x7f9b0c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 -- 172.21.15.161:0/2738856317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c143ae0 msgr2=0x7f9b0c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:24.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 --2- 172.21.15.161:0/2738856317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c143ae0 0x7f9b0c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 -- 172.21.15.161:0/2738856317 >> v1:172.21.15.161:6789/0 conn(0x7f9b0c15e1e0 legacy=0x7f9b0c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b09ffb640 1 -- 172.21.15.161:0/2738856317 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267901029 0 0) 0x7f9b0c0cfc30 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.441+0000 7f9b0a7fc640 1 -- 172.21.15.161:0/2738856317 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c15e990 con 0x7f9b0c0cf7d0 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.442+0000 7f9b0a7fc640 1 --2- 172.21.15.161:0/2738856317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c0cf7d0 0x7f9b0c15dca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000bb10 tx=0x7f9b0002e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c754907fe50f5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b09ffb640 1 -- 172.21.15.161:0/2738856317 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00036440 con 0x7f9b0c0cf7d0 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b09ffb640 1 -- 172.21.15.161:0/2738856317 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b000365a0 con 0x7f9b0c0cf7d0 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b09ffb640 1 -- 172.21.15.161:0/2738856317 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b00036930 con 0x7f9b0c0cf7d0 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b119a9640 1 -- 172.21.15.161:0/2738856317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c0cf7d0 msgr2=0x7f9b0c15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b119a9640 1 --2- 172.21.15.161:0/2738856317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c0cf7d0 0x7f9b0c15dca0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000bb10 tx=0x7f9b0002e150 comp rx=0 tx=0).stop 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b119a9640 1 -- 172.21.15.161:0/2738856317 shutdown_connections 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b119a9640 1 --2- 172.21.15.161:0/2738856317 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c0cf7d0 0x7f9b0c15dca0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b119a9640 1 --2- 172.21.15.161:0/2738856317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c143ae0 0x7f9b0c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.443+0000 7f9b119a9640 1 -- 172.21.15.161:0/2738856317 >> 172.21.15.161:0/2738856317 conn(0x7f9b0c06a800 msgr2=0x7f9b0c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.444+0000 7f9b119a9640 1 -- 172.21.15.161:0/2738856317 shutdown_connections 2023-11-24T08:02:24.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.444+0000 7f9b119a9640 1 -- 172.21.15.161:0/2738856317 wait complete. 2023-11-24T08:02:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.445+0000 7f9b119a9640 1 Processor -- start 2023-11-24T08:02:24.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.445+0000 7f9b119a9640 1 -- start start 2023-11-24T08:02:24.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.446+0000 7f9b119a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c0cf7d0 0x7f9b0c1f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.446+0000 7f9b119a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0c143ae0 0x7f9b0c159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.446+0000 7f9b119a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 0x7f9b0c1f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.446+0000 7f9b119a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0c3f50 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.446+0000 7f9b119a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c0cd3a0 con 0x7f9b0c143ae0 2023-11-24T08:02:24.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.446+0000 7f9b119a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1f3d20 con 0x7f9b0c0cf7d0 2023-11-24T08:02:24.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 0x7f9b0c1f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 0x7f9b0c1f3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45764/0 (socket says 172.21.15.161:45764) 2023-11-24T08:02:24.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 -- 172.21.15.161:0/637016327 learned_addr learned my addr 172.21.15.161:0/637016327 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:24.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0affd640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c0cf7d0 0x7f9b0c1f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 -- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c0cf7d0 msgr2=0x7f9b0c1f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c0cf7d0 0x7f9b0c1f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 -- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0c143ae0 msgr2=0x7f9b0c159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0c143ae0 0x7f9b0c159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 -- 172.21.15.161:0/637016327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0000b770 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.447+0000 7f9b0b7fe640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 0x7f9b0c1f3f20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c740 tx=0x7f9b0400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.448+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04003da0 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.448+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0400ce50 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.448+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04005290 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.448+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c0cc790 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.448+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c0ccd50 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.449+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c0cd550 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.450+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9b040053f0 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.451+0000 7f9af3fff640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9af806b020 0x7f9af806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.451+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b04088e40 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.451+0000 7f9b0affd640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9af806b020 0x7f9af806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.452+0000 7f9b0affd640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9af806b020 0x7f9af806d4e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006fd0 tx=0x7f9afc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.455+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b0c0cd550 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.650+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9b0c0cd550 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.650+0000 7f9af3fff640 1 -- 172.21.15.161:0/637016327 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9b0c0cd550 con 0x7f9b0c15e1e0 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:24.652 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:02:24.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9af806b020 msgr2=0x7f9af806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9af806b020 0x7f9af806d4e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9afc006fd0 tx=0x7f9afc008040 comp rx=0 tx=0).stop 2023-11-24T08:02:24.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 msgr2=0x7f9b0c1f3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 0x7f9b0c1f3f20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400c740 tx=0x7f9b0400cc00 comp rx=0 tx=0).stop 2023-11-24T08:02:24.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 shutdown_connections 2023-11-24T08:02:24.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9af806b020 0x7f9af806d4e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9b0c15e1e0 0x7f9b0c1f3f20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b0c143ae0 0x7f9b0c159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 --2- 172.21.15.161:0/637016327 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b0c0cf7d0 0x7f9b0c1f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 >> 172.21.15.161:0/637016327 conn(0x7f9b0c06a800 msgr2=0x7f9b0c15d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:24.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 shutdown_connections 2023-11-24T08:02:24.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.653+0000 7f9b119a9640 1 -- 172.21.15.161:0/637016327 wait complete. 2023-11-24T08:02:24.673 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:02:24.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:02:24.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.892+0000 7f76c8900640 1 Processor -- start 2023-11-24T08:02:24.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.892+0000 7f76c8900640 1 -- start start 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c8900640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c413ff20 0x7f76c415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c8900640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76c4140300 0x7f76c406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c8900640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76c406a920 0x7f76c40b3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c8900640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c406adb0 con 0x7f76c406a920 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c8900640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c40b5440 con 0x7f76c4140300 2023-11-24T08:02:24.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c8900640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4161c80 con 0x7f76c413ff20 2023-11-24T08:02:24.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.894+0000 7f76c359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76c406a920 0x7f76c40b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76c406a920 0x7f76c40b3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45772/0 (socket says 172.21.15.161:45772) 2023-11-24T08:02:24.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 -- 172.21.15.161:0/3175563589 learned_addr learned my addr 172.21.15.161:0/3175563589 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:24.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c2d9d640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c413ff20 0x7f76c415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c259c640 1 --2- 172.21.15.161:0/3175563589 >> v2:172.21.15.175:3300/0 conn(0x7f76c4140300 0x7f76c406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 -- 172.21.15.161:0/3175563589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c413ff20 msgr2=0x7f76c415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:24.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c413ff20 0x7f76c415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 -- 172.21.15.161:0/3175563589 >> v2:172.21.15.175:3300/0 conn(0x7f76c4140300 msgr2=0x7f76c406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:24.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 --2- 172.21.15.161:0/3175563589 >> v2:172.21.15.175:3300/0 conn(0x7f76c4140300 0x7f76c406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c359e640 1 -- 172.21.15.161:0/3175563589 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c415e6f0 con 0x7f76c406a920 2023-11-24T08:02:24.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c2d9d640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c413ff20 0x7f76c415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:24.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.895+0000 7f76c259c640 1 --2- 172.21.15.161:0/3175563589 >> v2:172.21.15.175:3300/0 conn(0x7f76c4140300 0x7f76c406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:24.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.897+0000 7f76c359e640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c406a920 0x7f76c40b3210 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f76c4074790 tx=0x7f76bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513de756a9477c6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.897+0000 7f76c1d9b640 1 -- 172.21.15.161:0/3175563589 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0317e0 con 0x7f76c406a920 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.897+0000 7f76c1d9b640 1 -- 172.21.15.161:0/3175563589 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc031940 con 0x7f76c406a920 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.897+0000 7f76c1d9b640 1 -- 172.21.15.161:0/3175563589 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc031cd0 con 0x7f76c406a920 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 -- 172.21.15.161:0/3175563589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c406a920 msgr2=0x7f76c40b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c406a920 0x7f76c40b3210 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f76c4074790 tx=0x7f76bc02b880 comp rx=0 tx=0).stop 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 -- 172.21.15.161:0/3175563589 shutdown_connections 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c406a920 0x7f76c40b3210 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 --2- 172.21.15.161:0/3175563589 >> v2:172.21.15.175:3300/0 conn(0x7f76c4140300 0x7f76c406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 --2- 172.21.15.161:0/3175563589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c413ff20 0x7f76c415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 -- 172.21.15.161:0/3175563589 >> 172.21.15.161:0/3175563589 conn(0x7f76c40b1cd0 msgr2=0x7f76c40b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:24.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 -- 172.21.15.161:0/3175563589 shutdown_connections 2023-11-24T08:02:24.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.898+0000 7f76c8900640 1 -- 172.21.15.161:0/3175563589 wait complete. 2023-11-24T08:02:24.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.900+0000 7f76c8900640 1 Processor -- start 2023-11-24T08:02:24.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.900+0000 7f76c8900640 1 -- start start 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c8900640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76c406a920 0x7f76c40adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c8900640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 0x7f76c414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c8900640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c4140300 0x7f76c415f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c8900640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4157af0 con 0x7f76c413ff20 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c8900640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4157db0 con 0x7f76c406a920 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c8900640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4158090 con 0x7f76c4140300 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 0x7f76c414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 0x7f76c414d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45784/0 (socket says 172.21.15.161:45784) 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.901+0000 7f76c259c640 1 -- 172.21.15.161:0/1736954574 learned_addr learned my addr 172.21.15.161:0/1736954574 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:24.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c359e640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c4140300 0x7f76c415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c2d9d640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76c406a920 0x7f76c40adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c259c640 1 -- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c4140300 msgr2=0x7f76c415f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c259c640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c4140300 0x7f76c415f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c259c640 1 -- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76c406a920 msgr2=0x7f76c40adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c259c640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76c406a920 0x7f76c40adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c259c640 1 -- 172.21.15.161:0/1736954574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc0094d0 con 0x7f76c413ff20 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c359e640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c4140300 0x7f76c415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:24.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c259c640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 0x7f76c414d0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00d7d0 tx=0x7f76ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004030 con 0x7f76c413ff20 2023-11-24T08:02:24.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac004190 con 0x7f76c413ff20 2023-11-24T08:02:24.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004520 con 0x7f76c413ff20 2023-11-24T08:02:24.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c4158370 con 0x7f76c413ff20 2023-11-24T08:02:24.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.902+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c40ae3e0 con 0x7f76c413ff20 2023-11-24T08:02:24.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.903+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c4067450 con 0x7f76c413ff20 2023-11-24T08:02:24.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.905+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f76ac00b6c0 con 0x7f76c413ff20 2023-11-24T08:02:24.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.905+0000 7f76bb7fe640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f76a406aff0 0x7f76a406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:24.906 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.906+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76ac089740 con 0x7f76c413ff20 2023-11-24T08:02:24.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.906+0000 7f76c2d9d640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f76a406aff0 0x7f76a406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:24.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.907+0000 7f76c2d9d640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f76a406aff0 0x7f76a406d4b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009f70 tx=0x7f76b400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:24.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:24.910+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76ac054820 con 0x7f76c413ff20 2023-11-24T08:02:25.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.105+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f76c40ad0d0 con 0x7f76c413ff20 2023-11-24T08:02:25.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.799+0000 7f76bb7fe640 1 -- 172.21.15.161:0/1736954574 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7f76ac057e40 con 0x7f76c413ff20 2023-11-24T08:02:25.801 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2023-11-24T08:02:25.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f76a406aff0 msgr2=0x7f76a406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:25.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f76a406aff0 0x7f76a406d4b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009f70 tx=0x7f76b400b040 comp rx=0 tx=0).stop 2023-11-24T08:02:25.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 msgr2=0x7f76c414d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:25.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 0x7f76c414d0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00d7d0 tx=0x7f76ac00dc90 comp rx=0 tx=0).stop 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 shutdown_connections 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f76a406aff0 0x7f76a406d4b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76c4140300 0x7f76c415f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76c413ff20 0x7f76c414d0c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 --2- 172.21.15.161:0/1736954574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76c406a920 0x7f76c40adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 >> 172.21.15.161:0/1736954574 conn(0x7f76c40b1cd0 msgr2=0x7f76c413dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 shutdown_connections 2023-11-24T08:02:25.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:25.803+0000 7f76c8900640 1 -- 172.21.15.161:0/1736954574 wait complete. 2023-11-24T08:02:25.829 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:02:26.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.031+0000 7f31a759e640 1 Processor -- start 2023-11-24T08:02:26.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.031+0000 7f31a759e640 1 -- start start 2023-11-24T08:02:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f31a8160920 0x7f31a80b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a80cf9f0 0x7f31a80cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31a8161010 0x7f31a81614a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a80d03b0 con 0x7f31a8160920 2023-11-24T08:02:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a759e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a80d0a10 con 0x7f31a8161010 2023-11-24T08:02:26.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80cf080 con 0x7f31a80cf9f0 2023-11-24T08:02:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a659c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f31a8160920 0x7f31a80b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a659c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f31a8160920 0x7f31a80b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45794/0 (socket says 172.21.15.161:45794) 2023-11-24T08:02:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.033+0000 7f31a659c640 1 -- 172.21.15.161:0/4117527267 learned_addr learned my addr 172.21.15.161:0/4117527267 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.034+0000 7f319ffff640 1 --2- 172.21.15.161:0/4117527267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a80cf9f0 0x7f31a80cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:26.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.034+0000 7f31a659c640 1 -- 172.21.15.161:0/4117527267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a80cf9f0 msgr2=0x7f31a80cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.034+0000 7f31a659c640 1 --2- 172.21.15.161:0/4117527267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a80cf9f0 0x7f31a80cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.034+0000 7f31a659c640 1 -- 172.21.15.161:0/4117527267 >> v2:172.21.15.175:3300/0 conn(0x7f31a8161010 msgr2=0x7f31a81614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.034+0000 7f31a659c640 1 --2- 172.21.15.161:0/4117527267 >> v2:172.21.15.175:3300/0 conn(0x7f31a8161010 0x7f31a81614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.034+0000 7f31a659c640 1 -- 172.21.15.161:0/4117527267 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a80c6be0 con 0x7f31a8160920 2023-11-24T08:02:26.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.035+0000 7f31a659c640 1 --2- 172.21.15.161:0/4117527267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8160920 0x7f31a80b3f30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f31a80c6930 tx=0x7f319802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9b1df5c52d011c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.035+0000 7f31a5d9b640 1 -- 172.21.15.161:0/4117527267 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198031870 con 0x7f31a8160920 2023-11-24T08:02:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.035+0000 7f31a5d9b640 1 -- 172.21.15.161:0/4117527267 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31980319d0 con 0x7f31a8160920 2023-11-24T08:02:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.035+0000 7f31a5d9b640 1 -- 172.21.15.161:0/4117527267 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198031d60 con 0x7f31a8160920 2023-11-24T08:02:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 -- 172.21.15.161:0/4117527267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8160920 msgr2=0x7f31a80b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 --2- 172.21.15.161:0/4117527267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8160920 0x7f31a80b3f30 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f31a80c6930 tx=0x7f319802b910 comp rx=0 tx=0).stop 2023-11-24T08:02:26.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 -- 172.21.15.161:0/4117527267 shutdown_connections 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 --2- 172.21.15.161:0/4117527267 >> v2:172.21.15.175:3300/0 conn(0x7f31a8161010 0x7f31a81614a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 --2- 172.21.15.161:0/4117527267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a80cf9f0 0x7f31a80cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 --2- 172.21.15.161:0/4117527267 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8160920 0x7f31a80b3f30 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 -- 172.21.15.161:0/4117527267 >> 172.21.15.161:0/4117527267 conn(0x7f31a80d3090 msgr2=0x7f31a80d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 -- 172.21.15.161:0/4117527267 shutdown_connections 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.036+0000 7f31a759e640 1 -- 172.21.15.161:0/4117527267 wait complete. 2023-11-24T08:02:26.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.038+0000 7f31a759e640 1 Processor -- start 2023-11-24T08:02:26.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.038+0000 7f31a759e640 1 -- start start 2023-11-24T08:02:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a80cf9f0 0x7f31a80b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a8160920 0x7f31a80c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 0x7f31a80b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80c63d0 con 0x7f31a8161010 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80ca850 con 0x7f31a80cf9f0 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a80b84d0 con 0x7f31a8160920 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 0x7f31a80b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 0x7f31a80b7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45804/0 (socket says 172.21.15.161:45804) 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a6d9d640 1 -- 172.21.15.161:0/4212404365 learned_addr learned my addr 172.21.15.161:0/4212404365 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f31a659c640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a80cf9f0 0x7f31a80b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.039+0000 7f319ffff640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a8160920 0x7f31a80c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a6d9d640 1 -- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a8160920 msgr2=0x7f31a80c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a6d9d640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a8160920 0x7f31a80c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a6d9d640 1 -- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a80cf9f0 msgr2=0x7f31a80b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a6d9d640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a80cf9f0 0x7f31a80b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a6d9d640 1 -- 172.21.15.161:0/4212404365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980094d0 con 0x7f31a8161010 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a6d9d640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 0x7f31a80b7f90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f31a000b9a0 tx=0x7f31a000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000cba0 con 0x7f31a8161010 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a000cd20 con 0x7f31a8161010 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0014680 con 0x7f31a8161010 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.040+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a80b8770 con 0x7f31a8161010 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.041+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a80ca4e0 con 0x7f31a8161010 2023-11-24T08:02:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.041+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a8067450 con 0x7f31a8161010 2023-11-24T08:02:26.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.043+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f31a0007370 con 0x7f31a8161010 2023-11-24T08:02:26.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.044+0000 7f319effd640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f318806aff0 0x7f318806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:26.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.044+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f31a0089a60 con 0x7f31a8161010 2023-11-24T08:02:26.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.044+0000 7f31a659c640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f318806aff0 0x7f318806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.046+0000 7f31a659c640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f318806aff0 0x7f318806d4b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3198036000 tx=0x7f319803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:26.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.048+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31a0054b50 con 0x7f31a8161010 2023-11-24T08:02:26.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.233+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f31a80ca990 con 0x7f31a8161010 2023-11-24T08:02:26.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.805+0000 7f319effd640 1 -- 172.21.15.161:0/4212404365 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7f31a0019020 con 0x7f31a8161010 2023-11-24T08:02:26.806 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2023-11-24T08:02:26.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f318806aff0 msgr2=0x7f318806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:26.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f318806aff0 0x7f318806d4b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3198036000 tx=0x7f319803c040 comp rx=0 tx=0).stop 2023-11-24T08:02:26.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 msgr2=0x7f31a80b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:26.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 0x7f31a80b7f90 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f31a000b9a0 tx=0x7f31a000be60 comp rx=0 tx=0).stop 2023-11-24T08:02:26.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 shutdown_connections 2023-11-24T08:02:26.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f318806aff0 0x7f318806d4b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31a8161010 0x7f31a80b7f90 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31a8160920 0x7f31a80c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 --2- 172.21.15.161:0/4212404365 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31a80cf9f0 0x7f31a80b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:26.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.809+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 >> 172.21.15.161:0/4212404365 conn(0x7f31a80d3090 msgr2=0x7f31a815b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:26.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.810+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 shutdown_connections 2023-11-24T08:02:26.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:26.810+0000 7f31a759e640 1 -- 172.21.15.161:0/4212404365 wait complete. 2023-11-24T08:02:26.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:02:27.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.025+0000 7f42c409b640 1 Processor -- start 2023-11-24T08:02:27.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.025+0000 7f42c409b640 1 -- start start 2023-11-24T08:02:27.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.026+0000 7f42c409b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:27.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c409b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42bc0cf290 0x7f42bc0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:27.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c409b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc070c40 con 0x7f42bc0ae5a0 2023-11-24T08:02:27.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c409b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc071450 con 0x7f42bc0cf290 2023-11-24T08:02:27.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c409b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0cfc60 con 0x7f42bc0b3ae0 2023-11-24T08:02:27.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c1636640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c2638640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f42bc0cf290 0x7f42bc0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c1636640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51630/0 (socket says 172.21.15.161:51630) 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.027+0000 7f42c1636640 1 -- 172.21.15.161:0/2018293523 learned_addr learned my addr 172.21.15.161:0/2018293523 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.028+0000 7f42c2638640 1 -- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 msgr2=0x7f42bc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.028+0000 7f42c2638640 1 --2- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.028+0000 7f42c2638640 1 -- 172.21.15.161:0/2018293523 >> v1:172.21.15.175:6789/0 conn(0x7f42bc0ae5a0 legacy=0x7f42bc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:27.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.028+0000 7f42c2638640 1 -- 172.21.15.161:0/2018293523 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc06c470 con 0x7f42bc0cf290 2023-11-24T08:02:27.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.029+0000 7f42c2638640 1 --2- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0cf290 0x7f42bc0cf720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009d90 tx=0x7f42b402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=194cc35f982ab3b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:27.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.030+0000 7f42c0e35640 1 -- 172.21.15.161:0/2018293523 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b402cce0 con 0x7f42bc0cf290 2023-11-24T08:02:27.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.030+0000 7f42c0e35640 1 -- 172.21.15.161:0/2018293523 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b402ce40 con 0x7f42bc0cf290 2023-11-24T08:02:27.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.030+0000 7f42c0e35640 1 -- 172.21.15.161:0/2018293523 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4034660 con 0x7f42bc0cf290 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 -- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0cf290 msgr2=0x7f42bc0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 --2- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0cf290 0x7f42bc0cf720 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009d90 tx=0x7f42b402bf30 comp rx=0 tx=0).stop 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 -- 172.21.15.161:0/2018293523 shutdown_connections 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 --2- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0cf290 0x7f42bc0cf720 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 --2- 172.21.15.161:0/2018293523 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 -- 172.21.15.161:0/2018293523 >> 172.21.15.161:0/2018293523 conn(0x7f42bc06a800 msgr2=0x7f42bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:27.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 -- 172.21.15.161:0/2018293523 shutdown_connections 2023-11-24T08:02:27.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.031+0000 7f42c409b640 1 -- 172.21.15.161:0/2018293523 wait complete. 2023-11-24T08:02:27.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.033+0000 7f42c409b640 1 Processor -- start 2023-11-24T08:02:27.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.033+0000 7f42c409b640 1 -- start start 2023-11-24T08:02:27.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c409b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0ae5a0 0x7f42bc149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:27.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c409b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:27.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c409b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 0x7f42bc15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:27.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c409b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc151d80 con 0x7f42bc0cf290 2023-11-24T08:02:27.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c409b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc152060 con 0x7f42bc0ae5a0 2023-11-24T08:02:27.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c409b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc152340 con 0x7f42bc0b3ae0 2023-11-24T08:02:27.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.034+0000 7f42c2638640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 0x7f42bc15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:27.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 0x7f42bc15cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45810/0 (socket says 172.21.15.161:45810) 2023-11-24T08:02:27.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 -- 172.21.15.161:0/471057113 learned_addr learned my addr 172.21.15.161:0/471057113 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:27.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c1636640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:27.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c1e37640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0ae5a0 0x7f42bc149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:27.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 -- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 msgr2=0x7f42bc15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:27.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 -- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0ae5a0 msgr2=0x7f42bc149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0ae5a0 0x7f42bc149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 -- 172.21.15.161:0/471057113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009a70 con 0x7f42bc0cf290 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.035+0000 7f42c2638640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 0x7f42bc15cc60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009d90 tx=0x7f42b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.036+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b403e670 con 0x7f42bc0cf290 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.036+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b403e7f0 con 0x7f42bc0cf290 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.036+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b403eba0 con 0x7f42bc0cf290 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.036+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc152620 con 0x7f42bc0cf290 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.036+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc1545d0 con 0x7f42bc0cf290 2023-11-24T08:02:27.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.037+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc152b40 con 0x7f42bc0cf290 2023-11-24T08:02:27.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.038+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f42b403b040 con 0x7f42bc0cf290 2023-11-24T08:02:27.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.039+0000 7f42b27fc640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f42a006aff0 0x7f42a006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:27.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.039+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f42b40ac340 con 0x7f42bc0cf290 2023-11-24T08:02:27.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.039+0000 7f42c1e37640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f42a006aff0 0x7f42a006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:27.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.041+0000 7f42c1e37640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f42a006aff0 0x7f42a006d4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000f60 tx=0x7f42b8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:27.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.044+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42bc152b40 con 0x7f42bc0cf290 2023-11-24T08:02:27.274 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.273+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f42bc152b40 con 0x7f42bc0cf290 2023-11-24T08:02:27.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.829+0000 7f42b27fc640 1 -- 172.21.15.161:0/471057113 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7f42bc152b40 con 0x7f42bc0cf290 2023-11-24T08:02:27.830 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 6 and data pool 7 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.832+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f42a006aff0 msgr2=0x7f42a006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.832+0000 7f42c409b640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f42a006aff0 0x7f42a006d4b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f42b8000f60 tx=0x7f42b8009040 comp rx=0 tx=0).stop 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.832+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 msgr2=0x7f42bc15cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.832+0000 7f42c409b640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 0x7f42bc15cc60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009d90 tx=0x7f42b4004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 shutdown_connections 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f42a006aff0 0x7f42a006d4b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42bc0cf290 0x7f42bc15cc60 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f42bc0b3ae0 0x7f42bc15c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 --2- 172.21.15.161:0/471057113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f42bc0ae5a0 0x7f42bc149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:27.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 >> 172.21.15.161:0/471057113 conn(0x7f42bc06a800 msgr2=0x7f42bc160f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:27.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 shutdown_connections 2023-11-24T08:02:27.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:27.833+0000 7f42c409b640 1 -- 172.21.15.161:0/471057113 wait complete. 2023-11-24T08:02:27.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:28.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.050+0000 7f19fa50f640 1 Processor -- start 2023-11-24T08:02:28.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.050+0000 7f19fa50f640 1 -- start start 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.051+0000 7f19fa50f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19f413df80 0x7f19f415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.051+0000 7f19fa50f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f40cf9a0 0x7f19f40cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19fa50f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f406c470 con 0x7f19f413e360 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19fa50f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f406c750 con 0x7f19f413df80 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19fa50f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f406ca30 con 0x7f19f40cf9a0 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f19f413df80 0x7f19f415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f37fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f19f413e360 0x7f19f40cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60934/0 (socket says 172.21.15.161:60934) 2023-11-24T08:02:28.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f37fe640 1 -- 172.21.15.161:0/1998800247 learned_addr learned my addr 172.21.15.161:0/1998800247 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f8aac640 1 --2- 172.21.15.161:0/1998800247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f40cf9a0 0x7f19f40cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f3fff640 1 -- 172.21.15.161:0/1998800247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f40cf9a0 msgr2=0x7f19f40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f3fff640 1 --2- 172.21.15.161:0/1998800247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f40cf9a0 0x7f19f40cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f3fff640 1 -- 172.21.15.161:0/1998800247 >> v1:172.21.15.161:6789/0 conn(0x7f19f413e360 legacy=0x7f19f40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f3fff640 1 -- 172.21.15.161:0/1998800247 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f406cd10 con 0x7f19f413df80 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.052+0000 7f19f2ffd640 1 -- 172.21.15.161:0/1998800247 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1660960542 0 0) 0x7f19f406c470 con 0x7f19f413e360 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.053+0000 7f19f3fff640 1 --2- 172.21.15.161:0/1998800247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413df80 0x7f19f415bee0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f19e40097a0 tx=0x7f19e402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43659aa879870c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19f2ffd640 1 -- 172.21.15.161:0/1998800247 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e402d040 con 0x7f19f413df80 2023-11-24T08:02:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19f2ffd640 1 -- 172.21.15.161:0/1998800247 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4031810 con 0x7f19f413df80 2023-11-24T08:02:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19f2ffd640 1 -- 172.21.15.161:0/1998800247 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4031ba0 con 0x7f19f413df80 2023-11-24T08:02:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19fa50f640 1 -- 172.21.15.161:0/1998800247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413df80 msgr2=0x7f19f415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19fa50f640 1 --2- 172.21.15.161:0/1998800247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413df80 0x7f19f415bee0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f19e40097a0 tx=0x7f19e402b8b0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19fa50f640 1 -- 172.21.15.161:0/1998800247 shutdown_connections 2023-11-24T08:02:28.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19fa50f640 1 --2- 172.21.15.161:0/1998800247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f40cf9a0 0x7f19f40cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19fa50f640 1 --2- 172.21.15.161:0/1998800247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413df80 0x7f19f415bee0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.054+0000 7f19fa50f640 1 -- 172.21.15.161:0/1998800247 >> 172.21.15.161:0/1998800247 conn(0x7f19f406a800 msgr2=0x7f19f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:28.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.055+0000 7f19fa50f640 1 -- 172.21.15.161:0/1998800247 shutdown_connections 2023-11-24T08:02:28.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.055+0000 7f19fa50f640 1 -- 172.21.15.161:0/1998800247 wait complete. 2023-11-24T08:02:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.056+0000 7f19fa50f640 1 Processor -- start 2023-11-24T08:02:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.056+0000 7f19fa50f640 1 -- start start 2023-11-24T08:02:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.057+0000 7f19fa50f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f40cf9a0 0x7f19f40b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.057+0000 7f19fa50f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f413df80 0x7f19f4148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.057+0000 7f19fa50f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 0x7f19f4148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.057+0000 7f19fa50f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4158af0 con 0x7f19f413e360 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.057+0000 7f19fa50f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4149490 con 0x7f19f40cf9a0 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.057+0000 7f19fa50f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4157e70 con 0x7f19f413df80 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 0x7f19f4148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 0x7f19f4148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45830/0 (socket says 172.21.15.161:45830) 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 -- 172.21.15.161:0/289158182 learned_addr learned my addr 172.21.15.161:0/289158182 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 -- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f413df80 msgr2=0x7f19f4148a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f3fff640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f40cf9a0 0x7f19f40b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f413df80 0x7f19f4148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 -- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f40cf9a0 msgr2=0x7f19f40b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f40cf9a0 0x7f19f40b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 -- 172.21.15.161:0/289158182 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e4009400 con 0x7f19f413e360 2023-11-24T08:02:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.058+0000 7f19f8aac640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 0x7f19f4148f50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00cc00 tx=0x7f19ec00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.059+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec00ce10 con 0x7f19f413e360 2023-11-24T08:02:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.059+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec003990 con 0x7f19f413e360 2023-11-24T08:02:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.059+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ec003d20 con 0x7f19f413e360 2023-11-24T08:02:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.059+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f4158150 con 0x7f19f413e360 2023-11-24T08:02:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.059+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f4158710 con 0x7f19f413e360 2023-11-24T08:02:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.060+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f4158c30 con 0x7f19f413e360 2023-11-24T08:02:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.061+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f19ec003e80 con 0x7f19f413e360 2023-11-24T08:02:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.062+0000 7f19f0ff9640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19e006aff0 0x7f19e006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.062+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19ec089ed0 con 0x7f19f413e360 2023-11-24T08:02:28.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.062+0000 7f19f3fff640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19e006aff0 0x7f19e006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.064+0000 7f19f3fff640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19e006aff0 0x7f19e006d4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19e4036000 tx=0x7f19e403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.066+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19ec054b50 con 0x7f19f413e360 2023-11-24T08:02:28.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.256+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f40675d0 con 0x7f19f413e360 2023-11-24T08:02:28.258 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.258+0000 7f19f0ff9640 1 -- 172.21.15.161:0/289158182 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16550 (secure 0 0 0) 0x7f19ec01d070 con 0x7f19f413e360 2023-11-24T08:02:28.259 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:28.259 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":46,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:27.274927+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19e006aff0 msgr2=0x7f19e006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19e006aff0 0x7f19e006d4b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f19e4036000 tx=0x7f19e403c040 comp rx=0 tx=0).stop 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 msgr2=0x7f19f4148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 0x7f19f4148f50 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00cc00 tx=0x7f19ec00a5c0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 shutdown_connections 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f19e006aff0 0x7f19e006d4b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19f413e360 0x7f19f4148f50 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19f413df80 0x7f19f4148a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.260+0000 7f19fa50f640 1 --2- 172.21.15.161:0/289158182 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19f40cf9a0 0x7f19f40b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.261+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 >> 172.21.15.161:0/289158182 conn(0x7f19f406a800 msgr2=0x7f19f40aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:28.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.261+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 shutdown_connections 2023-11-24T08:02:28.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.261+0000 7f19fa50f640 1 -- 172.21.15.161:0/289158182 wait complete. 2023-11-24T08:02:28.280 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:28.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.484+0000 7faba063d640 1 Processor -- start 2023-11-24T08:02:28.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.484+0000 7faba063d640 1 -- start start 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7faba063d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fab980b3ae0 0x7fab9815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7faba063d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab980cf290 0x7fab980cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7faba063d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab98070c40 con 0x7fab980ae5a0 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7faba063d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab98071450 con 0x7fab980cf290 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7faba063d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980cfc60 con 0x7fab980b3ae0 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9ebda640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab980cf290 0x7fab980cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9ebda640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab980cf290 0x7fab980cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45836/0 (socket says 172.21.15.161:45836) 2023-11-24T08:02:28.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9ebda640 1 -- 172.21.15.161:0/13127432 learned_addr learned my addr 172.21.15.161:0/13127432 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:28.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9dbd8640 1 --2- 172.21.15.161:0/13127432 >> v2:172.21.15.175:3300/0 conn(0x7fab980b3ae0 0x7fab9815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9ebda640 1 -- 172.21.15.161:0/13127432 >> v2:172.21.15.175:3300/0 conn(0x7fab980b3ae0 msgr2=0x7fab9815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:28.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9ebda640 1 --2- 172.21.15.161:0/13127432 >> v2:172.21.15.175:3300/0 conn(0x7fab980b3ae0 0x7fab9815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.486+0000 7fab9ebda640 1 -- 172.21.15.161:0/13127432 >> v1:172.21.15.161:6789/0 conn(0x7fab980ae5a0 legacy=0x7fab9806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.487+0000 7fab9ebda640 1 -- 172.21.15.161:0/13127432 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9806c470 con 0x7fab980cf290 2023-11-24T08:02:28.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.488+0000 7fab9ebda640 1 --2- 172.21.15.161:0/13127432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cf720 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fab980cfea0 tx=0x7fab9002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1652f2f0e687a55 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.488+0000 7fab9d3d7640 1 -- 172.21.15.161:0/13127432 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9002cbb0 con 0x7fab980cf290 2023-11-24T08:02:28.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.488+0000 7fab9d3d7640 1 -- 172.21.15.161:0/13127432 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9002cd10 con 0x7fab980cf290 2023-11-24T08:02:28.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.488+0000 7fab9d3d7640 1 -- 172.21.15.161:0/13127432 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90034610 con 0x7fab980cf290 2023-11-24T08:02:28.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.488+0000 7faba063d640 1 -- 172.21.15.161:0/13127432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 msgr2=0x7fab980cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.488+0000 7faba063d640 1 --2- 172.21.15.161:0/13127432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cf720 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fab980cfea0 tx=0x7fab9002c010 comp rx=0 tx=0).stop 2023-11-24T08:02:28.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.489+0000 7faba063d640 1 -- 172.21.15.161:0/13127432 shutdown_connections 2023-11-24T08:02:28.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.489+0000 7faba063d640 1 --2- 172.21.15.161:0/13127432 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cf720 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.489+0000 7faba063d640 1 --2- 172.21.15.161:0/13127432 >> v2:172.21.15.175:3300/0 conn(0x7fab980b3ae0 0x7fab9815e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.489+0000 7faba063d640 1 -- 172.21.15.161:0/13127432 >> 172.21.15.161:0/13127432 conn(0x7fab9806a800 msgr2=0x7fab9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:28.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.489+0000 7faba063d640 1 -- 172.21.15.161:0/13127432 shutdown_connections 2023-11-24T08:02:28.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.489+0000 7faba063d640 1 -- 172.21.15.161:0/13127432 wait complete. 2023-11-24T08:02:28.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.490+0000 7faba063d640 1 Processor -- start 2023-11-24T08:02:28.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 -- start start 2023-11-24T08:02:28.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980ae5a0 0x7fab9814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980b3ae0 0x7fab981602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab98153360 con 0x7fab980cf290 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9815f220 con 0x7fab980ae5a0 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.491+0000 7faba063d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9815f500 con 0x7fab980b3ae0 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45852/0 (socket says 172.21.15.161:45852) 2023-11-24T08:02:28.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 -- 172.21.15.161:0/1948796058 learned_addr learned my addr 172.21.15.161:0/1948796058 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:28.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9e3d9640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980ae5a0 0x7fab9814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9dbd8640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980b3ae0 0x7fab981602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 -- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980b3ae0 msgr2=0x7fab981602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980b3ae0 0x7fab981602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 -- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980ae5a0 msgr2=0x7fab9814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980ae5a0 0x7fab9814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9ebda640 1 -- 172.21.15.161:0/1948796058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009b30 con 0x7fab980cf290 2023-11-24T08:02:28.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.492+0000 7fab9e3d9640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980ae5a0 0x7fab9814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:28.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.493+0000 7fab9ebda640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cb8a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fab90009f40 tx=0x7fab90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.493+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9003e450 con 0x7fab980cf290 2023-11-24T08:02:28.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.493+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9003e5d0 con 0x7fab980cf290 2023-11-24T08:02:28.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.493+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9815f7e0 con 0x7fab980cf290 2023-11-24T08:02:28.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.493+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9003e980 con 0x7fab980cf290 2023-11-24T08:02:28.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.493+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9815fda0 con 0x7fab980cf290 2023-11-24T08:02:28.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.494+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab980675d0 con 0x7fab980cf290 2023-11-24T08:02:28.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.495+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fab9003eae0 con 0x7fab980cf290 2023-11-24T08:02:28.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.496+0000 7fab8effd640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab7c06aff0 0x7fab7c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.497+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab900ac420 con 0x7fab980cf290 2023-11-24T08:02:28.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.497+0000 7fab9e3d9640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab7c06aff0 0x7fab7c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.498+0000 7fab9e3d9640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab7c06aff0 0x7fab7c06d4b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab94001680 tx=0x7fab94009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.501+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab900771c0 con 0x7fab980cf290 2023-11-24T08:02:28.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.695+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab9814fd90 con 0x7fab980cf290 2023-11-24T08:02:28.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.697+0000 7fab8effd640 1 -- 172.21.15.161:0/1948796058 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16550 (secure 0 0 0) 0x7fab9007a7e0 con 0x7fab980cf290 2023-11-24T08:02:28.698 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:28.699 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":46,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:27.274927+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:28.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.699+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab7c06aff0 msgr2=0x7fab7c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.699+0000 7faba063d640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab7c06aff0 0x7fab7c06d4b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab94001680 tx=0x7fab94009040 comp rx=0 tx=0).stop 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.699+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 msgr2=0x7fab980cb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.699+0000 7faba063d640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cb8a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fab90009f40 tx=0x7fab90004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 shutdown_connections 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fab7c06aff0 0x7fab7c06d4b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab980cf290 0x7fab980cb8a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fab980b3ae0 0x7fab981602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 --2- 172.21.15.161:0/1948796058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fab980ae5a0 0x7fab9814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 >> 172.21.15.161:0/1948796058 conn(0x7fab9806a800 msgr2=0x7fab980b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:28.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 shutdown_connections 2023-11-24T08:02:28.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.700+0000 7faba063d640 1 -- 172.21.15.161:0/1948796058 wait complete. 2023-11-24T08:02:28.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:02:28.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.942+0000 7faf9b59e640 1 Processor -- start 2023-11-24T08:02:28.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.942+0000 7faf9b59e640 1 -- start start 2023-11-24T08:02:28.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.943+0000 7faf9b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf9c143810 0x7faf9c071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.943+0000 7faf9b59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faf9c0ae170 0x7faf9c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.943+0000 7faf9b59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c0ae620 con 0x7faf9c15d770 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.943+0000 7faf9b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c143bf0 con 0x7faf9c143810 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.943+0000 7faf9b59e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c06c730 con 0x7faf9c0ae170 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf9c143810 0x7faf9c071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faf9c143810 0x7faf9c071e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45860/0 (socket says 172.21.15.161:45860) 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 -- 172.21.15.161:0/3956428687 learned_addr learned my addr 172.21.15.161:0/3956428687 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:28.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9ad9d640 1 --1- 172.21.15.161:0/3956428687 >> v1:172.21.15.161:6789/0 conn(0x7faf9c15d770 0x7faf9c15dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60948/0 (socket says 172.21.15.161:60948) 2023-11-24T08:02:28.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf93fff640 1 --2- 172.21.15.161:0/3956428687 >> v2:172.21.15.175:3300/0 conn(0x7faf9c0ae170 0x7faf9c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 -- 172.21.15.161:0/3956428687 >> v2:172.21.15.175:3300/0 conn(0x7faf9c0ae170 msgr2=0x7faf9c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:28.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 --2- 172.21.15.161:0/3956428687 >> v2:172.21.15.175:3300/0 conn(0x7faf9c0ae170 0x7faf9c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 -- 172.21.15.161:0/3956428687 >> v1:172.21.15.161:6789/0 conn(0x7faf9c15d770 legacy=0x7faf9c15dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf99d9b640 1 -- 172.21.15.161:0/3956428687 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123488482 0 0) 0x7faf9c0ae620 con 0x7faf9c15d770 2023-11-24T08:02:28.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf9a59c640 1 -- 172.21.15.161:0/3956428687 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0724d0 con 0x7faf9c143810 2023-11-24T08:02:28.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.944+0000 7faf93fff640 1 --2- 172.21.15.161:0/3956428687 >> v2:172.21.15.175:3300/0 conn(0x7faf9c0ae170 0x7faf9c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.946+0000 7faf9a59c640 1 --2- 172.21.15.161:0/3956428687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c143810 0x7faf9c071e40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0b0a40 tx=0x7faf8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90a37fb979c9bc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.946+0000 7faf99d9b640 1 -- 172.21.15.161:0/3956428687 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c031870 con 0x7faf9c143810 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.946+0000 7faf99d9b640 1 -- 172.21.15.161:0/3956428687 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0319d0 con 0x7faf9c143810 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.946+0000 7faf99d9b640 1 -- 172.21.15.161:0/3956428687 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c031d60 con 0x7faf9c143810 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.946+0000 7faf9b59e640 1 -- 172.21.15.161:0/3956428687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c143810 msgr2=0x7faf9c071e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.946+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3956428687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c143810 0x7faf9c071e40 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7faf9c0b0a40 tx=0x7faf8c02b910 comp rx=0 tx=0).stop 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.947+0000 7faf9b59e640 1 -- 172.21.15.161:0/3956428687 shutdown_connections 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.947+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3956428687 >> v2:172.21.15.175:3300/0 conn(0x7faf9c0ae170 0x7faf9c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.947+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3956428687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c143810 0x7faf9c071e40 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.947+0000 7faf9b59e640 1 -- 172.21.15.161:0/3956428687 >> 172.21.15.161:0/3956428687 conn(0x7faf9c06a7d0 msgr2=0x7faf9c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.947+0000 7faf9b59e640 1 -- 172.21.15.161:0/3956428687 shutdown_connections 2023-11-24T08:02:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.947+0000 7faf9b59e640 1 -- 172.21.15.161:0/3956428687 wait complete. 2023-11-24T08:02:28.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.948+0000 7faf9b59e640 1 Processor -- start 2023-11-24T08:02:28.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.949+0000 7faf9b59e640 1 -- start start 2023-11-24T08:02:28.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.949+0000 7faf9b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 0x7faf9c13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.949+0000 7faf9b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c143810 0x7faf9c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c15d770 0x7faf9c0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0ccc60 con 0x7faf9c0ae170 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0cc630 con 0x7faf9c143810 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c0b1500 con 0x7faf9c15d770 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 0x7faf9c13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 0x7faf9c13d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45862/0 (socket says 172.21.15.161:45862) 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 -- 172.21.15.161:0/3731177020 learned_addr learned my addr 172.21.15.161:0/3731177020 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 -- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c15d770 msgr2=0x7faf9c0af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c15d770 0x7faf9c0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 -- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c143810 msgr2=0x7faf9c0aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c143810 0x7faf9c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:28.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 -- 172.21.15.161:0/3731177020 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0094d0 con 0x7faf9c0ae170 2023-11-24T08:02:28.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.950+0000 7faf9a59c640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 0x7faf9c13d3f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faf8c02b950 tx=0x7faf8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.951+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c031860 con 0x7faf9c0ae170 2023-11-24T08:02:28.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.951+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0443f0 con 0x7faf9c0ae170 2023-11-24T08:02:28.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.951+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0447a0 con 0x7faf9c0ae170 2023-11-24T08:02:28.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.951+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c0b17e0 con 0x7faf9c0ae170 2023-11-24T08:02:28.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.951+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c13d930 con 0x7faf9c0ae170 2023-11-24T08:02:28.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.952+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c067450 con 0x7faf9c0ae170 2023-11-24T08:02:28.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.953+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faf8c04d450 con 0x7faf9c0ae170 2023-11-24T08:02:28.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.954+0000 7faf92ffd640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf7c06aff0 0x7faf7c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:28.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.954+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8c02d040 con 0x7faf9c0ae170 2023-11-24T08:02:28.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.955+0000 7faf93fff640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf7c06aff0 0x7faf7c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:28.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.955+0000 7faf93fff640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf7c06aff0 0x7faf7c06d4b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faf84006fd0 tx=0x7faf84008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:28.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:28.958+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faf8c076ef0 con 0x7faf9c0ae170 2023-11-24T08:02:29.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.193+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faf9c0ad610 con 0x7faf9c0ae170 2023-11-24T08:02:29.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.861+0000 7faf92ffd640 1 -- 172.21.15.161:0/3731177020 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7faf8c0350b0 con 0x7faf9c0ae170 2023-11-24T08:02:29.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf7c06aff0 msgr2=0x7faf7c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:29.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf7c06aff0 0x7faf7c06d4b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7faf84006fd0 tx=0x7faf84008040 comp rx=0 tx=0).stop 2023-11-24T08:02:29.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 msgr2=0x7faf9c13d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:29.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 0x7faf9c13d3f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7faf8c02b950 tx=0x7faf8c0046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:29.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 shutdown_connections 2023-11-24T08:02:29.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faf7c06aff0 0x7faf7c06d4b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:29.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf9c15d770 0x7faf9c0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:29.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf9c143810 0x7faf9c0aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:29.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 --2- 172.21.15.161:0/3731177020 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faf9c0ae170 0x7faf9c13d3f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:29.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 >> 172.21.15.161:0/3731177020 conn(0x7faf9c06a7d0 msgr2=0x7faf9c06d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:29.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.865+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 shutdown_connections 2023-11-24T08:02:29.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:29.866+0000 7faf9b59e640 1 -- 172.21.15.161:0/3731177020 wait complete. 2023-11-24T08:02:29.889 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:02:29.889 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:02:30.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.110+0000 7effc5ff5640 1 Processor -- start 2023-11-24T08:02:30.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.110+0000 7effc5ff5640 1 -- start start 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effc5ff5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc014b2c0 0x7effc00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effc5ff5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7effc0071070 0x7effc00cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effc5ff5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00cfbf0 con 0x7effc00cf7d0 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effc5ff5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc014b6a0 con 0x7effc0071070 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effc5ff5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc0071690 con 0x7effc014b2c0 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effb6ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7effc00cf7d0 0x7effc0070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:60958/0 (socket says 172.21.15.161:60958) 2023-11-24T08:02:30.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effb6ffd640 1 -- 172.21.15.161:0/1248193520 learned_addr learned my addr 172.21.15.161:0/1248193520 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:30.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.112+0000 7effbffff640 1 --2- 172.21.15.161:0/1248193520 >> v2:172.21.15.161:3300/0 conn(0x7effc0071070 0x7effc00cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:30.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbf7fe640 1 --2- 172.21.15.161:0/1248193520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc014b2c0 0x7effc00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:30.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbeffd640 1 -- 172.21.15.161:0/1248193520 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581236614 0 0) 0x7effc00cfbf0 con 0x7effc00cf7d0 2023-11-24T08:02:30.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbeffd640 1 -- 172.21.15.161:0/1248193520 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effac003520 con 0x7effc00cf7d0 2023-11-24T08:02:30.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbffff640 1 -- 172.21.15.161:0/1248193520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc014b2c0 msgr2=0x7effc00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:30.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbffff640 1 --2- 172.21.15.161:0/1248193520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc014b2c0 0x7effc00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbffff640 1 -- 172.21.15.161:0/1248193520 >> v1:172.21.15.161:6789/0 conn(0x7effc00cf7d0 legacy=0x7effc0070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:30.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.113+0000 7effbffff640 1 -- 172.21.15.161:0/1248193520 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0071970 con 0x7effc0071070 2023-11-24T08:02:30.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.114+0000 7effbffff640 1 --2- 172.21.15.161:0/1248193520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc00cc160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7effb8009d90 tx=0x7effb802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b87d4ae7719a73 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:30.121 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.114+0000 7effbeffd640 1 -- 172.21.15.161:0/1248193520 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb802cc60 con 0x7effc0071070 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effbeffd640 1 -- 172.21.15.161:0/1248193520 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb802cdc0 con 0x7effc0071070 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effbeffd640 1 -- 172.21.15.161:0/1248193520 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8034660 con 0x7effc0071070 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 -- 172.21.15.161:0/1248193520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 msgr2=0x7effc00cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1248193520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc00cc160 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7effb8009d90 tx=0x7effb802beb0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 -- 172.21.15.161:0/1248193520 shutdown_connections 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1248193520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc00cc160 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1248193520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc014b2c0 0x7effc00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 -- 172.21.15.161:0/1248193520 >> 172.21.15.161:0/1248193520 conn(0x7effc006a800 msgr2=0x7effc006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 -- 172.21.15.161:0/1248193520 shutdown_connections 2023-11-24T08:02:30.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.115+0000 7effc5ff5640 1 -- 172.21.15.161:0/1248193520 wait complete. 2023-11-24T08:02:30.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.117+0000 7effc5ff5640 1 Processor -- start 2023-11-24T08:02:30.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.117+0000 7effc5ff5640 1 -- start start 2023-11-24T08:02:30.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effc5ff5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc01fb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:30.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effc5ff5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc00cf7d0 0x7effc0163800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:30.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effc5ff5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc014b2c0 0x7effc0148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:30.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effc5ff5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0164010 con 0x7effc0071070 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effc5ff5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0163d40 con 0x7effc014b2c0 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effc5ff5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc013f970 con 0x7effc00cf7d0 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effbf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc01fb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effbf7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc01fb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45880/0 (socket says 172.21.15.161:45880) 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.118+0000 7effbf7fe640 1 -- 172.21.15.161:0/1089360086 learned_addr learned my addr 172.21.15.161:0/1089360086 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbf7fe640 1 -- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc00cf7d0 msgr2=0x7effc0163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbf7fe640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc00cf7d0 0x7effc0163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbf7fe640 1 -- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc014b2c0 msgr2=0x7effc0148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbf7fe640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc014b2c0 0x7effc0148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbf7fe640 1 -- 172.21.15.161:0/1089360086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009a70 con 0x7effc0071070 2023-11-24T08:02:30.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbf7fe640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc01fb3e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7effb000d5f0 tx=0x7effb000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:30.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00125f0 con 0x7effc0071070 2023-11-24T08:02:30.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0012750 con 0x7effc0071070 2023-11-24T08:02:30.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc013fc50 con 0x7effc0071070 2023-11-24T08:02:30.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.119+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0012b00 con 0x7effc0071070 2023-11-24T08:02:30.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.120+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc0140210 con 0x7effc0071070 2023-11-24T08:02:30.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.121+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc01403d0 con 0x7effc0071070 2023-11-24T08:02:30.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.122+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7effb0012c60 con 0x7effc0071070 2023-11-24T08:02:30.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.123+0000 7effbcff9640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effa006aff0 0x7effa006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:30.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.123+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effb0089d70 con 0x7effc0071070 2023-11-24T08:02:30.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.123+0000 7effb6ffd640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effa006aff0 0x7effa006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:30.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.124+0000 7effb6ffd640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effa006aff0 0x7effa006d4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7effc00cc390 tx=0x7effa8007930 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:30.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.127+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effb0054c30 con 0x7effc0071070 2023-11-24T08:02:30.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.363+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7effc00cc460 con 0x7effc0071070 2023-11-24T08:02:30.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.880+0000 7effbcff9640 1 -- 172.21.15.161:0/1089360086 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7effb0058250 con 0x7effc0071070 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effa006aff0 msgr2=0x7effa006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effa006aff0 0x7effa006d4b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7effc00cc390 tx=0x7effa8007930 comp rx=0 tx=0).stop 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 msgr2=0x7effc01fb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc01fb3e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7effb000d5f0 tx=0x7effb000dab0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 shutdown_connections 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effa006aff0 0x7effa006d4b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7effc014b2c0 0x7effc0148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7effc00cf7d0 0x7effc0163800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 --2- 172.21.15.161:0/1089360086 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7effc0071070 0x7effc01fb3e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:30.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.885+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 >> 172.21.15.161:0/1089360086 conn(0x7effc006a800 msgr2=0x7effc0149bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:30.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.886+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 shutdown_connections 2023-11-24T08:02:30.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:30.886+0000 7effc5ff5640 1 -- 172.21.15.161:0/1089360086 wait complete. 2023-11-24T08:02:30.908 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:02:30.909 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:31.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.121+0000 7f9a7066b640 1 Processor -- start 2023-11-24T08:02:31.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.121+0000 7f9a7066b640 1 -- start start 2023-11-24T08:02:31.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.122+0000 7f9a7066b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a6813df80 0x7f9a6815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a7066b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a680cf9a0 0x7f9a680cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a7066b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a6806c470 con 0x7f9a6813e360 2023-11-24T08:02:31.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a7066b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a6806c750 con 0x7f9a6813df80 2023-11-24T08:02:31.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a7066b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6806ca30 con 0x7f9a680cf9a0 2023-11-24T08:02:31.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6e407640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9a6813df80 0x7f9a6815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6dc06640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9a6813e360 0x7f9a680cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34418/0 (socket says 172.21.15.161:34418) 2023-11-24T08:02:31.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6dc06640 1 -- 172.21.15.161:0/3663059059 learned_addr learned my addr 172.21.15.161:0/3663059059 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6e407640 1 -- 172.21.15.161:0/3663059059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a680cf9a0 msgr2=0x7f9a680cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6e407640 1 --2- 172.21.15.161:0/3663059059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a680cf9a0 0x7f9a680cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6e407640 1 -- 172.21.15.161:0/3663059059 >> v1:172.21.15.161:6789/0 conn(0x7f9a6813e360 legacy=0x7f9a680cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6e407640 1 -- 172.21.15.161:0/3663059059 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a6806cd10 con 0x7f9a6813df80 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.123+0000 7f9a6d405640 1 -- 172.21.15.161:0/3663059059 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090516036 0 0) 0x7f9a6806c470 con 0x7f9a6813e360 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.124+0000 7f9a6e407640 1 --2- 172.21.15.161:0/3663059059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813df80 0x7f9a6815bee0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9a640097a0 tx=0x7f9a6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f681e43db97fab6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a6d405640 1 -- 172.21.15.161:0/3663059059 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64031830 con 0x7f9a6813df80 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a6d405640 1 -- 172.21.15.161:0/3663059059 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a64031990 con 0x7f9a6813df80 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a6d405640 1 -- 172.21.15.161:0/3663059059 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a64031d20 con 0x7f9a6813df80 2023-11-24T08:02:31.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a7066b640 1 -- 172.21.15.161:0/3663059059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813df80 msgr2=0x7f9a6815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a7066b640 1 --2- 172.21.15.161:0/3663059059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813df80 0x7f9a6815bee0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9a640097a0 tx=0x7f9a6402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a7066b640 1 -- 172.21.15.161:0/3663059059 shutdown_connections 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a7066b640 1 --2- 172.21.15.161:0/3663059059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a680cf9a0 0x7f9a680cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a7066b640 1 --2- 172.21.15.161:0/3663059059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813df80 0x7f9a6815bee0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.125+0000 7f9a7066b640 1 -- 172.21.15.161:0/3663059059 >> 172.21.15.161:0/3663059059 conn(0x7f9a6806a800 msgr2=0x7f9a6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.126+0000 7f9a7066b640 1 -- 172.21.15.161:0/3663059059 shutdown_connections 2023-11-24T08:02:31.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.126+0000 7f9a7066b640 1 -- 172.21.15.161:0/3663059059 wait complete. 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.127+0000 7f9a7066b640 1 Processor -- start 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.127+0000 7f9a7066b640 1 -- start start 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.128+0000 7f9a7066b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a680cf9a0 0x7f9a6813d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.128+0000 7f9a7066b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6813df80 0x7f9a6814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.128+0000 7f9a7066b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 0x7f9a6814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.128+0000 7f9a7066b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6814d520 con 0x7f9a6813e360 2023-11-24T08:02:31.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.128+0000 7f9a7066b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6814f7c0 con 0x7f9a680cf9a0 2023-11-24T08:02:31.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.128+0000 7f9a7066b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6814c8a0 con 0x7f9a6813df80 2023-11-24T08:02:31.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 0x7f9a6814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 0x7f9a6814f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53876/0 (socket says 172.21.15.161:53876) 2023-11-24T08:02:31.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 -- 172.21.15.161:0/2493336751 learned_addr learned my addr 172.21.15.161:0/2493336751 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6dc06640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6813df80 0x7f9a6814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 -- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6813df80 msgr2=0x7f9a6814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6e407640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a680cf9a0 0x7f9a6813d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6813df80 0x7f9a6814c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 -- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a680cf9a0 msgr2=0x7f9a6813d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a680cf9a0 0x7f9a6813d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 -- 172.21.15.161:0/2493336751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a64009400 con 0x7f9a6813e360 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6e407640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a680cf9a0 0x7f9a6813d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.129+0000 7f9a6ec08640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 0x7f9a6814f280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b9e0 tx=0x7f9a6000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.130+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000cb20 con 0x7f9a6813e360 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.130+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000cca0 con 0x7f9a6813e360 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.130+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60014680 con 0x7f9a6813e360 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.130+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6814cb80 con 0x7f9a6813e360 2023-11-24T08:02:31.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.130+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6814d140 con 0x7f9a6813e360 2023-11-24T08:02:31.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.131+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a680cc2b0 con 0x7f9a6813e360 2023-11-24T08:02:31.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.132+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9a6001d3b0 con 0x7f9a6813e360 2023-11-24T08:02:31.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.133+0000 7f9a5effd640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a4c06b020 0x7f9a4c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.133+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a60089860 con 0x7f9a6813e360 2023-11-24T08:02:31.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.133+0000 7f9a6e407640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a4c06b020 0x7f9a4c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.135+0000 7f9a6e407640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a4c06b020 0x7f9a4c06d4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a64036000 tx=0x7f9a64008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:31.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.137+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a60054690 con 0x7f9a6813e360 2023-11-24T08:02:31.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.365+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a6814d660 con 0x7f9a6813e360 2023-11-24T08:02:31.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.366+0000 7f9a5effd640 1 -- 172.21.15.161:0/2493336751 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f9a6814d660 con 0x7f9a6813e360 2023-11-24T08:02:31.369 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:31.369 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:02:31.370 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 26 2023-11-24T08:02:31.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a4c06b020 msgr2=0x7f9a4c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a4c06b020 0x7f9a4c06d4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9a64036000 tx=0x7f9a64008030 comp rx=0 tx=0).stop 2023-11-24T08:02:31.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 msgr2=0x7f9a6814f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 0x7f9a6814f280 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b9e0 tx=0x7f9a6000bea0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 shutdown_connections 2023-11-24T08:02:31.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a4c06b020 0x7f9a4c06d4e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a6813e360 0x7f9a6814f280 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9a6813df80 0x7f9a6814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 --2- 172.21.15.161:0/2493336751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9a680cf9a0 0x7f9a6813d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.369+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 >> 172.21.15.161:0/2493336751 conn(0x7f9a6806a800 msgr2=0x7f9a6815c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:31.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.370+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 shutdown_connections 2023-11-24T08:02:31.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.370+0000 7f9a7066b640 1 -- 172.21.15.161:0/2493336751 wait complete. 2023-11-24T08:02:31.392 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:31.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.600+0000 7f31cdfec640 1 Processor -- start 2023-11-24T08:02:31.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.601+0000 7f31cdfec640 1 -- start start 2023-11-24T08:02:31.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.602+0000 7f31cdfec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31c813df80 0x7f31c815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.602+0000 7f31cdfec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806c470 con 0x7f31c80cf9a0 2023-11-24T08:02:31.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.602+0000 7f31cdfec640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c806c750 con 0x7f31c813e360 2023-11-24T08:02:31.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.602+0000 7f31cdfec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c806ca30 con 0x7f31c813df80 2023-11-24T08:02:31.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c7fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f31c80cf9a0 0x7f31c80cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34428/0 (socket says 172.21.15.161:34428) 2023-11-24T08:02:31.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c7fff640 1 -- 172.21.15.161:0/4177055459 learned_addr learned my addr 172.21.15.161:0/4177055459 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:31.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284428808 0 0) 0x7f31c806c470 con 0x7f31c80cf9a0 2023-11-24T08:02:31.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b4003520 con 0x7f31c80cf9a0 2023-11-24T08:02:31.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c77fe640 1 --2- 172.21.15.161:0/4177055459 >> v2:172.21.15.175:3300/0 conn(0x7f31c813df80 0x7f31c815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1963590068 0 0) 0x7f31b4003520 con 0x7f31c80cf9a0 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 >> v2:172.21.15.175:3300/0 conn(0x7f31c813df80 msgr2=0x7f31c815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c6ffd640 1 --2- 172.21.15.161:0/4177055459 >> v2:172.21.15.175:3300/0 conn(0x7f31c813df80 0x7f31c815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.603+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 >> v1:172.21.15.175:6789/0 conn(0x7f31c813e360 legacy=0x7f31c80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c806cd10 con 0x7f31c80cf9a0 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f31c0001670 con 0x7f31c80cf9a0 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 >> v1:172.21.15.161:6789/0 conn(0x7f31c80cf9a0 legacy=0x7f31c80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31b4003970 0x7f31b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b40047c0 0x7f31b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b4005180 0x7f31b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c806ca30 con 0x7f31b4005180 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b400c0d0 con 0x7f31b40047c0 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b400c290 con 0x7f31b4003970 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c77fe640 1 --2- 172.21.15.161:0/4177055459 >> v2:172.21.15.175:3300/0 conn(0x7f31c813df80 0x7f31c815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c7fff640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b4005180 0x7f31b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31beffd640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b40047c0 0x7f31b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c7fff640 1 -- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31b4003970 msgr2=0x7f31b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c7fff640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31b4003970 0x7f31b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c7fff640 1 -- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b40047c0 msgr2=0x7f31b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:31.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c7fff640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b40047c0 0x7f31b4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.604+0000 7f31c7fff640 1 -- 172.21.15.161:0/4177055459 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4003520 con 0x7f31b4005180 2023-11-24T08:02:31.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.605+0000 7f31c7fff640 1 -- 172.21.15.161:0/4177055459 reap_dead start 2023-11-24T08:02:31.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.605+0000 7f31c7fff640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b4005180 0x7f31b400b980 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c210 tx=0x7f31b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb3d3db0764ac5f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:31.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0005ad0 con 0x7f31b4005180 2023-11-24T08:02:31.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0005c30 con 0x7f31b4005180 2023-11-24T08:02:31.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31c6ffd640 1 -- 172.21.15.161:0/4177055459 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c002c890 con 0x7f31b4005180 2023-11-24T08:02:31.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31cdfec640 1 -- 172.21.15.161:0/4177055459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b4005180 msgr2=0x7f31b400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31cdfec640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b4005180 0x7f31b400b980 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c210 tx=0x7f31b40057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31cdfec640 1 -- 172.21.15.161:0/4177055459 shutdown_connections 2023-11-24T08:02:31.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31cdfec640 1 --2- 172.21.15.161:0/4177055459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31b4005180 0x7f31b400b980 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.606+0000 7f31cdfec640 1 -- 172.21.15.161:0/4177055459 >> 172.21.15.161:0/4177055459 conn(0x7f31c806a800 msgr2=0x7f31c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:31.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.607+0000 7f31cdfec640 1 -- 172.21.15.161:0/4177055459 shutdown_connections 2023-11-24T08:02:31.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.607+0000 7f31cdfec640 1 -- 172.21.15.161:0/4177055459 wait complete. 2023-11-24T08:02:31.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.608+0000 7f31cdfec640 1 Processor -- start 2023-11-24T08:02:31.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.608+0000 7f31cdfec640 1 -- start start 2023-11-24T08:02:31.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.609+0000 7f31cdfec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b4005180 0x7f31c80c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.609+0000 7f31cdfec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c813d350 0x7f31c813d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.609+0000 7f31cdfec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 0x7f31c815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31cdfec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c4da0 con 0x7f31c815d500 2023-11-24T08:02:31.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31cdfec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c5010 con 0x7f31b4005180 2023-11-24T08:02:31.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31cdfec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c52f0 con 0x7f31c813d350 2023-11-24T08:02:31.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 0x7f31c815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 0x7f31c815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53898/0 (socket says 172.21.15.161:53898) 2023-11-24T08:02:31.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 -- 172.21.15.161:0/1267310793 learned_addr learned my addr 172.21.15.161:0/1267310793 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:31.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31beffd640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c813d350 0x7f31c813d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 -- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c813d350 msgr2=0x7f31c813d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c813d350 0x7f31c813d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 -- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b4005180 msgr2=0x7f31c80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b4005180 0x7f31c80c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.610+0000 7f31c7fff640 1 -- 172.21.15.161:0/1267310793 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80c55d0 con 0x7f31c815d500 2023-11-24T08:02:31.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.611+0000 7f31c7fff640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 0x7f31c815d980 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c210 tx=0x7f31c0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:31.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.611+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c00049e0 con 0x7f31c815d500 2023-11-24T08:02:31.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.611+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c0004b60 con 0x7f31c815d500 2023-11-24T08:02:31.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.611+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c813dcf0 con 0x7f31c815d500 2023-11-24T08:02:31.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.611+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c0007070 con 0x7f31c815d500 2023-11-24T08:02:31.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.611+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c815dec0 con 0x7f31c815d500 2023-11-24T08:02:31.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.612+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c80675d0 con 0x7f31c815d500 2023-11-24T08:02:31.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.613+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f31c0032070 con 0x7f31c815d500 2023-11-24T08:02:31.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.614+0000 7f31c4ff9640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31a806aff0 0x7f31a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:31.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.614+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31c003c070 con 0x7f31c815d500 2023-11-24T08:02:31.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.615+0000 7f31c77fe640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31a806aff0 0x7f31a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:31.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.616+0000 7f31c77fe640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31a806aff0 0x7f31a806d4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009e90 tx=0x7f31b80094e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:31.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.619+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31c00752c0 con 0x7f31c815d500 2023-11-24T08:02:31.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.808+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31c806df00 con 0x7f31c815d500 2023-11-24T08:02:31.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.810+0000 7f31c4ff9640 1 -- 172.21.15.161:0/1267310793 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f31c00788e0 con 0x7f31c815d500 2023-11-24T08:02:31.814 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:31.815 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":47,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:28.848473+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:31.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31a806aff0 msgr2=0x7f31a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31a806aff0 0x7f31a806d4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009e90 tx=0x7f31b80094e0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 msgr2=0x7f31c815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:31.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 0x7f31c815d980 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f31c000c210 tx=0x7f31c0001a00 comp rx=0 tx=0).stop 2023-11-24T08:02:31.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 shutdown_connections 2023-11-24T08:02:31.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f31a806aff0 0x7f31a806d4b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f31c815d500 0x7f31c815d980 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31c813d350 0x7f31c813d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 --2- 172.21.15.161:0/1267310793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31b4005180 0x7f31c80c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:31.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 >> 172.21.15.161:0/1267310793 conn(0x7f31c806a800 msgr2=0x7f31c806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:31.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 shutdown_connections 2023-11-24T08:02:31.818 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:31.813+0000 7f31cdfec640 1 -- 172.21.15.161:0/1267310793 wait complete. 2023-11-24T08:02:31.833 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:02:31.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:02:32.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.031+0000 7f7a061a9640 1 Processor -- start 2023-11-24T08:02:32.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.032+0000 7f7a061a9640 1 -- start start 2023-11-24T08:02:32.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.033+0000 7f7a061a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7a000ae5a0 0x7f7a0015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.033+0000 7f7a061a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 0x7f7a000cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.033+0000 7f7a061a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a00070c40 con 0x7f7a000b3ae0 2023-11-24T08:02:32.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.033+0000 7f7a061a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a00071450 con 0x7f7a000ae5a0 2023-11-24T08:02:32.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.033+0000 7f7a061a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000cfc60 con 0x7f7a000cf290 2023-11-24T08:02:32.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.034+0000 7f79feffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7a000b3ae0 0x7f7a0006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34442/0 (socket says 172.21.15.161:34442) 2023-11-24T08:02:32.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.034+0000 7f79feffd640 1 -- 172.21.15.161:0/4003046060 learned_addr learned my addr 172.21.15.161:0/4003046060 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.034+0000 7f79fffff640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 0x7f7a000cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.034+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/4003046060 >> v2:172.21.15.175:3300/0 conn(0x7f7a000ae5a0 0x7f7a0015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.034+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639024371 0 0) 0x7f7a00070c40 con 0x7f7a000b3ae0 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.034+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ec003520 con 0x7f7a000b3ae0 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4259768796 0 0) 0x7f79ec003520 con 0x7f7a000b3ae0 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 msgr2=0x7f7a000cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:32.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 0x7f7a000cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 >> v2:172.21.15.175:3300/0 conn(0x7f7a000ae5a0 msgr2=0x7f7a0015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:32.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 --2- 172.21.15.161:0/4003046060 >> v2:172.21.15.175:3300/0 conn(0x7f7a000ae5a0 0x7f7a0015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0006c470 con 0x7f7a000b3ae0 2023-11-24T08:02:32.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f79e80019f0 con 0x7f7a000b3ae0 2023-11-24T08:02:32.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 >> v1:172.21.15.161:6789/0 conn(0x7f7a000b3ae0 legacy=0x7f7a0006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79ec0047c0 0x7f79ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 0x7f79ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a00071450 con 0x7f79ec003970 2023-11-24T08:02:32.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000cfc60 con 0x7f79ec0047c0 2023-11-24T08:02:32.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec00ba00 con 0x7f7a000cf290 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79ff7fe640 1 -- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 msgr2=0x7f79ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a000cf290 0x7f79ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79ff7fe640 1 -- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79ec0047c0 msgr2=0x7f79ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f79ec0047c0 0x7f79ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.035+0000 7f79ff7fe640 1 -- 172.21.15.161:0/4003046060 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec003520 con 0x7f79ec003970 2023-11-24T08:02:32.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.036+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009ac0 tx=0x7f79ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3f2bb391a1254e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:32.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f002c710 con 0x7f79ec003970 2023-11-24T08:02:32.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f002c870 con 0x7f79ec003970 2023-11-24T08:02:32.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f79fe7fc640 1 -- 172.21.15.161:0/4003046060 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f002cc00 con 0x7f79ec003970 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f7a061a9640 1 -- 172.21.15.161:0/4003046060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 msgr2=0x7f79ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f7a061a9640 1 --2- 172.21.15.161:0/4003046060 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f79ec003d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f79f0009ac0 tx=0x7f79ec0057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f79fffff640 1 -- 172.21.15.161:0/4003046060 reap_dead start 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f7a061a9640 1 -- 172.21.15.161:0/4003046060 shutdown_connections 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f7a061a9640 1 -- 172.21.15.161:0/4003046060 >> 172.21.15.161:0/4003046060 conn(0x7f7a0006a800 msgr2=0x7f7a0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f7a061a9640 1 -- 172.21.15.161:0/4003046060 shutdown_connections 2023-11-24T08:02:32.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.037+0000 7f7a061a9640 1 -- 172.21.15.161:0/4003046060 wait complete. 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.039+0000 7f7a061a9640 1 Processor -- start 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.039+0000 7f7a061a9640 1 -- start start 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f7a061a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f7a000ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f7a061a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a000b06a0 0x7f7a000c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f7a061a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a0006cae0 0x7f7a0006cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f7a061a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a000c4390 con 0x7f79ec003970 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f7a061a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0006d4a0 con 0x7f7a000b06a0 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f7a061a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a001f3a90 con 0x7f7a0006cae0 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f79ff7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f7a000ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f79ff7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f7a000ce360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53916/0 (socket says 172.21.15.161:53916) 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.040+0000 7f79ff7fe640 1 -- 172.21.15.161:0/1944411202 learned_addr learned my addr 172.21.15.161:0/1944411202 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79ff7fe640 1 -- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a0006cae0 msgr2=0x7f7a0006cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a0006cae0 0x7f7a0006cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79ff7fe640 1 -- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a000b06a0 msgr2=0x7f7a000c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a000b06a0 0x7f7a000c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79ff7fe640 1 -- 172.21.15.161:0/1944411202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a001f2cd0 con 0x7f79ec003970 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79ff7fe640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f7a000ce360 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f79f002c2b0 tx=0x7f79f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0003810 con 0x7f79ec003970 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f002de90 con 0x7f79ec003970 2023-11-24T08:02:32.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0003b70 con 0x7f79ec003970 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.041+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a001f2fb0 con 0x7f79ec003970 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.042+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a001f3570 con 0x7f79ec003970 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.043+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a001f3700 con 0x7f79ec003970 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.043+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f79f0003cd0 con 0x7f79ec003970 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.045+0000 7f79f7fff640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79e006aff0 0x7f79e006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.045+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79f00ab750 con 0x7f79ec003970 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.045+0000 7f79feffd640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79e006aff0 0x7f79e006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.046+0000 7f79feffd640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79e006aff0 0x7f79e006d4b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f79e8001b20 tx=0x7f79e80018d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:32.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.050+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79f0076570 con 0x7f79ec003970 2023-11-24T08:02:32.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.225+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a00071170 con 0x7f79e006aff0 2023-11-24T08:02:32.250 INFO:tasks.ceph.mds.b.smithi175.stderr:2023-11-24T08:02:32.248+0000 7fb31733a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:02:32.254 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.252+0000 7f79f7fff640 1 -- 172.21.15.161:0/1944411202 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7f79e8002030 con 0x7f79e006aff0 2023-11-24T08:02:32.258 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:32.262 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:02:32.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79e006aff0 msgr2=0x7f79e006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79e006aff0 0x7f79e006d4b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f79e8001b20 tx=0x7f79e80018d0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 msgr2=0x7f7a000ce360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f7a000ce360 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f79f002c2b0 tx=0x7f79f0004730 comp rx=0 tx=0).stop 2023-11-24T08:02:32.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 shutdown_connections 2023-11-24T08:02:32.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f79e006aff0 0x7f79e006d4b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7a0006cae0 0x7f7a0006cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7a000b06a0 0x7f7a000c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 --2- 172.21.15.161:0/1944411202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f79ec003970 0x7f7a000ce360 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 >> 172.21.15.161:0/1944411202 conn(0x7f7a0006a800 msgr2=0x7f7a0015e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:32.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 shutdown_connections 2023-11-24T08:02:32.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.259+0000 7f7a061a9640 1 -- 172.21.15.161:0/1944411202 wait complete. 2023-11-24T08:02:32.280 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-11-24T08:02:30.570284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229848,"kb_used_data":5328,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744872,"statfs":{"total":773094113280,"available":772858748928,"internally_reserved":0,"allocated":5455872,"data_stored":2884003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.767655"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.874263+0000","last_change":"2023-11-24T08:02:27.871772+0000","last_active":"2023-11-24T08:02:27.874263+0000","last_peered":"2023-11-24T08:02:27.874263+0000","last_clean":"2023-11-24T08:02:27.874263+0000","last_became_active":"2023-11-24T08:02:27.871437+0000","last_became_peered":"2023-11-24T08:02:27.871437+0000","last_unstale":"2023-11-24T08:02:27.874263+0000","last_undegraded":"2023-11-24T08:02:27.874263+0000","last_fullsized":"2023-11-24T08:02:27.874263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.875065+0000","last_change":"2023-11-24T08:02:27.872430+0000","last_active":"2023-11-24T08:02:27.875065+0000","last_peered":"2023-11-24T08:02:27.875065+0000","last_clean":"2023-11-24T08:02:27.875065+0000","last_became_active":"2023-11-24T08:02:27.872092+0000","last_became_peered":"2023-11-24T08:02:27.872092+0000","last_unstale":"2023-11-24T08:02:27.875065+0000","last_undegraded":"2023-11-24T08:02:27.875065+0000","last_fullsized":"2023-11-24T08:02:27.875065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:44.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831030+0000","last_change":"2023-11-24T08:02:26.831030+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831030+0000","last_undegraded":"2023-11-24T08:02:26.831030+0000","last_fullsized":"2023-11-24T08:02:26.831030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823208+0000","last_change":"2023-11-24T08:02:26.823208+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823208+0000","last_undegraded":"2023-11-24T08:02:26.823208+0000","last_fullsized":"2023-11-24T08:02:26.823208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869710+0000","last_change":"2023-11-24T08:02:27.863517+0000","last_active":"2023-11-24T08:02:27.869710+0000","last_peered":"2023-11-24T08:02:27.869710+0000","last_clean":"2023-11-24T08:02:27.869710+0000","last_became_active":"2023-11-24T08:02:27.863182+0000","last_became_peered":"2023-11-24T08:02:27.863182+0000","last_unstale":"2023-11-24T08:02:27.869710+0000","last_undegraded":"2023-11-24T08:02:27.869710+0000","last_fullsized":"2023-11-24T08:02:27.869710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:21:38.345681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876266+0000","last_change":"2023-11-24T08:02:27.867782+0000","last_active":"2023-11-24T08:02:27.876266+0000","last_peered":"2023-11-24T08:02:27.876266+0000","last_clean":"2023-11-24T08:02:27.876266+0000","last_became_active":"2023-11-24T08:02:27.867526+0000","last_became_peered":"2023-11-24T08:02:27.867526+0000","last_unstale":"2023-11-24T08:02:27.876266+0000","last_undegraded":"2023-11-24T08:02:27.876266+0000","last_fullsized":"2023-11-24T08:02:27.876266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871698+0000","last_change":"2023-11-24T08:02:27.869161+0000","last_active":"2023-11-24T08:02:27.871698+0000","last_peered":"2023-11-24T08:02:27.871698+0000","last_clean":"2023-11-24T08:02:27.871698+0000","last_became_active":"2023-11-24T08:02:27.868873+0000","last_became_peered":"2023-11-24T08:02:27.868873+0000","last_unstale":"2023-11-24T08:02:27.871698+0000","last_undegraded":"2023-11-24T08:02:27.871698+0000","last_fullsized":"2023-11-24T08:02:27.871698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.827349+0000","last_change":"2023-11-24T08:02:26.827349+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.827349+0000","last_undegraded":"2023-11-24T08:02:26.827349+0000","last_fullsized":"2023-11-24T08:02:26.827349+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823243+0000","last_change":"2023-11-24T08:02:26.823243+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823243+0000","last_undegraded":"2023-11-24T08:02:26.823243+0000","last_fullsized":"2023-11-24T08:02:26.823243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824006+0000","last_change":"2023-11-24T08:02:26.824006+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824006+0000","last_undegraded":"2023-11-24T08:02:26.824006+0000","last_fullsized":"2023-11-24T08:02:26.824006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822800+0000","last_change":"2023-11-24T08:02:26.822800+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822800+0000","last_undegraded":"2023-11-24T08:02:26.822800+0000","last_fullsized":"2023-11-24T08:02:26.822800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869618+0000","last_change":"2023-11-24T08:02:27.862671+0000","last_active":"2023-11-24T08:02:27.869618+0000","last_peered":"2023-11-24T08:02:27.869618+0000","last_clean":"2023-11-24T08:02:27.869618+0000","last_became_active":"2023-11-24T08:02:27.862402+0000","last_became_peered":"2023-11-24T08:02:27.862402+0000","last_unstale":"2023-11-24T08:02:27.869618+0000","last_undegraded":"2023-11-24T08:02:27.869618+0000","last_fullsized":"2023-11-24T08:02:27.869618+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.459268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867561+0000","last_change":"2023-11-24T08:02:27.864236+0000","last_active":"2023-11-24T08:02:27.867561+0000","last_peered":"2023-11-24T08:02:27.867561+0000","last_clean":"2023-11-24T08:02:27.867561+0000","last_became_active":"2023-11-24T08:02:27.863978+0000","last_became_peered":"2023-11-24T08:02:27.863978+0000","last_unstale":"2023-11-24T08:02:27.867561+0000","last_undegraded":"2023-11-24T08:02:27.867561+0000","last_fullsized":"2023-11-24T08:02:27.867561+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:46:35.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825063+0000","last_change":"2023-11-24T08:02:26.825063+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825063+0000","last_undegraded":"2023-11-24T08:02:26.825063+0000","last_fullsized":"2023-11-24T08:02:26.825063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877085+0000","last_change":"2023-11-24T08:02:27.874356+0000","last_active":"2023-11-24T08:02:27.877085+0000","last_peered":"2023-11-24T08:02:27.877085+0000","last_clean":"2023-11-24T08:02:27.877085+0000","last_became_active":"2023-11-24T08:02:27.872255+0000","last_became_peered":"2023-11-24T08:02:27.872255+0000","last_unstale":"2023-11-24T08:02:27.877085+0000","last_undegraded":"2023-11-24T08:02:27.877085+0000","last_fullsized":"2023-11-24T08:02:27.877085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.862012+0000","last_change":"2023-11-24T08:02:27.856951+0000","last_active":"2023-11-24T08:02:27.862012+0000","last_peered":"2023-11-24T08:02:27.862012+0000","last_clean":"2023-11-24T08:02:27.862012+0000","last_became_active":"2023-11-24T08:02:27.856675+0000","last_became_peered":"2023-11-24T08:02:27.856675+0000","last_unstale":"2023-11-24T08:02:27.862012+0000","last_undegraded":"2023-11-24T08:02:27.862012+0000","last_fullsized":"2023-11-24T08:02:27.862012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:18.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829418+0000","last_change":"2023-11-24T08:02:26.829418+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829418+0000","last_undegraded":"2023-11-24T08:02:26.829418+0000","last_fullsized":"2023-11-24T08:02:26.829418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832463+0000","last_change":"2023-11-24T08:02:26.832463+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832463+0000","last_undegraded":"2023-11-24T08:02:26.832463+0000","last_fullsized":"2023-11-24T08:02:26.832463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877527+0000","last_change":"2023-11-24T08:02:27.873342+0000","last_active":"2023-11-24T08:02:27.877527+0000","last_peered":"2023-11-24T08:02:27.877527+0000","last_clean":"2023-11-24T08:02:27.877527+0000","last_became_active":"2023-11-24T08:02:27.873093+0000","last_became_peered":"2023-11-24T08:02:27.873093+0000","last_unstale":"2023-11-24T08:02:27.877527+0000","last_undegraded":"2023-11-24T08:02:27.877527+0000","last_fullsized":"2023-11-24T08:02:27.877527+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:17.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867019+0000","last_change":"2023-11-24T08:02:27.862475+0000","last_active":"2023-11-24T08:02:27.867019+0000","last_peered":"2023-11-24T08:02:27.867019+0000","last_clean":"2023-11-24T08:02:27.867019+0000","last_became_active":"2023-11-24T08:02:27.862160+0000","last_became_peered":"2023-11-24T08:02:27.862160+0000","last_unstale":"2023-11-24T08:02:27.867019+0000","last_undegraded":"2023-11-24T08:02:27.867019+0000","last_fullsized":"2023-11-24T08:02:27.867019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876068+0000","last_change":"2023-11-24T08:02:27.865613+0000","last_active":"2023-11-24T08:02:27.876068+0000","last_peered":"2023-11-24T08:02:27.876068+0000","last_clean":"2023-11-24T08:02:27.876068+0000","last_became_active":"2023-11-24T08:02:27.864621+0000","last_became_peered":"2023-11-24T08:02:27.864621+0000","last_unstale":"2023-11-24T08:02:27.876068+0000","last_undegraded":"2023-11-24T08:02:27.876068+0000","last_fullsized":"2023-11-24T08:02:27.876068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824672+0000","last_change":"2023-11-24T08:02:26.824672+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824672+0000","last_undegraded":"2023-11-24T08:02:26.824672+0000","last_fullsized":"2023-11-24T08:02:26.824672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861911+0000","last_change":"2023-11-24T08:02:27.859022+0000","last_active":"2023-11-24T08:02:27.861911+0000","last_peered":"2023-11-24T08:02:27.861911+0000","last_clean":"2023-11-24T08:02:27.861911+0000","last_became_active":"2023-11-24T08:02:27.857661+0000","last_became_peered":"2023-11-24T08:02:27.857661+0000","last_unstale":"2023-11-24T08:02:27.861911+0000","last_undegraded":"2023-11-24T08:02:27.861911+0000","last_fullsized":"2023-11-24T08:02:27.861911+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.860875+0000","last_change":"2023-11-24T08:02:27.853340+0000","last_active":"2023-11-24T08:02:27.860875+0000","last_peered":"2023-11-24T08:02:27.860875+0000","last_clean":"2023-11-24T08:02:27.860875+0000","last_became_active":"2023-11-24T08:02:27.853026+0000","last_became_peered":"2023-11-24T08:02:27.853026+0000","last_unstale":"2023-11-24T08:02:27.860875+0000","last_undegraded":"2023-11-24T08:02:27.860875+0000","last_fullsized":"2023-11-24T08:02:27.860875+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869711+0000","last_change":"2023-11-24T08:02:27.867235+0000","last_active":"2023-11-24T08:02:27.869711+0000","last_peered":"2023-11-24T08:02:27.869711+0000","last_clean":"2023-11-24T08:02:27.869711+0000","last_became_active":"2023-11-24T08:02:27.866892+0000","last_became_peered":"2023-11-24T08:02:27.866892+0000","last_unstale":"2023-11-24T08:02:27.869711+0000","last_undegraded":"2023-11-24T08:02:27.869711+0000","last_fullsized":"2023-11-24T08:02:27.869711+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:36.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872468+0000","last_change":"2023-11-24T08:02:27.870150+0000","last_active":"2023-11-24T08:02:27.872468+0000","last_peered":"2023-11-24T08:02:27.872468+0000","last_clean":"2023-11-24T08:02:27.872468+0000","last_became_active":"2023-11-24T08:02:27.869895+0000","last_became_peered":"2023-11-24T08:02:27.869895+0000","last_unstale":"2023-11-24T08:02:27.872468+0000","last_undegraded":"2023-11-24T08:02:27.872468+0000","last_fullsized":"2023-11-24T08:02:27.872468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824828+0000","last_change":"2023-11-24T08:02:26.824828+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824828+0000","last_undegraded":"2023-11-24T08:02:26.824828+0000","last_fullsized":"2023-11-24T08:02:26.824828+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871556+0000","last_change":"2023-11-24T08:02:27.865353+0000","last_active":"2023-11-24T08:02:27.871556+0000","last_peered":"2023-11-24T08:02:27.871556+0000","last_clean":"2023-11-24T08:02:27.871556+0000","last_became_active":"2023-11-24T08:02:27.865086+0000","last_became_peered":"2023-11-24T08:02:27.865086+0000","last_unstale":"2023-11-24T08:02:27.871556+0000","last_undegraded":"2023-11-24T08:02:27.871556+0000","last_fullsized":"2023-11-24T08:02:27.871556+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:29.982443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865525+0000","last_change":"2023-11-24T08:02:27.863455+0000","last_active":"2023-11-24T08:02:27.865525+0000","last_peered":"2023-11-24T08:02:27.865525+0000","last_clean":"2023-11-24T08:02:27.865525+0000","last_became_active":"2023-11-24T08:02:27.863097+0000","last_became_peered":"2023-11-24T08:02:27.863097+0000","last_unstale":"2023-11-24T08:02:27.865525+0000","last_undegraded":"2023-11-24T08:02:27.865525+0000","last_fullsized":"2023-11-24T08:02:27.865525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:27.501200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832977+0000","last_change":"2023-11-24T08:02:26.832977+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832977+0000","last_undegraded":"2023-11-24T08:02:26.832977+0000","last_fullsized":"2023-11-24T08:02:26.832977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876882+0000","last_change":"2023-11-24T08:02:27.871959+0000","last_active":"2023-11-24T08:02:27.876882+0000","last_peered":"2023-11-24T08:02:27.876882+0000","last_clean":"2023-11-24T08:02:27.876882+0000","last_became_active":"2023-11-24T08:02:27.871685+0000","last_became_peered":"2023-11-24T08:02:27.871685+0000","last_unstale":"2023-11-24T08:02:27.876882+0000","last_undegraded":"2023-11-24T08:02:27.876882+0000","last_fullsized":"2023-11-24T08:02:27.876882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873165+0000","last_change":"2023-11-24T08:02:27.868750+0000","last_active":"2023-11-24T08:02:27.873165+0000","last_peered":"2023-11-24T08:02:27.873165+0000","last_clean":"2023-11-24T08:02:27.873165+0000","last_became_active":"2023-11-24T08:02:27.865780+0000","last_became_peered":"2023-11-24T08:02:27.865780+0000","last_unstale":"2023-11-24T08:02:27.873165+0000","last_undegraded":"2023-11-24T08:02:27.873165+0000","last_fullsized":"2023-11-24T08:02:27.873165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:53.929316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822134+0000","last_change":"2023-11-24T08:02:26.822134+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822134+0000","last_undegraded":"2023-11-24T08:02:26.822134+0000","last_fullsized":"2023-11-24T08:02:26.822134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878053+0000","last_change":"2023-11-24T08:02:26.843012+0000","last_active":"2023-11-24T08:02:27.878053+0000","last_peered":"2023-11-24T08:02:27.878053+0000","last_clean":"2023-11-24T08:02:27.878053+0000","last_became_active":"2023-11-24T08:02:26.842339+0000","last_became_peered":"2023-11-24T08:02:26.842339+0000","last_unstale":"2023-11-24T08:02:27.878053+0000","last_undegraded":"2023-11-24T08:02:27.878053+0000","last_fullsized":"2023-11-24T08:02:27.878053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:30.575544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851294+0000","last_change":"2023-11-24T08:02:27.850153+0000","last_active":"2023-11-24T08:02:27.851294+0000","last_peered":"2023-11-24T08:02:27.851294+0000","last_clean":"2023-11-24T08:02:27.851294+0000","last_became_active":"2023-11-24T08:02:27.849283+0000","last_became_peered":"2023-11-24T08:02:27.849283+0000","last_unstale":"2023-11-24T08:02:27.851294+0000","last_undegraded":"2023-11-24T08:02:27.851294+0000","last_fullsized":"2023-11-24T08:02:27.851294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:16.249245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.842510+0000","last_change":"2023-11-24T08:02:26.838582+0000","last_active":"2023-11-24T08:02:26.842510+0000","last_peered":"2023-11-24T08:02:26.842510+0000","last_clean":"2023-11-24T08:02:26.842510+0000","last_became_active":"2023-11-24T08:02:26.838273+0000","last_became_peered":"2023-11-24T08:02:26.838273+0000","last_unstale":"2023-11-24T08:02:26.842510+0000","last_undegraded":"2023-11-24T08:02:26.842510+0000","last_fullsized":"2023-11-24T08:02:26.842510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872589+0000","last_change":"2023-11-24T08:02:27.868436+0000","last_active":"2023-11-24T08:02:27.872589+0000","last_peered":"2023-11-24T08:02:27.872589+0000","last_clean":"2023-11-24T08:02:27.872589+0000","last_became_active":"2023-11-24T08:02:27.868148+0000","last_became_peered":"2023-11-24T08:02:27.868148+0000","last_unstale":"2023-11-24T08:02:27.872589+0000","last_undegraded":"2023-11-24T08:02:27.872589+0000","last_fullsized":"2023-11-24T08:02:27.872589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.272222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848361+0000","last_change":"2023-11-24T08:02:26.845023+0000","last_active":"2023-11-24T08:02:26.848361+0000","last_peered":"2023-11-24T08:02:26.848361+0000","last_clean":"2023-11-24T08:02:26.848361+0000","last_became_active":"2023-11-24T08:02:26.844504+0000","last_became_peered":"2023-11-24T08:02:26.844504+0000","last_unstale":"2023-11-24T08:02:26.848361+0000","last_undegraded":"2023-11-24T08:02:26.848361+0000","last_fullsized":"2023-11-24T08:02:26.848361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:34.764747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818355+0000","last_change":"2023-11-24T08:02:26.818355+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818355+0000","last_undegraded":"2023-11-24T08:02:26.818355+0000","last_fullsized":"2023-11-24T08:02:26.818355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867513+0000","last_change":"2023-11-24T08:02:26.840493+0000","last_active":"2023-11-24T08:02:27.867513+0000","last_peered":"2023-11-24T08:02:27.867513+0000","last_clean":"2023-11-24T08:02:27.867513+0000","last_became_active":"2023-11-24T08:02:26.840190+0000","last_became_peered":"2023-11-24T08:02:26.840190+0000","last_unstale":"2023-11-24T08:02:27.867513+0000","last_undegraded":"2023-11-24T08:02:27.867513+0000","last_fullsized":"2023-11-24T08:02:27.867513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829807+0000","last_change":"2023-11-24T08:02:26.829807+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829807+0000","last_undegraded":"2023-11-24T08:02:26.829807+0000","last_fullsized":"2023-11-24T08:02:26.829807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872417+0000","last_change":"2023-11-24T08:02:26.837411+0000","last_active":"2023-11-24T08:02:27.872417+0000","last_peered":"2023-11-24T08:02:27.872417+0000","last_clean":"2023-11-24T08:02:27.872417+0000","last_became_active":"2023-11-24T08:02:26.837120+0000","last_became_peered":"2023-11-24T08:02:26.837120+0000","last_unstale":"2023-11-24T08:02:27.872417+0000","last_undegraded":"2023-11-24T08:02:27.872417+0000","last_fullsized":"2023-11-24T08:02:27.872417+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:10:07.268127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819356+0000","last_change":"2023-11-24T08:02:26.819356+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819356+0000","last_undegraded":"2023-11-24T08:02:26.819356+0000","last_fullsized":"2023-11-24T08:02:26.819356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.847275+0000","last_change":"2023-11-24T08:02:26.845666+0000","last_active":"2023-11-24T08:02:26.847275+0000","last_peered":"2023-11-24T08:02:26.847275+0000","last_clean":"2023-11-24T08:02:26.847275+0000","last_became_active":"2023-11-24T08:02:26.845413+0000","last_became_peered":"2023-11-24T08:02:26.845413+0000","last_unstale":"2023-11-24T08:02:26.847275+0000","last_undegraded":"2023-11-24T08:02:26.847275+0000","last_fullsized":"2023-11-24T08:02:26.847275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819420+0000","last_change":"2023-11-24T08:02:26.819420+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819420+0000","last_undegraded":"2023-11-24T08:02:26.819420+0000","last_fullsized":"2023-11-24T08:02:26.819420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.846960+0000","last_change":"2023-11-24T08:02:26.841048+0000","last_active":"2023-11-24T08:02:27.846960+0000","last_peered":"2023-11-24T08:02:27.846960+0000","last_clean":"2023-11-24T08:02:27.846960+0000","last_became_active":"2023-11-24T08:02:26.839883+0000","last_became_peered":"2023-11-24T08:02:26.839883+0000","last_unstale":"2023-11-24T08:02:27.846960+0000","last_undegraded":"2023-11-24T08:02:27.846960+0000","last_fullsized":"2023-11-24T08:02:27.846960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:06:03.431625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861930+0000","last_change":"2023-11-24T08:02:27.859193+0000","last_active":"2023-11-24T08:02:27.861930+0000","last_peered":"2023-11-24T08:02:27.861930+0000","last_clean":"2023-11-24T08:02:27.861930+0000","last_became_active":"2023-11-24T08:02:27.858753+0000","last_became_peered":"2023-11-24T08:02:27.858753+0000","last_unstale":"2023-11-24T08:02:27.861930+0000","last_undegraded":"2023-11-24T08:02:27.861930+0000","last_fullsized":"2023-11-24T08:02:27.861930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840158+0000","last_change":"2023-11-24T08:02:26.833298+0000","last_active":"2023-11-24T08:02:26.840158+0000","last_peered":"2023-11-24T08:02:26.840158+0000","last_clean":"2023-11-24T08:02:26.840158+0000","last_became_active":"2023-11-24T08:02:26.832945+0000","last_became_peered":"2023-11-24T08:02:26.832945+0000","last_unstale":"2023-11-24T08:02:26.840158+0000","last_undegraded":"2023-11-24T08:02:26.840158+0000","last_fullsized":"2023-11-24T08:02:26.840158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831434+0000","last_change":"2023-11-24T08:02:26.831434+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831434+0000","last_undegraded":"2023-11-24T08:02:26.831434+0000","last_fullsized":"2023-11-24T08:02:26.831434+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845065+0000","last_change":"2023-11-24T08:02:26.840157+0000","last_active":"2023-11-24T08:02:26.845065+0000","last_peered":"2023-11-24T08:02:26.845065+0000","last_clean":"2023-11-24T08:02:26.845065+0000","last_became_active":"2023-11-24T08:02:26.838372+0000","last_became_peered":"2023-11-24T08:02:26.838372+0000","last_unstale":"2023-11-24T08:02:26.845065+0000","last_undegraded":"2023-11-24T08:02:26.845065+0000","last_fullsized":"2023-11-24T08:02:26.845065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871620+0000","last_change":"2023-11-24T08:02:27.866876+0000","last_active":"2023-11-24T08:02:27.871620+0000","last_peered":"2023-11-24T08:02:27.871620+0000","last_clean":"2023-11-24T08:02:27.871620+0000","last_became_active":"2023-11-24T08:02:27.866515+0000","last_became_peered":"2023-11-24T08:02:27.866515+0000","last_unstale":"2023-11-24T08:02:27.871620+0000","last_undegraded":"2023-11-24T08:02:27.871620+0000","last_fullsized":"2023-11-24T08:02:27.871620+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.841153+0000","last_change":"2023-11-24T08:02:26.838700+0000","last_active":"2023-11-24T08:02:26.841153+0000","last_peered":"2023-11-24T08:02:26.841153+0000","last_clean":"2023-11-24T08:02:26.841153+0000","last_became_active":"2023-11-24T08:02:26.838175+0000","last_became_peered":"2023-11-24T08:02:26.838175+0000","last_unstale":"2023-11-24T08:02:26.841153+0000","last_undegraded":"2023-11-24T08:02:26.841153+0000","last_fullsized":"2023-11-24T08:02:26.841153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876965+0000","last_change":"2023-11-24T08:02:27.865063+0000","last_active":"2023-11-24T08:02:27.876965+0000","last_peered":"2023-11-24T08:02:27.876965+0000","last_clean":"2023-11-24T08:02:27.876965+0000","last_became_active":"2023-11-24T08:02:27.864806+0000","last_became_peered":"2023-11-24T08:02:27.864806+0000","last_unstale":"2023-11-24T08:02:27.876965+0000","last_undegraded":"2023-11-24T08:02:27.876965+0000","last_fullsized":"2023-11-24T08:02:27.876965+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.744987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867781+0000","last_change":"2023-11-24T08:02:26.841842+0000","last_active":"2023-11-24T08:02:27.867781+0000","last_peered":"2023-11-24T08:02:27.867781+0000","last_clean":"2023-11-24T08:02:27.867781+0000","last_became_active":"2023-11-24T08:02:26.841524+0000","last_became_peered":"2023-11-24T08:02:26.841524+0000","last_unstale":"2023-11-24T08:02:27.867781+0000","last_undegraded":"2023-11-24T08:02:27.867781+0000","last_fullsized":"2023-11-24T08:02:27.867781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880633+0000","last_change":"2023-11-24T08:02:27.876155+0000","last_active":"2023-11-24T08:02:27.880633+0000","last_peered":"2023-11-24T08:02:27.880633+0000","last_clean":"2023-11-24T08:02:27.880633+0000","last_became_active":"2023-11-24T08:02:27.875932+0000","last_became_peered":"2023-11-24T08:02:27.875932+0000","last_unstale":"2023-11-24T08:02:27.880633+0000","last_undegraded":"2023-11-24T08:02:27.880633+0000","last_fullsized":"2023-11-24T08:02:27.880633+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.881849+0000","last_change":"2023-11-24T08:02:26.839195+0000","last_active":"2023-11-24T08:02:27.881849+0000","last_peered":"2023-11-24T08:02:27.881849+0000","last_clean":"2023-11-24T08:02:27.881849+0000","last_became_active":"2023-11-24T08:02:26.838946+0000","last_became_peered":"2023-11-24T08:02:26.838946+0000","last_unstale":"2023-11-24T08:02:27.881849+0000","last_undegraded":"2023-11-24T08:02:27.881849+0000","last_fullsized":"2023-11-24T08:02:27.881849+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:17.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865493+0000","last_change":"2023-11-24T08:02:27.863330+0000","last_active":"2023-11-24T08:02:27.865493+0000","last_peered":"2023-11-24T08:02:27.865493+0000","last_clean":"2023-11-24T08:02:27.865493+0000","last_became_active":"2023-11-24T08:02:27.863064+0000","last_became_peered":"2023-11-24T08:02:27.863064+0000","last_unstale":"2023-11-24T08:02:27.865493+0000","last_undegraded":"2023-11-24T08:02:27.865493+0000","last_fullsized":"2023-11-24T08:02:27.865493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:54.675687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880362+0000","last_change":"2023-11-24T08:02:26.833854+0000","last_active":"2023-11-24T08:02:27.880362+0000","last_peered":"2023-11-24T08:02:27.880362+0000","last_clean":"2023-11-24T08:02:27.880362+0000","last_became_active":"2023-11-24T08:02:26.833026+0000","last_became_peered":"2023-11-24T08:02:26.833026+0000","last_unstale":"2023-11-24T08:02:27.880362+0000","last_undegraded":"2023-11-24T08:02:27.880362+0000","last_fullsized":"2023-11-24T08:02:27.880362+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:18.256936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818723+0000","last_change":"2023-11-24T08:02:26.818723+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818723+0000","last_undegraded":"2023-11-24T08:02:26.818723+0000","last_fullsized":"2023-11-24T08:02:26.818723+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852819+0000","last_change":"2023-11-24T08:02:26.832072+0000","last_active":"2023-11-24T08:02:27.852819+0000","last_peered":"2023-11-24T08:02:27.852819+0000","last_clean":"2023-11-24T08:02:27.852819+0000","last_became_active":"2023-11-24T08:02:26.831711+0000","last_became_peered":"2023-11-24T08:02:26.831711+0000","last_unstale":"2023-11-24T08:02:27.852819+0000","last_undegraded":"2023-11-24T08:02:27.852819+0000","last_fullsized":"2023-11-24T08:02:27.852819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:48.836292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876004+0000","last_change":"2023-11-24T08:02:27.863802+0000","last_active":"2023-11-24T08:02:27.876004+0000","last_peered":"2023-11-24T08:02:27.876004+0000","last_clean":"2023-11-24T08:02:27.876004+0000","last_became_active":"2023-11-24T08:02:27.863505+0000","last_became_peered":"2023-11-24T08:02:27.863505+0000","last_unstale":"2023-11-24T08:02:27.876004+0000","last_undegraded":"2023-11-24T08:02:27.876004+0000","last_fullsized":"2023-11-24T08:02:27.876004+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:28.155079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847468+0000","last_change":"2023-11-24T08:02:26.835308+0000","last_active":"2023-11-24T08:02:27.847468+0000","last_peered":"2023-11-24T08:02:27.847468+0000","last_clean":"2023-11-24T08:02:27.847468+0000","last_became_active":"2023-11-24T08:02:26.835069+0000","last_became_peered":"2023-11-24T08:02:26.835069+0000","last_unstale":"2023-11-24T08:02:27.847468+0000","last_undegraded":"2023-11-24T08:02:27.847468+0000","last_fullsized":"2023-11-24T08:02:27.847468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871664+0000","last_change":"2023-11-24T08:02:27.867003+0000","last_active":"2023-11-24T08:02:27.871664+0000","last_peered":"2023-11-24T08:02:27.871664+0000","last_clean":"2023-11-24T08:02:27.871664+0000","last_became_active":"2023-11-24T08:02:27.865266+0000","last_became_peered":"2023-11-24T08:02:27.865266+0000","last_unstale":"2023-11-24T08:02:27.871664+0000","last_undegraded":"2023-11-24T08:02:27.871664+0000","last_fullsized":"2023-11-24T08:02:27.871664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846302+0000","last_change":"2023-11-24T08:02:26.845056+0000","last_active":"2023-11-24T08:02:26.846302+0000","last_peered":"2023-11-24T08:02:26.846302+0000","last_clean":"2023-11-24T08:02:26.846302+0000","last_became_active":"2023-11-24T08:02:26.844746+0000","last_became_peered":"2023-11-24T08:02:26.844746+0000","last_unstale":"2023-11-24T08:02:26.846302+0000","last_undegraded":"2023-11-24T08:02:26.846302+0000","last_fullsized":"2023-11-24T08:02:26.846302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.856913+0000","last_change":"2023-11-24T08:02:27.851025+0000","last_active":"2023-11-24T08:02:27.856913+0000","last_peered":"2023-11-24T08:02:27.856913+0000","last_clean":"2023-11-24T08:02:27.856913+0000","last_became_active":"2023-11-24T08:02:27.850749+0000","last_became_peered":"2023-11-24T08:02:27.850749+0000","last_unstale":"2023-11-24T08:02:27.856913+0000","last_undegraded":"2023-11-24T08:02:27.856913+0000","last_fullsized":"2023-11-24T08:02:27.856913+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878734+0000","last_change":"2023-11-24T08:02:26.834787+0000","last_active":"2023-11-24T08:02:27.878734+0000","last_peered":"2023-11-24T08:02:27.878734+0000","last_clean":"2023-11-24T08:02:27.878734+0000","last_became_active":"2023-11-24T08:02:26.834159+0000","last_became_peered":"2023-11-24T08:02:26.834159+0000","last_unstale":"2023-11-24T08:02:27.878734+0000","last_undegraded":"2023-11-24T08:02:27.878734+0000","last_fullsized":"2023-11-24T08:02:27.878734+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:20:04.530498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822775+0000","last_change":"2023-11-24T08:02:26.822775+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822775+0000","last_undegraded":"2023-11-24T08:02:26.822775+0000","last_fullsized":"2023-11-24T08:02:26.822775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846515+0000","last_change":"2023-11-24T08:02:26.842806+0000","last_active":"2023-11-24T08:02:26.846515+0000","last_peered":"2023-11-24T08:02:26.846515+0000","last_clean":"2023-11-24T08:02:26.846515+0000","last_became_active":"2023-11-24T08:02:26.842317+0000","last_became_peered":"2023-11-24T08:02:26.842317+0000","last_unstale":"2023-11-24T08:02:26.846515+0000","last_undegraded":"2023-11-24T08:02:26.846515+0000","last_fullsized":"2023-11-24T08:02:26.846515+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870877+0000","last_change":"2023-11-24T08:02:27.868287+0000","last_active":"2023-11-24T08:02:27.870877+0000","last_peered":"2023-11-24T08:02:27.870877+0000","last_clean":"2023-11-24T08:02:27.870877+0000","last_became_active":"2023-11-24T08:02:27.867921+0000","last_became_peered":"2023-11-24T08:02:27.867921+0000","last_unstale":"2023-11-24T08:02:27.870877+0000","last_undegraded":"2023-11-24T08:02:27.870877+0000","last_fullsized":"2023-11-24T08:02:27.870877+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:12:51.094917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869028+0000","last_change":"2023-11-24T08:02:26.844242+0000","last_active":"2023-11-24T08:02:27.869028+0000","last_peered":"2023-11-24T08:02:27.869028+0000","last_clean":"2023-11-24T08:02:27.869028+0000","last_became_active":"2023-11-24T08:02:26.843949+0000","last_became_peered":"2023-11-24T08:02:26.843949+0000","last_unstale":"2023-11-24T08:02:27.869028+0000","last_undegraded":"2023-11-24T08:02:27.869028+0000","last_fullsized":"2023-11-24T08:02:27.869028+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869412+0000","last_change":"2023-11-24T08:02:27.866311+0000","last_active":"2023-11-24T08:02:27.869412+0000","last_peered":"2023-11-24T08:02:27.869412+0000","last_clean":"2023-11-24T08:02:27.869412+0000","last_became_active":"2023-11-24T08:02:27.865994+0000","last_became_peered":"2023-11-24T08:02:27.865994+0000","last_unstale":"2023-11-24T08:02:27.869412+0000","last_undegraded":"2023-11-24T08:02:27.869412+0000","last_fullsized":"2023-11-24T08:02:27.869412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:20.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852142+0000","last_change":"2023-11-24T08:02:26.841437+0000","last_active":"2023-11-24T08:02:27.852142+0000","last_peered":"2023-11-24T08:02:27.852142+0000","last_clean":"2023-11-24T08:02:27.852142+0000","last_became_active":"2023-11-24T08:02:26.841101+0000","last_became_peered":"2023-11-24T08:02:26.841101+0000","last_unstale":"2023-11-24T08:02:27.852142+0000","last_undegraded":"2023-11-24T08:02:27.852142+0000","last_fullsized":"2023-11-24T08:02:27.852142+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:19:21.245356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.859818+0000","last_change":"2023-11-24T08:02:27.854759+0000","last_active":"2023-11-24T08:02:27.859818+0000","last_peered":"2023-11-24T08:02:27.859818+0000","last_clean":"2023-11-24T08:02:27.859818+0000","last_became_active":"2023-11-24T08:02:27.854463+0000","last_became_peered":"2023-11-24T08:02:27.854463+0000","last_unstale":"2023-11-24T08:02:27.859818+0000","last_undegraded":"2023-11-24T08:02:27.859818+0000","last_fullsized":"2023-11-24T08:02:27.859818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871456+0000","last_change":"2023-11-24T08:02:26.837311+0000","last_active":"2023-11-24T08:02:27.871456+0000","last_peered":"2023-11-24T08:02:27.871456+0000","last_clean":"2023-11-24T08:02:27.871456+0000","last_became_active":"2023-11-24T08:02:26.836798+0000","last_became_peered":"2023-11-24T08:02:26.836798+0000","last_unstale":"2023-11-24T08:02:27.871456+0000","last_undegraded":"2023-11-24T08:02:27.871456+0000","last_fullsized":"2023-11-24T08:02:27.871456+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:17.818121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.821010+0000","last_change":"2023-11-24T08:02:26.821010+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.821010+0000","last_undegraded":"2023-11-24T08:02:26.821010+0000","last_fullsized":"2023-11-24T08:02:26.821010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847070+0000","last_change":"2023-11-24T08:02:26.846707+0000","last_active":"2023-11-24T08:02:27.847070+0000","last_peered":"2023-11-24T08:02:27.847070+0000","last_clean":"2023-11-24T08:02:27.847070+0000","last_became_active":"2023-11-24T08:02:26.846336+0000","last_became_peered":"2023-11-24T08:02:26.846336+0000","last_unstale":"2023-11-24T08:02:27.847070+0000","last_undegraded":"2023-11-24T08:02:27.847070+0000","last_fullsized":"2023-11-24T08:02:27.847070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.651309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.857927+0000","last_change":"2023-11-24T08:02:27.853113+0000","last_active":"2023-11-24T08:02:27.857927+0000","last_peered":"2023-11-24T08:02:27.857927+0000","last_clean":"2023-11-24T08:02:27.857927+0000","last_became_active":"2023-11-24T08:02:27.852792+0000","last_became_peered":"2023-11-24T08:02:27.852792+0000","last_unstale":"2023-11-24T08:02:27.857927+0000","last_undegraded":"2023-11-24T08:02:27.857927+0000","last_fullsized":"2023-11-24T08:02:27.857927+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:12.600997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846251+0000","last_change":"2023-11-24T08:02:26.841551+0000","last_active":"2023-11-24T08:02:26.846251+0000","last_peered":"2023-11-24T08:02:26.846251+0000","last_clean":"2023-11-24T08:02:26.846251+0000","last_became_active":"2023-11-24T08:02:26.840861+0000","last_became_peered":"2023-11-24T08:02:26.840861+0000","last_unstale":"2023-11-24T08:02:26.846251+0000","last_undegraded":"2023-11-24T08:02:26.846251+0000","last_fullsized":"2023-11-24T08:02:26.846251+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825895+0000","last_change":"2023-11-24T08:02:26.825895+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825895+0000","last_undegraded":"2023-11-24T08:02:26.825895+0000","last_fullsized":"2023-11-24T08:02:26.825895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851575+0000","last_change":"2023-11-24T08:02:26.831194+0000","last_active":"2023-11-24T08:02:27.851575+0000","last_peered":"2023-11-24T08:02:27.851575+0000","last_clean":"2023-11-24T08:02:27.851575+0000","last_became_active":"2023-11-24T08:02:26.830870+0000","last_became_peered":"2023-11-24T08:02:26.830870+0000","last_unstale":"2023-11-24T08:02:27.851575+0000","last_undegraded":"2023-11-24T08:02:27.851575+0000","last_fullsized":"2023-11-24T08:02:27.851575+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:28.971796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865587+0000","last_change":"2023-11-24T08:02:27.863129+0000","last_active":"2023-11-24T08:02:27.865587+0000","last_peered":"2023-11-24T08:02:27.865587+0000","last_clean":"2023-11-24T08:02:27.865587+0000","last_became_active":"2023-11-24T08:02:27.862818+0000","last_became_peered":"2023-11-24T08:02:27.862818+0000","last_unstale":"2023-11-24T08:02:27.865587+0000","last_undegraded":"2023-11-24T08:02:27.865587+0000","last_fullsized":"2023-11-24T08:02:27.865587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:44.172148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852960+0000","last_change":"2023-11-24T08:02:26.842429+0000","last_active":"2023-11-24T08:02:27.852960+0000","last_peered":"2023-11-24T08:02:27.852960+0000","last_clean":"2023-11-24T08:02:27.852960+0000","last_became_active":"2023-11-24T08:02:26.842153+0000","last_became_peered":"2023-11-24T08:02:26.842153+0000","last_unstale":"2023-11-24T08:02:27.852960+0000","last_undegraded":"2023-11-24T08:02:27.852960+0000","last_fullsized":"2023-11-24T08:02:27.852960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:35.629826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822712+0000","last_change":"2023-11-24T08:02:26.822712+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822712+0000","last_undegraded":"2023-11-24T08:02:26.822712+0000","last_fullsized":"2023-11-24T08:02:26.822712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.854493+0000","last_change":"2023-11-24T08:02:26.841087+0000","last_active":"2023-11-24T08:02:27.854493+0000","last_peered":"2023-11-24T08:02:27.854493+0000","last_clean":"2023-11-24T08:02:27.854493+0000","last_became_active":"2023-11-24T08:02:26.840807+0000","last_became_peered":"2023-11-24T08:02:26.840807+0000","last_unstale":"2023-11-24T08:02:27.854493+0000","last_undegraded":"2023-11-24T08:02:27.854493+0000","last_fullsized":"2023-11-24T08:02:27.854493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:59.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867833+0000","last_change":"2023-11-24T08:02:27.861891+0000","last_active":"2023-11-24T08:02:27.867833+0000","last_peered":"2023-11-24T08:02:27.867833+0000","last_clean":"2023-11-24T08:02:27.867833+0000","last_became_active":"2023-11-24T08:02:27.861391+0000","last_became_peered":"2023-11-24T08:02:27.861391+0000","last_unstale":"2023-11-24T08:02:27.867833+0000","last_undegraded":"2023-11-24T08:02:27.867833+0000","last_fullsized":"2023-11-24T08:02:27.867833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848396+0000","last_change":"2023-11-24T08:02:26.845613+0000","last_active":"2023-11-24T08:02:26.848396+0000","last_peered":"2023-11-24T08:02:26.848396+0000","last_clean":"2023-11-24T08:02:26.848396+0000","last_became_active":"2023-11-24T08:02:26.845190+0000","last_became_peered":"2023-11-24T08:02:26.845190+0000","last_unstale":"2023-11-24T08:02:26.848396+0000","last_undegraded":"2023-11-24T08:02:26.848396+0000","last_fullsized":"2023-11-24T08:02:26.848396+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:11:34.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876976+0000","last_change":"2023-11-24T08:02:27.874289+0000","last_active":"2023-11-24T08:02:27.876976+0000","last_peered":"2023-11-24T08:02:27.876976+0000","last_clean":"2023-11-24T08:02:27.876976+0000","last_became_active":"2023-11-24T08:02:27.873177+0000","last_became_peered":"2023-11-24T08:02:27.873177+0000","last_unstale":"2023-11-24T08:02:27.876976+0000","last_undegraded":"2023-11-24T08:02:27.876976+0000","last_fullsized":"2023-11-24T08:02:27.876976+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852098+0000","last_change":"2023-11-24T08:02:26.840761+0000","last_active":"2023-11-24T08:02:27.852098+0000","last_peered":"2023-11-24T08:02:27.852098+0000","last_clean":"2023-11-24T08:02:27.852098+0000","last_became_active":"2023-11-24T08:02:26.838173+0000","last_became_peered":"2023-11-24T08:02:26.838173+0000","last_unstale":"2023-11-24T08:02:27.852098+0000","last_undegraded":"2023-11-24T08:02:27.852098+0000","last_fullsized":"2023-11-24T08:02:27.852098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876091+0000","last_change":"2023-11-24T08:02:27.865925+0000","last_active":"2023-11-24T08:02:27.876091+0000","last_peered":"2023-11-24T08:02:27.876091+0000","last_clean":"2023-11-24T08:02:27.876091+0000","last_became_active":"2023-11-24T08:02:27.865643+0000","last_became_peered":"2023-11-24T08:02:27.865643+0000","last_unstale":"2023-11-24T08:02:27.876091+0000","last_undegraded":"2023-11-24T08:02:27.876091+0000","last_fullsized":"2023-11-24T08:02:27.876091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:00.868558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846408+0000","last_change":"2023-11-24T08:02:26.842216+0000","last_active":"2023-11-24T08:02:26.846408+0000","last_peered":"2023-11-24T08:02:26.846408+0000","last_clean":"2023-11-24T08:02:26.846408+0000","last_became_active":"2023-11-24T08:02:26.841172+0000","last_became_peered":"2023-11-24T08:02:26.841172+0000","last_unstale":"2023-11-24T08:02:26.846408+0000","last_undegraded":"2023-11-24T08:02:26.846408+0000","last_fullsized":"2023-11-24T08:02:26.846408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871968+0000","last_change":"2023-11-24T08:02:27.866805+0000","last_active":"2023-11-24T08:02:27.871968+0000","last_peered":"2023-11-24T08:02:27.871968+0000","last_clean":"2023-11-24T08:02:27.871968+0000","last_became_active":"2023-11-24T08:02:27.866254+0000","last_became_peered":"2023-11-24T08:02:27.866254+0000","last_unstale":"2023-11-24T08:02:27.871968+0000","last_undegraded":"2023-11-24T08:02:27.871968+0000","last_fullsized":"2023-11-24T08:02:27.871968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:55:47.185739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845567+0000","last_change":"2023-11-24T08:02:26.837671+0000","last_active":"2023-11-24T08:02:26.845567+0000","last_peered":"2023-11-24T08:02:26.845567+0000","last_clean":"2023-11-24T08:02:26.845567+0000","last_became_active":"2023-11-24T08:02:26.837141+0000","last_became_peered":"2023-11-24T08:02:26.837141+0000","last_unstale":"2023-11-24T08:02:26.845567+0000","last_undegraded":"2023-11-24T08:02:26.845567+0000","last_fullsized":"2023-11-24T08:02:26.845567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:02.489853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823776+0000","last_change":"2023-11-24T08:02:26.823776+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823776+0000","last_undegraded":"2023-11-24T08:02:26.823776+0000","last_fullsized":"2023-11-24T08:02:26.823776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840559+0000","last_change":"2023-11-24T08:02:26.834763+0000","last_active":"2023-11-24T08:02:26.840559+0000","last_peered":"2023-11-24T08:02:26.840559+0000","last_clean":"2023-11-24T08:02:26.840559+0000","last_became_active":"2023-11-24T08:02:26.834426+0000","last_became_peered":"2023-11-24T08:02:26.834426+0000","last_unstale":"2023-11-24T08:02:26.840559+0000","last_undegraded":"2023-11-24T08:02:26.840559+0000","last_fullsized":"2023-11-24T08:02:26.840559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823658+0000","last_change":"2023-11-24T08:02:26.823658+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823658+0000","last_undegraded":"2023-11-24T08:02:26.823658+0000","last_fullsized":"2023-11-24T08:02:26.823658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873697+0000","last_change":"2023-11-24T08:02:26.843331+0000","last_active":"2023-11-24T08:02:27.873697+0000","last_peered":"2023-11-24T08:02:27.873697+0000","last_clean":"2023-11-24T08:02:27.873697+0000","last_became_active":"2023-11-24T08:02:26.843044+0000","last_became_peered":"2023-11-24T08:02:26.843044+0000","last_unstale":"2023-11-24T08:02:27.873697+0000","last_undegraded":"2023-11-24T08:02:27.873697+0000","last_fullsized":"2023-11-24T08:02:27.873697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.820974+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:02:26.820974+0000","last_peered":"2023-11-24T08:02:26.820974+0000","last_clean":"2023-11-24T08:02:26.820974+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:02:26.820974+0000","last_undegraded":"2023-11-24T08:02:26.820974+0000","last_fullsized":"2023-11-24T08:02:26.820974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":805519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.113,"15min":1.133},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.5229999999999999,"5min":1.72,"15min":1.72},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.70599999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1830000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.159,"15min":1.161},"min":{"1min":0.79800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5229999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5389999999999999,"5min":2.02,"15min":2.02},"last":1.087}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3759999999999999,"15min":1.383},"min":{"1min":1.0029999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6319999999999999,"5min":1.944,"15min":1.944},"last":1.5189999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1619999999999999,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6000000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.405,"15min":1.411},"min":{"1min":0.94599999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4079999999999999,"15min":1.4139999999999999},"min":{"1min":0.98499999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3300000000000001,"15min":1.3129999999999999},"min":{"1min":0.98399999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.774,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5569999999999999,"15min":1.5620000000000001},"min":{"1min":1.2669999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7609999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.595},{"interface":"front","average":{"1min":1.552,"5min":1.542,"15min":1.54},"min":{"1min":1.085,"5min":1.01,"15min":1.01},"max":{"1min":1.881,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.4319999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.6160000000000001,"15min":1.609},"min":{"1min":1.2210000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.141,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.5349999999999999,"15min":1.5269999999999999},"min":{"1min":1.2529999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.839,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":215733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.72199999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1970000000000001,"15min":1.1950000000000001},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.238,"15min":1.244},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5109999999999999,"5min":2.597,"15min":2.597},"last":1.5600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2390000000000001,"15min":1.2589999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.623,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.29},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.706,"5min":2.831,"15min":2.831},"last":1.468}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.294,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.605,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.3360000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3879999999999999,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.873},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4019999999999999,"15min":1.4119999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5920000000000001,"15min":1.5960000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.163},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.546,"15min":1.54},"min":{"1min":1.016,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.226}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.6060000000000001,"15min":1.6180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9159999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.28},{"interface":"front","average":{"1min":1.649,"5min":1.6020000000000001,"15min":1.5940000000000001},"min":{"1min":1.202,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.444}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.72,"5min":2.431,"15min":2.431},"last":1.446},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0640000000000001,"15min":1.056},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5149999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4139999999999999,"5min":1.768,"15min":1.768},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.335,"15min":1.351},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6339999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.339,"15min":1.373},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7789999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7569999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.4359999999999999},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.569,"15min":2.569},"last":1.232},{"interface":"front","average":{"1min":1.361,"5min":1.5129999999999999,"15min":1.538},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.121}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.665,"15min":1.7130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.96,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.577},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.113},"last":1.3400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":215699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.383,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.50900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.3480000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0369999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.486,"5min":1.601,"15min":1.601},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.998},"min":{"1min":0.59699999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.526,"5min":1.569,"15min":1.569},"last":1.1910000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.111,"15min":1.105},"min":{"1min":0.75700000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5429999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.1799999999999999},"min":{"1min":0.77500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.272}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.288,"15min":1.2789999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.482},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2470000000000001,"15min":1.2450000000000001},"min":{"1min":0.77400000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2370000000000001,"15min":1.24},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6699999999999999,"5min":1.861,"15min":1.861},"last":1.52},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3680000000000001,"15min":1.3640000000000001},"min":{"1min":0.91000000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.921,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.389}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.294},"min":{"1min":0.76800000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.262},"min":{"1min":0.85499999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.746,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5780000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":216695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.41899999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.27,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.526,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":3.343}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.504,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.113,"15min":1.137},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3089999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":2.3479999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96599999999999997,"15min":0.97099999999999997},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.236,"5min":1.637,"15min":1.637},"last":7.5670000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.409,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":2.3980000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.794,"5min":6.452,"15min":6.452},"last":7.0119999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.548,"15min":1.581},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7370000000000001,"5min":6.306,"15min":6.306},"last":7.0609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.5189999999999999,"15min":1.5369999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7889999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.296,"15min":1.3069999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.708,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":12.798}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.381,"15min":1.3879999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.857,"5min":2.069,"15min":2.069},"last":7.6200000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.577,"15min":1.6160000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8779999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.786,"5min":1.948,"15min":1.948},"last":7.4539999999999997},{"interface":"front","average":{"1min":1.454,"5min":1.5900000000000001,"15min":1.6120000000000001},"min":{"1min":0.93200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.921,"5min":6.399,"15min":6.399},"last":1.538}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.60199999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.629,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.099,"15min":1.1200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.536,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1639999999999999,"15min":1.159},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8340000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.23},{"interface":"front","average":{"1min":1.145,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.51,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.3009999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3959999999999999,"5min":1.518,"15min":1.518},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.4279999999999999,"15min":1.446},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.794,"5min":1.966,"15min":1.966},"last":1.488}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8420000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.611},{"interface":"front","average":{"1min":1.282,"5min":1.4059999999999999,"15min":1.4259999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8959999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.044}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.492,"15min":1.508},"min":{"1min":1.0609999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.056,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.532,"15min":1.52},"min":{"1min":1.149,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.986,"5min":2.073,"15min":2.073},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5549999999999999,"15min":1.5640000000000001},"min":{"1min":1.1519999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7589999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.6000000000000001,"15min":1.6240000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.968,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.5309999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.6080000000000001,"15min":1.6120000000000001},"min":{"1min":1.208,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.897,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6870000000000001,"15min":1.706},"min":{"1min":1.262,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0099999999999998,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.4079999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.40100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5109999999999999,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":1.012},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":3.266,"15min":3.266},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1819999999999999,"15min":1.196},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5780000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.216},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.597,"5min":1.976,"15min":1.976},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.4710000000000001,"15min":1.5189999999999999},"min":{"1min":0.73099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1139999999999999,"5min":4.367,"15min":4.367},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.4370000000000001,"15min":1.4550000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8939999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.3420000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.5289999999999999,"15min":1.583},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6890000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4830000000000001,"15min":1.5029999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7170000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.155}]},{"osd":6,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.9570000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.256},{"interface":"front","average":{"1min":1.419,"5min":1.639,"15min":1.675},"min":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0059999999999998,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.234}]},{"osd":7,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8220000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.657,"15min":1.704},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0739999999999998,"5min":4.452,"15min":4.452},"last":1.1830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":798654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0660000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1299999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.876,"5min":1.0149999999999999,"15min":1.038},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.466,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.04,"15min":1.046},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.512,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.284},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.622,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5600000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6459999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2170000000000001,"15min":1.2250000000000001},"min":{"1min":0.91900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.431,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.544},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6439999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.0569999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.476,"15min":1.5089999999999999},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.895,"5min":2.839,"15min":2.839},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3660000000000001,"15min":1.3879999999999999},"min":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5389999999999999,"5min":2.823,"15min":2.823},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.72,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86499999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0539999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.337}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1480000000000001,"5min":2.875,"15min":2.875},"last":1.476},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.776,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:02:32.285 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:02:32.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.536+0000 7fd3bd4e1640 1 Processor -- start 2023-11-24T08:02:32.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.536+0000 7fd3bd4e1640 1 -- start start 2023-11-24T08:02:32.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bd4e1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd3b806d760 0x7fd3b8070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bd4e1640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b8071790 con 0x7fd3b80b3c20 2023-11-24T08:02:32.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bd4e1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b8071100 con 0x7fd3b8159590 2023-11-24T08:02:32.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bd4e1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b8070860 con 0x7fd3b806d760 2023-11-24T08:02:32.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3affff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd3b80b3c20 0x7fd3b806d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34448/0 (socket says 172.21.15.161:34448) 2023-11-24T08:02:32.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3affff640 1 -- 172.21.15.161:0/1187438244 learned_addr learned my addr 172.21.15.161:0/1187438244 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:32.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bcce0640 1 --2- 172.21.15.161:0/1187438244 >> v2:172.21.15.161:3300/0 conn(0x7fd3b806d760 0x7fd3b8070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3b77fe640 1 -- 172.21.15.161:0/1187438244 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503876305 0 0) 0x7fd3b8071790 con 0x7fd3b80b3c20 2023-11-24T08:02:32.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3b77fe640 1 -- 172.21.15.161:0/1187438244 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a4003440 con 0x7fd3b80b3c20 2023-11-24T08:02:32.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bcce0640 1 -- 172.21.15.161:0/1187438244 >> v1:172.21.15.175:6789/0 conn(0x7fd3b8159590 legacy=0x7fd3b80ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bcce0640 1 -- 172.21.15.161:0/1187438244 >> v1:172.21.15.161:6789/0 conn(0x7fd3b80b3c20 legacy=0x7fd3b806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.538+0000 7fd3bcce0640 1 -- 172.21.15.161:0/1187438244 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8070b40 con 0x7fd3b806d760 2023-11-24T08:02:32.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.540+0000 7fd3bcce0640 1 --2- 172.21.15.161:0/1187438244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8070160 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009d90 tx=0x7fd3b002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1ded798f2ddde7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:32.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.540+0000 7fd3b77fe640 1 -- 172.21.15.161:0/1187438244 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b002cbd0 con 0x7fd3b806d760 2023-11-24T08:02:32.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.540+0000 7fd3b77fe640 1 -- 172.21.15.161:0/1187438244 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b002cd30 con 0x7fd3b806d760 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.540+0000 7fd3b77fe640 1 -- 172.21.15.161:0/1187438244 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b002cea0 con 0x7fd3b806d760 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.540+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/1187438244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 msgr2=0x7fd3b8070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.540+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/1187438244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8070160 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0009d90 tx=0x7fd3b002be20 comp rx=0 tx=0).stop 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.541+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/1187438244 shutdown_connections 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.541+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/1187438244 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8070160 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.541+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/1187438244 >> 172.21.15.161:0/1187438244 conn(0x7fd3b806a800 msgr2=0x7fd3b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.541+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/1187438244 shutdown_connections 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.541+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/1187438244 wait complete. 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.542+0000 7fd3bd4e1640 1 Processor -- start 2023-11-24T08:02:32.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 -- start start 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3b80b3c20 0x7fd3b814d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3b8159590 0x7fd3b80afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814db80 con 0x7fd3b806d760 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814c350 con 0x7fd3b8159590 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.543+0000 7fd3bd4e1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b814d1b0 con 0x7fd3b80b3c20 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8144820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53934/0 (socket says 172.21.15.161:53934) 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 -- 172.21.15.161:0/688633767 learned_addr learned my addr 172.21.15.161:0/688633767 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 -- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3b80b3c20 msgr2=0x7fd3b814d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3b80b3c20 0x7fd3b814d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 -- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3b8159590 msgr2=0x7fd3b80afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3b8159590 0x7fd3b80afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 -- 172.21.15.161:0/688633767 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b0009a70 con 0x7fd3b806d760 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.544+0000 7fd3b7fff640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8144820 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800b3f0 tx=0x7fd3a800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.545+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8011830 con 0x7fd3b806d760 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.545+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8011990 con 0x7fd3b806d760 2023-11-24T08:02:32.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.545+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8011d40 con 0x7fd3b806d760 2023-11-24T08:02:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.545+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b814c5a0 con 0x7fd3b806d760 2023-11-24T08:02:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.545+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b814cb60 con 0x7fd3b806d760 2023-11-24T08:02:32.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.546+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b8067450 con 0x7fd3b806d760 2023-11-24T08:02:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.547+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd3a801a400 con 0x7fd3b806d760 2023-11-24T08:02:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.548+0000 7fd3b57fa640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd39806b020 0x7fd39806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.548+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3a80896f0 con 0x7fd3b806d760 2023-11-24T08:02:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.548+0000 7fd3affff640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd39806b020 0x7fd39806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:32.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.550+0000 7fd3affff640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd39806b020 0x7fd39806d4e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80b30c0 tx=0x7fd3a0007950 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:32.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.553+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3a80545b0 con 0x7fd3b806d760 2023-11-24T08:02:32.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.742+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3b8159970 con 0x7fd39806b020 2023-11-24T08:02:32.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.766+0000 7fd3b57fa640 1 -- 172.21.15.161:0/688633767 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7fd3a00070d0 con 0x7fd39806b020 2023-11-24T08:02:32.772 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:32.773 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:02:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd39806b020 msgr2=0x7fd39806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd39806b020 0x7fd39806d4e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd3b80b30c0 tx=0x7fd3a0007950 comp rx=0 tx=0).stop 2023-11-24T08:02:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 msgr2=0x7fd3b8144820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8144820 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800b3f0 tx=0x7fd3a800b8b0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 shutdown_connections 2023-11-24T08:02:32.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd39806b020 0x7fd39806d4e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3b8159590 0x7fd3b80afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3b80b3c20 0x7fd3b814d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.771+0000 7fd3bd4e1640 1 --2- 172.21.15.161:0/688633767 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3b806d760 0x7fd3b8144820 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:32.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.772+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 >> 172.21.15.161:0/688633767 conn(0x7fd3b806a800 msgr2=0x7fd3b815d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:32.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.772+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 shutdown_connections 2023-11-24T08:02:32.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:32.772+0000 7fd3bd4e1640 1 -- 172.21.15.161:0/688633767 wait complete. 2023-11-24T08:02:32.794 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-11-24T08:02:32.570870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229848,"kb_used_data":5328,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744872,"statfs":{"total":773094113280,"available":772858748928,"internally_reserved":0,"allocated":5455872,"data_stored":2884003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001807"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.874263+0000","last_change":"2023-11-24T08:02:27.871772+0000","last_active":"2023-11-24T08:02:27.874263+0000","last_peered":"2023-11-24T08:02:27.874263+0000","last_clean":"2023-11-24T08:02:27.874263+0000","last_became_active":"2023-11-24T08:02:27.871437+0000","last_became_peered":"2023-11-24T08:02:27.871437+0000","last_unstale":"2023-11-24T08:02:27.874263+0000","last_undegraded":"2023-11-24T08:02:27.874263+0000","last_fullsized":"2023-11-24T08:02:27.874263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.875065+0000","last_change":"2023-11-24T08:02:27.872430+0000","last_active":"2023-11-24T08:02:27.875065+0000","last_peered":"2023-11-24T08:02:27.875065+0000","last_clean":"2023-11-24T08:02:27.875065+0000","last_became_active":"2023-11-24T08:02:27.872092+0000","last_became_peered":"2023-11-24T08:02:27.872092+0000","last_unstale":"2023-11-24T08:02:27.875065+0000","last_undegraded":"2023-11-24T08:02:27.875065+0000","last_fullsized":"2023-11-24T08:02:27.875065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:44.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831030+0000","last_change":"2023-11-24T08:02:26.831030+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831030+0000","last_undegraded":"2023-11-24T08:02:26.831030+0000","last_fullsized":"2023-11-24T08:02:26.831030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823208+0000","last_change":"2023-11-24T08:02:26.823208+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823208+0000","last_undegraded":"2023-11-24T08:02:26.823208+0000","last_fullsized":"2023-11-24T08:02:26.823208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869710+0000","last_change":"2023-11-24T08:02:27.863517+0000","last_active":"2023-11-24T08:02:27.869710+0000","last_peered":"2023-11-24T08:02:27.869710+0000","last_clean":"2023-11-24T08:02:27.869710+0000","last_became_active":"2023-11-24T08:02:27.863182+0000","last_became_peered":"2023-11-24T08:02:27.863182+0000","last_unstale":"2023-11-24T08:02:27.869710+0000","last_undegraded":"2023-11-24T08:02:27.869710+0000","last_fullsized":"2023-11-24T08:02:27.869710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:21:38.345681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876266+0000","last_change":"2023-11-24T08:02:27.867782+0000","last_active":"2023-11-24T08:02:27.876266+0000","last_peered":"2023-11-24T08:02:27.876266+0000","last_clean":"2023-11-24T08:02:27.876266+0000","last_became_active":"2023-11-24T08:02:27.867526+0000","last_became_peered":"2023-11-24T08:02:27.867526+0000","last_unstale":"2023-11-24T08:02:27.876266+0000","last_undegraded":"2023-11-24T08:02:27.876266+0000","last_fullsized":"2023-11-24T08:02:27.876266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871698+0000","last_change":"2023-11-24T08:02:27.869161+0000","last_active":"2023-11-24T08:02:27.871698+0000","last_peered":"2023-11-24T08:02:27.871698+0000","last_clean":"2023-11-24T08:02:27.871698+0000","last_became_active":"2023-11-24T08:02:27.868873+0000","last_became_peered":"2023-11-24T08:02:27.868873+0000","last_unstale":"2023-11-24T08:02:27.871698+0000","last_undegraded":"2023-11-24T08:02:27.871698+0000","last_fullsized":"2023-11-24T08:02:27.871698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.827349+0000","last_change":"2023-11-24T08:02:26.827349+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.827349+0000","last_undegraded":"2023-11-24T08:02:26.827349+0000","last_fullsized":"2023-11-24T08:02:26.827349+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823243+0000","last_change":"2023-11-24T08:02:26.823243+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823243+0000","last_undegraded":"2023-11-24T08:02:26.823243+0000","last_fullsized":"2023-11-24T08:02:26.823243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824006+0000","last_change":"2023-11-24T08:02:26.824006+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824006+0000","last_undegraded":"2023-11-24T08:02:26.824006+0000","last_fullsized":"2023-11-24T08:02:26.824006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822800+0000","last_change":"2023-11-24T08:02:26.822800+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822800+0000","last_undegraded":"2023-11-24T08:02:26.822800+0000","last_fullsized":"2023-11-24T08:02:26.822800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869618+0000","last_change":"2023-11-24T08:02:27.862671+0000","last_active":"2023-11-24T08:02:27.869618+0000","last_peered":"2023-11-24T08:02:27.869618+0000","last_clean":"2023-11-24T08:02:27.869618+0000","last_became_active":"2023-11-24T08:02:27.862402+0000","last_became_peered":"2023-11-24T08:02:27.862402+0000","last_unstale":"2023-11-24T08:02:27.869618+0000","last_undegraded":"2023-11-24T08:02:27.869618+0000","last_fullsized":"2023-11-24T08:02:27.869618+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.459268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867561+0000","last_change":"2023-11-24T08:02:27.864236+0000","last_active":"2023-11-24T08:02:27.867561+0000","last_peered":"2023-11-24T08:02:27.867561+0000","last_clean":"2023-11-24T08:02:27.867561+0000","last_became_active":"2023-11-24T08:02:27.863978+0000","last_became_peered":"2023-11-24T08:02:27.863978+0000","last_unstale":"2023-11-24T08:02:27.867561+0000","last_undegraded":"2023-11-24T08:02:27.867561+0000","last_fullsized":"2023-11-24T08:02:27.867561+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:46:35.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825063+0000","last_change":"2023-11-24T08:02:26.825063+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825063+0000","last_undegraded":"2023-11-24T08:02:26.825063+0000","last_fullsized":"2023-11-24T08:02:26.825063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877085+0000","last_change":"2023-11-24T08:02:27.874356+0000","last_active":"2023-11-24T08:02:27.877085+0000","last_peered":"2023-11-24T08:02:27.877085+0000","last_clean":"2023-11-24T08:02:27.877085+0000","last_became_active":"2023-11-24T08:02:27.872255+0000","last_became_peered":"2023-11-24T08:02:27.872255+0000","last_unstale":"2023-11-24T08:02:27.877085+0000","last_undegraded":"2023-11-24T08:02:27.877085+0000","last_fullsized":"2023-11-24T08:02:27.877085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.862012+0000","last_change":"2023-11-24T08:02:27.856951+0000","last_active":"2023-11-24T08:02:27.862012+0000","last_peered":"2023-11-24T08:02:27.862012+0000","last_clean":"2023-11-24T08:02:27.862012+0000","last_became_active":"2023-11-24T08:02:27.856675+0000","last_became_peered":"2023-11-24T08:02:27.856675+0000","last_unstale":"2023-11-24T08:02:27.862012+0000","last_undegraded":"2023-11-24T08:02:27.862012+0000","last_fullsized":"2023-11-24T08:02:27.862012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:18.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829418+0000","last_change":"2023-11-24T08:02:26.829418+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829418+0000","last_undegraded":"2023-11-24T08:02:26.829418+0000","last_fullsized":"2023-11-24T08:02:26.829418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832463+0000","last_change":"2023-11-24T08:02:26.832463+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832463+0000","last_undegraded":"2023-11-24T08:02:26.832463+0000","last_fullsized":"2023-11-24T08:02:26.832463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877527+0000","last_change":"2023-11-24T08:02:27.873342+0000","last_active":"2023-11-24T08:02:27.877527+0000","last_peered":"2023-11-24T08:02:27.877527+0000","last_clean":"2023-11-24T08:02:27.877527+0000","last_became_active":"2023-11-24T08:02:27.873093+0000","last_became_peered":"2023-11-24T08:02:27.873093+0000","last_unstale":"2023-11-24T08:02:27.877527+0000","last_undegraded":"2023-11-24T08:02:27.877527+0000","last_fullsized":"2023-11-24T08:02:27.877527+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:17.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867019+0000","last_change":"2023-11-24T08:02:27.862475+0000","last_active":"2023-11-24T08:02:27.867019+0000","last_peered":"2023-11-24T08:02:27.867019+0000","last_clean":"2023-11-24T08:02:27.867019+0000","last_became_active":"2023-11-24T08:02:27.862160+0000","last_became_peered":"2023-11-24T08:02:27.862160+0000","last_unstale":"2023-11-24T08:02:27.867019+0000","last_undegraded":"2023-11-24T08:02:27.867019+0000","last_fullsized":"2023-11-24T08:02:27.867019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876068+0000","last_change":"2023-11-24T08:02:27.865613+0000","last_active":"2023-11-24T08:02:27.876068+0000","last_peered":"2023-11-24T08:02:27.876068+0000","last_clean":"2023-11-24T08:02:27.876068+0000","last_became_active":"2023-11-24T08:02:27.864621+0000","last_became_peered":"2023-11-24T08:02:27.864621+0000","last_unstale":"2023-11-24T08:02:27.876068+0000","last_undegraded":"2023-11-24T08:02:27.876068+0000","last_fullsized":"2023-11-24T08:02:27.876068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824672+0000","last_change":"2023-11-24T08:02:26.824672+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824672+0000","last_undegraded":"2023-11-24T08:02:26.824672+0000","last_fullsized":"2023-11-24T08:02:26.824672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861911+0000","last_change":"2023-11-24T08:02:27.859022+0000","last_active":"2023-11-24T08:02:27.861911+0000","last_peered":"2023-11-24T08:02:27.861911+0000","last_clean":"2023-11-24T08:02:27.861911+0000","last_became_active":"2023-11-24T08:02:27.857661+0000","last_became_peered":"2023-11-24T08:02:27.857661+0000","last_unstale":"2023-11-24T08:02:27.861911+0000","last_undegraded":"2023-11-24T08:02:27.861911+0000","last_fullsized":"2023-11-24T08:02:27.861911+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.860875+0000","last_change":"2023-11-24T08:02:27.853340+0000","last_active":"2023-11-24T08:02:27.860875+0000","last_peered":"2023-11-24T08:02:27.860875+0000","last_clean":"2023-11-24T08:02:27.860875+0000","last_became_active":"2023-11-24T08:02:27.853026+0000","last_became_peered":"2023-11-24T08:02:27.853026+0000","last_unstale":"2023-11-24T08:02:27.860875+0000","last_undegraded":"2023-11-24T08:02:27.860875+0000","last_fullsized":"2023-11-24T08:02:27.860875+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869711+0000","last_change":"2023-11-24T08:02:27.867235+0000","last_active":"2023-11-24T08:02:27.869711+0000","last_peered":"2023-11-24T08:02:27.869711+0000","last_clean":"2023-11-24T08:02:27.869711+0000","last_became_active":"2023-11-24T08:02:27.866892+0000","last_became_peered":"2023-11-24T08:02:27.866892+0000","last_unstale":"2023-11-24T08:02:27.869711+0000","last_undegraded":"2023-11-24T08:02:27.869711+0000","last_fullsized":"2023-11-24T08:02:27.869711+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:36.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872468+0000","last_change":"2023-11-24T08:02:27.870150+0000","last_active":"2023-11-24T08:02:27.872468+0000","last_peered":"2023-11-24T08:02:27.872468+0000","last_clean":"2023-11-24T08:02:27.872468+0000","last_became_active":"2023-11-24T08:02:27.869895+0000","last_became_peered":"2023-11-24T08:02:27.869895+0000","last_unstale":"2023-11-24T08:02:27.872468+0000","last_undegraded":"2023-11-24T08:02:27.872468+0000","last_fullsized":"2023-11-24T08:02:27.872468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824828+0000","last_change":"2023-11-24T08:02:26.824828+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824828+0000","last_undegraded":"2023-11-24T08:02:26.824828+0000","last_fullsized":"2023-11-24T08:02:26.824828+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871556+0000","last_change":"2023-11-24T08:02:27.865353+0000","last_active":"2023-11-24T08:02:27.871556+0000","last_peered":"2023-11-24T08:02:27.871556+0000","last_clean":"2023-11-24T08:02:27.871556+0000","last_became_active":"2023-11-24T08:02:27.865086+0000","last_became_peered":"2023-11-24T08:02:27.865086+0000","last_unstale":"2023-11-24T08:02:27.871556+0000","last_undegraded":"2023-11-24T08:02:27.871556+0000","last_fullsized":"2023-11-24T08:02:27.871556+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:29.982443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865525+0000","last_change":"2023-11-24T08:02:27.863455+0000","last_active":"2023-11-24T08:02:27.865525+0000","last_peered":"2023-11-24T08:02:27.865525+0000","last_clean":"2023-11-24T08:02:27.865525+0000","last_became_active":"2023-11-24T08:02:27.863097+0000","last_became_peered":"2023-11-24T08:02:27.863097+0000","last_unstale":"2023-11-24T08:02:27.865525+0000","last_undegraded":"2023-11-24T08:02:27.865525+0000","last_fullsized":"2023-11-24T08:02:27.865525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:27.501200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832977+0000","last_change":"2023-11-24T08:02:26.832977+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832977+0000","last_undegraded":"2023-11-24T08:02:26.832977+0000","last_fullsized":"2023-11-24T08:02:26.832977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876882+0000","last_change":"2023-11-24T08:02:27.871959+0000","last_active":"2023-11-24T08:02:27.876882+0000","last_peered":"2023-11-24T08:02:27.876882+0000","last_clean":"2023-11-24T08:02:27.876882+0000","last_became_active":"2023-11-24T08:02:27.871685+0000","last_became_peered":"2023-11-24T08:02:27.871685+0000","last_unstale":"2023-11-24T08:02:27.876882+0000","last_undegraded":"2023-11-24T08:02:27.876882+0000","last_fullsized":"2023-11-24T08:02:27.876882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873165+0000","last_change":"2023-11-24T08:02:27.868750+0000","last_active":"2023-11-24T08:02:27.873165+0000","last_peered":"2023-11-24T08:02:27.873165+0000","last_clean":"2023-11-24T08:02:27.873165+0000","last_became_active":"2023-11-24T08:02:27.865780+0000","last_became_peered":"2023-11-24T08:02:27.865780+0000","last_unstale":"2023-11-24T08:02:27.873165+0000","last_undegraded":"2023-11-24T08:02:27.873165+0000","last_fullsized":"2023-11-24T08:02:27.873165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:53.929316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822134+0000","last_change":"2023-11-24T08:02:26.822134+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822134+0000","last_undegraded":"2023-11-24T08:02:26.822134+0000","last_fullsized":"2023-11-24T08:02:26.822134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878053+0000","last_change":"2023-11-24T08:02:26.843012+0000","last_active":"2023-11-24T08:02:27.878053+0000","last_peered":"2023-11-24T08:02:27.878053+0000","last_clean":"2023-11-24T08:02:27.878053+0000","last_became_active":"2023-11-24T08:02:26.842339+0000","last_became_peered":"2023-11-24T08:02:26.842339+0000","last_unstale":"2023-11-24T08:02:27.878053+0000","last_undegraded":"2023-11-24T08:02:27.878053+0000","last_fullsized":"2023-11-24T08:02:27.878053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:30.575544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851294+0000","last_change":"2023-11-24T08:02:27.850153+0000","last_active":"2023-11-24T08:02:27.851294+0000","last_peered":"2023-11-24T08:02:27.851294+0000","last_clean":"2023-11-24T08:02:27.851294+0000","last_became_active":"2023-11-24T08:02:27.849283+0000","last_became_peered":"2023-11-24T08:02:27.849283+0000","last_unstale":"2023-11-24T08:02:27.851294+0000","last_undegraded":"2023-11-24T08:02:27.851294+0000","last_fullsized":"2023-11-24T08:02:27.851294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:16.249245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.842510+0000","last_change":"2023-11-24T08:02:26.838582+0000","last_active":"2023-11-24T08:02:26.842510+0000","last_peered":"2023-11-24T08:02:26.842510+0000","last_clean":"2023-11-24T08:02:26.842510+0000","last_became_active":"2023-11-24T08:02:26.838273+0000","last_became_peered":"2023-11-24T08:02:26.838273+0000","last_unstale":"2023-11-24T08:02:26.842510+0000","last_undegraded":"2023-11-24T08:02:26.842510+0000","last_fullsized":"2023-11-24T08:02:26.842510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872589+0000","last_change":"2023-11-24T08:02:27.868436+0000","last_active":"2023-11-24T08:02:27.872589+0000","last_peered":"2023-11-24T08:02:27.872589+0000","last_clean":"2023-11-24T08:02:27.872589+0000","last_became_active":"2023-11-24T08:02:27.868148+0000","last_became_peered":"2023-11-24T08:02:27.868148+0000","last_unstale":"2023-11-24T08:02:27.872589+0000","last_undegraded":"2023-11-24T08:02:27.872589+0000","last_fullsized":"2023-11-24T08:02:27.872589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.272222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848361+0000","last_change":"2023-11-24T08:02:26.845023+0000","last_active":"2023-11-24T08:02:26.848361+0000","last_peered":"2023-11-24T08:02:26.848361+0000","last_clean":"2023-11-24T08:02:26.848361+0000","last_became_active":"2023-11-24T08:02:26.844504+0000","last_became_peered":"2023-11-24T08:02:26.844504+0000","last_unstale":"2023-11-24T08:02:26.848361+0000","last_undegraded":"2023-11-24T08:02:26.848361+0000","last_fullsized":"2023-11-24T08:02:26.848361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:34.764747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818355+0000","last_change":"2023-11-24T08:02:26.818355+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818355+0000","last_undegraded":"2023-11-24T08:02:26.818355+0000","last_fullsized":"2023-11-24T08:02:26.818355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867513+0000","last_change":"2023-11-24T08:02:26.840493+0000","last_active":"2023-11-24T08:02:27.867513+0000","last_peered":"2023-11-24T08:02:27.867513+0000","last_clean":"2023-11-24T08:02:27.867513+0000","last_became_active":"2023-11-24T08:02:26.840190+0000","last_became_peered":"2023-11-24T08:02:26.840190+0000","last_unstale":"2023-11-24T08:02:27.867513+0000","last_undegraded":"2023-11-24T08:02:27.867513+0000","last_fullsized":"2023-11-24T08:02:27.867513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829807+0000","last_change":"2023-11-24T08:02:26.829807+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829807+0000","last_undegraded":"2023-11-24T08:02:26.829807+0000","last_fullsized":"2023-11-24T08:02:26.829807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872417+0000","last_change":"2023-11-24T08:02:26.837411+0000","last_active":"2023-11-24T08:02:27.872417+0000","last_peered":"2023-11-24T08:02:27.872417+0000","last_clean":"2023-11-24T08:02:27.872417+0000","last_became_active":"2023-11-24T08:02:26.837120+0000","last_became_peered":"2023-11-24T08:02:26.837120+0000","last_unstale":"2023-11-24T08:02:27.872417+0000","last_undegraded":"2023-11-24T08:02:27.872417+0000","last_fullsized":"2023-11-24T08:02:27.872417+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:10:07.268127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819356+0000","last_change":"2023-11-24T08:02:26.819356+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819356+0000","last_undegraded":"2023-11-24T08:02:26.819356+0000","last_fullsized":"2023-11-24T08:02:26.819356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.847275+0000","last_change":"2023-11-24T08:02:26.845666+0000","last_active":"2023-11-24T08:02:26.847275+0000","last_peered":"2023-11-24T08:02:26.847275+0000","last_clean":"2023-11-24T08:02:26.847275+0000","last_became_active":"2023-11-24T08:02:26.845413+0000","last_became_peered":"2023-11-24T08:02:26.845413+0000","last_unstale":"2023-11-24T08:02:26.847275+0000","last_undegraded":"2023-11-24T08:02:26.847275+0000","last_fullsized":"2023-11-24T08:02:26.847275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819420+0000","last_change":"2023-11-24T08:02:26.819420+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819420+0000","last_undegraded":"2023-11-24T08:02:26.819420+0000","last_fullsized":"2023-11-24T08:02:26.819420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.846960+0000","last_change":"2023-11-24T08:02:26.841048+0000","last_active":"2023-11-24T08:02:27.846960+0000","last_peered":"2023-11-24T08:02:27.846960+0000","last_clean":"2023-11-24T08:02:27.846960+0000","last_became_active":"2023-11-24T08:02:26.839883+0000","last_became_peered":"2023-11-24T08:02:26.839883+0000","last_unstale":"2023-11-24T08:02:27.846960+0000","last_undegraded":"2023-11-24T08:02:27.846960+0000","last_fullsized":"2023-11-24T08:02:27.846960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:06:03.431625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861930+0000","last_change":"2023-11-24T08:02:27.859193+0000","last_active":"2023-11-24T08:02:27.861930+0000","last_peered":"2023-11-24T08:02:27.861930+0000","last_clean":"2023-11-24T08:02:27.861930+0000","last_became_active":"2023-11-24T08:02:27.858753+0000","last_became_peered":"2023-11-24T08:02:27.858753+0000","last_unstale":"2023-11-24T08:02:27.861930+0000","last_undegraded":"2023-11-24T08:02:27.861930+0000","last_fullsized":"2023-11-24T08:02:27.861930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840158+0000","last_change":"2023-11-24T08:02:26.833298+0000","last_active":"2023-11-24T08:02:26.840158+0000","last_peered":"2023-11-24T08:02:26.840158+0000","last_clean":"2023-11-24T08:02:26.840158+0000","last_became_active":"2023-11-24T08:02:26.832945+0000","last_became_peered":"2023-11-24T08:02:26.832945+0000","last_unstale":"2023-11-24T08:02:26.840158+0000","last_undegraded":"2023-11-24T08:02:26.840158+0000","last_fullsized":"2023-11-24T08:02:26.840158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831434+0000","last_change":"2023-11-24T08:02:26.831434+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831434+0000","last_undegraded":"2023-11-24T08:02:26.831434+0000","last_fullsized":"2023-11-24T08:02:26.831434+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845065+0000","last_change":"2023-11-24T08:02:26.840157+0000","last_active":"2023-11-24T08:02:26.845065+0000","last_peered":"2023-11-24T08:02:26.845065+0000","last_clean":"2023-11-24T08:02:26.845065+0000","last_became_active":"2023-11-24T08:02:26.838372+0000","last_became_peered":"2023-11-24T08:02:26.838372+0000","last_unstale":"2023-11-24T08:02:26.845065+0000","last_undegraded":"2023-11-24T08:02:26.845065+0000","last_fullsized":"2023-11-24T08:02:26.845065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871620+0000","last_change":"2023-11-24T08:02:27.866876+0000","last_active":"2023-11-24T08:02:27.871620+0000","last_peered":"2023-11-24T08:02:27.871620+0000","last_clean":"2023-11-24T08:02:27.871620+0000","last_became_active":"2023-11-24T08:02:27.866515+0000","last_became_peered":"2023-11-24T08:02:27.866515+0000","last_unstale":"2023-11-24T08:02:27.871620+0000","last_undegraded":"2023-11-24T08:02:27.871620+0000","last_fullsized":"2023-11-24T08:02:27.871620+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.841153+0000","last_change":"2023-11-24T08:02:26.838700+0000","last_active":"2023-11-24T08:02:26.841153+0000","last_peered":"2023-11-24T08:02:26.841153+0000","last_clean":"2023-11-24T08:02:26.841153+0000","last_became_active":"2023-11-24T08:02:26.838175+0000","last_became_peered":"2023-11-24T08:02:26.838175+0000","last_unstale":"2023-11-24T08:02:26.841153+0000","last_undegraded":"2023-11-24T08:02:26.841153+0000","last_fullsized":"2023-11-24T08:02:26.841153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876965+0000","last_change":"2023-11-24T08:02:27.865063+0000","last_active":"2023-11-24T08:02:27.876965+0000","last_peered":"2023-11-24T08:02:27.876965+0000","last_clean":"2023-11-24T08:02:27.876965+0000","last_became_active":"2023-11-24T08:02:27.864806+0000","last_became_peered":"2023-11-24T08:02:27.864806+0000","last_unstale":"2023-11-24T08:02:27.876965+0000","last_undegraded":"2023-11-24T08:02:27.876965+0000","last_fullsized":"2023-11-24T08:02:27.876965+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.744987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867781+0000","last_change":"2023-11-24T08:02:26.841842+0000","last_active":"2023-11-24T08:02:27.867781+0000","last_peered":"2023-11-24T08:02:27.867781+0000","last_clean":"2023-11-24T08:02:27.867781+0000","last_became_active":"2023-11-24T08:02:26.841524+0000","last_became_peered":"2023-11-24T08:02:26.841524+0000","last_unstale":"2023-11-24T08:02:27.867781+0000","last_undegraded":"2023-11-24T08:02:27.867781+0000","last_fullsized":"2023-11-24T08:02:27.867781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880633+0000","last_change":"2023-11-24T08:02:27.876155+0000","last_active":"2023-11-24T08:02:27.880633+0000","last_peered":"2023-11-24T08:02:27.880633+0000","last_clean":"2023-11-24T08:02:27.880633+0000","last_became_active":"2023-11-24T08:02:27.875932+0000","last_became_peered":"2023-11-24T08:02:27.875932+0000","last_unstale":"2023-11-24T08:02:27.880633+0000","last_undegraded":"2023-11-24T08:02:27.880633+0000","last_fullsized":"2023-11-24T08:02:27.880633+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.881849+0000","last_change":"2023-11-24T08:02:26.839195+0000","last_active":"2023-11-24T08:02:27.881849+0000","last_peered":"2023-11-24T08:02:27.881849+0000","last_clean":"2023-11-24T08:02:27.881849+0000","last_became_active":"2023-11-24T08:02:26.838946+0000","last_became_peered":"2023-11-24T08:02:26.838946+0000","last_unstale":"2023-11-24T08:02:27.881849+0000","last_undegraded":"2023-11-24T08:02:27.881849+0000","last_fullsized":"2023-11-24T08:02:27.881849+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:17.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865493+0000","last_change":"2023-11-24T08:02:27.863330+0000","last_active":"2023-11-24T08:02:27.865493+0000","last_peered":"2023-11-24T08:02:27.865493+0000","last_clean":"2023-11-24T08:02:27.865493+0000","last_became_active":"2023-11-24T08:02:27.863064+0000","last_became_peered":"2023-11-24T08:02:27.863064+0000","last_unstale":"2023-11-24T08:02:27.865493+0000","last_undegraded":"2023-11-24T08:02:27.865493+0000","last_fullsized":"2023-11-24T08:02:27.865493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:54.675687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880362+0000","last_change":"2023-11-24T08:02:26.833854+0000","last_active":"2023-11-24T08:02:27.880362+0000","last_peered":"2023-11-24T08:02:27.880362+0000","last_clean":"2023-11-24T08:02:27.880362+0000","last_became_active":"2023-11-24T08:02:26.833026+0000","last_became_peered":"2023-11-24T08:02:26.833026+0000","last_unstale":"2023-11-24T08:02:27.880362+0000","last_undegraded":"2023-11-24T08:02:27.880362+0000","last_fullsized":"2023-11-24T08:02:27.880362+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:18.256936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818723+0000","last_change":"2023-11-24T08:02:26.818723+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818723+0000","last_undegraded":"2023-11-24T08:02:26.818723+0000","last_fullsized":"2023-11-24T08:02:26.818723+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852819+0000","last_change":"2023-11-24T08:02:26.832072+0000","last_active":"2023-11-24T08:02:27.852819+0000","last_peered":"2023-11-24T08:02:27.852819+0000","last_clean":"2023-11-24T08:02:27.852819+0000","last_became_active":"2023-11-24T08:02:26.831711+0000","last_became_peered":"2023-11-24T08:02:26.831711+0000","last_unstale":"2023-11-24T08:02:27.852819+0000","last_undegraded":"2023-11-24T08:02:27.852819+0000","last_fullsized":"2023-11-24T08:02:27.852819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:48.836292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876004+0000","last_change":"2023-11-24T08:02:27.863802+0000","last_active":"2023-11-24T08:02:27.876004+0000","last_peered":"2023-11-24T08:02:27.876004+0000","last_clean":"2023-11-24T08:02:27.876004+0000","last_became_active":"2023-11-24T08:02:27.863505+0000","last_became_peered":"2023-11-24T08:02:27.863505+0000","last_unstale":"2023-11-24T08:02:27.876004+0000","last_undegraded":"2023-11-24T08:02:27.876004+0000","last_fullsized":"2023-11-24T08:02:27.876004+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:28.155079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847468+0000","last_change":"2023-11-24T08:02:26.835308+0000","last_active":"2023-11-24T08:02:27.847468+0000","last_peered":"2023-11-24T08:02:27.847468+0000","last_clean":"2023-11-24T08:02:27.847468+0000","last_became_active":"2023-11-24T08:02:26.835069+0000","last_became_peered":"2023-11-24T08:02:26.835069+0000","last_unstale":"2023-11-24T08:02:27.847468+0000","last_undegraded":"2023-11-24T08:02:27.847468+0000","last_fullsized":"2023-11-24T08:02:27.847468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871664+0000","last_change":"2023-11-24T08:02:27.867003+0000","last_active":"2023-11-24T08:02:27.871664+0000","last_peered":"2023-11-24T08:02:27.871664+0000","last_clean":"2023-11-24T08:02:27.871664+0000","last_became_active":"2023-11-24T08:02:27.865266+0000","last_became_peered":"2023-11-24T08:02:27.865266+0000","last_unstale":"2023-11-24T08:02:27.871664+0000","last_undegraded":"2023-11-24T08:02:27.871664+0000","last_fullsized":"2023-11-24T08:02:27.871664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846302+0000","last_change":"2023-11-24T08:02:26.845056+0000","last_active":"2023-11-24T08:02:26.846302+0000","last_peered":"2023-11-24T08:02:26.846302+0000","last_clean":"2023-11-24T08:02:26.846302+0000","last_became_active":"2023-11-24T08:02:26.844746+0000","last_became_peered":"2023-11-24T08:02:26.844746+0000","last_unstale":"2023-11-24T08:02:26.846302+0000","last_undegraded":"2023-11-24T08:02:26.846302+0000","last_fullsized":"2023-11-24T08:02:26.846302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.856913+0000","last_change":"2023-11-24T08:02:27.851025+0000","last_active":"2023-11-24T08:02:27.856913+0000","last_peered":"2023-11-24T08:02:27.856913+0000","last_clean":"2023-11-24T08:02:27.856913+0000","last_became_active":"2023-11-24T08:02:27.850749+0000","last_became_peered":"2023-11-24T08:02:27.850749+0000","last_unstale":"2023-11-24T08:02:27.856913+0000","last_undegraded":"2023-11-24T08:02:27.856913+0000","last_fullsized":"2023-11-24T08:02:27.856913+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878734+0000","last_change":"2023-11-24T08:02:26.834787+0000","last_active":"2023-11-24T08:02:27.878734+0000","last_peered":"2023-11-24T08:02:27.878734+0000","last_clean":"2023-11-24T08:02:27.878734+0000","last_became_active":"2023-11-24T08:02:26.834159+0000","last_became_peered":"2023-11-24T08:02:26.834159+0000","last_unstale":"2023-11-24T08:02:27.878734+0000","last_undegraded":"2023-11-24T08:02:27.878734+0000","last_fullsized":"2023-11-24T08:02:27.878734+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:20:04.530498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822775+0000","last_change":"2023-11-24T08:02:26.822775+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822775+0000","last_undegraded":"2023-11-24T08:02:26.822775+0000","last_fullsized":"2023-11-24T08:02:26.822775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846515+0000","last_change":"2023-11-24T08:02:26.842806+0000","last_active":"2023-11-24T08:02:26.846515+0000","last_peered":"2023-11-24T08:02:26.846515+0000","last_clean":"2023-11-24T08:02:26.846515+0000","last_became_active":"2023-11-24T08:02:26.842317+0000","last_became_peered":"2023-11-24T08:02:26.842317+0000","last_unstale":"2023-11-24T08:02:26.846515+0000","last_undegraded":"2023-11-24T08:02:26.846515+0000","last_fullsized":"2023-11-24T08:02:26.846515+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870877+0000","last_change":"2023-11-24T08:02:27.868287+0000","last_active":"2023-11-24T08:02:27.870877+0000","last_peered":"2023-11-24T08:02:27.870877+0000","last_clean":"2023-11-24T08:02:27.870877+0000","last_became_active":"2023-11-24T08:02:27.867921+0000","last_became_peered":"2023-11-24T08:02:27.867921+0000","last_unstale":"2023-11-24T08:02:27.870877+0000","last_undegraded":"2023-11-24T08:02:27.870877+0000","last_fullsized":"2023-11-24T08:02:27.870877+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:12:51.094917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869028+0000","last_change":"2023-11-24T08:02:26.844242+0000","last_active":"2023-11-24T08:02:27.869028+0000","last_peered":"2023-11-24T08:02:27.869028+0000","last_clean":"2023-11-24T08:02:27.869028+0000","last_became_active":"2023-11-24T08:02:26.843949+0000","last_became_peered":"2023-11-24T08:02:26.843949+0000","last_unstale":"2023-11-24T08:02:27.869028+0000","last_undegraded":"2023-11-24T08:02:27.869028+0000","last_fullsized":"2023-11-24T08:02:27.869028+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869412+0000","last_change":"2023-11-24T08:02:27.866311+0000","last_active":"2023-11-24T08:02:27.869412+0000","last_peered":"2023-11-24T08:02:27.869412+0000","last_clean":"2023-11-24T08:02:27.869412+0000","last_became_active":"2023-11-24T08:02:27.865994+0000","last_became_peered":"2023-11-24T08:02:27.865994+0000","last_unstale":"2023-11-24T08:02:27.869412+0000","last_undegraded":"2023-11-24T08:02:27.869412+0000","last_fullsized":"2023-11-24T08:02:27.869412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:20.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852142+0000","last_change":"2023-11-24T08:02:26.841437+0000","last_active":"2023-11-24T08:02:27.852142+0000","last_peered":"2023-11-24T08:02:27.852142+0000","last_clean":"2023-11-24T08:02:27.852142+0000","last_became_active":"2023-11-24T08:02:26.841101+0000","last_became_peered":"2023-11-24T08:02:26.841101+0000","last_unstale":"2023-11-24T08:02:27.852142+0000","last_undegraded":"2023-11-24T08:02:27.852142+0000","last_fullsized":"2023-11-24T08:02:27.852142+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:19:21.245356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.859818+0000","last_change":"2023-11-24T08:02:27.854759+0000","last_active":"2023-11-24T08:02:27.859818+0000","last_peered":"2023-11-24T08:02:27.859818+0000","last_clean":"2023-11-24T08:02:27.859818+0000","last_became_active":"2023-11-24T08:02:27.854463+0000","last_became_peered":"2023-11-24T08:02:27.854463+0000","last_unstale":"2023-11-24T08:02:27.859818+0000","last_undegraded":"2023-11-24T08:02:27.859818+0000","last_fullsized":"2023-11-24T08:02:27.859818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871456+0000","last_change":"2023-11-24T08:02:26.837311+0000","last_active":"2023-11-24T08:02:27.871456+0000","last_peered":"2023-11-24T08:02:27.871456+0000","last_clean":"2023-11-24T08:02:27.871456+0000","last_became_active":"2023-11-24T08:02:26.836798+0000","last_became_peered":"2023-11-24T08:02:26.836798+0000","last_unstale":"2023-11-24T08:02:27.871456+0000","last_undegraded":"2023-11-24T08:02:27.871456+0000","last_fullsized":"2023-11-24T08:02:27.871456+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:17.818121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.821010+0000","last_change":"2023-11-24T08:02:26.821010+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.821010+0000","last_undegraded":"2023-11-24T08:02:26.821010+0000","last_fullsized":"2023-11-24T08:02:26.821010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847070+0000","last_change":"2023-11-24T08:02:26.846707+0000","last_active":"2023-11-24T08:02:27.847070+0000","last_peered":"2023-11-24T08:02:27.847070+0000","last_clean":"2023-11-24T08:02:27.847070+0000","last_became_active":"2023-11-24T08:02:26.846336+0000","last_became_peered":"2023-11-24T08:02:26.846336+0000","last_unstale":"2023-11-24T08:02:27.847070+0000","last_undegraded":"2023-11-24T08:02:27.847070+0000","last_fullsized":"2023-11-24T08:02:27.847070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.651309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.857927+0000","last_change":"2023-11-24T08:02:27.853113+0000","last_active":"2023-11-24T08:02:27.857927+0000","last_peered":"2023-11-24T08:02:27.857927+0000","last_clean":"2023-11-24T08:02:27.857927+0000","last_became_active":"2023-11-24T08:02:27.852792+0000","last_became_peered":"2023-11-24T08:02:27.852792+0000","last_unstale":"2023-11-24T08:02:27.857927+0000","last_undegraded":"2023-11-24T08:02:27.857927+0000","last_fullsized":"2023-11-24T08:02:27.857927+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:12.600997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846251+0000","last_change":"2023-11-24T08:02:26.841551+0000","last_active":"2023-11-24T08:02:26.846251+0000","last_peered":"2023-11-24T08:02:26.846251+0000","last_clean":"2023-11-24T08:02:26.846251+0000","last_became_active":"2023-11-24T08:02:26.840861+0000","last_became_peered":"2023-11-24T08:02:26.840861+0000","last_unstale":"2023-11-24T08:02:26.846251+0000","last_undegraded":"2023-11-24T08:02:26.846251+0000","last_fullsized":"2023-11-24T08:02:26.846251+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825895+0000","last_change":"2023-11-24T08:02:26.825895+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825895+0000","last_undegraded":"2023-11-24T08:02:26.825895+0000","last_fullsized":"2023-11-24T08:02:26.825895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851575+0000","last_change":"2023-11-24T08:02:26.831194+0000","last_active":"2023-11-24T08:02:27.851575+0000","last_peered":"2023-11-24T08:02:27.851575+0000","last_clean":"2023-11-24T08:02:27.851575+0000","last_became_active":"2023-11-24T08:02:26.830870+0000","last_became_peered":"2023-11-24T08:02:26.830870+0000","last_unstale":"2023-11-24T08:02:27.851575+0000","last_undegraded":"2023-11-24T08:02:27.851575+0000","last_fullsized":"2023-11-24T08:02:27.851575+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:28.971796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865587+0000","last_change":"2023-11-24T08:02:27.863129+0000","last_active":"2023-11-24T08:02:27.865587+0000","last_peered":"2023-11-24T08:02:27.865587+0000","last_clean":"2023-11-24T08:02:27.865587+0000","last_became_active":"2023-11-24T08:02:27.862818+0000","last_became_peered":"2023-11-24T08:02:27.862818+0000","last_unstale":"2023-11-24T08:02:27.865587+0000","last_undegraded":"2023-11-24T08:02:27.865587+0000","last_fullsized":"2023-11-24T08:02:27.865587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:44.172148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852960+0000","last_change":"2023-11-24T08:02:26.842429+0000","last_active":"2023-11-24T08:02:27.852960+0000","last_peered":"2023-11-24T08:02:27.852960+0000","last_clean":"2023-11-24T08:02:27.852960+0000","last_became_active":"2023-11-24T08:02:26.842153+0000","last_became_peered":"2023-11-24T08:02:26.842153+0000","last_unstale":"2023-11-24T08:02:27.852960+0000","last_undegraded":"2023-11-24T08:02:27.852960+0000","last_fullsized":"2023-11-24T08:02:27.852960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:35.629826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822712+0000","last_change":"2023-11-24T08:02:26.822712+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822712+0000","last_undegraded":"2023-11-24T08:02:26.822712+0000","last_fullsized":"2023-11-24T08:02:26.822712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.854493+0000","last_change":"2023-11-24T08:02:26.841087+0000","last_active":"2023-11-24T08:02:27.854493+0000","last_peered":"2023-11-24T08:02:27.854493+0000","last_clean":"2023-11-24T08:02:27.854493+0000","last_became_active":"2023-11-24T08:02:26.840807+0000","last_became_peered":"2023-11-24T08:02:26.840807+0000","last_unstale":"2023-11-24T08:02:27.854493+0000","last_undegraded":"2023-11-24T08:02:27.854493+0000","last_fullsized":"2023-11-24T08:02:27.854493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:59.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867833+0000","last_change":"2023-11-24T08:02:27.861891+0000","last_active":"2023-11-24T08:02:27.867833+0000","last_peered":"2023-11-24T08:02:27.867833+0000","last_clean":"2023-11-24T08:02:27.867833+0000","last_became_active":"2023-11-24T08:02:27.861391+0000","last_became_peered":"2023-11-24T08:02:27.861391+0000","last_unstale":"2023-11-24T08:02:27.867833+0000","last_undegraded":"2023-11-24T08:02:27.867833+0000","last_fullsized":"2023-11-24T08:02:27.867833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848396+0000","last_change":"2023-11-24T08:02:26.845613+0000","last_active":"2023-11-24T08:02:26.848396+0000","last_peered":"2023-11-24T08:02:26.848396+0000","last_clean":"2023-11-24T08:02:26.848396+0000","last_became_active":"2023-11-24T08:02:26.845190+0000","last_became_peered":"2023-11-24T08:02:26.845190+0000","last_unstale":"2023-11-24T08:02:26.848396+0000","last_undegraded":"2023-11-24T08:02:26.848396+0000","last_fullsized":"2023-11-24T08:02:26.848396+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:11:34.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876976+0000","last_change":"2023-11-24T08:02:27.874289+0000","last_active":"2023-11-24T08:02:27.876976+0000","last_peered":"2023-11-24T08:02:27.876976+0000","last_clean":"2023-11-24T08:02:27.876976+0000","last_became_active":"2023-11-24T08:02:27.873177+0000","last_became_peered":"2023-11-24T08:02:27.873177+0000","last_unstale":"2023-11-24T08:02:27.876976+0000","last_undegraded":"2023-11-24T08:02:27.876976+0000","last_fullsized":"2023-11-24T08:02:27.876976+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852098+0000","last_change":"2023-11-24T08:02:26.840761+0000","last_active":"2023-11-24T08:02:27.852098+0000","last_peered":"2023-11-24T08:02:27.852098+0000","last_clean":"2023-11-24T08:02:27.852098+0000","last_became_active":"2023-11-24T08:02:26.838173+0000","last_became_peered":"2023-11-24T08:02:26.838173+0000","last_unstale":"2023-11-24T08:02:27.852098+0000","last_undegraded":"2023-11-24T08:02:27.852098+0000","last_fullsized":"2023-11-24T08:02:27.852098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876091+0000","last_change":"2023-11-24T08:02:27.865925+0000","last_active":"2023-11-24T08:02:27.876091+0000","last_peered":"2023-11-24T08:02:27.876091+0000","last_clean":"2023-11-24T08:02:27.876091+0000","last_became_active":"2023-11-24T08:02:27.865643+0000","last_became_peered":"2023-11-24T08:02:27.865643+0000","last_unstale":"2023-11-24T08:02:27.876091+0000","last_undegraded":"2023-11-24T08:02:27.876091+0000","last_fullsized":"2023-11-24T08:02:27.876091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:00.868558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846408+0000","last_change":"2023-11-24T08:02:26.842216+0000","last_active":"2023-11-24T08:02:26.846408+0000","last_peered":"2023-11-24T08:02:26.846408+0000","last_clean":"2023-11-24T08:02:26.846408+0000","last_became_active":"2023-11-24T08:02:26.841172+0000","last_became_peered":"2023-11-24T08:02:26.841172+0000","last_unstale":"2023-11-24T08:02:26.846408+0000","last_undegraded":"2023-11-24T08:02:26.846408+0000","last_fullsized":"2023-11-24T08:02:26.846408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871968+0000","last_change":"2023-11-24T08:02:27.866805+0000","last_active":"2023-11-24T08:02:27.871968+0000","last_peered":"2023-11-24T08:02:27.871968+0000","last_clean":"2023-11-24T08:02:27.871968+0000","last_became_active":"2023-11-24T08:02:27.866254+0000","last_became_peered":"2023-11-24T08:02:27.866254+0000","last_unstale":"2023-11-24T08:02:27.871968+0000","last_undegraded":"2023-11-24T08:02:27.871968+0000","last_fullsized":"2023-11-24T08:02:27.871968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:55:47.185739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845567+0000","last_change":"2023-11-24T08:02:26.837671+0000","last_active":"2023-11-24T08:02:26.845567+0000","last_peered":"2023-11-24T08:02:26.845567+0000","last_clean":"2023-11-24T08:02:26.845567+0000","last_became_active":"2023-11-24T08:02:26.837141+0000","last_became_peered":"2023-11-24T08:02:26.837141+0000","last_unstale":"2023-11-24T08:02:26.845567+0000","last_undegraded":"2023-11-24T08:02:26.845567+0000","last_fullsized":"2023-11-24T08:02:26.845567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:02.489853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823776+0000","last_change":"2023-11-24T08:02:26.823776+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823776+0000","last_undegraded":"2023-11-24T08:02:26.823776+0000","last_fullsized":"2023-11-24T08:02:26.823776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840559+0000","last_change":"2023-11-24T08:02:26.834763+0000","last_active":"2023-11-24T08:02:26.840559+0000","last_peered":"2023-11-24T08:02:26.840559+0000","last_clean":"2023-11-24T08:02:26.840559+0000","last_became_active":"2023-11-24T08:02:26.834426+0000","last_became_peered":"2023-11-24T08:02:26.834426+0000","last_unstale":"2023-11-24T08:02:26.840559+0000","last_undegraded":"2023-11-24T08:02:26.840559+0000","last_fullsized":"2023-11-24T08:02:26.840559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823658+0000","last_change":"2023-11-24T08:02:26.823658+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823658+0000","last_undegraded":"2023-11-24T08:02:26.823658+0000","last_fullsized":"2023-11-24T08:02:26.823658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873697+0000","last_change":"2023-11-24T08:02:26.843331+0000","last_active":"2023-11-24T08:02:27.873697+0000","last_peered":"2023-11-24T08:02:27.873697+0000","last_clean":"2023-11-24T08:02:27.873697+0000","last_became_active":"2023-11-24T08:02:26.843044+0000","last_became_peered":"2023-11-24T08:02:26.843044+0000","last_unstale":"2023-11-24T08:02:27.873697+0000","last_undegraded":"2023-11-24T08:02:27.873697+0000","last_fullsized":"2023-11-24T08:02:27.873697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.820974+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:02:26.820974+0000","last_peered":"2023-11-24T08:02:26.820974+0000","last_clean":"2023-11-24T08:02:26.820974+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:02:26.820974+0000","last_undegraded":"2023-11-24T08:02:26.820974+0000","last_fullsized":"2023-11-24T08:02:26.820974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":805519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.113,"15min":1.133},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.5229999999999999,"5min":1.72,"15min":1.72},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.70599999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1830000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.159,"15min":1.161},"min":{"1min":0.79800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5229999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5389999999999999,"5min":2.02,"15min":2.02},"last":1.087}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3759999999999999,"15min":1.383},"min":{"1min":1.0029999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6319999999999999,"5min":1.944,"15min":1.944},"last":1.5189999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1619999999999999,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6000000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.405,"15min":1.411},"min":{"1min":0.94599999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4079999999999999,"15min":1.4139999999999999},"min":{"1min":0.98499999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3300000000000001,"15min":1.3129999999999999},"min":{"1min":0.98399999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.774,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5569999999999999,"15min":1.5620000000000001},"min":{"1min":1.2669999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7609999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.595},{"interface":"front","average":{"1min":1.552,"5min":1.542,"15min":1.54},"min":{"1min":1.085,"5min":1.01,"15min":1.01},"max":{"1min":1.881,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.4319999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.6160000000000001,"15min":1.609},"min":{"1min":1.2210000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.141,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.5349999999999999,"15min":1.5269999999999999},"min":{"1min":1.2529999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.839,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":215733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.72199999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1970000000000001,"15min":1.1950000000000001},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.238,"15min":1.244},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5109999999999999,"5min":2.597,"15min":2.597},"last":1.5600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2390000000000001,"15min":1.2589999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.623,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.29},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.706,"5min":2.831,"15min":2.831},"last":1.468}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.294,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.605,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.3360000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3879999999999999,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.873},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4019999999999999,"15min":1.4119999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5920000000000001,"15min":1.5960000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.163},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.546,"15min":1.54},"min":{"1min":1.016,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.226}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.6060000000000001,"15min":1.6180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9159999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.28},{"interface":"front","average":{"1min":1.649,"5min":1.6020000000000001,"15min":1.5940000000000001},"min":{"1min":1.202,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.444}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.72,"5min":2.431,"15min":2.431},"last":1.446},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0640000000000001,"15min":1.056},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5149999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4139999999999999,"5min":1.768,"15min":1.768},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.335,"15min":1.351},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6339999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.339,"15min":1.373},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7789999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7569999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.4359999999999999},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.569,"15min":2.569},"last":1.232},{"interface":"front","average":{"1min":1.361,"5min":1.5129999999999999,"15min":1.538},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.121}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.665,"15min":1.7130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.96,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.577},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.113},"last":1.3400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":215699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.383,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.50900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.3480000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0369999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.486,"5min":1.601,"15min":1.601},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.998},"min":{"1min":0.59699999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.526,"5min":1.569,"15min":1.569},"last":1.1910000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.111,"15min":1.105},"min":{"1min":0.75700000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5429999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.1799999999999999},"min":{"1min":0.77500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.272}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.288,"15min":1.2789999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.482},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2470000000000001,"15min":1.2450000000000001},"min":{"1min":0.77400000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2370000000000001,"15min":1.24},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6699999999999999,"5min":1.861,"15min":1.861},"last":1.52},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3680000000000001,"15min":1.3640000000000001},"min":{"1min":0.91000000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.921,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.389}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.294},"min":{"1min":0.76800000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.262},"min":{"1min":0.85499999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.746,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5780000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":216695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.41899999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.27,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.526,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":3.343}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.504,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.113,"15min":1.137},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3089999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":2.3479999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96599999999999997,"15min":0.97099999999999997},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.236,"5min":1.637,"15min":1.637},"last":7.5670000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.409,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":2.3980000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.794,"5min":6.452,"15min":6.452},"last":7.0119999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.548,"15min":1.581},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7370000000000001,"5min":6.306,"15min":6.306},"last":7.0609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.5189999999999999,"15min":1.5369999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7889999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.296,"15min":1.3069999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.708,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":12.798}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.381,"15min":1.3879999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.857,"5min":2.069,"15min":2.069},"last":7.6200000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.577,"15min":1.6160000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8779999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.786,"5min":1.948,"15min":1.948},"last":7.4539999999999997},{"interface":"front","average":{"1min":1.454,"5min":1.5900000000000001,"15min":1.6120000000000001},"min":{"1min":0.93200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.921,"5min":6.399,"15min":6.399},"last":1.538}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.60199999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.629,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.099,"15min":1.1200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.536,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1639999999999999,"15min":1.159},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8340000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.23},{"interface":"front","average":{"1min":1.145,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.51,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.3009999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3959999999999999,"5min":1.518,"15min":1.518},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.4279999999999999,"15min":1.446},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.794,"5min":1.966,"15min":1.966},"last":1.488}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8420000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.611},{"interface":"front","average":{"1min":1.282,"5min":1.4059999999999999,"15min":1.4259999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8959999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.044}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.492,"15min":1.508},"min":{"1min":1.0609999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.056,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.532,"15min":1.52},"min":{"1min":1.149,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.986,"5min":2.073,"15min":2.073},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5549999999999999,"15min":1.5640000000000001},"min":{"1min":1.1519999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7589999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.6000000000000001,"15min":1.6240000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.968,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.5309999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.6080000000000001,"15min":1.6120000000000001},"min":{"1min":1.208,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.897,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6870000000000001,"15min":1.706},"min":{"1min":1.262,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0099999999999998,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.4079999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.40100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5109999999999999,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":1.012},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":3.266,"15min":3.266},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1819999999999999,"15min":1.196},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5780000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.216},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.597,"5min":1.976,"15min":1.976},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.4710000000000001,"15min":1.5189999999999999},"min":{"1min":0.73099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1139999999999999,"5min":4.367,"15min":4.367},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.4370000000000001,"15min":1.4550000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8939999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.3420000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.5289999999999999,"15min":1.583},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6890000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4830000000000001,"15min":1.5029999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7170000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.155}]},{"osd":6,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.9570000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.256},{"interface":"front","average":{"1min":1.419,"5min":1.639,"15min":1.675},"min":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0059999999999998,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.234}]},{"osd":7,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8220000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.657,"15min":1.704},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0739999999999998,"5min":4.452,"15min":4.452},"last":1.1830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":798654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0660000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1299999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.876,"5min":1.0149999999999999,"15min":1.038},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.466,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.04,"15min":1.046},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.512,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.284},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.622,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5600000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6459999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2170000000000001,"15min":1.2250000000000001},"min":{"1min":0.91900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.431,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.544},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6439999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.0569999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.476,"15min":1.5089999999999999},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.895,"5min":2.839,"15min":2.839},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3660000000000001,"15min":1.3879999999999999},"min":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5389999999999999,"5min":2.823,"15min":2.823},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.72,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86499999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0539999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.337}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1480000000000001,"5min":2.875,"15min":2.875},"last":1.476},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.776,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:02:32.800 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:02:33.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.055+0000 7efc9897a640 1 Processor -- start 2023-11-24T08:02:33.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.055+0000 7efc9897a640 1 -- start start 2023-11-24T08:02:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc9897a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc94143c40 0x7efc94071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc9897a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc940ccc10 0x7efc9406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc9897a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc94070e50 con 0x7efc940717d0 2023-11-24T08:02:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc9897a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc940723c0 con 0x7efc94143c40 2023-11-24T08:02:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc9897a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc94144020 con 0x7efc940ccc10 2023-11-24T08:02:33.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc937fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc94143c40 0x7efc94071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc8bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efc940717d0 0x7efc940cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34460/0 (socket says 172.21.15.161:34460) 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc8bfff640 1 -- 172.21.15.161:0/2872261648 learned_addr learned my addr 172.21.15.161:0/2872261648 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc937fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efc94143c40 0x7efc94071290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53942/0 (socket says 172.21.15.161:53942) 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.057+0000 7efc93fff640 1 --2- 172.21.15.161:0/2872261648 >> v2:172.21.15.175:3300/0 conn(0x7efc940ccc10 0x7efc9406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.058+0000 7efc937fe640 1 -- 172.21.15.161:0/2872261648 >> v2:172.21.15.175:3300/0 conn(0x7efc940ccc10 msgr2=0x7efc9406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.058+0000 7efc937fe640 1 --2- 172.21.15.161:0/2872261648 >> v2:172.21.15.175:3300/0 conn(0x7efc940ccc10 0x7efc9406d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.058+0000 7efc937fe640 1 -- 172.21.15.161:0/2872261648 >> v1:172.21.15.161:6789/0 conn(0x7efc940717d0 legacy=0x7efc940cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.058+0000 7efc937fe640 1 -- 172.21.15.161:0/2872261648 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94071e00 con 0x7efc94143c40 2023-11-24T08:02:33.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.058+0000 7efc92ffd640 1 -- 172.21.15.161:0/2872261648 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065554777 0 0) 0x7efc94070e50 con 0x7efc940717d0 2023-11-24T08:02:33.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.058+0000 7efc93fff640 1 --2- 172.21.15.161:0/2872261648 >> v2:172.21.15.175:3300/0 conn(0x7efc940ccc10 0x7efc9406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:33.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.059+0000 7efc937fe640 1 --2- 172.21.15.161:0/2872261648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc94143c40 0x7efc94071290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efc94070690 tx=0x7efc8402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a11d6f12a4a3b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:33.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.059+0000 7efc92ffd640 1 -- 172.21.15.161:0/2872261648 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8402e070 con 0x7efc94143c40 2023-11-24T08:02:33.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.059+0000 7efc92ffd640 1 -- 172.21.15.161:0/2872261648 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc840315a0 con 0x7efc94143c40 2023-11-24T08:02:33.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.059+0000 7efc92ffd640 1 -- 172.21.15.161:0/2872261648 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc84031930 con 0x7efc94143c40 2023-11-24T08:02:33.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.059+0000 7efc9897a640 1 -- 172.21.15.161:0/2872261648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc94143c40 msgr2=0x7efc94071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.059+0000 7efc9897a640 1 --2- 172.21.15.161:0/2872261648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc94143c40 0x7efc94071290 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7efc94070690 tx=0x7efc8402b840 comp rx=0 tx=0).stop 2023-11-24T08:02:33.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.060+0000 7efc9897a640 1 -- 172.21.15.161:0/2872261648 shutdown_connections 2023-11-24T08:02:33.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.060+0000 7efc9897a640 1 --2- 172.21.15.161:0/2872261648 >> v2:172.21.15.175:3300/0 conn(0x7efc940ccc10 0x7efc9406d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.060+0000 7efc9897a640 1 --2- 172.21.15.161:0/2872261648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc94143c40 0x7efc94071290 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.060+0000 7efc9897a640 1 -- 172.21.15.161:0/2872261648 >> 172.21.15.161:0/2872261648 conn(0x7efc9406a800 msgr2=0x7efc9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:33.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.060+0000 7efc9897a640 1 -- 172.21.15.161:0/2872261648 shutdown_connections 2023-11-24T08:02:33.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.060+0000 7efc9897a640 1 -- 172.21.15.161:0/2872261648 wait complete. 2023-11-24T08:02:33.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.061+0000 7efc9897a640 1 Processor -- start 2023-11-24T08:02:33.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.062+0000 7efc9897a640 1 -- start start 2023-11-24T08:02:33.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.062+0000 7efc9897a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc940717d0 0x7efc941e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.062+0000 7efc9897a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 0x7efc9413dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc9897a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc94143c40 0x7efc941e0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc9897a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941e1a60 con 0x7efc940ccc10 2023-11-24T08:02:33.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc9897a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc941e0de0 con 0x7efc940717d0 2023-11-24T08:02:33.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc9897a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc941e10c0 con 0x7efc94143c40 2023-11-24T08:02:33.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 0x7efc9413dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 0x7efc9413dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53952/0 (socket says 172.21.15.161:53952) 2023-11-24T08:02:33.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 -- 172.21.15.161:0/3026714768 learned_addr learned my addr 172.21.15.161:0/3026714768 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 -- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc94143c40 msgr2=0x7efc941e0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc93fff640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc94143c40 0x7efc941e0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc937fe640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc940717d0 0x7efc941e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc94143c40 0x7efc941e0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 -- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc940717d0 msgr2=0x7efc941e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc940717d0 0x7efc941e1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.063+0000 7efc8bfff640 1 -- 172.21.15.161:0/3026714768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc84009400 con 0x7efc940ccc10 2023-11-24T08:02:33.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.064+0000 7efc8bfff640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 0x7efc9413dbe0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00c430 tx=0x7efc7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:33.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.064+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0074e0 con 0x7efc940ccc10 2023-11-24T08:02:33.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.064+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c007660 con 0x7efc940ccc10 2023-11-24T08:02:33.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.064+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c004a20 con 0x7efc940ccc10 2023-11-24T08:02:33.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.064+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc941e13a0 con 0x7efc940ccc10 2023-11-24T08:02:33.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.064+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc941e23c0 con 0x7efc940ccc10 2023-11-24T08:02:33.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.065+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc941e1ba0 con 0x7efc940ccc10 2023-11-24T08:02:33.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.066+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efc7c004b80 con 0x7efc940ccc10 2023-11-24T08:02:33.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.067+0000 7efc90ff9640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc7406aff0 0x7efc7406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.067+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc7c0896d0 con 0x7efc940ccc10 2023-11-24T08:02:33.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.067+0000 7efc937fe640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc7406aff0 0x7efc7406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.069+0000 7efc937fe640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc7406aff0 0x7efc7406d4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efc84036000 tx=0x7efc8403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:33.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.071+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc941e1ba0 con 0x7efc940ccc10 2023-11-24T08:02:33.263 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.261+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc9406cc40 con 0x7efc7406aff0 2023-11-24T08:02:33.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.284+0000 7efc90ff9640 1 -- 172.21.15.161:0/3026714768 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7efc84031b10 con 0x7efc7406aff0 2023-11-24T08:02:33.290 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:33.292 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:02:33.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc7406aff0 msgr2=0x7efc7406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc7406aff0 0x7efc7406d4b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7efc84036000 tx=0x7efc8403d040 comp rx=0 tx=0).stop 2023-11-24T08:02:33.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 msgr2=0x7efc9413dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 0x7efc9413dbe0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7efc7c00c430 tx=0x7efc7c00c8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 shutdown_connections 2023-11-24T08:02:33.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efc7406aff0 0x7efc7406d4b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc94143c40 0x7efc941e0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efc940ccc10 0x7efc9413dbe0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 --2- 172.21.15.161:0/3026714768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc940717d0 0x7efc941e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 >> 172.21.15.161:0/3026714768 conn(0x7efc9406a800 msgr2=0x7efc9406d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:33.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 shutdown_connections 2023-11-24T08:02:33.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.289+0000 7efc9897a640 1 -- 172.21.15.161:0/3026714768 wait complete. 2023-11-24T08:02:33.311 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-11-24T08:02:32.570870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229848,"kb_used_data":5328,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744872,"statfs":{"total":773094113280,"available":772858748928,"internally_reserved":0,"allocated":5455872,"data_stored":2884003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001807"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.874263+0000","last_change":"2023-11-24T08:02:27.871772+0000","last_active":"2023-11-24T08:02:27.874263+0000","last_peered":"2023-11-24T08:02:27.874263+0000","last_clean":"2023-11-24T08:02:27.874263+0000","last_became_active":"2023-11-24T08:02:27.871437+0000","last_became_peered":"2023-11-24T08:02:27.871437+0000","last_unstale":"2023-11-24T08:02:27.874263+0000","last_undegraded":"2023-11-24T08:02:27.874263+0000","last_fullsized":"2023-11-24T08:02:27.874263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.875065+0000","last_change":"2023-11-24T08:02:27.872430+0000","last_active":"2023-11-24T08:02:27.875065+0000","last_peered":"2023-11-24T08:02:27.875065+0000","last_clean":"2023-11-24T08:02:27.875065+0000","last_became_active":"2023-11-24T08:02:27.872092+0000","last_became_peered":"2023-11-24T08:02:27.872092+0000","last_unstale":"2023-11-24T08:02:27.875065+0000","last_undegraded":"2023-11-24T08:02:27.875065+0000","last_fullsized":"2023-11-24T08:02:27.875065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:44.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831030+0000","last_change":"2023-11-24T08:02:26.831030+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831030+0000","last_undegraded":"2023-11-24T08:02:26.831030+0000","last_fullsized":"2023-11-24T08:02:26.831030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823208+0000","last_change":"2023-11-24T08:02:26.823208+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823208+0000","last_undegraded":"2023-11-24T08:02:26.823208+0000","last_fullsized":"2023-11-24T08:02:26.823208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869710+0000","last_change":"2023-11-24T08:02:27.863517+0000","last_active":"2023-11-24T08:02:27.869710+0000","last_peered":"2023-11-24T08:02:27.869710+0000","last_clean":"2023-11-24T08:02:27.869710+0000","last_became_active":"2023-11-24T08:02:27.863182+0000","last_became_peered":"2023-11-24T08:02:27.863182+0000","last_unstale":"2023-11-24T08:02:27.869710+0000","last_undegraded":"2023-11-24T08:02:27.869710+0000","last_fullsized":"2023-11-24T08:02:27.869710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:21:38.345681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876266+0000","last_change":"2023-11-24T08:02:27.867782+0000","last_active":"2023-11-24T08:02:27.876266+0000","last_peered":"2023-11-24T08:02:27.876266+0000","last_clean":"2023-11-24T08:02:27.876266+0000","last_became_active":"2023-11-24T08:02:27.867526+0000","last_became_peered":"2023-11-24T08:02:27.867526+0000","last_unstale":"2023-11-24T08:02:27.876266+0000","last_undegraded":"2023-11-24T08:02:27.876266+0000","last_fullsized":"2023-11-24T08:02:27.876266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871698+0000","last_change":"2023-11-24T08:02:27.869161+0000","last_active":"2023-11-24T08:02:27.871698+0000","last_peered":"2023-11-24T08:02:27.871698+0000","last_clean":"2023-11-24T08:02:27.871698+0000","last_became_active":"2023-11-24T08:02:27.868873+0000","last_became_peered":"2023-11-24T08:02:27.868873+0000","last_unstale":"2023-11-24T08:02:27.871698+0000","last_undegraded":"2023-11-24T08:02:27.871698+0000","last_fullsized":"2023-11-24T08:02:27.871698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.827349+0000","last_change":"2023-11-24T08:02:26.827349+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.827349+0000","last_undegraded":"2023-11-24T08:02:26.827349+0000","last_fullsized":"2023-11-24T08:02:26.827349+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823243+0000","last_change":"2023-11-24T08:02:26.823243+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823243+0000","last_undegraded":"2023-11-24T08:02:26.823243+0000","last_fullsized":"2023-11-24T08:02:26.823243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824006+0000","last_change":"2023-11-24T08:02:26.824006+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824006+0000","last_undegraded":"2023-11-24T08:02:26.824006+0000","last_fullsized":"2023-11-24T08:02:26.824006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822800+0000","last_change":"2023-11-24T08:02:26.822800+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822800+0000","last_undegraded":"2023-11-24T08:02:26.822800+0000","last_fullsized":"2023-11-24T08:02:26.822800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869618+0000","last_change":"2023-11-24T08:02:27.862671+0000","last_active":"2023-11-24T08:02:27.869618+0000","last_peered":"2023-11-24T08:02:27.869618+0000","last_clean":"2023-11-24T08:02:27.869618+0000","last_became_active":"2023-11-24T08:02:27.862402+0000","last_became_peered":"2023-11-24T08:02:27.862402+0000","last_unstale":"2023-11-24T08:02:27.869618+0000","last_undegraded":"2023-11-24T08:02:27.869618+0000","last_fullsized":"2023-11-24T08:02:27.869618+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.459268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867561+0000","last_change":"2023-11-24T08:02:27.864236+0000","last_active":"2023-11-24T08:02:27.867561+0000","last_peered":"2023-11-24T08:02:27.867561+0000","last_clean":"2023-11-24T08:02:27.867561+0000","last_became_active":"2023-11-24T08:02:27.863978+0000","last_became_peered":"2023-11-24T08:02:27.863978+0000","last_unstale":"2023-11-24T08:02:27.867561+0000","last_undegraded":"2023-11-24T08:02:27.867561+0000","last_fullsized":"2023-11-24T08:02:27.867561+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:46:35.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825063+0000","last_change":"2023-11-24T08:02:26.825063+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825063+0000","last_undegraded":"2023-11-24T08:02:26.825063+0000","last_fullsized":"2023-11-24T08:02:26.825063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877085+0000","last_change":"2023-11-24T08:02:27.874356+0000","last_active":"2023-11-24T08:02:27.877085+0000","last_peered":"2023-11-24T08:02:27.877085+0000","last_clean":"2023-11-24T08:02:27.877085+0000","last_became_active":"2023-11-24T08:02:27.872255+0000","last_became_peered":"2023-11-24T08:02:27.872255+0000","last_unstale":"2023-11-24T08:02:27.877085+0000","last_undegraded":"2023-11-24T08:02:27.877085+0000","last_fullsized":"2023-11-24T08:02:27.877085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.862012+0000","last_change":"2023-11-24T08:02:27.856951+0000","last_active":"2023-11-24T08:02:27.862012+0000","last_peered":"2023-11-24T08:02:27.862012+0000","last_clean":"2023-11-24T08:02:27.862012+0000","last_became_active":"2023-11-24T08:02:27.856675+0000","last_became_peered":"2023-11-24T08:02:27.856675+0000","last_unstale":"2023-11-24T08:02:27.862012+0000","last_undegraded":"2023-11-24T08:02:27.862012+0000","last_fullsized":"2023-11-24T08:02:27.862012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:18.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829418+0000","last_change":"2023-11-24T08:02:26.829418+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829418+0000","last_undegraded":"2023-11-24T08:02:26.829418+0000","last_fullsized":"2023-11-24T08:02:26.829418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832463+0000","last_change":"2023-11-24T08:02:26.832463+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832463+0000","last_undegraded":"2023-11-24T08:02:26.832463+0000","last_fullsized":"2023-11-24T08:02:26.832463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877527+0000","last_change":"2023-11-24T08:02:27.873342+0000","last_active":"2023-11-24T08:02:27.877527+0000","last_peered":"2023-11-24T08:02:27.877527+0000","last_clean":"2023-11-24T08:02:27.877527+0000","last_became_active":"2023-11-24T08:02:27.873093+0000","last_became_peered":"2023-11-24T08:02:27.873093+0000","last_unstale":"2023-11-24T08:02:27.877527+0000","last_undegraded":"2023-11-24T08:02:27.877527+0000","last_fullsized":"2023-11-24T08:02:27.877527+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:17.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867019+0000","last_change":"2023-11-24T08:02:27.862475+0000","last_active":"2023-11-24T08:02:27.867019+0000","last_peered":"2023-11-24T08:02:27.867019+0000","last_clean":"2023-11-24T08:02:27.867019+0000","last_became_active":"2023-11-24T08:02:27.862160+0000","last_became_peered":"2023-11-24T08:02:27.862160+0000","last_unstale":"2023-11-24T08:02:27.867019+0000","last_undegraded":"2023-11-24T08:02:27.867019+0000","last_fullsized":"2023-11-24T08:02:27.867019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876068+0000","last_change":"2023-11-24T08:02:27.865613+0000","last_active":"2023-11-24T08:02:27.876068+0000","last_peered":"2023-11-24T08:02:27.876068+0000","last_clean":"2023-11-24T08:02:27.876068+0000","last_became_active":"2023-11-24T08:02:27.864621+0000","last_became_peered":"2023-11-24T08:02:27.864621+0000","last_unstale":"2023-11-24T08:02:27.876068+0000","last_undegraded":"2023-11-24T08:02:27.876068+0000","last_fullsized":"2023-11-24T08:02:27.876068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824672+0000","last_change":"2023-11-24T08:02:26.824672+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824672+0000","last_undegraded":"2023-11-24T08:02:26.824672+0000","last_fullsized":"2023-11-24T08:02:26.824672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861911+0000","last_change":"2023-11-24T08:02:27.859022+0000","last_active":"2023-11-24T08:02:27.861911+0000","last_peered":"2023-11-24T08:02:27.861911+0000","last_clean":"2023-11-24T08:02:27.861911+0000","last_became_active":"2023-11-24T08:02:27.857661+0000","last_became_peered":"2023-11-24T08:02:27.857661+0000","last_unstale":"2023-11-24T08:02:27.861911+0000","last_undegraded":"2023-11-24T08:02:27.861911+0000","last_fullsized":"2023-11-24T08:02:27.861911+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.860875+0000","last_change":"2023-11-24T08:02:27.853340+0000","last_active":"2023-11-24T08:02:27.860875+0000","last_peered":"2023-11-24T08:02:27.860875+0000","last_clean":"2023-11-24T08:02:27.860875+0000","last_became_active":"2023-11-24T08:02:27.853026+0000","last_became_peered":"2023-11-24T08:02:27.853026+0000","last_unstale":"2023-11-24T08:02:27.860875+0000","last_undegraded":"2023-11-24T08:02:27.860875+0000","last_fullsized":"2023-11-24T08:02:27.860875+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869711+0000","last_change":"2023-11-24T08:02:27.867235+0000","last_active":"2023-11-24T08:02:27.869711+0000","last_peered":"2023-11-24T08:02:27.869711+0000","last_clean":"2023-11-24T08:02:27.869711+0000","last_became_active":"2023-11-24T08:02:27.866892+0000","last_became_peered":"2023-11-24T08:02:27.866892+0000","last_unstale":"2023-11-24T08:02:27.869711+0000","last_undegraded":"2023-11-24T08:02:27.869711+0000","last_fullsized":"2023-11-24T08:02:27.869711+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:36.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872468+0000","last_change":"2023-11-24T08:02:27.870150+0000","last_active":"2023-11-24T08:02:27.872468+0000","last_peered":"2023-11-24T08:02:27.872468+0000","last_clean":"2023-11-24T08:02:27.872468+0000","last_became_active":"2023-11-24T08:02:27.869895+0000","last_became_peered":"2023-11-24T08:02:27.869895+0000","last_unstale":"2023-11-24T08:02:27.872468+0000","last_undegraded":"2023-11-24T08:02:27.872468+0000","last_fullsized":"2023-11-24T08:02:27.872468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824828+0000","last_change":"2023-11-24T08:02:26.824828+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824828+0000","last_undegraded":"2023-11-24T08:02:26.824828+0000","last_fullsized":"2023-11-24T08:02:26.824828+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871556+0000","last_change":"2023-11-24T08:02:27.865353+0000","last_active":"2023-11-24T08:02:27.871556+0000","last_peered":"2023-11-24T08:02:27.871556+0000","last_clean":"2023-11-24T08:02:27.871556+0000","last_became_active":"2023-11-24T08:02:27.865086+0000","last_became_peered":"2023-11-24T08:02:27.865086+0000","last_unstale":"2023-11-24T08:02:27.871556+0000","last_undegraded":"2023-11-24T08:02:27.871556+0000","last_fullsized":"2023-11-24T08:02:27.871556+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:29.982443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865525+0000","last_change":"2023-11-24T08:02:27.863455+0000","last_active":"2023-11-24T08:02:27.865525+0000","last_peered":"2023-11-24T08:02:27.865525+0000","last_clean":"2023-11-24T08:02:27.865525+0000","last_became_active":"2023-11-24T08:02:27.863097+0000","last_became_peered":"2023-11-24T08:02:27.863097+0000","last_unstale":"2023-11-24T08:02:27.865525+0000","last_undegraded":"2023-11-24T08:02:27.865525+0000","last_fullsized":"2023-11-24T08:02:27.865525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:27.501200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832977+0000","last_change":"2023-11-24T08:02:26.832977+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832977+0000","last_undegraded":"2023-11-24T08:02:26.832977+0000","last_fullsized":"2023-11-24T08:02:26.832977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876882+0000","last_change":"2023-11-24T08:02:27.871959+0000","last_active":"2023-11-24T08:02:27.876882+0000","last_peered":"2023-11-24T08:02:27.876882+0000","last_clean":"2023-11-24T08:02:27.876882+0000","last_became_active":"2023-11-24T08:02:27.871685+0000","last_became_peered":"2023-11-24T08:02:27.871685+0000","last_unstale":"2023-11-24T08:02:27.876882+0000","last_undegraded":"2023-11-24T08:02:27.876882+0000","last_fullsized":"2023-11-24T08:02:27.876882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873165+0000","last_change":"2023-11-24T08:02:27.868750+0000","last_active":"2023-11-24T08:02:27.873165+0000","last_peered":"2023-11-24T08:02:27.873165+0000","last_clean":"2023-11-24T08:02:27.873165+0000","last_became_active":"2023-11-24T08:02:27.865780+0000","last_became_peered":"2023-11-24T08:02:27.865780+0000","last_unstale":"2023-11-24T08:02:27.873165+0000","last_undegraded":"2023-11-24T08:02:27.873165+0000","last_fullsized":"2023-11-24T08:02:27.873165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:53.929316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822134+0000","last_change":"2023-11-24T08:02:26.822134+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822134+0000","last_undegraded":"2023-11-24T08:02:26.822134+0000","last_fullsized":"2023-11-24T08:02:26.822134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878053+0000","last_change":"2023-11-24T08:02:26.843012+0000","last_active":"2023-11-24T08:02:27.878053+0000","last_peered":"2023-11-24T08:02:27.878053+0000","last_clean":"2023-11-24T08:02:27.878053+0000","last_became_active":"2023-11-24T08:02:26.842339+0000","last_became_peered":"2023-11-24T08:02:26.842339+0000","last_unstale":"2023-11-24T08:02:27.878053+0000","last_undegraded":"2023-11-24T08:02:27.878053+0000","last_fullsized":"2023-11-24T08:02:27.878053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:30.575544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851294+0000","last_change":"2023-11-24T08:02:27.850153+0000","last_active":"2023-11-24T08:02:27.851294+0000","last_peered":"2023-11-24T08:02:27.851294+0000","last_clean":"2023-11-24T08:02:27.851294+0000","last_became_active":"2023-11-24T08:02:27.849283+0000","last_became_peered":"2023-11-24T08:02:27.849283+0000","last_unstale":"2023-11-24T08:02:27.851294+0000","last_undegraded":"2023-11-24T08:02:27.851294+0000","last_fullsized":"2023-11-24T08:02:27.851294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:16.249245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.842510+0000","last_change":"2023-11-24T08:02:26.838582+0000","last_active":"2023-11-24T08:02:26.842510+0000","last_peered":"2023-11-24T08:02:26.842510+0000","last_clean":"2023-11-24T08:02:26.842510+0000","last_became_active":"2023-11-24T08:02:26.838273+0000","last_became_peered":"2023-11-24T08:02:26.838273+0000","last_unstale":"2023-11-24T08:02:26.842510+0000","last_undegraded":"2023-11-24T08:02:26.842510+0000","last_fullsized":"2023-11-24T08:02:26.842510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872589+0000","last_change":"2023-11-24T08:02:27.868436+0000","last_active":"2023-11-24T08:02:27.872589+0000","last_peered":"2023-11-24T08:02:27.872589+0000","last_clean":"2023-11-24T08:02:27.872589+0000","last_became_active":"2023-11-24T08:02:27.868148+0000","last_became_peered":"2023-11-24T08:02:27.868148+0000","last_unstale":"2023-11-24T08:02:27.872589+0000","last_undegraded":"2023-11-24T08:02:27.872589+0000","last_fullsized":"2023-11-24T08:02:27.872589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.272222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848361+0000","last_change":"2023-11-24T08:02:26.845023+0000","last_active":"2023-11-24T08:02:26.848361+0000","last_peered":"2023-11-24T08:02:26.848361+0000","last_clean":"2023-11-24T08:02:26.848361+0000","last_became_active":"2023-11-24T08:02:26.844504+0000","last_became_peered":"2023-11-24T08:02:26.844504+0000","last_unstale":"2023-11-24T08:02:26.848361+0000","last_undegraded":"2023-11-24T08:02:26.848361+0000","last_fullsized":"2023-11-24T08:02:26.848361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:34.764747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818355+0000","last_change":"2023-11-24T08:02:26.818355+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818355+0000","last_undegraded":"2023-11-24T08:02:26.818355+0000","last_fullsized":"2023-11-24T08:02:26.818355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867513+0000","last_change":"2023-11-24T08:02:26.840493+0000","last_active":"2023-11-24T08:02:27.867513+0000","last_peered":"2023-11-24T08:02:27.867513+0000","last_clean":"2023-11-24T08:02:27.867513+0000","last_became_active":"2023-11-24T08:02:26.840190+0000","last_became_peered":"2023-11-24T08:02:26.840190+0000","last_unstale":"2023-11-24T08:02:27.867513+0000","last_undegraded":"2023-11-24T08:02:27.867513+0000","last_fullsized":"2023-11-24T08:02:27.867513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829807+0000","last_change":"2023-11-24T08:02:26.829807+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829807+0000","last_undegraded":"2023-11-24T08:02:26.829807+0000","last_fullsized":"2023-11-24T08:02:26.829807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872417+0000","last_change":"2023-11-24T08:02:26.837411+0000","last_active":"2023-11-24T08:02:27.872417+0000","last_peered":"2023-11-24T08:02:27.872417+0000","last_clean":"2023-11-24T08:02:27.872417+0000","last_became_active":"2023-11-24T08:02:26.837120+0000","last_became_peered":"2023-11-24T08:02:26.837120+0000","last_unstale":"2023-11-24T08:02:27.872417+0000","last_undegraded":"2023-11-24T08:02:27.872417+0000","last_fullsized":"2023-11-24T08:02:27.872417+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:10:07.268127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819356+0000","last_change":"2023-11-24T08:02:26.819356+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819356+0000","last_undegraded":"2023-11-24T08:02:26.819356+0000","last_fullsized":"2023-11-24T08:02:26.819356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.847275+0000","last_change":"2023-11-24T08:02:26.845666+0000","last_active":"2023-11-24T08:02:26.847275+0000","last_peered":"2023-11-24T08:02:26.847275+0000","last_clean":"2023-11-24T08:02:26.847275+0000","last_became_active":"2023-11-24T08:02:26.845413+0000","last_became_peered":"2023-11-24T08:02:26.845413+0000","last_unstale":"2023-11-24T08:02:26.847275+0000","last_undegraded":"2023-11-24T08:02:26.847275+0000","last_fullsized":"2023-11-24T08:02:26.847275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819420+0000","last_change":"2023-11-24T08:02:26.819420+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819420+0000","last_undegraded":"2023-11-24T08:02:26.819420+0000","last_fullsized":"2023-11-24T08:02:26.819420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.846960+0000","last_change":"2023-11-24T08:02:26.841048+0000","last_active":"2023-11-24T08:02:27.846960+0000","last_peered":"2023-11-24T08:02:27.846960+0000","last_clean":"2023-11-24T08:02:27.846960+0000","last_became_active":"2023-11-24T08:02:26.839883+0000","last_became_peered":"2023-11-24T08:02:26.839883+0000","last_unstale":"2023-11-24T08:02:27.846960+0000","last_undegraded":"2023-11-24T08:02:27.846960+0000","last_fullsized":"2023-11-24T08:02:27.846960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:06:03.431625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861930+0000","last_change":"2023-11-24T08:02:27.859193+0000","last_active":"2023-11-24T08:02:27.861930+0000","last_peered":"2023-11-24T08:02:27.861930+0000","last_clean":"2023-11-24T08:02:27.861930+0000","last_became_active":"2023-11-24T08:02:27.858753+0000","last_became_peered":"2023-11-24T08:02:27.858753+0000","last_unstale":"2023-11-24T08:02:27.861930+0000","last_undegraded":"2023-11-24T08:02:27.861930+0000","last_fullsized":"2023-11-24T08:02:27.861930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840158+0000","last_change":"2023-11-24T08:02:26.833298+0000","last_active":"2023-11-24T08:02:26.840158+0000","last_peered":"2023-11-24T08:02:26.840158+0000","last_clean":"2023-11-24T08:02:26.840158+0000","last_became_active":"2023-11-24T08:02:26.832945+0000","last_became_peered":"2023-11-24T08:02:26.832945+0000","last_unstale":"2023-11-24T08:02:26.840158+0000","last_undegraded":"2023-11-24T08:02:26.840158+0000","last_fullsized":"2023-11-24T08:02:26.840158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831434+0000","last_change":"2023-11-24T08:02:26.831434+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831434+0000","last_undegraded":"2023-11-24T08:02:26.831434+0000","last_fullsized":"2023-11-24T08:02:26.831434+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845065+0000","last_change":"2023-11-24T08:02:26.840157+0000","last_active":"2023-11-24T08:02:26.845065+0000","last_peered":"2023-11-24T08:02:26.845065+0000","last_clean":"2023-11-24T08:02:26.845065+0000","last_became_active":"2023-11-24T08:02:26.838372+0000","last_became_peered":"2023-11-24T08:02:26.838372+0000","last_unstale":"2023-11-24T08:02:26.845065+0000","last_undegraded":"2023-11-24T08:02:26.845065+0000","last_fullsized":"2023-11-24T08:02:26.845065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871620+0000","last_change":"2023-11-24T08:02:27.866876+0000","last_active":"2023-11-24T08:02:27.871620+0000","last_peered":"2023-11-24T08:02:27.871620+0000","last_clean":"2023-11-24T08:02:27.871620+0000","last_became_active":"2023-11-24T08:02:27.866515+0000","last_became_peered":"2023-11-24T08:02:27.866515+0000","last_unstale":"2023-11-24T08:02:27.871620+0000","last_undegraded":"2023-11-24T08:02:27.871620+0000","last_fullsized":"2023-11-24T08:02:27.871620+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.841153+0000","last_change":"2023-11-24T08:02:26.838700+0000","last_active":"2023-11-24T08:02:26.841153+0000","last_peered":"2023-11-24T08:02:26.841153+0000","last_clean":"2023-11-24T08:02:26.841153+0000","last_became_active":"2023-11-24T08:02:26.838175+0000","last_became_peered":"2023-11-24T08:02:26.838175+0000","last_unstale":"2023-11-24T08:02:26.841153+0000","last_undegraded":"2023-11-24T08:02:26.841153+0000","last_fullsized":"2023-11-24T08:02:26.841153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876965+0000","last_change":"2023-11-24T08:02:27.865063+0000","last_active":"2023-11-24T08:02:27.876965+0000","last_peered":"2023-11-24T08:02:27.876965+0000","last_clean":"2023-11-24T08:02:27.876965+0000","last_became_active":"2023-11-24T08:02:27.864806+0000","last_became_peered":"2023-11-24T08:02:27.864806+0000","last_unstale":"2023-11-24T08:02:27.876965+0000","last_undegraded":"2023-11-24T08:02:27.876965+0000","last_fullsized":"2023-11-24T08:02:27.876965+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.744987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867781+0000","last_change":"2023-11-24T08:02:26.841842+0000","last_active":"2023-11-24T08:02:27.867781+0000","last_peered":"2023-11-24T08:02:27.867781+0000","last_clean":"2023-11-24T08:02:27.867781+0000","last_became_active":"2023-11-24T08:02:26.841524+0000","last_became_peered":"2023-11-24T08:02:26.841524+0000","last_unstale":"2023-11-24T08:02:27.867781+0000","last_undegraded":"2023-11-24T08:02:27.867781+0000","last_fullsized":"2023-11-24T08:02:27.867781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880633+0000","last_change":"2023-11-24T08:02:27.876155+0000","last_active":"2023-11-24T08:02:27.880633+0000","last_peered":"2023-11-24T08:02:27.880633+0000","last_clean":"2023-11-24T08:02:27.880633+0000","last_became_active":"2023-11-24T08:02:27.875932+0000","last_became_peered":"2023-11-24T08:02:27.875932+0000","last_unstale":"2023-11-24T08:02:27.880633+0000","last_undegraded":"2023-11-24T08:02:27.880633+0000","last_fullsized":"2023-11-24T08:02:27.880633+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.881849+0000","last_change":"2023-11-24T08:02:26.839195+0000","last_active":"2023-11-24T08:02:27.881849+0000","last_peered":"2023-11-24T08:02:27.881849+0000","last_clean":"2023-11-24T08:02:27.881849+0000","last_became_active":"2023-11-24T08:02:26.838946+0000","last_became_peered":"2023-11-24T08:02:26.838946+0000","last_unstale":"2023-11-24T08:02:27.881849+0000","last_undegraded":"2023-11-24T08:02:27.881849+0000","last_fullsized":"2023-11-24T08:02:27.881849+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:17.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865493+0000","last_change":"2023-11-24T08:02:27.863330+0000","last_active":"2023-11-24T08:02:27.865493+0000","last_peered":"2023-11-24T08:02:27.865493+0000","last_clean":"2023-11-24T08:02:27.865493+0000","last_became_active":"2023-11-24T08:02:27.863064+0000","last_became_peered":"2023-11-24T08:02:27.863064+0000","last_unstale":"2023-11-24T08:02:27.865493+0000","last_undegraded":"2023-11-24T08:02:27.865493+0000","last_fullsized":"2023-11-24T08:02:27.865493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:54.675687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880362+0000","last_change":"2023-11-24T08:02:26.833854+0000","last_active":"2023-11-24T08:02:27.880362+0000","last_peered":"2023-11-24T08:02:27.880362+0000","last_clean":"2023-11-24T08:02:27.880362+0000","last_became_active":"2023-11-24T08:02:26.833026+0000","last_became_peered":"2023-11-24T08:02:26.833026+0000","last_unstale":"2023-11-24T08:02:27.880362+0000","last_undegraded":"2023-11-24T08:02:27.880362+0000","last_fullsized":"2023-11-24T08:02:27.880362+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:18.256936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818723+0000","last_change":"2023-11-24T08:02:26.818723+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818723+0000","last_undegraded":"2023-11-24T08:02:26.818723+0000","last_fullsized":"2023-11-24T08:02:26.818723+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852819+0000","last_change":"2023-11-24T08:02:26.832072+0000","last_active":"2023-11-24T08:02:27.852819+0000","last_peered":"2023-11-24T08:02:27.852819+0000","last_clean":"2023-11-24T08:02:27.852819+0000","last_became_active":"2023-11-24T08:02:26.831711+0000","last_became_peered":"2023-11-24T08:02:26.831711+0000","last_unstale":"2023-11-24T08:02:27.852819+0000","last_undegraded":"2023-11-24T08:02:27.852819+0000","last_fullsized":"2023-11-24T08:02:27.852819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:48.836292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876004+0000","last_change":"2023-11-24T08:02:27.863802+0000","last_active":"2023-11-24T08:02:27.876004+0000","last_peered":"2023-11-24T08:02:27.876004+0000","last_clean":"2023-11-24T08:02:27.876004+0000","last_became_active":"2023-11-24T08:02:27.863505+0000","last_became_peered":"2023-11-24T08:02:27.863505+0000","last_unstale":"2023-11-24T08:02:27.876004+0000","last_undegraded":"2023-11-24T08:02:27.876004+0000","last_fullsized":"2023-11-24T08:02:27.876004+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:28.155079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847468+0000","last_change":"2023-11-24T08:02:26.835308+0000","last_active":"2023-11-24T08:02:27.847468+0000","last_peered":"2023-11-24T08:02:27.847468+0000","last_clean":"2023-11-24T08:02:27.847468+0000","last_became_active":"2023-11-24T08:02:26.835069+0000","last_became_peered":"2023-11-24T08:02:26.835069+0000","last_unstale":"2023-11-24T08:02:27.847468+0000","last_undegraded":"2023-11-24T08:02:27.847468+0000","last_fullsized":"2023-11-24T08:02:27.847468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871664+0000","last_change":"2023-11-24T08:02:27.867003+0000","last_active":"2023-11-24T08:02:27.871664+0000","last_peered":"2023-11-24T08:02:27.871664+0000","last_clean":"2023-11-24T08:02:27.871664+0000","last_became_active":"2023-11-24T08:02:27.865266+0000","last_became_peered":"2023-11-24T08:02:27.865266+0000","last_unstale":"2023-11-24T08:02:27.871664+0000","last_undegraded":"2023-11-24T08:02:27.871664+0000","last_fullsized":"2023-11-24T08:02:27.871664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846302+0000","last_change":"2023-11-24T08:02:26.845056+0000","last_active":"2023-11-24T08:02:26.846302+0000","last_peered":"2023-11-24T08:02:26.846302+0000","last_clean":"2023-11-24T08:02:26.846302+0000","last_became_active":"2023-11-24T08:02:26.844746+0000","last_became_peered":"2023-11-24T08:02:26.844746+0000","last_unstale":"2023-11-24T08:02:26.846302+0000","last_undegraded":"2023-11-24T08:02:26.846302+0000","last_fullsized":"2023-11-24T08:02:26.846302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.856913+0000","last_change":"2023-11-24T08:02:27.851025+0000","last_active":"2023-11-24T08:02:27.856913+0000","last_peered":"2023-11-24T08:02:27.856913+0000","last_clean":"2023-11-24T08:02:27.856913+0000","last_became_active":"2023-11-24T08:02:27.850749+0000","last_became_peered":"2023-11-24T08:02:27.850749+0000","last_unstale":"2023-11-24T08:02:27.856913+0000","last_undegraded":"2023-11-24T08:02:27.856913+0000","last_fullsized":"2023-11-24T08:02:27.856913+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878734+0000","last_change":"2023-11-24T08:02:26.834787+0000","last_active":"2023-11-24T08:02:27.878734+0000","last_peered":"2023-11-24T08:02:27.878734+0000","last_clean":"2023-11-24T08:02:27.878734+0000","last_became_active":"2023-11-24T08:02:26.834159+0000","last_became_peered":"2023-11-24T08:02:26.834159+0000","last_unstale":"2023-11-24T08:02:27.878734+0000","last_undegraded":"2023-11-24T08:02:27.878734+0000","last_fullsized":"2023-11-24T08:02:27.878734+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:20:04.530498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822775+0000","last_change":"2023-11-24T08:02:26.822775+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822775+0000","last_undegraded":"2023-11-24T08:02:26.822775+0000","last_fullsized":"2023-11-24T08:02:26.822775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846515+0000","last_change":"2023-11-24T08:02:26.842806+0000","last_active":"2023-11-24T08:02:26.846515+0000","last_peered":"2023-11-24T08:02:26.846515+0000","last_clean":"2023-11-24T08:02:26.846515+0000","last_became_active":"2023-11-24T08:02:26.842317+0000","last_became_peered":"2023-11-24T08:02:26.842317+0000","last_unstale":"2023-11-24T08:02:26.846515+0000","last_undegraded":"2023-11-24T08:02:26.846515+0000","last_fullsized":"2023-11-24T08:02:26.846515+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870877+0000","last_change":"2023-11-24T08:02:27.868287+0000","last_active":"2023-11-24T08:02:27.870877+0000","last_peered":"2023-11-24T08:02:27.870877+0000","last_clean":"2023-11-24T08:02:27.870877+0000","last_became_active":"2023-11-24T08:02:27.867921+0000","last_became_peered":"2023-11-24T08:02:27.867921+0000","last_unstale":"2023-11-24T08:02:27.870877+0000","last_undegraded":"2023-11-24T08:02:27.870877+0000","last_fullsized":"2023-11-24T08:02:27.870877+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:12:51.094917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869028+0000","last_change":"2023-11-24T08:02:26.844242+0000","last_active":"2023-11-24T08:02:27.869028+0000","last_peered":"2023-11-24T08:02:27.869028+0000","last_clean":"2023-11-24T08:02:27.869028+0000","last_became_active":"2023-11-24T08:02:26.843949+0000","last_became_peered":"2023-11-24T08:02:26.843949+0000","last_unstale":"2023-11-24T08:02:27.869028+0000","last_undegraded":"2023-11-24T08:02:27.869028+0000","last_fullsized":"2023-11-24T08:02:27.869028+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869412+0000","last_change":"2023-11-24T08:02:27.866311+0000","last_active":"2023-11-24T08:02:27.869412+0000","last_peered":"2023-11-24T08:02:27.869412+0000","last_clean":"2023-11-24T08:02:27.869412+0000","last_became_active":"2023-11-24T08:02:27.865994+0000","last_became_peered":"2023-11-24T08:02:27.865994+0000","last_unstale":"2023-11-24T08:02:27.869412+0000","last_undegraded":"2023-11-24T08:02:27.869412+0000","last_fullsized":"2023-11-24T08:02:27.869412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:20.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852142+0000","last_change":"2023-11-24T08:02:26.841437+0000","last_active":"2023-11-24T08:02:27.852142+0000","last_peered":"2023-11-24T08:02:27.852142+0000","last_clean":"2023-11-24T08:02:27.852142+0000","last_became_active":"2023-11-24T08:02:26.841101+0000","last_became_peered":"2023-11-24T08:02:26.841101+0000","last_unstale":"2023-11-24T08:02:27.852142+0000","last_undegraded":"2023-11-24T08:02:27.852142+0000","last_fullsized":"2023-11-24T08:02:27.852142+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:19:21.245356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.859818+0000","last_change":"2023-11-24T08:02:27.854759+0000","last_active":"2023-11-24T08:02:27.859818+0000","last_peered":"2023-11-24T08:02:27.859818+0000","last_clean":"2023-11-24T08:02:27.859818+0000","last_became_active":"2023-11-24T08:02:27.854463+0000","last_became_peered":"2023-11-24T08:02:27.854463+0000","last_unstale":"2023-11-24T08:02:27.859818+0000","last_undegraded":"2023-11-24T08:02:27.859818+0000","last_fullsized":"2023-11-24T08:02:27.859818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871456+0000","last_change":"2023-11-24T08:02:26.837311+0000","last_active":"2023-11-24T08:02:27.871456+0000","last_peered":"2023-11-24T08:02:27.871456+0000","last_clean":"2023-11-24T08:02:27.871456+0000","last_became_active":"2023-11-24T08:02:26.836798+0000","last_became_peered":"2023-11-24T08:02:26.836798+0000","last_unstale":"2023-11-24T08:02:27.871456+0000","last_undegraded":"2023-11-24T08:02:27.871456+0000","last_fullsized":"2023-11-24T08:02:27.871456+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:17.818121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.821010+0000","last_change":"2023-11-24T08:02:26.821010+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.821010+0000","last_undegraded":"2023-11-24T08:02:26.821010+0000","last_fullsized":"2023-11-24T08:02:26.821010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847070+0000","last_change":"2023-11-24T08:02:26.846707+0000","last_active":"2023-11-24T08:02:27.847070+0000","last_peered":"2023-11-24T08:02:27.847070+0000","last_clean":"2023-11-24T08:02:27.847070+0000","last_became_active":"2023-11-24T08:02:26.846336+0000","last_became_peered":"2023-11-24T08:02:26.846336+0000","last_unstale":"2023-11-24T08:02:27.847070+0000","last_undegraded":"2023-11-24T08:02:27.847070+0000","last_fullsized":"2023-11-24T08:02:27.847070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.651309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.857927+0000","last_change":"2023-11-24T08:02:27.853113+0000","last_active":"2023-11-24T08:02:27.857927+0000","last_peered":"2023-11-24T08:02:27.857927+0000","last_clean":"2023-11-24T08:02:27.857927+0000","last_became_active":"2023-11-24T08:02:27.852792+0000","last_became_peered":"2023-11-24T08:02:27.852792+0000","last_unstale":"2023-11-24T08:02:27.857927+0000","last_undegraded":"2023-11-24T08:02:27.857927+0000","last_fullsized":"2023-11-24T08:02:27.857927+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:12.600997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846251+0000","last_change":"2023-11-24T08:02:26.841551+0000","last_active":"2023-11-24T08:02:26.846251+0000","last_peered":"2023-11-24T08:02:26.846251+0000","last_clean":"2023-11-24T08:02:26.846251+0000","last_became_active":"2023-11-24T08:02:26.840861+0000","last_became_peered":"2023-11-24T08:02:26.840861+0000","last_unstale":"2023-11-24T08:02:26.846251+0000","last_undegraded":"2023-11-24T08:02:26.846251+0000","last_fullsized":"2023-11-24T08:02:26.846251+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825895+0000","last_change":"2023-11-24T08:02:26.825895+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825895+0000","last_undegraded":"2023-11-24T08:02:26.825895+0000","last_fullsized":"2023-11-24T08:02:26.825895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851575+0000","last_change":"2023-11-24T08:02:26.831194+0000","last_active":"2023-11-24T08:02:27.851575+0000","last_peered":"2023-11-24T08:02:27.851575+0000","last_clean":"2023-11-24T08:02:27.851575+0000","last_became_active":"2023-11-24T08:02:26.830870+0000","last_became_peered":"2023-11-24T08:02:26.830870+0000","last_unstale":"2023-11-24T08:02:27.851575+0000","last_undegraded":"2023-11-24T08:02:27.851575+0000","last_fullsized":"2023-11-24T08:02:27.851575+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:28.971796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865587+0000","last_change":"2023-11-24T08:02:27.863129+0000","last_active":"2023-11-24T08:02:27.865587+0000","last_peered":"2023-11-24T08:02:27.865587+0000","last_clean":"2023-11-24T08:02:27.865587+0000","last_became_active":"2023-11-24T08:02:27.862818+0000","last_became_peered":"2023-11-24T08:02:27.862818+0000","last_unstale":"2023-11-24T08:02:27.865587+0000","last_undegraded":"2023-11-24T08:02:27.865587+0000","last_fullsized":"2023-11-24T08:02:27.865587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:44.172148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852960+0000","last_change":"2023-11-24T08:02:26.842429+0000","last_active":"2023-11-24T08:02:27.852960+0000","last_peered":"2023-11-24T08:02:27.852960+0000","last_clean":"2023-11-24T08:02:27.852960+0000","last_became_active":"2023-11-24T08:02:26.842153+0000","last_became_peered":"2023-11-24T08:02:26.842153+0000","last_unstale":"2023-11-24T08:02:27.852960+0000","last_undegraded":"2023-11-24T08:02:27.852960+0000","last_fullsized":"2023-11-24T08:02:27.852960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:35.629826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822712+0000","last_change":"2023-11-24T08:02:26.822712+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822712+0000","last_undegraded":"2023-11-24T08:02:26.822712+0000","last_fullsized":"2023-11-24T08:02:26.822712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.854493+0000","last_change":"2023-11-24T08:02:26.841087+0000","last_active":"2023-11-24T08:02:27.854493+0000","last_peered":"2023-11-24T08:02:27.854493+0000","last_clean":"2023-11-24T08:02:27.854493+0000","last_became_active":"2023-11-24T08:02:26.840807+0000","last_became_peered":"2023-11-24T08:02:26.840807+0000","last_unstale":"2023-11-24T08:02:27.854493+0000","last_undegraded":"2023-11-24T08:02:27.854493+0000","last_fullsized":"2023-11-24T08:02:27.854493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:59.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867833+0000","last_change":"2023-11-24T08:02:27.861891+0000","last_active":"2023-11-24T08:02:27.867833+0000","last_peered":"2023-11-24T08:02:27.867833+0000","last_clean":"2023-11-24T08:02:27.867833+0000","last_became_active":"2023-11-24T08:02:27.861391+0000","last_became_peered":"2023-11-24T08:02:27.861391+0000","last_unstale":"2023-11-24T08:02:27.867833+0000","last_undegraded":"2023-11-24T08:02:27.867833+0000","last_fullsized":"2023-11-24T08:02:27.867833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848396+0000","last_change":"2023-11-24T08:02:26.845613+0000","last_active":"2023-11-24T08:02:26.848396+0000","last_peered":"2023-11-24T08:02:26.848396+0000","last_clean":"2023-11-24T08:02:26.848396+0000","last_became_active":"2023-11-24T08:02:26.845190+0000","last_became_peered":"2023-11-24T08:02:26.845190+0000","last_unstale":"2023-11-24T08:02:26.848396+0000","last_undegraded":"2023-11-24T08:02:26.848396+0000","last_fullsized":"2023-11-24T08:02:26.848396+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:11:34.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876976+0000","last_change":"2023-11-24T08:02:27.874289+0000","last_active":"2023-11-24T08:02:27.876976+0000","last_peered":"2023-11-24T08:02:27.876976+0000","last_clean":"2023-11-24T08:02:27.876976+0000","last_became_active":"2023-11-24T08:02:27.873177+0000","last_became_peered":"2023-11-24T08:02:27.873177+0000","last_unstale":"2023-11-24T08:02:27.876976+0000","last_undegraded":"2023-11-24T08:02:27.876976+0000","last_fullsized":"2023-11-24T08:02:27.876976+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852098+0000","last_change":"2023-11-24T08:02:26.840761+0000","last_active":"2023-11-24T08:02:27.852098+0000","last_peered":"2023-11-24T08:02:27.852098+0000","last_clean":"2023-11-24T08:02:27.852098+0000","last_became_active":"2023-11-24T08:02:26.838173+0000","last_became_peered":"2023-11-24T08:02:26.838173+0000","last_unstale":"2023-11-24T08:02:27.852098+0000","last_undegraded":"2023-11-24T08:02:27.852098+0000","last_fullsized":"2023-11-24T08:02:27.852098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876091+0000","last_change":"2023-11-24T08:02:27.865925+0000","last_active":"2023-11-24T08:02:27.876091+0000","last_peered":"2023-11-24T08:02:27.876091+0000","last_clean":"2023-11-24T08:02:27.876091+0000","last_became_active":"2023-11-24T08:02:27.865643+0000","last_became_peered":"2023-11-24T08:02:27.865643+0000","last_unstale":"2023-11-24T08:02:27.876091+0000","last_undegraded":"2023-11-24T08:02:27.876091+0000","last_fullsized":"2023-11-24T08:02:27.876091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:00.868558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846408+0000","last_change":"2023-11-24T08:02:26.842216+0000","last_active":"2023-11-24T08:02:26.846408+0000","last_peered":"2023-11-24T08:02:26.846408+0000","last_clean":"2023-11-24T08:02:26.846408+0000","last_became_active":"2023-11-24T08:02:26.841172+0000","last_became_peered":"2023-11-24T08:02:26.841172+0000","last_unstale":"2023-11-24T08:02:26.846408+0000","last_undegraded":"2023-11-24T08:02:26.846408+0000","last_fullsized":"2023-11-24T08:02:26.846408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871968+0000","last_change":"2023-11-24T08:02:27.866805+0000","last_active":"2023-11-24T08:02:27.871968+0000","last_peered":"2023-11-24T08:02:27.871968+0000","last_clean":"2023-11-24T08:02:27.871968+0000","last_became_active":"2023-11-24T08:02:27.866254+0000","last_became_peered":"2023-11-24T08:02:27.866254+0000","last_unstale":"2023-11-24T08:02:27.871968+0000","last_undegraded":"2023-11-24T08:02:27.871968+0000","last_fullsized":"2023-11-24T08:02:27.871968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:55:47.185739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845567+0000","last_change":"2023-11-24T08:02:26.837671+0000","last_active":"2023-11-24T08:02:26.845567+0000","last_peered":"2023-11-24T08:02:26.845567+0000","last_clean":"2023-11-24T08:02:26.845567+0000","last_became_active":"2023-11-24T08:02:26.837141+0000","last_became_peered":"2023-11-24T08:02:26.837141+0000","last_unstale":"2023-11-24T08:02:26.845567+0000","last_undegraded":"2023-11-24T08:02:26.845567+0000","last_fullsized":"2023-11-24T08:02:26.845567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:02.489853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823776+0000","last_change":"2023-11-24T08:02:26.823776+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823776+0000","last_undegraded":"2023-11-24T08:02:26.823776+0000","last_fullsized":"2023-11-24T08:02:26.823776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840559+0000","last_change":"2023-11-24T08:02:26.834763+0000","last_active":"2023-11-24T08:02:26.840559+0000","last_peered":"2023-11-24T08:02:26.840559+0000","last_clean":"2023-11-24T08:02:26.840559+0000","last_became_active":"2023-11-24T08:02:26.834426+0000","last_became_peered":"2023-11-24T08:02:26.834426+0000","last_unstale":"2023-11-24T08:02:26.840559+0000","last_undegraded":"2023-11-24T08:02:26.840559+0000","last_fullsized":"2023-11-24T08:02:26.840559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823658+0000","last_change":"2023-11-24T08:02:26.823658+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823658+0000","last_undegraded":"2023-11-24T08:02:26.823658+0000","last_fullsized":"2023-11-24T08:02:26.823658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873697+0000","last_change":"2023-11-24T08:02:26.843331+0000","last_active":"2023-11-24T08:02:27.873697+0000","last_peered":"2023-11-24T08:02:27.873697+0000","last_clean":"2023-11-24T08:02:27.873697+0000","last_became_active":"2023-11-24T08:02:26.843044+0000","last_became_peered":"2023-11-24T08:02:26.843044+0000","last_unstale":"2023-11-24T08:02:27.873697+0000","last_undegraded":"2023-11-24T08:02:27.873697+0000","last_fullsized":"2023-11-24T08:02:27.873697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.820974+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:02:26.820974+0000","last_peered":"2023-11-24T08:02:26.820974+0000","last_clean":"2023-11-24T08:02:26.820974+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:02:26.820974+0000","last_undegraded":"2023-11-24T08:02:26.820974+0000","last_fullsized":"2023-11-24T08:02:26.820974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":805519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.113,"15min":1.133},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.5229999999999999,"5min":1.72,"15min":1.72},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.70599999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1830000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.159,"15min":1.161},"min":{"1min":0.79800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5229999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5389999999999999,"5min":2.02,"15min":2.02},"last":1.087}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3759999999999999,"15min":1.383},"min":{"1min":1.0029999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6319999999999999,"5min":1.944,"15min":1.944},"last":1.5189999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1619999999999999,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6000000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.405,"15min":1.411},"min":{"1min":0.94599999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4079999999999999,"15min":1.4139999999999999},"min":{"1min":0.98499999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3300000000000001,"15min":1.3129999999999999},"min":{"1min":0.98399999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.774,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5569999999999999,"15min":1.5620000000000001},"min":{"1min":1.2669999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7609999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.595},{"interface":"front","average":{"1min":1.552,"5min":1.542,"15min":1.54},"min":{"1min":1.085,"5min":1.01,"15min":1.01},"max":{"1min":1.881,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.4319999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.6160000000000001,"15min":1.609},"min":{"1min":1.2210000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.141,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.5349999999999999,"15min":1.5269999999999999},"min":{"1min":1.2529999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.839,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":215733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.72199999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1970000000000001,"15min":1.1950000000000001},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.238,"15min":1.244},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5109999999999999,"5min":2.597,"15min":2.597},"last":1.5600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2390000000000001,"15min":1.2589999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.623,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.29},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.706,"5min":2.831,"15min":2.831},"last":1.468}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.294,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.605,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.3360000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3879999999999999,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.873},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4019999999999999,"15min":1.4119999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5920000000000001,"15min":1.5960000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.163},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.546,"15min":1.54},"min":{"1min":1.016,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.226}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.6060000000000001,"15min":1.6180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9159999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.28},{"interface":"front","average":{"1min":1.649,"5min":1.6020000000000001,"15min":1.5940000000000001},"min":{"1min":1.202,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.444}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.72,"5min":2.431,"15min":2.431},"last":1.446},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0640000000000001,"15min":1.056},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5149999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4139999999999999,"5min":1.768,"15min":1.768},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.335,"15min":1.351},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6339999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.339,"15min":1.373},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7789999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7569999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.4359999999999999},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.569,"15min":2.569},"last":1.232},{"interface":"front","average":{"1min":1.361,"5min":1.5129999999999999,"15min":1.538},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.121}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.665,"15min":1.7130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.96,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.577},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.113},"last":1.3400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":215699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.383,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.50900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.3480000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0369999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.486,"5min":1.601,"15min":1.601},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.998},"min":{"1min":0.59699999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.526,"5min":1.569,"15min":1.569},"last":1.1910000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.111,"15min":1.105},"min":{"1min":0.75700000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5429999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.1799999999999999},"min":{"1min":0.77500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.272}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.288,"15min":1.2789999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.482},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2470000000000001,"15min":1.2450000000000001},"min":{"1min":0.77400000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2370000000000001,"15min":1.24},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6699999999999999,"5min":1.861,"15min":1.861},"last":1.52},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3680000000000001,"15min":1.3640000000000001},"min":{"1min":0.91000000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.921,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.389}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.294},"min":{"1min":0.76800000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.262},"min":{"1min":0.85499999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.746,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5780000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":216695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.41899999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.27,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.526,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":3.343}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.504,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.113,"15min":1.137},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3089999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":2.3479999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96599999999999997,"15min":0.97099999999999997},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.236,"5min":1.637,"15min":1.637},"last":7.5670000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.409,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":2.3980000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.794,"5min":6.452,"15min":6.452},"last":7.0119999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.548,"15min":1.581},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7370000000000001,"5min":6.306,"15min":6.306},"last":7.0609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.5189999999999999,"15min":1.5369999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7889999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.296,"15min":1.3069999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.708,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":12.798}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.381,"15min":1.3879999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.857,"5min":2.069,"15min":2.069},"last":7.6200000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.577,"15min":1.6160000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8779999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.786,"5min":1.948,"15min":1.948},"last":7.4539999999999997},{"interface":"front","average":{"1min":1.454,"5min":1.5900000000000001,"15min":1.6120000000000001},"min":{"1min":0.93200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.921,"5min":6.399,"15min":6.399},"last":1.538}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.60199999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.629,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.099,"15min":1.1200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.536,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1639999999999999,"15min":1.159},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8340000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.23},{"interface":"front","average":{"1min":1.145,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.51,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.3009999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3959999999999999,"5min":1.518,"15min":1.518},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.4279999999999999,"15min":1.446},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.794,"5min":1.966,"15min":1.966},"last":1.488}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8420000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.611},{"interface":"front","average":{"1min":1.282,"5min":1.4059999999999999,"15min":1.4259999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8959999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.044}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.492,"15min":1.508},"min":{"1min":1.0609999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.056,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.532,"15min":1.52},"min":{"1min":1.149,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.986,"5min":2.073,"15min":2.073},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5549999999999999,"15min":1.5640000000000001},"min":{"1min":1.1519999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7589999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.6000000000000001,"15min":1.6240000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.968,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.5309999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.6080000000000001,"15min":1.6120000000000001},"min":{"1min":1.208,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.897,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6870000000000001,"15min":1.706},"min":{"1min":1.262,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0099999999999998,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.4079999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.40100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5109999999999999,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":1.012},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":3.266,"15min":3.266},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1819999999999999,"15min":1.196},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5780000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.216},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.597,"5min":1.976,"15min":1.976},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.4710000000000001,"15min":1.5189999999999999},"min":{"1min":0.73099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1139999999999999,"5min":4.367,"15min":4.367},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.4370000000000001,"15min":1.4550000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8939999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.3420000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.5289999999999999,"15min":1.583},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6890000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4830000000000001,"15min":1.5029999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7170000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.155}]},{"osd":6,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.9570000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.256},{"interface":"front","average":{"1min":1.419,"5min":1.639,"15min":1.675},"min":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0059999999999998,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.234}]},{"osd":7,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8220000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.657,"15min":1.704},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0739999999999998,"5min":4.452,"15min":4.452},"last":1.1830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":798654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0660000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1299999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.876,"5min":1.0149999999999999,"15min":1.038},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.466,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.04,"15min":1.046},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.512,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.284},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.622,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5600000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6459999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2170000000000001,"15min":1.2250000000000001},"min":{"1min":0.91900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.431,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.544},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6439999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.0569999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.476,"15min":1.5089999999999999},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.895,"5min":2.839,"15min":2.839},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3660000000000001,"15min":1.3879999999999999},"min":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5389999999999999,"5min":2.823,"15min":2.823},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.72,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86499999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0539999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.337}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1480000000000001,"5min":2.875,"15min":2.875},"last":1.476},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.776,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:02:33.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-11-24T08:02:33.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.831030+0000', 'last_change': '2023-11-24T08:02:26.831030+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.831030+0000', 'last_undegraded': '2023-11-24T08:02:26.831030+0000', 'last_fullsized': '2023-11-24T08:02:26.831030+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-11-24T08:02:33.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.823208+0000', 'last_change': '2023-11-24T08:02:26.823208+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.823208+0000', 'last_undegraded': '2023-11-24T08:02:26.823208+0000', 'last_fullsized': '2023-11-24T08:02:26.823208+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-11-24T08:02:33.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.827349+0000', 'last_change': '2023-11-24T08:02:26.827349+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.827349+0000', 'last_undegraded': '2023-11-24T08:02:26.827349+0000', 'last_fullsized': '2023-11-24T08:02:26.827349+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-11-24T08:02:33.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.823243+0000', 'last_change': '2023-11-24T08:02:26.823243+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.823243+0000', 'last_undegraded': '2023-11-24T08:02:26.823243+0000', 'last_fullsized': '2023-11-24T08:02:26.823243+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-11-24T08:02:33.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.824006+0000', 'last_change': '2023-11-24T08:02:26.824006+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.824006+0000', 'last_undegraded': '2023-11-24T08:02:26.824006+0000', 'last_fullsized': '2023-11-24T08:02:26.824006+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-11-24T08:02:33.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.822800+0000', 'last_change': '2023-11-24T08:02:26.822800+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.822800+0000', 'last_undegraded': '2023-11-24T08:02:26.822800+0000', 'last_fullsized': '2023-11-24T08:02:26.822800+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-11-24T08:02:33.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.825063+0000', 'last_change': '2023-11-24T08:02:26.825063+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.825063+0000', 'last_undegraded': '2023-11-24T08:02:26.825063+0000', 'last_fullsized': '2023-11-24T08:02:26.825063+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-11-24T08:02:33.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.829418+0000', 'last_change': '2023-11-24T08:02:26.829418+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.829418+0000', 'last_undegraded': '2023-11-24T08:02:26.829418+0000', 'last_fullsized': '2023-11-24T08:02:26.829418+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-11-24T08:02:33.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.832463+0000', 'last_change': '2023-11-24T08:02:26.832463+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.832463+0000', 'last_undegraded': '2023-11-24T08:02:26.832463+0000', 'last_fullsized': '2023-11-24T08:02:26.832463+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-11-24T08:02:33.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.824672+0000', 'last_change': '2023-11-24T08:02:26.824672+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.824672+0000', 'last_undegraded': '2023-11-24T08:02:26.824672+0000', 'last_fullsized': '2023-11-24T08:02:26.824672+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-11-24T08:02:33.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.824828+0000', 'last_change': '2023-11-24T08:02:26.824828+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.824828+0000', 'last_undegraded': '2023-11-24T08:02:26.824828+0000', 'last_fullsized': '2023-11-24T08:02:26.824828+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-11-24T08:02:33.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.832977+0000', 'last_change': '2023-11-24T08:02:26.832977+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.832977+0000', 'last_undegraded': '2023-11-24T08:02:26.832977+0000', 'last_fullsized': '2023-11-24T08:02:26.832977+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-11-24T08:02:33.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.822134+0000', 'last_change': '2023-11-24T08:02:26.822134+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.822134+0000', 'last_undegraded': '2023-11-24T08:02:26.822134+0000', 'last_fullsized': '2023-11-24T08:02:26.822134+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T08:02:33.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-11-24T08:02:33.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.818355+0000', 'last_change': '2023-11-24T08:02:26.818355+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.818355+0000', 'last_undegraded': '2023-11-24T08:02:26.818355+0000', 'last_fullsized': '2023-11-24T08:02:26.818355+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T08:02:33.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-11-24T08:02:33.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.829807+0000', 'last_change': '2023-11-24T08:02:26.829807+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.829807+0000', 'last_undegraded': '2023-11-24T08:02:26.829807+0000', 'last_fullsized': '2023-11-24T08:02:26.829807+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-11-24T08:02:33.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.819356+0000', 'last_change': '2023-11-24T08:02:26.819356+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.819356+0000', 'last_undegraded': '2023-11-24T08:02:26.819356+0000', 'last_fullsized': '2023-11-24T08:02:26.819356+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-11-24T08:02:33.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.819420+0000', 'last_change': '2023-11-24T08:02:26.819420+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.819420+0000', 'last_undegraded': '2023-11-24T08:02:26.819420+0000', 'last_fullsized': '2023-11-24T08:02:26.819420+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-11-24T08:02:33.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.831434+0000', 'last_change': '2023-11-24T08:02:26.831434+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.831434+0000', 'last_undegraded': '2023-11-24T08:02:26.831434+0000', 'last_fullsized': '2023-11-24T08:02:26.831434+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-11-24T08:02:33.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.818723+0000', 'last_change': '2023-11-24T08:02:26.818723+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.818723+0000', 'last_undegraded': '2023-11-24T08:02:26.818723+0000', 'last_fullsized': '2023-11-24T08:02:26.818723+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-11-24T08:02:33.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.822775+0000', 'last_change': '2023-11-24T08:02:26.822775+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.822775+0000', 'last_undegraded': '2023-11-24T08:02:26.822775+0000', 'last_fullsized': '2023-11-24T08:02:26.822775+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-11-24T08:02:33.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.821010+0000', 'last_change': '2023-11-24T08:02:26.821010+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.821010+0000', 'last_undegraded': '2023-11-24T08:02:26.821010+0000', 'last_fullsized': '2023-11-24T08:02:26.821010+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-24T08:02:33.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-11-24T08:02:33.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.825895+0000', 'last_change': '2023-11-24T08:02:26.825895+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.825895+0000', 'last_undegraded': '2023-11-24T08:02:26.825895+0000', 'last_fullsized': '2023-11-24T08:02:26.825895+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-11-24T08:02:33.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.822712+0000', 'last_change': '2023-11-24T08:02:26.822712+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.822712+0000', 'last_undegraded': '2023-11-24T08:02:26.822712+0000', 'last_fullsized': '2023-11-24T08:02:26.822712+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-11-24T08:02:33.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.823776+0000', 'last_change': '2023-11-24T08:02:26.823776+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.823776+0000', 'last_undegraded': '2023-11-24T08:02:26.823776+0000', 'last_fullsized': '2023-11-24T08:02:26.823776+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-24T08:02:33.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-11-24T08:02:33.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 45, 'state': 'creating+peering', 'last_fresh': '2023-11-24T08:02:26.823658+0000', 'last_change': '2023-11-24T08:02:26.823658+0000', 'last_active': '2023-11-24T08:02:26.799238+0000', 'last_peered': '2023-11-24T08:02:26.799238+0000', 'last_clean': '2023-11-24T08:02:26.799238+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-24T08:02:26.823658+0000', 'last_undegraded': '2023-11-24T08:02:26.823658+0000', 'last_fullsized': '2023-11-24T08:02:26.823658+0000', 'mapping_epoch': 45, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 45, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'last_clean_scrub_stamp': '2023-11-24T08:02:26.799238+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-24T08:02:33.334 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-24T08:02:33.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.571+0000 7f639db27640 1 Processor -- start 2023-11-24T08:02:33.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.571+0000 7f639db27640 1 -- start start 2023-11-24T08:02:33.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f639db27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f639806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f639db27640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6398070e50 con 0x7f63980cc500 2023-11-24T08:02:33.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f639db27640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6398144020 con 0x7f6398143c40 2023-11-24T08:02:33.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f639db27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980723c0 con 0x7f63980cc990 2023-11-24T08:02:33.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f6397fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f63980cc500 0x7f639806d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34470/0 (socket says 172.21.15.161:34470) 2023-11-24T08:02:33.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f6397fff640 1 -- 172.21.15.161:0/2895007000 learned_addr learned my addr 172.21.15.161:0/2895007000 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:33.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.573+0000 7f639d326640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f639806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3569488664 0 0) 0x7f6398070e50 con 0x7f63980cc500 2023-11-24T08:02:33.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6388003520 con 0x7f63980cc500 2023-11-24T08:02:33.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 468012466 0 0) 0x7f6388003520 con 0x7f63980cc500 2023-11-24T08:02:33.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 msgr2=0x7f639806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f639806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 >> v1:172.21.15.175:6789/0 conn(0x7f6398143c40 legacy=0x7f6398071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398071e00 con 0x7f63980cc500 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6384001690 con 0x7f63980cc500 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 >> v1:172.21.15.161:6789/0 conn(0x7f63980cc500 legacy=0x7f639806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63880039a0 0x7f6388003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880047c0 0x7f6388004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f6388005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980723c0 con 0x7f63880039a0 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638800bb40 con 0x7f63880047c0 2023-11-24T08:02:33.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.574+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638800bd00 con 0x7f63980cc990 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639cb25640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63880039a0 0x7f6388003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f6397fff640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880047c0 0x7f6388004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639d326640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f6388005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639cb25640 1 -- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 msgr2=0x7f6388005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639cb25640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f6388005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639cb25640 1 -- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880047c0 msgr2=0x7f6388004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639cb25640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880047c0 0x7f6388004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639cb25640 1 -- 172.21.15.161:0/2895007000 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388003520 con 0x7f63880039a0 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f6397fff640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880047c0 0x7f6388004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.575+0000 7f639d326640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63980cc990 0x7f6388005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:33.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.576+0000 7f639cb25640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63880039a0 0x7f6388003dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f638c001750 tx=0x7f63880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eab0b5e24446efe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:33.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.576+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c0052d0 con 0x7f63880039a0 2023-11-24T08:02:33.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.576+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c02e050 con 0x7f63880039a0 2023-11-24T08:02:33.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.576+0000 7f63977fe640 1 -- 172.21.15.161:0/2895007000 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c0035f0 con 0x7f63880039a0 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639db27640 1 -- 172.21.15.161:0/2895007000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63880039a0 msgr2=0x7f6388003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639db27640 1 --2- 172.21.15.161:0/2895007000 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63880039a0 0x7f6388003dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f638c001750 tx=0x7f63880057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639d326640 1 -- 172.21.15.161:0/2895007000 reap_dead start 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639db27640 1 -- 172.21.15.161:0/2895007000 shutdown_connections 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639db27640 1 -- 172.21.15.161:0/2895007000 >> 172.21.15.161:0/2895007000 conn(0x7f639806a800 msgr2=0x7f639806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639db27640 1 -- 172.21.15.161:0/2895007000 shutdown_connections 2023-11-24T08:02:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.577+0000 7f639db27640 1 -- 172.21.15.161:0/2895007000 wait complete. 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.579+0000 7f639db27640 1 Processor -- start 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.579+0000 7f639db27640 1 -- start start 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f639db27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880039a0 0x7f63981423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f639db27640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 0x7f6398159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f639db27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63981e0f00 0x7f63981e1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f639db27640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981e3310 con 0x7f63981411d0 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f639db27640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981e18c0 con 0x7f63880039a0 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f639db27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6398142a20 con 0x7f63981e0f00 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f6397fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 0x7f6398159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f6397fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 0x7f6398159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53962/0 (socket says 172.21.15.161:53962) 2023-11-24T08:02:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.580+0000 7f6397fff640 1 -- 172.21.15.161:0/3656390071 learned_addr learned my addr 172.21.15.161:0/3656390071 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f6397fff640 1 -- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63981e0f00 msgr2=0x7f63981e1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f6397fff640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63981e0f00 0x7f63981e1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f6397fff640 1 -- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880039a0 msgr2=0x7f63981423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f639cb25640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880039a0 0x7f63981423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f6397fff640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880039a0 0x7f63981423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f6397fff640 1 -- 172.21.15.161:0/3656390071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6398142d00 con 0x7f63981411d0 2023-11-24T08:02:33.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f6397fff640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 0x7f6398159ee0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f638400d720 tx=0x7f638400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63840074e0 con 0x7f63981411d0 2023-11-24T08:02:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6384007640 con 0x7f63981411d0 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6384004a20 con 0x7f63981411d0 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.581+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6398142fe0 con 0x7f63981411d0 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.582+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639815a420 con 0x7f63981411d0 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.583+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6398067450 con 0x7f63981411d0 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.583+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6384004b80 con 0x7f63981411d0 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.584+0000 7f63957fa640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f637c06b020 0x7f637c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.584+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6384089280 con 0x7f63981411d0 2023-11-24T08:02:33.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.585+0000 7f639cb25640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f637c06b020 0x7f637c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:33.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.586+0000 7f639cb25640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f637c06b020 0x7f637c06d4e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f638c033000 tx=0x7f638c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:33.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.589+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6384053f90 con 0x7f63981411d0 2023-11-24T08:02:33.850 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.848+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f63980ceb30 con 0x7f63981411d0 2023-11-24T08:02:33.851 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.849+0000 7f63957fa640 1 -- 172.21.15.161:0/3656390071 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1517 (secure 0 0 0) 0x7f63840575b0 con 0x7f63981411d0 2023-11-24T08:02:33.851 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:33.851 INFO:teuthology.orchestra.run.smithi161.stdout:{"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":154,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1700812818,"num_in_osds":8,"osd_in_since":1700812809,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":72},{"state_name":"creating+peering","count":25}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592778,"bytes_used":235364352,"bytes_avail":772858748928,"bytes_total":773094113280,"inactive_pgs_ratio":0.25773194432258606,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5688}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-11-24T08:02:14.565760+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-24T08:02:33.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.851+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f637c06b020 msgr2=0x7f637c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.851+0000 7f639db27640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f637c06b020 0x7f637c06d4e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f638c033000 tx=0x7f638c009030 comp rx=0 tx=0).stop 2023-11-24T08:02:33.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 msgr2=0x7f6398159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:33.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 0x7f6398159ee0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f638400d720 tx=0x7f638400dbe0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.854 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 shutdown_connections 2023-11-24T08:02:33.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f637c06b020 0x7f637c06d4e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63981e0f00 0x7f63981e1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63981411d0 0x7f6398159ee0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 --2- 172.21.15.161:0/3656390071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63880039a0 0x7f63981423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:33.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 >> 172.21.15.161:0/3656390071 conn(0x7f639806a800 msgr2=0x7f639806d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:33.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 shutdown_connections 2023-11-24T08:02:33.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:33.852+0000 7f639db27640 1 -- 172.21.15.161:0/3656390071 wait complete. 2023-11-24T08:02:33.874 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-24T08:02:33.874 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:02:34.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.079+0000 7fb357b73640 1 Processor -- start 2023-11-24T08:02:34.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.079+0000 7fb357b73640 1 -- start start 2023-11-24T08:02:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.081+0000 7fb357b73640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3500cf9a0 0x7fb350166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.081+0000 7fb357b73640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35015c5f0 con 0x7fb35013df80 2023-11-24T08:02:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.081+0000 7fb357b73640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35006c470 con 0x7fb35013e360 2023-11-24T08:02:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.081+0000 7fb357b73640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35006c750 con 0x7fb3500cf9a0 2023-11-24T08:02:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.081+0000 7fb35590f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb35013df80 0x7fb35015bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34478/0 (socket says 172.21.15.161:34478) 2023-11-24T08:02:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.081+0000 7fb35590f640 1 -- 172.21.15.161:0/3579327967 learned_addr learned my addr 172.21.15.161:0/3579327967 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:34.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092045188 0 0) 0x7fb35015c5f0 con 0x7fb35013df80 2023-11-24T08:02:34.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb33c003520 con 0x7fb35013df80 2023-11-24T08:02:34.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb356110640 1 --2- 172.21.15.161:0/3579327967 >> v2:172.21.15.175:3300/0 conn(0x7fb3500cf9a0 0x7fb350166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:34.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2467696561 0 0) 0x7fb33c003520 con 0x7fb35013df80 2023-11-24T08:02:34.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 >> v2:172.21.15.175:3300/0 conn(0x7fb3500cf9a0 msgr2=0x7fb350166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:34.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 --2- 172.21.15.161:0/3579327967 >> v2:172.21.15.175:3300/0 conn(0x7fb3500cf9a0 0x7fb350166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 >> v1:172.21.15.175:6789/0 conn(0x7fb35013e360 legacy=0x7fb3500cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35006ca30 con 0x7fb35013df80 2023-11-24T08:02:34.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fb34c001670 con 0x7fb35013df80 2023-11-24T08:02:34.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 >> v1:172.21.15.161:6789/0 conn(0x7fb35013df80 legacy=0x7fb35015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb33c0039c0 0x7fb33c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb33c0047c0 0x7fb33c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0051d0 0x7fb33c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35006c750 con 0x7fb33c0039c0 2023-11-24T08:02:34.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00c120 con 0x7fb33c0051d0 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33c00c2e0 con 0x7fb33c0047c0 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.082+0000 7fb35590f640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb33c0039c0 0x7fb33c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.083+0000 7fb35590f640 1 -- 172.21.15.161:0/3579327967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb33c0047c0 msgr2=0x7fb33c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.083+0000 7fb35590f640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb33c0047c0 0x7fb33c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.083+0000 7fb35590f640 1 -- 172.21.15.161:0/3579327967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0051d0 msgr2=0x7fb33c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.083+0000 7fb35590f640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0051d0 0x7fb33c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.083+0000 7fb35590f640 1 -- 172.21.15.161:0/3579327967 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33c003520 con 0x7fb33c0039c0 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.083+0000 7fb356110640 1 -- 172.21.15.161:0/3579327967 reap_dead start 2023-11-24T08:02:34.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.084+0000 7fb35590f640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb33c0039c0 0x7fb33c003de0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c0e0 tx=0x7fb33c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499626d79b48d2df server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.084+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c005ad0 con 0x7fb33c0039c0 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.084+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c005c30 con 0x7fb33c0039c0 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.084+0000 7fb35490d640 1 -- 172.21.15.161:0/3579327967 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c02ca50 con 0x7fb33c0039c0 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 -- 172.21.15.161:0/3579327967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb33c0039c0 msgr2=0x7fb33c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb33c0039c0 0x7fb33c003de0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00c0e0 tx=0x7fb33c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 -- 172.21.15.161:0/3579327967 shutdown_connections 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 --2- 172.21.15.161:0/3579327967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb33c0039c0 0x7fb33c003de0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 -- 172.21.15.161:0/3579327967 >> 172.21.15.161:0/3579327967 conn(0x7fb35006a800 msgr2=0x7fb35006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:34.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 -- 172.21.15.161:0/3579327967 shutdown_connections 2023-11-24T08:02:34.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.085+0000 7fb357b73640 1 -- 172.21.15.161:0/3579327967 wait complete. 2023-11-24T08:02:34.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.087+0000 7fb357b73640 1 Processor -- start 2023-11-24T08:02:34.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.087+0000 7fb357b73640 1 -- start start 2023-11-24T08:02:34.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.088+0000 7fb357b73640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0039c0 0x7fb3500a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.088+0000 7fb357b73640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 0x7fb3500a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.088+0000 7fb357b73640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb350153170 0x7fb3500afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.088+0000 7fb357b73640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500a8a00 con 0x7fb35013d6b0 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.088+0000 7fb357b73640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500a8c80 con 0x7fb33c0039c0 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.088+0000 7fb357b73640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500a8f60 con 0x7fb350153170 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 0x7fb3500a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 0x7fb3500a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53986/0 (socket says 172.21.15.161:53986) 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 -- 172.21.15.161:0/3081788755 learned_addr learned my addr 172.21.15.161:0/3081788755 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35590f640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0039c0 0x7fb3500a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb356110640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb350153170 0x7fb3500afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:34.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 -- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb350153170 msgr2=0x7fb3500afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb350153170 0x7fb3500afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 -- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0039c0 msgr2=0x7fb3500a9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0039c0 0x7fb3500a9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 -- 172.21.15.161:0/3081788755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500a9240 con 0x7fb35013d6b0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35590f640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0039c0 0x7fb3500a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.089+0000 7fb35510e640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 0x7fb3500a84c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb34000c430 tx=0x7fb34000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.090+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400052d0 con 0x7fb35013d6b0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.090+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340005450 con 0x7fb35013d6b0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.090+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340003830 con 0x7fb35013d6b0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.090+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3500a9520 con 0x7fb35013d6b0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.090+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3501535f0 con 0x7fb35013d6b0 2023-11-24T08:02:34.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.091+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3500cc300 con 0x7fb35013d6b0 2023-11-24T08:02:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.092+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb340003990 con 0x7fb35013d6b0 2023-11-24T08:02:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.093+0000 7fb3467fc640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb33406b020 0x7fb33406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.093+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb340088b00 con 0x7fb35013d6b0 2023-11-24T08:02:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.094+0000 7fb35590f640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb33406b020 0x7fb33406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.095+0000 7fb35590f640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb33406b020 0x7fb33406d4e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb34c034000 tx=0x7fb34c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.098+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb34008ae60 con 0x7fb35013d6b0 2023-11-24T08:02:34.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.287+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb35006cff0 con 0x7fb33406b020 2023-11-24T08:02:34.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.308+0000 7fb3467fc640 1 -- 172.21.15.161:0/3081788755 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7fb34c0014f0 con 0x7fb33406b020 2023-11-24T08:02:34.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:34.316 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:02:34.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb33406b020 msgr2=0x7fb33406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb33406b020 0x7fb33406d4e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb34c034000 tx=0x7fb34c009030 comp rx=0 tx=0).stop 2023-11-24T08:02:34.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 msgr2=0x7fb3500a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:34.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 0x7fb3500a84c0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb34000c430 tx=0x7fb34000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 shutdown_connections 2023-11-24T08:02:34.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb33406b020 0x7fb33406d4e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb350153170 0x7fb3500afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb35013d6b0 0x7fb3500a84c0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 --2- 172.21.15.161:0/3081788755 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb33c0039c0 0x7fb3500a9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:34.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 >> 172.21.15.161:0/3081788755 conn(0x7fb35006a800 msgr2=0x7fb35015cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:34.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 shutdown_connections 2023-11-24T08:02:34.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:34.314+0000 7fb357b73640 1 -- 172.21.15.161:0/3081788755 wait complete. 2023-11-24T08:02:34.336 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2023-11-24T08:02:32.570870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229848,"kb_used_data":5328,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744872,"statfs":{"total":773094113280,"available":772858748928,"internally_reserved":0,"allocated":5455872,"data_stored":2884003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001807"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.874263+0000","last_change":"2023-11-24T08:02:27.871772+0000","last_active":"2023-11-24T08:02:27.874263+0000","last_peered":"2023-11-24T08:02:27.874263+0000","last_clean":"2023-11-24T08:02:27.874263+0000","last_became_active":"2023-11-24T08:02:27.871437+0000","last_became_peered":"2023-11-24T08:02:27.871437+0000","last_unstale":"2023-11-24T08:02:27.874263+0000","last_undegraded":"2023-11-24T08:02:27.874263+0000","last_fullsized":"2023-11-24T08:02:27.874263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.875065+0000","last_change":"2023-11-24T08:02:27.872430+0000","last_active":"2023-11-24T08:02:27.875065+0000","last_peered":"2023-11-24T08:02:27.875065+0000","last_clean":"2023-11-24T08:02:27.875065+0000","last_became_active":"2023-11-24T08:02:27.872092+0000","last_became_peered":"2023-11-24T08:02:27.872092+0000","last_unstale":"2023-11-24T08:02:27.875065+0000","last_undegraded":"2023-11-24T08:02:27.875065+0000","last_fullsized":"2023-11-24T08:02:27.875065+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:44.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831030+0000","last_change":"2023-11-24T08:02:26.831030+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831030+0000","last_undegraded":"2023-11-24T08:02:26.831030+0000","last_fullsized":"2023-11-24T08:02:26.831030+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823208+0000","last_change":"2023-11-24T08:02:26.823208+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823208+0000","last_undegraded":"2023-11-24T08:02:26.823208+0000","last_fullsized":"2023-11-24T08:02:26.823208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869710+0000","last_change":"2023-11-24T08:02:27.863517+0000","last_active":"2023-11-24T08:02:27.869710+0000","last_peered":"2023-11-24T08:02:27.869710+0000","last_clean":"2023-11-24T08:02:27.869710+0000","last_became_active":"2023-11-24T08:02:27.863182+0000","last_became_peered":"2023-11-24T08:02:27.863182+0000","last_unstale":"2023-11-24T08:02:27.869710+0000","last_undegraded":"2023-11-24T08:02:27.869710+0000","last_fullsized":"2023-11-24T08:02:27.869710+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:21:38.345681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876266+0000","last_change":"2023-11-24T08:02:27.867782+0000","last_active":"2023-11-24T08:02:27.876266+0000","last_peered":"2023-11-24T08:02:27.876266+0000","last_clean":"2023-11-24T08:02:27.876266+0000","last_became_active":"2023-11-24T08:02:27.867526+0000","last_became_peered":"2023-11-24T08:02:27.867526+0000","last_unstale":"2023-11-24T08:02:27.876266+0000","last_undegraded":"2023-11-24T08:02:27.876266+0000","last_fullsized":"2023-11-24T08:02:27.876266+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871698+0000","last_change":"2023-11-24T08:02:27.869161+0000","last_active":"2023-11-24T08:02:27.871698+0000","last_peered":"2023-11-24T08:02:27.871698+0000","last_clean":"2023-11-24T08:02:27.871698+0000","last_became_active":"2023-11-24T08:02:27.868873+0000","last_became_peered":"2023-11-24T08:02:27.868873+0000","last_unstale":"2023-11-24T08:02:27.871698+0000","last_undegraded":"2023-11-24T08:02:27.871698+0000","last_fullsized":"2023-11-24T08:02:27.871698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.827349+0000","last_change":"2023-11-24T08:02:26.827349+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.827349+0000","last_undegraded":"2023-11-24T08:02:26.827349+0000","last_fullsized":"2023-11-24T08:02:26.827349+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823243+0000","last_change":"2023-11-24T08:02:26.823243+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823243+0000","last_undegraded":"2023-11-24T08:02:26.823243+0000","last_fullsized":"2023-11-24T08:02:26.823243+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824006+0000","last_change":"2023-11-24T08:02:26.824006+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824006+0000","last_undegraded":"2023-11-24T08:02:26.824006+0000","last_fullsized":"2023-11-24T08:02:26.824006+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822800+0000","last_change":"2023-11-24T08:02:26.822800+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822800+0000","last_undegraded":"2023-11-24T08:02:26.822800+0000","last_fullsized":"2023-11-24T08:02:26.822800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869618+0000","last_change":"2023-11-24T08:02:27.862671+0000","last_active":"2023-11-24T08:02:27.869618+0000","last_peered":"2023-11-24T08:02:27.869618+0000","last_clean":"2023-11-24T08:02:27.869618+0000","last_became_active":"2023-11-24T08:02:27.862402+0000","last_became_peered":"2023-11-24T08:02:27.862402+0000","last_unstale":"2023-11-24T08:02:27.869618+0000","last_undegraded":"2023-11-24T08:02:27.869618+0000","last_fullsized":"2023-11-24T08:02:27.869618+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.459268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867561+0000","last_change":"2023-11-24T08:02:27.864236+0000","last_active":"2023-11-24T08:02:27.867561+0000","last_peered":"2023-11-24T08:02:27.867561+0000","last_clean":"2023-11-24T08:02:27.867561+0000","last_became_active":"2023-11-24T08:02:27.863978+0000","last_became_peered":"2023-11-24T08:02:27.863978+0000","last_unstale":"2023-11-24T08:02:27.867561+0000","last_undegraded":"2023-11-24T08:02:27.867561+0000","last_fullsized":"2023-11-24T08:02:27.867561+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:46:35.136133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825063+0000","last_change":"2023-11-24T08:02:26.825063+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825063+0000","last_undegraded":"2023-11-24T08:02:26.825063+0000","last_fullsized":"2023-11-24T08:02:26.825063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877085+0000","last_change":"2023-11-24T08:02:27.874356+0000","last_active":"2023-11-24T08:02:27.877085+0000","last_peered":"2023-11-24T08:02:27.877085+0000","last_clean":"2023-11-24T08:02:27.877085+0000","last_became_active":"2023-11-24T08:02:27.872255+0000","last_became_peered":"2023-11-24T08:02:27.872255+0000","last_unstale":"2023-11-24T08:02:27.877085+0000","last_undegraded":"2023-11-24T08:02:27.877085+0000","last_fullsized":"2023-11-24T08:02:27.877085+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.862012+0000","last_change":"2023-11-24T08:02:27.856951+0000","last_active":"2023-11-24T08:02:27.862012+0000","last_peered":"2023-11-24T08:02:27.862012+0000","last_clean":"2023-11-24T08:02:27.862012+0000","last_became_active":"2023-11-24T08:02:27.856675+0000","last_became_peered":"2023-11-24T08:02:27.856675+0000","last_unstale":"2023-11-24T08:02:27.862012+0000","last_undegraded":"2023-11-24T08:02:27.862012+0000","last_fullsized":"2023-11-24T08:02:27.862012+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:18.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829418+0000","last_change":"2023-11-24T08:02:26.829418+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829418+0000","last_undegraded":"2023-11-24T08:02:26.829418+0000","last_fullsized":"2023-11-24T08:02:26.829418+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832463+0000","last_change":"2023-11-24T08:02:26.832463+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832463+0000","last_undegraded":"2023-11-24T08:02:26.832463+0000","last_fullsized":"2023-11-24T08:02:26.832463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.877527+0000","last_change":"2023-11-24T08:02:27.873342+0000","last_active":"2023-11-24T08:02:27.877527+0000","last_peered":"2023-11-24T08:02:27.877527+0000","last_clean":"2023-11-24T08:02:27.877527+0000","last_became_active":"2023-11-24T08:02:27.873093+0000","last_became_peered":"2023-11-24T08:02:27.873093+0000","last_unstale":"2023-11-24T08:02:27.877527+0000","last_undegraded":"2023-11-24T08:02:27.877527+0000","last_fullsized":"2023-11-24T08:02:27.877527+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:17.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867019+0000","last_change":"2023-11-24T08:02:27.862475+0000","last_active":"2023-11-24T08:02:27.867019+0000","last_peered":"2023-11-24T08:02:27.867019+0000","last_clean":"2023-11-24T08:02:27.867019+0000","last_became_active":"2023-11-24T08:02:27.862160+0000","last_became_peered":"2023-11-24T08:02:27.862160+0000","last_unstale":"2023-11-24T08:02:27.867019+0000","last_undegraded":"2023-11-24T08:02:27.867019+0000","last_fullsized":"2023-11-24T08:02:27.867019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876068+0000","last_change":"2023-11-24T08:02:27.865613+0000","last_active":"2023-11-24T08:02:27.876068+0000","last_peered":"2023-11-24T08:02:27.876068+0000","last_clean":"2023-11-24T08:02:27.876068+0000","last_became_active":"2023-11-24T08:02:27.864621+0000","last_became_peered":"2023-11-24T08:02:27.864621+0000","last_unstale":"2023-11-24T08:02:27.876068+0000","last_undegraded":"2023-11-24T08:02:27.876068+0000","last_fullsized":"2023-11-24T08:02:27.876068+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:43:54.971905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824672+0000","last_change":"2023-11-24T08:02:26.824672+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824672+0000","last_undegraded":"2023-11-24T08:02:26.824672+0000","last_fullsized":"2023-11-24T08:02:26.824672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861911+0000","last_change":"2023-11-24T08:02:27.859022+0000","last_active":"2023-11-24T08:02:27.861911+0000","last_peered":"2023-11-24T08:02:27.861911+0000","last_clean":"2023-11-24T08:02:27.861911+0000","last_became_active":"2023-11-24T08:02:27.857661+0000","last_became_peered":"2023-11-24T08:02:27.857661+0000","last_unstale":"2023-11-24T08:02:27.861911+0000","last_undegraded":"2023-11-24T08:02:27.861911+0000","last_fullsized":"2023-11-24T08:02:27.861911+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:45:39.192732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.860875+0000","last_change":"2023-11-24T08:02:27.853340+0000","last_active":"2023-11-24T08:02:27.860875+0000","last_peered":"2023-11-24T08:02:27.860875+0000","last_clean":"2023-11-24T08:02:27.860875+0000","last_became_active":"2023-11-24T08:02:27.853026+0000","last_became_peered":"2023-11-24T08:02:27.853026+0000","last_unstale":"2023-11-24T08:02:27.860875+0000","last_undegraded":"2023-11-24T08:02:27.860875+0000","last_fullsized":"2023-11-24T08:02:27.860875+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869711+0000","last_change":"2023-11-24T08:02:27.867235+0000","last_active":"2023-11-24T08:02:27.869711+0000","last_peered":"2023-11-24T08:02:27.869711+0000","last_clean":"2023-11-24T08:02:27.869711+0000","last_became_active":"2023-11-24T08:02:27.866892+0000","last_became_peered":"2023-11-24T08:02:27.866892+0000","last_unstale":"2023-11-24T08:02:27.869711+0000","last_undegraded":"2023-11-24T08:02:27.869711+0000","last_fullsized":"2023-11-24T08:02:27.869711+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:49:36.129445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872468+0000","last_change":"2023-11-24T08:02:27.870150+0000","last_active":"2023-11-24T08:02:27.872468+0000","last_peered":"2023-11-24T08:02:27.872468+0000","last_clean":"2023-11-24T08:02:27.872468+0000","last_became_active":"2023-11-24T08:02:27.869895+0000","last_became_peered":"2023-11-24T08:02:27.869895+0000","last_unstale":"2023-11-24T08:02:27.872468+0000","last_undegraded":"2023-11-24T08:02:27.872468+0000","last_fullsized":"2023-11-24T08:02:27.872468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.824828+0000","last_change":"2023-11-24T08:02:26.824828+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.824828+0000","last_undegraded":"2023-11-24T08:02:26.824828+0000","last_fullsized":"2023-11-24T08:02:26.824828+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871556+0000","last_change":"2023-11-24T08:02:27.865353+0000","last_active":"2023-11-24T08:02:27.871556+0000","last_peered":"2023-11-24T08:02:27.871556+0000","last_clean":"2023-11-24T08:02:27.871556+0000","last_became_active":"2023-11-24T08:02:27.865086+0000","last_became_peered":"2023-11-24T08:02:27.865086+0000","last_unstale":"2023-11-24T08:02:27.871556+0000","last_undegraded":"2023-11-24T08:02:27.871556+0000","last_fullsized":"2023-11-24T08:02:27.871556+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:29.982443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865525+0000","last_change":"2023-11-24T08:02:27.863455+0000","last_active":"2023-11-24T08:02:27.865525+0000","last_peered":"2023-11-24T08:02:27.865525+0000","last_clean":"2023-11-24T08:02:27.865525+0000","last_became_active":"2023-11-24T08:02:27.863097+0000","last_became_peered":"2023-11-24T08:02:27.863097+0000","last_unstale":"2023-11-24T08:02:27.865525+0000","last_undegraded":"2023-11-24T08:02:27.865525+0000","last_fullsized":"2023-11-24T08:02:27.865525+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:27.501200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.832977+0000","last_change":"2023-11-24T08:02:26.832977+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.832977+0000","last_undegraded":"2023-11-24T08:02:26.832977+0000","last_fullsized":"2023-11-24T08:02:26.832977+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876882+0000","last_change":"2023-11-24T08:02:27.871959+0000","last_active":"2023-11-24T08:02:27.876882+0000","last_peered":"2023-11-24T08:02:27.876882+0000","last_clean":"2023-11-24T08:02:27.876882+0000","last_became_active":"2023-11-24T08:02:27.871685+0000","last_became_peered":"2023-11-24T08:02:27.871685+0000","last_unstale":"2023-11-24T08:02:27.876882+0000","last_undegraded":"2023-11-24T08:02:27.876882+0000","last_fullsized":"2023-11-24T08:02:27.876882+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873165+0000","last_change":"2023-11-24T08:02:27.868750+0000","last_active":"2023-11-24T08:02:27.873165+0000","last_peered":"2023-11-24T08:02:27.873165+0000","last_clean":"2023-11-24T08:02:27.873165+0000","last_became_active":"2023-11-24T08:02:27.865780+0000","last_became_peered":"2023-11-24T08:02:27.865780+0000","last_unstale":"2023-11-24T08:02:27.873165+0000","last_undegraded":"2023-11-24T08:02:27.873165+0000","last_fullsized":"2023-11-24T08:02:27.873165+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:53.929316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822134+0000","last_change":"2023-11-24T08:02:26.822134+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822134+0000","last_undegraded":"2023-11-24T08:02:26.822134+0000","last_fullsized":"2023-11-24T08:02:26.822134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878053+0000","last_change":"2023-11-24T08:02:26.843012+0000","last_active":"2023-11-24T08:02:27.878053+0000","last_peered":"2023-11-24T08:02:27.878053+0000","last_clean":"2023-11-24T08:02:27.878053+0000","last_became_active":"2023-11-24T08:02:26.842339+0000","last_became_peered":"2023-11-24T08:02:26.842339+0000","last_unstale":"2023-11-24T08:02:27.878053+0000","last_undegraded":"2023-11-24T08:02:27.878053+0000","last_fullsized":"2023-11-24T08:02:27.878053+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:30.575544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851294+0000","last_change":"2023-11-24T08:02:27.850153+0000","last_active":"2023-11-24T08:02:27.851294+0000","last_peered":"2023-11-24T08:02:27.851294+0000","last_clean":"2023-11-24T08:02:27.851294+0000","last_became_active":"2023-11-24T08:02:27.849283+0000","last_became_peered":"2023-11-24T08:02:27.849283+0000","last_unstale":"2023-11-24T08:02:27.851294+0000","last_undegraded":"2023-11-24T08:02:27.851294+0000","last_fullsized":"2023-11-24T08:02:27.851294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:38:16.249245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.842510+0000","last_change":"2023-11-24T08:02:26.838582+0000","last_active":"2023-11-24T08:02:26.842510+0000","last_peered":"2023-11-24T08:02:26.842510+0000","last_clean":"2023-11-24T08:02:26.842510+0000","last_became_active":"2023-11-24T08:02:26.838273+0000","last_became_peered":"2023-11-24T08:02:26.838273+0000","last_unstale":"2023-11-24T08:02:26.842510+0000","last_undegraded":"2023-11-24T08:02:26.842510+0000","last_fullsized":"2023-11-24T08:02:26.842510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872589+0000","last_change":"2023-11-24T08:02:27.868436+0000","last_active":"2023-11-24T08:02:27.872589+0000","last_peered":"2023-11-24T08:02:27.872589+0000","last_clean":"2023-11-24T08:02:27.872589+0000","last_became_active":"2023-11-24T08:02:27.868148+0000","last_became_peered":"2023-11-24T08:02:27.868148+0000","last_unstale":"2023-11-24T08:02:27.872589+0000","last_undegraded":"2023-11-24T08:02:27.872589+0000","last_fullsized":"2023-11-24T08:02:27.872589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.272222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848361+0000","last_change":"2023-11-24T08:02:26.845023+0000","last_active":"2023-11-24T08:02:26.848361+0000","last_peered":"2023-11-24T08:02:26.848361+0000","last_clean":"2023-11-24T08:02:26.848361+0000","last_became_active":"2023-11-24T08:02:26.844504+0000","last_became_peered":"2023-11-24T08:02:26.844504+0000","last_unstale":"2023-11-24T08:02:26.848361+0000","last_undegraded":"2023-11-24T08:02:26.848361+0000","last_fullsized":"2023-11-24T08:02:26.848361+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:13:34.764747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818355+0000","last_change":"2023-11-24T08:02:26.818355+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818355+0000","last_undegraded":"2023-11-24T08:02:26.818355+0000","last_fullsized":"2023-11-24T08:02:26.818355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867513+0000","last_change":"2023-11-24T08:02:26.840493+0000","last_active":"2023-11-24T08:02:27.867513+0000","last_peered":"2023-11-24T08:02:27.867513+0000","last_clean":"2023-11-24T08:02:27.867513+0000","last_became_active":"2023-11-24T08:02:26.840190+0000","last_became_peered":"2023-11-24T08:02:26.840190+0000","last_unstale":"2023-11-24T08:02:27.867513+0000","last_undegraded":"2023-11-24T08:02:27.867513+0000","last_fullsized":"2023-11-24T08:02:27.867513+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.829807+0000","last_change":"2023-11-24T08:02:26.829807+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.829807+0000","last_undegraded":"2023-11-24T08:02:26.829807+0000","last_fullsized":"2023-11-24T08:02:26.829807+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.872417+0000","last_change":"2023-11-24T08:02:26.837411+0000","last_active":"2023-11-24T08:02:27.872417+0000","last_peered":"2023-11-24T08:02:27.872417+0000","last_clean":"2023-11-24T08:02:27.872417+0000","last_became_active":"2023-11-24T08:02:26.837120+0000","last_became_peered":"2023-11-24T08:02:26.837120+0000","last_unstale":"2023-11-24T08:02:27.872417+0000","last_undegraded":"2023-11-24T08:02:27.872417+0000","last_fullsized":"2023-11-24T08:02:27.872417+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:10:07.268127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819356+0000","last_change":"2023-11-24T08:02:26.819356+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819356+0000","last_undegraded":"2023-11-24T08:02:26.819356+0000","last_fullsized":"2023-11-24T08:02:26.819356+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.847275+0000","last_change":"2023-11-24T08:02:26.845666+0000","last_active":"2023-11-24T08:02:26.847275+0000","last_peered":"2023-11-24T08:02:26.847275+0000","last_clean":"2023-11-24T08:02:26.847275+0000","last_became_active":"2023-11-24T08:02:26.845413+0000","last_became_peered":"2023-11-24T08:02:26.845413+0000","last_unstale":"2023-11-24T08:02:26.847275+0000","last_undegraded":"2023-11-24T08:02:26.847275+0000","last_fullsized":"2023-11-24T08:02:26.847275+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.819420+0000","last_change":"2023-11-24T08:02:26.819420+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.819420+0000","last_undegraded":"2023-11-24T08:02:26.819420+0000","last_fullsized":"2023-11-24T08:02:26.819420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.846960+0000","last_change":"2023-11-24T08:02:26.841048+0000","last_active":"2023-11-24T08:02:27.846960+0000","last_peered":"2023-11-24T08:02:27.846960+0000","last_clean":"2023-11-24T08:02:27.846960+0000","last_became_active":"2023-11-24T08:02:26.839883+0000","last_became_peered":"2023-11-24T08:02:26.839883+0000","last_unstale":"2023-11-24T08:02:27.846960+0000","last_undegraded":"2023-11-24T08:02:27.846960+0000","last_fullsized":"2023-11-24T08:02:27.846960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:06:03.431625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.861930+0000","last_change":"2023-11-24T08:02:27.859193+0000","last_active":"2023-11-24T08:02:27.861930+0000","last_peered":"2023-11-24T08:02:27.861930+0000","last_clean":"2023-11-24T08:02:27.861930+0000","last_became_active":"2023-11-24T08:02:27.858753+0000","last_became_peered":"2023-11-24T08:02:27.858753+0000","last_unstale":"2023-11-24T08:02:27.861930+0000","last_undegraded":"2023-11-24T08:02:27.861930+0000","last_fullsized":"2023-11-24T08:02:27.861930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:55.968364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840158+0000","last_change":"2023-11-24T08:02:26.833298+0000","last_active":"2023-11-24T08:02:26.840158+0000","last_peered":"2023-11-24T08:02:26.840158+0000","last_clean":"2023-11-24T08:02:26.840158+0000","last_became_active":"2023-11-24T08:02:26.832945+0000","last_became_peered":"2023-11-24T08:02:26.832945+0000","last_unstale":"2023-11-24T08:02:26.840158+0000","last_undegraded":"2023-11-24T08:02:26.840158+0000","last_fullsized":"2023-11-24T08:02:26.840158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.831434+0000","last_change":"2023-11-24T08:02:26.831434+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.831434+0000","last_undegraded":"2023-11-24T08:02:26.831434+0000","last_fullsized":"2023-11-24T08:02:26.831434+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845065+0000","last_change":"2023-11-24T08:02:26.840157+0000","last_active":"2023-11-24T08:02:26.845065+0000","last_peered":"2023-11-24T08:02:26.845065+0000","last_clean":"2023-11-24T08:02:26.845065+0000","last_became_active":"2023-11-24T08:02:26.838372+0000","last_became_peered":"2023-11-24T08:02:26.838372+0000","last_unstale":"2023-11-24T08:02:26.845065+0000","last_undegraded":"2023-11-24T08:02:26.845065+0000","last_fullsized":"2023-11-24T08:02:26.845065+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:15:21.207486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871620+0000","last_change":"2023-11-24T08:02:27.866876+0000","last_active":"2023-11-24T08:02:27.871620+0000","last_peered":"2023-11-24T08:02:27.871620+0000","last_clean":"2023-11-24T08:02:27.871620+0000","last_became_active":"2023-11-24T08:02:27.866515+0000","last_became_peered":"2023-11-24T08:02:27.866515+0000","last_unstale":"2023-11-24T08:02:27.871620+0000","last_undegraded":"2023-11-24T08:02:27.871620+0000","last_fullsized":"2023-11-24T08:02:27.871620+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.841153+0000","last_change":"2023-11-24T08:02:26.838700+0000","last_active":"2023-11-24T08:02:26.841153+0000","last_peered":"2023-11-24T08:02:26.841153+0000","last_clean":"2023-11-24T08:02:26.841153+0000","last_became_active":"2023-11-24T08:02:26.838175+0000","last_became_peered":"2023-11-24T08:02:26.838175+0000","last_unstale":"2023-11-24T08:02:26.841153+0000","last_undegraded":"2023-11-24T08:02:26.841153+0000","last_fullsized":"2023-11-24T08:02:26.841153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:17.175671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876965+0000","last_change":"2023-11-24T08:02:27.865063+0000","last_active":"2023-11-24T08:02:27.876965+0000","last_peered":"2023-11-24T08:02:27.876965+0000","last_clean":"2023-11-24T08:02:27.876965+0000","last_became_active":"2023-11-24T08:02:27.864806+0000","last_became_peered":"2023-11-24T08:02:27.864806+0000","last_unstale":"2023-11-24T08:02:27.876965+0000","last_undegraded":"2023-11-24T08:02:27.876965+0000","last_fullsized":"2023-11-24T08:02:27.876965+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.744987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867781+0000","last_change":"2023-11-24T08:02:26.841842+0000","last_active":"2023-11-24T08:02:27.867781+0000","last_peered":"2023-11-24T08:02:27.867781+0000","last_clean":"2023-11-24T08:02:27.867781+0000","last_became_active":"2023-11-24T08:02:26.841524+0000","last_became_peered":"2023-11-24T08:02:26.841524+0000","last_unstale":"2023-11-24T08:02:27.867781+0000","last_undegraded":"2023-11-24T08:02:27.867781+0000","last_fullsized":"2023-11-24T08:02:27.867781+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880633+0000","last_change":"2023-11-24T08:02:27.876155+0000","last_active":"2023-11-24T08:02:27.880633+0000","last_peered":"2023-11-24T08:02:27.880633+0000","last_clean":"2023-11-24T08:02:27.880633+0000","last_became_active":"2023-11-24T08:02:27.875932+0000","last_became_peered":"2023-11-24T08:02:27.875932+0000","last_unstale":"2023-11-24T08:02:27.880633+0000","last_undegraded":"2023-11-24T08:02:27.880633+0000","last_fullsized":"2023-11-24T08:02:27.880633+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.881849+0000","last_change":"2023-11-24T08:02:26.839195+0000","last_active":"2023-11-24T08:02:27.881849+0000","last_peered":"2023-11-24T08:02:27.881849+0000","last_clean":"2023-11-24T08:02:27.881849+0000","last_became_active":"2023-11-24T08:02:26.838946+0000","last_became_peered":"2023-11-24T08:02:26.838946+0000","last_unstale":"2023-11-24T08:02:27.881849+0000","last_undegraded":"2023-11-24T08:02:27.881849+0000","last_fullsized":"2023-11-24T08:02:27.881849+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:17.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865493+0000","last_change":"2023-11-24T08:02:27.863330+0000","last_active":"2023-11-24T08:02:27.865493+0000","last_peered":"2023-11-24T08:02:27.865493+0000","last_clean":"2023-11-24T08:02:27.865493+0000","last_became_active":"2023-11-24T08:02:27.863064+0000","last_became_peered":"2023-11-24T08:02:27.863064+0000","last_unstale":"2023-11-24T08:02:27.865493+0000","last_undegraded":"2023-11-24T08:02:27.865493+0000","last_fullsized":"2023-11-24T08:02:27.865493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:54.675687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.880362+0000","last_change":"2023-11-24T08:02:26.833854+0000","last_active":"2023-11-24T08:02:27.880362+0000","last_peered":"2023-11-24T08:02:27.880362+0000","last_clean":"2023-11-24T08:02:27.880362+0000","last_became_active":"2023-11-24T08:02:26.833026+0000","last_became_peered":"2023-11-24T08:02:26.833026+0000","last_unstale":"2023-11-24T08:02:27.880362+0000","last_undegraded":"2023-11-24T08:02:27.880362+0000","last_fullsized":"2023-11-24T08:02:27.880362+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:18.256936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.818723+0000","last_change":"2023-11-24T08:02:26.818723+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.818723+0000","last_undegraded":"2023-11-24T08:02:26.818723+0000","last_fullsized":"2023-11-24T08:02:26.818723+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852819+0000","last_change":"2023-11-24T08:02:26.832072+0000","last_active":"2023-11-24T08:02:27.852819+0000","last_peered":"2023-11-24T08:02:27.852819+0000","last_clean":"2023-11-24T08:02:27.852819+0000","last_became_active":"2023-11-24T08:02:26.831711+0000","last_became_peered":"2023-11-24T08:02:26.831711+0000","last_unstale":"2023-11-24T08:02:27.852819+0000","last_undegraded":"2023-11-24T08:02:27.852819+0000","last_fullsized":"2023-11-24T08:02:27.852819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:48.836292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876004+0000","last_change":"2023-11-24T08:02:27.863802+0000","last_active":"2023-11-24T08:02:27.876004+0000","last_peered":"2023-11-24T08:02:27.876004+0000","last_clean":"2023-11-24T08:02:27.876004+0000","last_became_active":"2023-11-24T08:02:27.863505+0000","last_became_peered":"2023-11-24T08:02:27.863505+0000","last_unstale":"2023-11-24T08:02:27.876004+0000","last_undegraded":"2023-11-24T08:02:27.876004+0000","last_fullsized":"2023-11-24T08:02:27.876004+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:11:28.155079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847468+0000","last_change":"2023-11-24T08:02:26.835308+0000","last_active":"2023-11-24T08:02:27.847468+0000","last_peered":"2023-11-24T08:02:27.847468+0000","last_clean":"2023-11-24T08:02:27.847468+0000","last_became_active":"2023-11-24T08:02:26.835069+0000","last_became_peered":"2023-11-24T08:02:26.835069+0000","last_unstale":"2023-11-24T08:02:27.847468+0000","last_undegraded":"2023-11-24T08:02:27.847468+0000","last_fullsized":"2023-11-24T08:02:27.847468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871664+0000","last_change":"2023-11-24T08:02:27.867003+0000","last_active":"2023-11-24T08:02:27.871664+0000","last_peered":"2023-11-24T08:02:27.871664+0000","last_clean":"2023-11-24T08:02:27.871664+0000","last_became_active":"2023-11-24T08:02:27.865266+0000","last_became_peered":"2023-11-24T08:02:27.865266+0000","last_unstale":"2023-11-24T08:02:27.871664+0000","last_undegraded":"2023-11-24T08:02:27.871664+0000","last_fullsized":"2023-11-24T08:02:27.871664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846302+0000","last_change":"2023-11-24T08:02:26.845056+0000","last_active":"2023-11-24T08:02:26.846302+0000","last_peered":"2023-11-24T08:02:26.846302+0000","last_clean":"2023-11-24T08:02:26.846302+0000","last_became_active":"2023-11-24T08:02:26.844746+0000","last_became_peered":"2023-11-24T08:02:26.844746+0000","last_unstale":"2023-11-24T08:02:26.846302+0000","last_undegraded":"2023-11-24T08:02:26.846302+0000","last_fullsized":"2023-11-24T08:02:26.846302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:02:45.655966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.856913+0000","last_change":"2023-11-24T08:02:27.851025+0000","last_active":"2023-11-24T08:02:27.856913+0000","last_peered":"2023-11-24T08:02:27.856913+0000","last_clean":"2023-11-24T08:02:27.856913+0000","last_became_active":"2023-11-24T08:02:27.850749+0000","last_became_peered":"2023-11-24T08:02:27.850749+0000","last_unstale":"2023-11-24T08:02:27.856913+0000","last_undegraded":"2023-11-24T08:02:27.856913+0000","last_fullsized":"2023-11-24T08:02:27.856913+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:52.362750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.878734+0000","last_change":"2023-11-24T08:02:26.834787+0000","last_active":"2023-11-24T08:02:27.878734+0000","last_peered":"2023-11-24T08:02:27.878734+0000","last_clean":"2023-11-24T08:02:27.878734+0000","last_became_active":"2023-11-24T08:02:26.834159+0000","last_became_peered":"2023-11-24T08:02:26.834159+0000","last_unstale":"2023-11-24T08:02:27.878734+0000","last_undegraded":"2023-11-24T08:02:27.878734+0000","last_fullsized":"2023-11-24T08:02:27.878734+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:20:04.530498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822775+0000","last_change":"2023-11-24T08:02:26.822775+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822775+0000","last_undegraded":"2023-11-24T08:02:26.822775+0000","last_fullsized":"2023-11-24T08:02:26.822775+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846515+0000","last_change":"2023-11-24T08:02:26.842806+0000","last_active":"2023-11-24T08:02:26.846515+0000","last_peered":"2023-11-24T08:02:26.846515+0000","last_clean":"2023-11-24T08:02:26.846515+0000","last_became_active":"2023-11-24T08:02:26.842317+0000","last_became_peered":"2023-11-24T08:02:26.842317+0000","last_unstale":"2023-11-24T08:02:26.846515+0000","last_undegraded":"2023-11-24T08:02:26.846515+0000","last_fullsized":"2023-11-24T08:02:26.846515+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870877+0000","last_change":"2023-11-24T08:02:27.868287+0000","last_active":"2023-11-24T08:02:27.870877+0000","last_peered":"2023-11-24T08:02:27.870877+0000","last_clean":"2023-11-24T08:02:27.870877+0000","last_became_active":"2023-11-24T08:02:27.867921+0000","last_became_peered":"2023-11-24T08:02:27.867921+0000","last_unstale":"2023-11-24T08:02:27.870877+0000","last_undegraded":"2023-11-24T08:02:27.870877+0000","last_fullsized":"2023-11-24T08:02:27.870877+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:12:51.094917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869028+0000","last_change":"2023-11-24T08:02:26.844242+0000","last_active":"2023-11-24T08:02:27.869028+0000","last_peered":"2023-11-24T08:02:27.869028+0000","last_clean":"2023-11-24T08:02:27.869028+0000","last_became_active":"2023-11-24T08:02:26.843949+0000","last_became_peered":"2023-11-24T08:02:26.843949+0000","last_unstale":"2023-11-24T08:02:27.869028+0000","last_undegraded":"2023-11-24T08:02:27.869028+0000","last_fullsized":"2023-11-24T08:02:27.869028+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.869412+0000","last_change":"2023-11-24T08:02:27.866311+0000","last_active":"2023-11-24T08:02:27.869412+0000","last_peered":"2023-11-24T08:02:27.869412+0000","last_clean":"2023-11-24T08:02:27.869412+0000","last_became_active":"2023-11-24T08:02:27.865994+0000","last_became_peered":"2023-11-24T08:02:27.865994+0000","last_unstale":"2023-11-24T08:02:27.869412+0000","last_undegraded":"2023-11-24T08:02:27.869412+0000","last_fullsized":"2023-11-24T08:02:27.869412+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:20.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852142+0000","last_change":"2023-11-24T08:02:26.841437+0000","last_active":"2023-11-24T08:02:27.852142+0000","last_peered":"2023-11-24T08:02:27.852142+0000","last_clean":"2023-11-24T08:02:27.852142+0000","last_became_active":"2023-11-24T08:02:26.841101+0000","last_became_peered":"2023-11-24T08:02:26.841101+0000","last_unstale":"2023-11-24T08:02:27.852142+0000","last_undegraded":"2023-11-24T08:02:27.852142+0000","last_fullsized":"2023-11-24T08:02:27.852142+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:19:21.245356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.859818+0000","last_change":"2023-11-24T08:02:27.854759+0000","last_active":"2023-11-24T08:02:27.859818+0000","last_peered":"2023-11-24T08:02:27.859818+0000","last_clean":"2023-11-24T08:02:27.859818+0000","last_became_active":"2023-11-24T08:02:27.854463+0000","last_became_peered":"2023-11-24T08:02:27.854463+0000","last_unstale":"2023-11-24T08:02:27.859818+0000","last_undegraded":"2023-11-24T08:02:27.859818+0000","last_fullsized":"2023-11-24T08:02:27.859818+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871456+0000","last_change":"2023-11-24T08:02:26.837311+0000","last_active":"2023-11-24T08:02:27.871456+0000","last_peered":"2023-11-24T08:02:27.871456+0000","last_clean":"2023-11-24T08:02:27.871456+0000","last_became_active":"2023-11-24T08:02:26.836798+0000","last_became_peered":"2023-11-24T08:02:26.836798+0000","last_unstale":"2023-11-24T08:02:27.871456+0000","last_undegraded":"2023-11-24T08:02:27.871456+0000","last_fullsized":"2023-11-24T08:02:27.871456+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:17.818121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.821010+0000","last_change":"2023-11-24T08:02:26.821010+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.821010+0000","last_undegraded":"2023-11-24T08:02:26.821010+0000","last_fullsized":"2023-11-24T08:02:26.821010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.847070+0000","last_change":"2023-11-24T08:02:26.846707+0000","last_active":"2023-11-24T08:02:27.847070+0000","last_peered":"2023-11-24T08:02:27.847070+0000","last_clean":"2023-11-24T08:02:27.847070+0000","last_became_active":"2023-11-24T08:02:26.846336+0000","last_became_peered":"2023-11-24T08:02:26.846336+0000","last_unstale":"2023-11-24T08:02:27.847070+0000","last_undegraded":"2023-11-24T08:02:27.847070+0000","last_fullsized":"2023-11-24T08:02:27.847070+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.651309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.857927+0000","last_change":"2023-11-24T08:02:27.853113+0000","last_active":"2023-11-24T08:02:27.857927+0000","last_peered":"2023-11-24T08:02:27.857927+0000","last_clean":"2023-11-24T08:02:27.857927+0000","last_became_active":"2023-11-24T08:02:27.852792+0000","last_became_peered":"2023-11-24T08:02:27.852792+0000","last_unstale":"2023-11-24T08:02:27.857927+0000","last_undegraded":"2023-11-24T08:02:27.857927+0000","last_fullsized":"2023-11-24T08:02:27.857927+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:59:12.600997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846251+0000","last_change":"2023-11-24T08:02:26.841551+0000","last_active":"2023-11-24T08:02:26.846251+0000","last_peered":"2023-11-24T08:02:26.846251+0000","last_clean":"2023-11-24T08:02:26.846251+0000","last_became_active":"2023-11-24T08:02:26.840861+0000","last_became_peered":"2023-11-24T08:02:26.840861+0000","last_unstale":"2023-11-24T08:02:26.846251+0000","last_undegraded":"2023-11-24T08:02:26.846251+0000","last_fullsized":"2023-11-24T08:02:26.846251+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.825895+0000","last_change":"2023-11-24T08:02:26.825895+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.825895+0000","last_undegraded":"2023-11-24T08:02:26.825895+0000","last_fullsized":"2023-11-24T08:02:26.825895+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851575+0000","last_change":"2023-11-24T08:02:26.831194+0000","last_active":"2023-11-24T08:02:27.851575+0000","last_peered":"2023-11-24T08:02:27.851575+0000","last_clean":"2023-11-24T08:02:27.851575+0000","last_became_active":"2023-11-24T08:02:26.830870+0000","last_became_peered":"2023-11-24T08:02:26.830870+0000","last_unstale":"2023-11-24T08:02:27.851575+0000","last_undegraded":"2023-11-24T08:02:27.851575+0000","last_fullsized":"2023-11-24T08:02:27.851575+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:28.971796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.865587+0000","last_change":"2023-11-24T08:02:27.863129+0000","last_active":"2023-11-24T08:02:27.865587+0000","last_peered":"2023-11-24T08:02:27.865587+0000","last_clean":"2023-11-24T08:02:27.865587+0000","last_became_active":"2023-11-24T08:02:27.862818+0000","last_became_peered":"2023-11-24T08:02:27.862818+0000","last_unstale":"2023-11-24T08:02:27.865587+0000","last_undegraded":"2023-11-24T08:02:27.865587+0000","last_fullsized":"2023-11-24T08:02:27.865587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:44.172148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852960+0000","last_change":"2023-11-24T08:02:26.842429+0000","last_active":"2023-11-24T08:02:27.852960+0000","last_peered":"2023-11-24T08:02:27.852960+0000","last_clean":"2023-11-24T08:02:27.852960+0000","last_became_active":"2023-11-24T08:02:26.842153+0000","last_became_peered":"2023-11-24T08:02:26.842153+0000","last_unstale":"2023-11-24T08:02:27.852960+0000","last_undegraded":"2023-11-24T08:02:27.852960+0000","last_fullsized":"2023-11-24T08:02:27.852960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:35.629826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.822712+0000","last_change":"2023-11-24T08:02:26.822712+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.822712+0000","last_undegraded":"2023-11-24T08:02:26.822712+0000","last_fullsized":"2023-11-24T08:02:26.822712+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.854493+0000","last_change":"2023-11-24T08:02:26.841087+0000","last_active":"2023-11-24T08:02:27.854493+0000","last_peered":"2023-11-24T08:02:27.854493+0000","last_clean":"2023-11-24T08:02:27.854493+0000","last_became_active":"2023-11-24T08:02:26.840807+0000","last_became_peered":"2023-11-24T08:02:26.840807+0000","last_unstale":"2023-11-24T08:02:27.854493+0000","last_undegraded":"2023-11-24T08:02:27.854493+0000","last_fullsized":"2023-11-24T08:02:27.854493+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:59.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.867833+0000","last_change":"2023-11-24T08:02:27.861891+0000","last_active":"2023-11-24T08:02:27.867833+0000","last_peered":"2023-11-24T08:02:27.867833+0000","last_clean":"2023-11-24T08:02:27.867833+0000","last_became_active":"2023-11-24T08:02:27.861391+0000","last_became_peered":"2023-11-24T08:02:27.861391+0000","last_unstale":"2023-11-24T08:02:27.867833+0000","last_undegraded":"2023-11-24T08:02:27.867833+0000","last_fullsized":"2023-11-24T08:02:27.867833+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.848396+0000","last_change":"2023-11-24T08:02:26.845613+0000","last_active":"2023-11-24T08:02:26.848396+0000","last_peered":"2023-11-24T08:02:26.848396+0000","last_clean":"2023-11-24T08:02:26.848396+0000","last_became_active":"2023-11-24T08:02:26.845190+0000","last_became_peered":"2023-11-24T08:02:26.845190+0000","last_unstale":"2023-11-24T08:02:26.848396+0000","last_undegraded":"2023-11-24T08:02:26.848396+0000","last_fullsized":"2023-11-24T08:02:26.848396+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:11:34.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876976+0000","last_change":"2023-11-24T08:02:27.874289+0000","last_active":"2023-11-24T08:02:27.876976+0000","last_peered":"2023-11-24T08:02:27.876976+0000","last_clean":"2023-11-24T08:02:27.876976+0000","last_became_active":"2023-11-24T08:02:27.873177+0000","last_became_peered":"2023-11-24T08:02:27.873177+0000","last_unstale":"2023-11-24T08:02:27.876976+0000","last_undegraded":"2023-11-24T08:02:27.876976+0000","last_fullsized":"2023-11-24T08:02:27.876976+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.852098+0000","last_change":"2023-11-24T08:02:26.840761+0000","last_active":"2023-11-24T08:02:27.852098+0000","last_peered":"2023-11-24T08:02:27.852098+0000","last_clean":"2023-11-24T08:02:27.852098+0000","last_became_active":"2023-11-24T08:02:26.838173+0000","last_became_peered":"2023-11-24T08:02:26.838173+0000","last_unstale":"2023-11-24T08:02:27.852098+0000","last_undegraded":"2023-11-24T08:02:27.852098+0000","last_fullsized":"2023-11-24T08:02:27.852098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.876091+0000","last_change":"2023-11-24T08:02:27.865925+0000","last_active":"2023-11-24T08:02:27.876091+0000","last_peered":"2023-11-24T08:02:27.876091+0000","last_clean":"2023-11-24T08:02:27.876091+0000","last_became_active":"2023-11-24T08:02:27.865643+0000","last_became_peered":"2023-11-24T08:02:27.865643+0000","last_unstale":"2023-11-24T08:02:27.876091+0000","last_undegraded":"2023-11-24T08:02:27.876091+0000","last_fullsized":"2023-11-24T08:02:27.876091+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:00.868558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.846408+0000","last_change":"2023-11-24T08:02:26.842216+0000","last_active":"2023-11-24T08:02:26.846408+0000","last_peered":"2023-11-24T08:02:26.846408+0000","last_clean":"2023-11-24T08:02:26.846408+0000","last_became_active":"2023-11-24T08:02:26.841172+0000","last_became_peered":"2023-11-24T08:02:26.841172+0000","last_unstale":"2023-11-24T08:02:26.846408+0000","last_undegraded":"2023-11-24T08:02:26.846408+0000","last_fullsized":"2023-11-24T08:02:26.846408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:19.921630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.871968+0000","last_change":"2023-11-24T08:02:27.866805+0000","last_active":"2023-11-24T08:02:27.871968+0000","last_peered":"2023-11-24T08:02:27.871968+0000","last_clean":"2023-11-24T08:02:27.871968+0000","last_became_active":"2023-11-24T08:02:27.866254+0000","last_became_peered":"2023-11-24T08:02:27.866254+0000","last_unstale":"2023-11-24T08:02:27.871968+0000","last_undegraded":"2023-11-24T08:02:27.871968+0000","last_fullsized":"2023-11-24T08:02:27.871968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:55:47.185739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.845567+0000","last_change":"2023-11-24T08:02:26.837671+0000","last_active":"2023-11-24T08:02:26.845567+0000","last_peered":"2023-11-24T08:02:26.845567+0000","last_clean":"2023-11-24T08:02:26.845567+0000","last_became_active":"2023-11-24T08:02:26.837141+0000","last_became_peered":"2023-11-24T08:02:26.837141+0000","last_unstale":"2023-11-24T08:02:26.845567+0000","last_undegraded":"2023-11-24T08:02:26.845567+0000","last_fullsized":"2023-11-24T08:02:26.845567+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:02.489853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823776+0000","last_change":"2023-11-24T08:02:26.823776+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823776+0000","last_undegraded":"2023-11-24T08:02:26.823776+0000","last_fullsized":"2023-11-24T08:02:26.823776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.840559+0000","last_change":"2023-11-24T08:02:26.834763+0000","last_active":"2023-11-24T08:02:26.840559+0000","last_peered":"2023-11-24T08:02:26.840559+0000","last_clean":"2023-11-24T08:02:26.840559+0000","last_became_active":"2023-11-24T08:02:26.834426+0000","last_became_peered":"2023-11-24T08:02:26.834426+0000","last_unstale":"2023-11-24T08:02:26.840559+0000","last_undegraded":"2023-11-24T08:02:26.840559+0000","last_fullsized":"2023-11-24T08:02:26.840559+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:25:03.327550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":45,"state":"creating+peering","last_fresh":"2023-11-24T08:02:26.823658+0000","last_change":"2023-11-24T08:02:26.823658+0000","last_active":"2023-11-24T08:02:26.799238+0000","last_peered":"2023-11-24T08:02:26.799238+0000","last_clean":"2023-11-24T08:02:26.799238+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:02:26.823658+0000","last_undegraded":"2023-11-24T08:02:26.823658+0000","last_fullsized":"2023-11-24T08:02:26.823658+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.873697+0000","last_change":"2023-11-24T08:02:26.843331+0000","last_active":"2023-11-24T08:02:27.873697+0000","last_peered":"2023-11-24T08:02:27.873697+0000","last_clean":"2023-11-24T08:02:27.873697+0000","last_became_active":"2023-11-24T08:02:26.843044+0000","last_became_peered":"2023-11-24T08:02:26.843044+0000","last_unstale":"2023-11-24T08:02:27.873697+0000","last_undegraded":"2023-11-24T08:02:27.873697+0000","last_fullsized":"2023-11-24T08:02:27.873697+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":187,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-11-24T08:02:26.820974+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:02:26.820974+0000","last_peered":"2023-11-24T08:02:26.820974+0000","last_clean":"2023-11-24T08:02:26.820974+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:02:26.820974+0000","last_undegraded":"2023-11-24T08:02:26.820974+0000","last_fullsized":"2023-11-24T08:02:26.820974+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":805519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.113,"15min":1.133},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.5229999999999999,"5min":1.72,"15min":1.72},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.093,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.70599999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1830000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.159,"15min":1.161},"min":{"1min":0.79800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5229999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.147,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5389999999999999,"5min":2.02,"15min":2.02},"last":1.087}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3759999999999999,"15min":1.383},"min":{"1min":1.0029999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6319999999999999,"5min":1.944,"15min":1.944},"last":1.5189999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1619999999999999,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6000000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.405,"15min":1.411},"min":{"1min":0.94599999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.3799999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4079999999999999,"15min":1.4139999999999999},"min":{"1min":0.98499999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3300000000000001,"15min":1.3129999999999999},"min":{"1min":0.98399999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.774,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.4710000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5569999999999999,"15min":1.5620000000000001},"min":{"1min":1.2669999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7609999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.595},{"interface":"front","average":{"1min":1.552,"5min":1.542,"15min":1.54},"min":{"1min":1.085,"5min":1.01,"15min":1.01},"max":{"1min":1.881,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.4319999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.6160000000000001,"15min":1.609},"min":{"1min":1.2210000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.141,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.5349999999999999,"15min":1.5269999999999999},"min":{"1min":1.2529999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.839,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.2769999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":540672,"data_stored":215733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.72199999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1970000000000001,"15min":1.1950000000000001},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.238,"15min":1.244},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5109999999999999,"5min":2.597,"15min":2.597},"last":1.5600000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2390000000000001,"15min":1.2589999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.623,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.29},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.706,"5min":2.831,"15min":2.831},"last":1.468}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.294,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.605,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.3360000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3879999999999999,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.873},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4019999999999999,"15min":1.4119999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3859999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5920000000000001,"15min":1.5960000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.163},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.546,"15min":1.54},"min":{"1min":1.016,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.226}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.6060000000000001,"15min":1.6180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9159999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.28},{"interface":"front","average":{"1min":1.649,"5min":1.6020000000000001,"15min":1.5940000000000001},"min":{"1min":1.202,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.444}]}]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":536576,"data_stored":215131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.72,"5min":2.431,"15min":2.431},"last":1.446},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0640000000000001,"15min":1.056},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.141,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5149999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.2909999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4139999999999999,"5min":1.768,"15min":1.768},"last":0.85299999999999998}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.335,"15min":1.351},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6339999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.0800000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.339,"15min":1.373},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7789999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7569999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.385}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.4359999999999999},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.569,"15min":2.569},"last":1.232},{"interface":"front","average":{"1min":1.361,"5min":1.5129999999999999,"15min":1.538},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.121}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.665,"15min":1.7130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.96,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.577},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.113},"last":1.3400000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509470,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":544768,"data_stored":215699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.383,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.50900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":1.3480000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0369999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.486,"5min":1.601,"15min":1.601},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.998},"min":{"1min":0.59699999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.526,"5min":1.569,"15min":1.569},"last":1.1910000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.111,"15min":1.105},"min":{"1min":0.75700000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5429999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.1799999999999999},"min":{"1min":0.77500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.272}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.288,"15min":1.2789999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.482},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2470000000000001,"15min":1.2450000000000001},"min":{"1min":0.77400000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.3140000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2370000000000001,"15min":1.24},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6699999999999999,"5min":1.861,"15min":1.861},"last":1.52},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3680000000000001,"15min":1.3640000000000001},"min":{"1min":0.91000000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.921,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.389}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.294},"min":{"1min":0.76800000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.262},"min":{"1min":0.85499999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.746,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5780000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":216695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.41899999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.27,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.526,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":3.343}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.504,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.113,"15min":1.137},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3089999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":2.3479999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96599999999999997,"15min":0.97099999999999997},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.236,"5min":1.637,"15min":1.637},"last":7.5670000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.409,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":2.3980000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.794,"5min":6.452,"15min":6.452},"last":7.0119999999999996},{"interface":"front","average":{"1min":1.349,"5min":1.548,"15min":1.581},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7370000000000001,"5min":6.306,"15min":6.306},"last":7.0609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.5189999999999999,"15min":1.5369999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7889999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.296,"15min":1.3069999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.708,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":12.798}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.381,"15min":1.3879999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.857,"5min":2.069,"15min":2.069},"last":7.6200000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.577,"15min":1.6160000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8779999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":0.85499999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.786,"5min":1.948,"15min":1.948},"last":7.4539999999999997},{"interface":"front","average":{"1min":1.454,"5min":1.5900000000000001,"15min":1.6120000000000001},"min":{"1min":0.93200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.921,"5min":6.399,"15min":6.399},"last":1.538}]}]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.60199999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.629,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.3680000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.099,"15min":1.1200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.536,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1639999999999999,"15min":1.159},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8340000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.23},{"interface":"front","average":{"1min":1.145,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.51,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.3009999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3959999999999999,"5min":1.518,"15min":1.518},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.4279999999999999,"15min":1.446},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.794,"5min":1.966,"15min":1.966},"last":1.488}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8420000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.611},{"interface":"front","average":{"1min":1.282,"5min":1.4059999999999999,"15min":1.4259999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8959999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.044}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.492,"15min":1.508},"min":{"1min":1.0609999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.056,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.532,"15min":1.52},"min":{"1min":1.149,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.986,"5min":2.073,"15min":2.073},"last":1.6679999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5549999999999999,"15min":1.5640000000000001},"min":{"1min":1.1519999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7589999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.6000000000000001,"15min":1.6240000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.968,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.5309999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.6080000000000001,"15min":1.6120000000000001},"min":{"1min":1.208,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.897,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.575,"5min":1.6870000000000001,"15min":1.706},"min":{"1min":1.262,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0099999999999998,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.4079999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":208286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.40100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5109999999999999,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":1.012},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":3.266,"15min":3.266},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.0620000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1819999999999999,"15min":1.196},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5780000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.216},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.597,"5min":1.976,"15min":1.976},"last":0.89400000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.4710000000000001,"15min":1.5189999999999999},"min":{"1min":0.73099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1139999999999999,"5min":4.367,"15min":4.367},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.4370000000000001,"15min":1.4550000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8939999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.3420000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.5289999999999999,"15min":1.583},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6890000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4830000000000001,"15min":1.5029999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7170000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.155}]},{"osd":6,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.9570000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.256},{"interface":"front","average":{"1min":1.419,"5min":1.639,"15min":1.675},"min":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0059999999999998,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.234}]},{"osd":7,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8220000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.377,"5min":1.657,"15min":1.704},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0739999999999998,"5min":4.452,"15min":4.452},"last":1.1830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1088,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1114112,"data_stored":798654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0660000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1299999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":1.101}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.3859999999999999},{"interface":"front","average":{"1min":0.876,"5min":1.0149999999999999,"15min":1.038},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.466,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.04,"15min":1.046},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.512,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.284},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.622,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5600000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6459999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2170000000000001,"15min":1.2250000000000001},"min":{"1min":0.91900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.431,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.544},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6439999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.0569999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.476,"15min":1.5089999999999999},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.895,"5min":2.839,"15min":2.839},"last":1.5920000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3660000000000001,"15min":1.3879999999999999},"min":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5389999999999999,"5min":2.823,"15min":2.823},"last":1.4450000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.72,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.7350000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86499999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0539999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.337}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1480000000000001,"5min":2.875,"15min":2.875},"last":1.476},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.776,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:02:37.343 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:02:37.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.564+0000 7f16ceee0640 1 Processor -- start 2023-11-24T08:02:37.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.565+0000 7f16ceee0640 1 -- start start 2023-11-24T08:02:37.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.566+0000 7f16ceee0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 0x7f16c815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:37.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.566+0000 7f16ceee0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16c80b3ae0 0x7f16c806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:37.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.566+0000 7f16ceee0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c8070c40 con 0x7f16c806d120 2023-11-24T08:02:37.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.566+0000 7f16ceee0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8071450 con 0x7f16c80b3ae0 2023-11-24T08:02:37.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.566+0000 7f16ceee0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c806c470 con 0x7f16c80ae5a0 2023-11-24T08:02:37.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.567+0000 7f16ccc7c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 0x7f16c815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:37.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.567+0000 7f16ccc7c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 0x7f16c815e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:60532/0 (socket says 172.21.15.161:60532) 2023-11-24T08:02:37.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.567+0000 7f16ccc7c640 1 -- 172.21.15.161:0/1857506100 learned_addr learned my addr 172.21.15.161:0/1857506100 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:37.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.567+0000 7f16c7fff640 1 --2- 172.21.15.161:0/1857506100 >> v2:172.21.15.175:3300/0 conn(0x7f16c80b3ae0 0x7f16c806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:37.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.568+0000 7f16ccc7c640 1 -- 172.21.15.161:0/1857506100 >> v2:172.21.15.175:3300/0 conn(0x7f16c80b3ae0 msgr2=0x7f16c806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:37.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.568+0000 7f16ccc7c640 1 --2- 172.21.15.161:0/1857506100 >> v2:172.21.15.175:3300/0 conn(0x7f16c80b3ae0 0x7f16c806cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.568+0000 7f16ccc7c640 1 -- 172.21.15.161:0/1857506100 >> v1:172.21.15.175:6789/0 conn(0x7f16c806d120 legacy=0x7f16c80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:37.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.568+0000 7f16ccc7c640 1 -- 172.21.15.161:0/1857506100 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c806c750 con 0x7f16c80ae5a0 2023-11-24T08:02:37.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.569+0000 7f16ccc7c640 1 --2- 172.21.15.161:0/1857506100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 0x7f16c815e430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009870 tx=0x7f16bc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd3caa42bed8ee8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:37.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.570+0000 7f16c77fe640 1 -- 172.21.15.161:0/1857506100 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc030840 con 0x7f16c80ae5a0 2023-11-24T08:02:37.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.570+0000 7f16c77fe640 1 -- 172.21.15.161:0/1857506100 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0309a0 con 0x7f16c80ae5a0 2023-11-24T08:02:37.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.570+0000 7f16c77fe640 1 -- 172.21.15.161:0/1857506100 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc030d30 con 0x7f16c80ae5a0 2023-11-24T08:02:37.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 -- 172.21.15.161:0/1857506100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 msgr2=0x7f16c815e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:37.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1857506100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 0x7f16c815e430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009870 tx=0x7f16bc02b980 comp rx=0 tx=0).stop 2023-11-24T08:02:37.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 -- 172.21.15.161:0/1857506100 shutdown_connections 2023-11-24T08:02:37.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1857506100 >> v2:172.21.15.175:3300/0 conn(0x7f16c80b3ae0 0x7f16c806cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1857506100 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c80ae5a0 0x7f16c815e430 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 -- 172.21.15.161:0/1857506100 >> 172.21.15.161:0/1857506100 conn(0x7f16c806a800 msgr2=0x7f16c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:37.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 -- 172.21.15.161:0/1857506100 shutdown_connections 2023-11-24T08:02:37.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.571+0000 7f16ceee0640 1 -- 172.21.15.161:0/1857506100 wait complete. 2023-11-24T08:02:37.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.572+0000 7f16ceee0640 1 Processor -- start 2023-11-24T08:02:37.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.573+0000 7f16ceee0640 1 -- start start 2023-11-24T08:02:37.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ceee0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c806d120 0x7f16c80ce210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:37.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ceee0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 0x7f16c814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:37.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ceee0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c80b3ae0 0x7f16c80cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:37.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ceee0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80adb30 con 0x7f16c80ae5a0 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ceee0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8157310 con 0x7f16c80b3ae0 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ceee0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81575f0 con 0x7f16c806d120 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 0x7f16c814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 0x7f16c814b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53996/0 (socket says 172.21.15.161:53996) 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 -- 172.21.15.161:0/1414180193 learned_addr learned my addr 172.21.15.161:0/1414180193 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16ccc7c640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c806d120 0x7f16c80ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 -- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c806d120 msgr2=0x7f16c80ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c806d120 0x7f16c80ce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 -- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c80b3ae0 msgr2=0x7f16c80cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c80b3ae0 0x7f16c80cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.574+0000 7f16c7fff640 1 -- 172.21.15.161:0/1414180193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0094d0 con 0x7f16c80ae5a0 2023-11-24T08:02:37.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.575+0000 7f16c7fff640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 0x7f16c814b8b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f16b400e870 tx=0x7f16b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:37.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.575+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b40094f0 con 0x7f16c80ae5a0 2023-11-24T08:02:37.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.575+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b400c940 con 0x7f16c80ae5a0 2023-11-24T08:02:37.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.575+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400ccf0 con 0x7f16c80ae5a0 2023-11-24T08:02:37.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.575+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c81578d0 con 0x7f16c80ae5a0 2023-11-24T08:02:37.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.575+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c8157e90 con 0x7f16c80ae5a0 2023-11-24T08:02:37.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.576+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c8072130 con 0x7f16c80ae5a0 2023-11-24T08:02:37.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.577+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f16b4013470 con 0x7f16c80ae5a0 2023-11-24T08:02:37.580 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.579+0000 7f16c57fa640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16ac06b020 0x7f16ac06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:37.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.579+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b4089a80 con 0x7f16c80ae5a0 2023-11-24T08:02:37.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.579+0000 7f16ccc7c640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16ac06b020 0x7f16ac06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:37.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.580+0000 7f16ccc7c640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16ac06b020 0x7f16ac06d4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f16bc036000 tx=0x7f16bc03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:37.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.584+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16b4054810 con 0x7f16c80ae5a0 2023-11-24T08:02:37.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.773+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16c8070550 con 0x7f16ac06b020 2023-11-24T08:02:37.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.796+0000 7f16c57fa640 1 -- 172.21.15.161:0/1414180193 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286855 (secure 0 0 0) 0x7f16bc030b90 con 0x7f16ac06b020 2023-11-24T08:02:37.801 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:37.804 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:02:37.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16ac06b020 msgr2=0x7f16ac06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:37.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16ac06b020 0x7f16ac06d4e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f16bc036000 tx=0x7f16bc03b040 comp rx=0 tx=0).stop 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 msgr2=0x7f16c814b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 0x7f16c814b8b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f16b400e870 tx=0x7f16b400ed30 comp rx=0 tx=0).stop 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 shutdown_connections 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16ac06b020 0x7f16ac06d4e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16c80b3ae0 0x7f16c80cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16c80ae5a0 0x7f16c814b8b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 --2- 172.21.15.161:0/1414180193 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16c806d120 0x7f16c80ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 >> 172.21.15.161:0/1414180193 conn(0x7f16c806a800 msgr2=0x7f16c815aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 shutdown_connections 2023-11-24T08:02:37.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:37.803+0000 7f16ceee0640 1 -- 172.21.15.161:0/1414180193 wait complete. 2023-11-24T08:02:37.824 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-11-24T08:02:36.572391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229976,"kb_used_data":5480,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744744,"statfs":{"total":773094113280,"available":772858617856,"internally_reserved":0,"allocated":5611520,"data_stored":2956444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":229756467},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.738991"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.358036+0000","last_change":"2023-11-24T08:02:27.871772+0000","last_active":"2023-11-24T08:02:30.358036+0000","last_peered":"2023-11-24T08:02:30.358036+0000","last_clean":"2023-11-24T08:02:30.358036+0000","last_became_active":"2023-11-24T08:02:27.871437+0000","last_became_peered":"2023-11-24T08:02:27.871437+0000","last_unstale":"2023-11-24T08:02:30.358036+0000","last_undegraded":"2023-11-24T08:02:30.358036+0000","last_fullsized":"2023-11-24T08:02:30.358036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:10:08.278774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866956+0000","last_change":"2023-11-24T08:02:27.872430+0000","last_active":"2023-11-24T08:02:28.866956+0000","last_peered":"2023-11-24T08:02:28.866956+0000","last_clean":"2023-11-24T08:02:28.866956+0000","last_became_active":"2023-11-24T08:02:27.872092+0000","last_became_peered":"2023-11-24T08:02:27.872092+0000","last_unstale":"2023-11-24T08:02:28.866956+0000","last_undegraded":"2023-11-24T08:02:28.866956+0000","last_fullsized":"2023-11-24T08:02:28.866956+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:27.453117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356254+0000","last_change":"2023-11-24T08:02:27.859923+0000","last_active":"2023-11-24T08:02:30.356254+0000","last_peered":"2023-11-24T08:02:30.356254+0000","last_clean":"2023-11-24T08:02:30.356254+0000","last_became_active":"2023-11-24T08:02:27.859621+0000","last_became_peered":"2023-11-24T08:02:27.859621+0000","last_unstale":"2023-11-24T08:02:30.356254+0000","last_undegraded":"2023-11-24T08:02:30.356254+0000","last_fullsized":"2023-11-24T08:02:30.356254+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:12:14.269577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356361+0000","last_change":"2023-11-24T08:02:27.863156+0000","last_active":"2023-11-24T08:02:30.356361+0000","last_peered":"2023-11-24T08:02:30.356361+0000","last_clean":"2023-11-24T08:02:30.356361+0000","last_became_active":"2023-11-24T08:02:27.862809+0000","last_became_peered":"2023-11-24T08:02:27.862809+0000","last_unstale":"2023-11-24T08:02:30.356361+0000","last_undegraded":"2023-11-24T08:02:30.356361+0000","last_fullsized":"2023-11-24T08:02:30.356361+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:57.092258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866294+0000","last_change":"2023-11-24T08:02:27.863517+0000","last_active":"2023-11-24T08:02:28.866294+0000","last_peered":"2023-11-24T08:02:28.866294+0000","last_clean":"2023-11-24T08:02:28.866294+0000","last_became_active":"2023-11-24T08:02:27.863182+0000","last_became_peered":"2023-11-24T08:02:27.863182+0000","last_unstale":"2023-11-24T08:02:28.866294+0000","last_undegraded":"2023-11-24T08:02:28.866294+0000","last_fullsized":"2023-11-24T08:02:28.866294+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:13:25.802758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046280+0000","last_change":"2023-11-24T08:02:27.867782+0000","last_active":"2023-11-24T08:02:30.046280+0000","last_peered":"2023-11-24T08:02:30.046280+0000","last_clean":"2023-11-24T08:02:30.046280+0000","last_became_active":"2023-11-24T08:02:27.867526+0000","last_became_peered":"2023-11-24T08:02:27.867526+0000","last_unstale":"2023-11-24T08:02:30.046280+0000","last_undegraded":"2023-11-24T08:02:30.046280+0000","last_fullsized":"2023-11-24T08:02:30.046280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:31:09.593649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357268+0000","last_change":"2023-11-24T08:02:27.869161+0000","last_active":"2023-11-24T08:02:30.357268+0000","last_peered":"2023-11-24T08:02:30.357268+0000","last_clean":"2023-11-24T08:02:30.357268+0000","last_became_active":"2023-11-24T08:02:27.868873+0000","last_became_peered":"2023-11-24T08:02:27.868873+0000","last_unstale":"2023-11-24T08:02:30.357268+0000","last_undegraded":"2023-11-24T08:02:30.357268+0000","last_fullsized":"2023-11-24T08:02:30.357268+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:30:28.744987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.354809+0000","last_change":"2023-11-24T08:02:27.857823+0000","last_active":"2023-11-24T08:02:30.354809+0000","last_peered":"2023-11-24T08:02:30.354809+0000","last_clean":"2023-11-24T08:02:30.354809+0000","last_became_active":"2023-11-24T08:02:27.856548+0000","last_became_peered":"2023-11-24T08:02:27.856548+0000","last_unstale":"2023-11-24T08:02:30.354809+0000","last_undegraded":"2023-11-24T08:02:30.354809+0000","last_fullsized":"2023-11-24T08:02:30.354809+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:08.249067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357230+0000","last_change":"2023-11-24T08:02:27.877523+0000","last_active":"2023-11-24T08:02:30.357230+0000","last_peered":"2023-11-24T08:02:30.357230+0000","last_clean":"2023-11-24T08:02:30.357230+0000","last_became_active":"2023-11-24T08:02:27.877228+0000","last_became_peered":"2023-11-24T08:02:27.877228+0000","last_unstale":"2023-11-24T08:02:30.357230+0000","last_undegraded":"2023-11-24T08:02:30.357230+0000","last_fullsized":"2023-11-24T08:02:30.357230+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:15:36.023822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357426+0000","last_change":"2023-11-24T08:02:27.871354+0000","last_active":"2023-11-24T08:02:30.357426+0000","last_peered":"2023-11-24T08:02:30.357426+0000","last_clean":"2023-11-24T08:02:30.357426+0000","last_became_active":"2023-11-24T08:02:27.862913+0000","last_became_peered":"2023-11-24T08:02:27.862913+0000","last_unstale":"2023-11-24T08:02:30.357426+0000","last_undegraded":"2023-11-24T08:02:30.357426+0000","last_fullsized":"2023-11-24T08:02:30.357426+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:13:07.558262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356699+0000","last_change":"2023-11-24T08:02:27.871648+0000","last_active":"2023-11-24T08:02:30.356699+0000","last_peered":"2023-11-24T08:02:30.356699+0000","last_clean":"2023-11-24T08:02:30.356699+0000","last_became_active":"2023-11-24T08:02:27.871318+0000","last_became_peered":"2023-11-24T08:02:27.871318+0000","last_unstale":"2023-11-24T08:02:30.356699+0000","last_undegraded":"2023-11-24T08:02:30.356699+0000","last_fullsized":"2023-11-24T08:02:30.356699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:51:11.178816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866062+0000","last_change":"2023-11-24T08:02:27.862671+0000","last_active":"2023-11-24T08:02:28.866062+0000","last_peered":"2023-11-24T08:02:28.866062+0000","last_clean":"2023-11-24T08:02:28.866062+0000","last_became_active":"2023-11-24T08:02:27.862402+0000","last_became_peered":"2023-11-24T08:02:27.862402+0000","last_unstale":"2023-11-24T08:02:28.866062+0000","last_undegraded":"2023-11-24T08:02:28.866062+0000","last_fullsized":"2023-11-24T08:02:28.866062+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:13.409285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355477+0000","last_change":"2023-11-24T08:02:27.864236+0000","last_active":"2023-11-24T08:02:30.355477+0000","last_peered":"2023-11-24T08:02:30.355477+0000","last_clean":"2023-11-24T08:02:30.355477+0000","last_became_active":"2023-11-24T08:02:27.863978+0000","last_became_peered":"2023-11-24T08:02:27.863978+0000","last_unstale":"2023-11-24T08:02:30.355477+0000","last_undegraded":"2023-11-24T08:02:30.355477+0000","last_fullsized":"2023-11-24T08:02:30.355477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:25:17.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.354986+0000","last_change":"2023-11-24T08:02:27.871884+0000","last_active":"2023-11-24T08:02:30.354986+0000","last_peered":"2023-11-24T08:02:30.354986+0000","last_clean":"2023-11-24T08:02:30.354986+0000","last_became_active":"2023-11-24T08:02:27.871188+0000","last_became_peered":"2023-11-24T08:02:27.871188+0000","last_unstale":"2023-11-24T08:02:30.354986+0000","last_undegraded":"2023-11-24T08:02:30.354986+0000","last_fullsized":"2023-11-24T08:02:30.354986+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:48:30.479835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046182+0000","last_change":"2023-11-24T08:02:27.874356+0000","last_active":"2023-11-24T08:02:30.046182+0000","last_peered":"2023-11-24T08:02:30.046182+0000","last_clean":"2023-11-24T08:02:30.046182+0000","last_became_active":"2023-11-24T08:02:27.872255+0000","last_became_peered":"2023-11-24T08:02:27.872255+0000","last_unstale":"2023-11-24T08:02:30.046182+0000","last_undegraded":"2023-11-24T08:02:30.046182+0000","last_fullsized":"2023-11-24T08:02:30.046182+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:20:06.397271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.867347+0000","last_change":"2023-11-24T08:02:27.856951+0000","last_active":"2023-11-24T08:02:28.867347+0000","last_peered":"2023-11-24T08:02:28.867347+0000","last_clean":"2023-11-24T08:02:28.867347+0000","last_became_active":"2023-11-24T08:02:27.856675+0000","last_became_peered":"2023-11-24T08:02:27.856675+0000","last_unstale":"2023-11-24T08:02:28.867347+0000","last_undegraded":"2023-11-24T08:02:28.867347+0000","last_fullsized":"2023-11-24T08:02:28.867347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:07:53.260273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356308+0000","last_change":"2023-11-24T08:02:27.852975+0000","last_active":"2023-11-24T08:02:30.356308+0000","last_peered":"2023-11-24T08:02:30.356308+0000","last_clean":"2023-11-24T08:02:30.356308+0000","last_became_active":"2023-11-24T08:02:27.852692+0000","last_became_peered":"2023-11-24T08:02:27.852692+0000","last_unstale":"2023-11-24T08:02:30.356308+0000","last_undegraded":"2023-11-24T08:02:30.356308+0000","last_fullsized":"2023-11-24T08:02:30.356308+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:41.296502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356018+0000","last_change":"2023-11-24T08:02:27.864607+0000","last_active":"2023-11-24T08:02:30.356018+0000","last_peered":"2023-11-24T08:02:30.356018+0000","last_clean":"2023-11-24T08:02:30.356018+0000","last_became_active":"2023-11-24T08:02:27.864191+0000","last_became_peered":"2023-11-24T08:02:27.864191+0000","last_unstale":"2023-11-24T08:02:30.356018+0000","last_undegraded":"2023-11-24T08:02:30.356018+0000","last_fullsized":"2023-11-24T08:02:30.356018+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:59:37.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.868222+0000","last_change":"2023-11-24T08:02:27.873342+0000","last_active":"2023-11-24T08:02:28.868222+0000","last_peered":"2023-11-24T08:02:28.868222+0000","last_clean":"2023-11-24T08:02:28.868222+0000","last_became_active":"2023-11-24T08:02:27.873093+0000","last_became_peered":"2023-11-24T08:02:27.873093+0000","last_unstale":"2023-11-24T08:02:28.868222+0000","last_undegraded":"2023-11-24T08:02:28.868222+0000","last_fullsized":"2023-11-24T08:02:28.868222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:06:04.442272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355776+0000","last_change":"2023-11-24T08:02:27.862475+0000","last_active":"2023-11-24T08:02:30.355776+0000","last_peered":"2023-11-24T08:02:30.355776+0000","last_clean":"2023-11-24T08:02:30.355776+0000","last_became_active":"2023-11-24T08:02:27.862160+0000","last_became_peered":"2023-11-24T08:02:27.862160+0000","last_unstale":"2023-11-24T08:02:30.355776+0000","last_undegraded":"2023-11-24T08:02:30.355776+0000","last_fullsized":"2023-11-24T08:02:30.355776+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:44.172148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046547+0000","last_change":"2023-11-24T08:02:27.865613+0000","last_active":"2023-11-24T08:02:30.046547+0000","last_peered":"2023-11-24T08:02:30.046547+0000","last_clean":"2023-11-24T08:02:30.046547+0000","last_became_active":"2023-11-24T08:02:27.864621+0000","last_became_peered":"2023-11-24T08:02:27.864621+0000","last_unstale":"2023-11-24T08:02:30.046547+0000","last_undegraded":"2023-11-24T08:02:30.046547+0000","last_fullsized":"2023-11-24T08:02:30.046547+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:38:04.498552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355124+0000","last_change":"2023-11-24T08:02:27.862830+0000","last_active":"2023-11-24T08:02:30.355124+0000","last_peered":"2023-11-24T08:02:30.355124+0000","last_clean":"2023-11-24T08:02:30.355124+0000","last_became_active":"2023-11-24T08:02:27.862531+0000","last_became_peered":"2023-11-24T08:02:27.862531+0000","last_unstale":"2023-11-24T08:02:30.355124+0000","last_undegraded":"2023-11-24T08:02:30.355124+0000","last_fullsized":"2023-11-24T08:02:30.355124+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:53:55.208815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.867488+0000","last_change":"2023-11-24T08:02:27.859022+0000","last_active":"2023-11-24T08:02:28.867488+0000","last_peered":"2023-11-24T08:02:28.867488+0000","last_clean":"2023-11-24T08:02:28.867488+0000","last_became_active":"2023-11-24T08:02:27.857661+0000","last_became_peered":"2023-11-24T08:02:27.857661+0000","last_unstale":"2023-11-24T08:02:28.867488+0000","last_undegraded":"2023-11-24T08:02:28.867488+0000","last_fullsized":"2023-11-24T08:02:28.867488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:26:57.198232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.867205+0000","last_change":"2023-11-24T08:02:27.853340+0000","last_active":"2023-11-24T08:02:28.867205+0000","last_peered":"2023-11-24T08:02:28.867205+0000","last_clean":"2023-11-24T08:02:28.867205+0000","last_became_active":"2023-11-24T08:02:27.853026+0000","last_became_peered":"2023-11-24T08:02:27.853026+0000","last_unstale":"2023-11-24T08:02:28.867205+0000","last_undegraded":"2023-11-24T08:02:28.867205+0000","last_fullsized":"2023-11-24T08:02:28.867205+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:15:26.157043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.868281+0000","last_change":"2023-11-24T08:02:27.867235+0000","last_active":"2023-11-24T08:02:28.868281+0000","last_peered":"2023-11-24T08:02:28.868281+0000","last_clean":"2023-11-24T08:02:28.868281+0000","last_became_active":"2023-11-24T08:02:27.866892+0000","last_became_peered":"2023-11-24T08:02:27.866892+0000","last_unstale":"2023-11-24T08:02:28.868281+0000","last_undegraded":"2023-11-24T08:02:28.868281+0000","last_fullsized":"2023-11-24T08:02:28.868281+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:55:47.185739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355086+0000","last_change":"2023-11-24T08:02:27.870150+0000","last_active":"2023-11-24T08:02:30.355086+0000","last_peered":"2023-11-24T08:02:30.355086+0000","last_clean":"2023-11-24T08:02:30.355086+0000","last_became_active":"2023-11-24T08:02:27.869895+0000","last_became_peered":"2023-11-24T08:02:27.869895+0000","last_unstale":"2023-11-24T08:02:30.355086+0000","last_undegraded":"2023-11-24T08:02:30.355086+0000","last_fullsized":"2023-11-24T08:02:30.355086+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:12:51.094917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356340+0000","last_change":"2023-11-24T08:02:27.852451+0000","last_active":"2023-11-24T08:02:30.356340+0000","last_peered":"2023-11-24T08:02:30.356340+0000","last_clean":"2023-11-24T08:02:30.356340+0000","last_became_active":"2023-11-24T08:02:27.852172+0000","last_became_peered":"2023-11-24T08:02:27.852172+0000","last_unstale":"2023-11-24T08:02:30.356340+0000","last_undegraded":"2023-11-24T08:02:30.356340+0000","last_fullsized":"2023-11-24T08:02:30.356340+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:30:48.564564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866256+0000","last_change":"2023-11-24T08:02:27.865353+0000","last_active":"2023-11-24T08:02:28.866256+0000","last_peered":"2023-11-24T08:02:28.866256+0000","last_clean":"2023-11-24T08:02:28.866256+0000","last_became_active":"2023-11-24T08:02:27.865086+0000","last_became_peered":"2023-11-24T08:02:27.865086+0000","last_unstale":"2023-11-24T08:02:28.866256+0000","last_undegraded":"2023-11-24T08:02:28.866256+0000","last_fullsized":"2023-11-24T08:02:28.866256+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:35.305026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.867619+0000","last_change":"2023-11-24T08:02:27.863455+0000","last_active":"2023-11-24T08:02:28.867619+0000","last_peered":"2023-11-24T08:02:28.867619+0000","last_clean":"2023-11-24T08:02:28.867619+0000","last_became_active":"2023-11-24T08:02:27.863097+0000","last_became_peered":"2023-11-24T08:02:27.863097+0000","last_unstale":"2023-11-24T08:02:28.867619+0000","last_undegraded":"2023-11-24T08:02:28.867619+0000","last_fullsized":"2023-11-24T08:02:28.867619+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:44.654743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355567+0000","last_change":"2023-11-24T08:02:27.864859+0000","last_active":"2023-11-24T08:02:30.355567+0000","last_peered":"2023-11-24T08:02:30.355567+0000","last_clean":"2023-11-24T08:02:30.355567+0000","last_became_active":"2023-11-24T08:02:27.863550+0000","last_became_peered":"2023-11-24T08:02:27.863550+0000","last_unstale":"2023-11-24T08:02:30.355567+0000","last_undegraded":"2023-11-24T08:02:30.355567+0000","last_fullsized":"2023-11-24T08:02:30.355567+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:36:57.249381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046357+0000","last_change":"2023-11-24T08:02:27.871959+0000","last_active":"2023-11-24T08:02:30.046357+0000","last_peered":"2023-11-24T08:02:30.046357+0000","last_clean":"2023-11-24T08:02:30.046357+0000","last_became_active":"2023-11-24T08:02:27.871685+0000","last_became_peered":"2023-11-24T08:02:27.871685+0000","last_unstale":"2023-11-24T08:02:30.046357+0000","last_undegraded":"2023-11-24T08:02:30.046357+0000","last_fullsized":"2023-11-24T08:02:30.046357+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:29:19.870255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.354724+0000","last_change":"2023-11-24T08:02:27.868750+0000","last_active":"2023-11-24T08:02:30.354724+0000","last_peered":"2023-11-24T08:02:30.354724+0000","last_clean":"2023-11-24T08:02:30.354724+0000","last_became_active":"2023-11-24T08:02:27.865780+0000","last_became_peered":"2023-11-24T08:02:27.865780+0000","last_unstale":"2023-11-24T08:02:30.354724+0000","last_undegraded":"2023-11-24T08:02:30.354724+0000","last_fullsized":"2023-11-24T08:02:30.354724+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:29:27.501200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866025+0000","last_change":"2023-11-24T08:02:27.875153+0000","last_active":"2023-11-24T08:02:28.866025+0000","last_peered":"2023-11-24T08:02:28.866025+0000","last_clean":"2023-11-24T08:02:28.866025+0000","last_became_active":"2023-11-24T08:02:27.874903+0000","last_became_peered":"2023-11-24T08:02:27.874903+0000","last_unstale":"2023-11-24T08:02:28.866025+0000","last_undegraded":"2023-11-24T08:02:28.866025+0000","last_fullsized":"2023-11-24T08:02:28.866025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:05:09.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.778784+0000","last_change":"2023-11-24T08:02:26.843012+0000","last_active":"2023-11-24T08:02:28.778784+0000","last_peered":"2023-11-24T08:02:28.778784+0000","last_clean":"2023-11-24T08:02:28.778784+0000","last_became_active":"2023-11-24T08:02:26.842339+0000","last_became_peered":"2023-11-24T08:02:26.842339+0000","last_unstale":"2023-11-24T08:02:28.778784+0000","last_undegraded":"2023-11-24T08:02:28.778784+0000","last_fullsized":"2023-11-24T08:02:28.778784+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:06:30.575544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.868367+0000","last_change":"2023-11-24T08:02:27.850153+0000","last_active":"2023-11-24T08:02:28.868367+0000","last_peered":"2023-11-24T08:02:28.868367+0000","last_clean":"2023-11-24T08:02:28.868367+0000","last_became_active":"2023-11-24T08:02:27.849283+0000","last_became_peered":"2023-11-24T08:02:27.849283+0000","last_unstale":"2023-11-24T08:02:28.868367+0000","last_undegraded":"2023-11-24T08:02:28.868367+0000","last_fullsized":"2023-11-24T08:02:28.868367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:20.459268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870909+0000","last_change":"2023-11-24T08:02:26.838582+0000","last_active":"2023-11-24T08:02:27.870909+0000","last_peered":"2023-11-24T08:02:27.870909+0000","last_clean":"2023-11-24T08:02:27.870909+0000","last_became_active":"2023-11-24T08:02:26.838273+0000","last_became_peered":"2023-11-24T08:02:26.838273+0000","last_unstale":"2023-11-24T08:02:27.870909+0000","last_undegraded":"2023-11-24T08:02:27.870909+0000","last_fullsized":"2023-11-24T08:02:27.870909+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:11:34.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866245+0000","last_change":"2023-11-24T08:02:27.868436+0000","last_active":"2023-11-24T08:02:28.866245+0000","last_peered":"2023-11-24T08:02:28.866245+0000","last_clean":"2023-11-24T08:02:28.866245+0000","last_became_active":"2023-11-24T08:02:27.868148+0000","last_became_peered":"2023-11-24T08:02:27.868148+0000","last_unstale":"2023-11-24T08:02:28.866245+0000","last_undegraded":"2023-11-24T08:02:28.866245+0000","last_fullsized":"2023-11-24T08:02:28.866245+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:32:35.648698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.875183+0000","last_change":"2023-11-24T08:02:26.845023+0000","last_active":"2023-11-24T08:02:27.875183+0000","last_peered":"2023-11-24T08:02:27.875183+0000","last_clean":"2023-11-24T08:02:27.875183+0000","last_became_active":"2023-11-24T08:02:26.844504+0000","last_became_peered":"2023-11-24T08:02:26.844504+0000","last_unstale":"2023-11-24T08:02:27.875183+0000","last_undegraded":"2023-11-24T08:02:27.875183+0000","last_fullsized":"2023-11-24T08:02:27.875183+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:36:56.238734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.866170+0000","last_change":"2023-11-24T08:02:27.863904+0000","last_active":"2023-11-24T08:02:28.866170+0000","last_peered":"2023-11-24T08:02:28.866170+0000","last_clean":"2023-11-24T08:02:28.866170+0000","last_became_active":"2023-11-24T08:02:27.863615+0000","last_became_peered":"2023-11-24T08:02:27.863615+0000","last_unstale":"2023-11-24T08:02:28.866170+0000","last_undegraded":"2023-11-24T08:02:28.866170+0000","last_fullsized":"2023-11-24T08:02:28.866170+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:59:37.524729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.783206+0000","last_change":"2023-11-24T08:02:26.840493+0000","last_active":"2023-11-24T08:02:28.783206+0000","last_peered":"2023-11-24T08:02:28.783206+0000","last_clean":"2023-11-24T08:02:28.783206+0000","last_became_active":"2023-11-24T08:02:26.840190+0000","last_became_peered":"2023-11-24T08:02:26.840190+0000","last_unstale":"2023-11-24T08:02:28.783206+0000","last_undegraded":"2023-11-24T08:02:28.783206+0000","last_fullsized":"2023-11-24T08:02:28.783206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355620+0000","last_change":"2023-11-24T08:02:27.851974+0000","last_active":"2023-11-24T08:02:30.355620+0000","last_peered":"2023-11-24T08:02:30.355620+0000","last_clean":"2023-11-24T08:02:30.355620+0000","last_became_active":"2023-11-24T08:02:27.850478+0000","last_became_peered":"2023-11-24T08:02:27.850478+0000","last_unstale":"2023-11-24T08:02:30.355620+0000","last_undegraded":"2023-11-24T08:02:30.355620+0000","last_fullsized":"2023-11-24T08:02:30.355620+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:05:09.396274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.778705+0000","last_change":"2023-11-24T08:02:26.837411+0000","last_active":"2023-11-24T08:02:28.778705+0000","last_peered":"2023-11-24T08:02:28.778705+0000","last_clean":"2023-11-24T08:02:28.778705+0000","last_became_active":"2023-11-24T08:02:26.837120+0000","last_became_peered":"2023-11-24T08:02:26.837120+0000","last_unstale":"2023-11-24T08:02:28.778705+0000","last_undegraded":"2023-11-24T08:02:28.778705+0000","last_fullsized":"2023-11-24T08:02:28.778705+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:10:07.268127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356118+0000","last_change":"2023-11-24T08:02:27.869581+0000","last_active":"2023-11-24T08:02:30.356118+0000","last_peered":"2023-11-24T08:02:30.356118+0000","last_clean":"2023-11-24T08:02:30.356118+0000","last_became_active":"2023-11-24T08:02:27.862377+0000","last_became_peered":"2023-11-24T08:02:27.862377+0000","last_unstale":"2023-11-24T08:02:30.356118+0000","last_undegraded":"2023-11-24T08:02:30.356118+0000","last_fullsized":"2023-11-24T08:02:30.356118+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:03.044900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870672+0000","last_change":"2023-11-24T08:02:26.845666+0000","last_active":"2023-11-24T08:02:27.870672+0000","last_peered":"2023-11-24T08:02:27.870672+0000","last_clean":"2023-11-24T08:02:27.870672+0000","last_became_active":"2023-11-24T08:02:26.845413+0000","last_became_peered":"2023-11-24T08:02:26.845413+0000","last_unstale":"2023-11-24T08:02:27.870672+0000","last_undegraded":"2023-11-24T08:02:27.870672+0000","last_fullsized":"2023-11-24T08:02:27.870672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:35.851239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355163+0000","last_change":"2023-11-24T08:02:27.855236+0000","last_active":"2023-11-24T08:02:30.355163+0000","last_peered":"2023-11-24T08:02:30.355163+0000","last_clean":"2023-11-24T08:02:30.355163+0000","last_became_active":"2023-11-24T08:02:27.854925+0000","last_became_peered":"2023-11-24T08:02:27.854925+0000","last_unstale":"2023-11-24T08:02:30.355163+0000","last_undegraded":"2023-11-24T08:02:30.355163+0000","last_fullsized":"2023-11-24T08:02:30.355163+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:56:19.553319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.774954+0000","last_change":"2023-11-24T08:02:26.841048+0000","last_active":"2023-11-24T08:02:28.774954+0000","last_peered":"2023-11-24T08:02:28.774954+0000","last_clean":"2023-11-24T08:02:28.774954+0000","last_became_active":"2023-11-24T08:02:26.839883+0000","last_became_peered":"2023-11-24T08:02:26.839883+0000","last_unstale":"2023-11-24T08:02:28.774954+0000","last_undegraded":"2023-11-24T08:02:28.774954+0000","last_fullsized":"2023-11-24T08:02:28.774954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:06:03.431625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.867281+0000","last_change":"2023-11-24T08:02:27.859193+0000","last_active":"2023-11-24T08:02:28.867281+0000","last_peered":"2023-11-24T08:02:28.867281+0000","last_clean":"2023-11-24T08:02:28.867281+0000","last_became_active":"2023-11-24T08:02:27.858753+0000","last_became_peered":"2023-11-24T08:02:27.858753+0000","last_unstale":"2023-11-24T08:02:28.867281+0000","last_undegraded":"2023-11-24T08:02:28.867281+0000","last_fullsized":"2023-11-24T08:02:28.867281+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:27.520497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.843198+0000","last_change":"2023-11-24T08:02:26.833298+0000","last_active":"2023-11-24T08:02:27.843198+0000","last_peered":"2023-11-24T08:02:27.843198+0000","last_clean":"2023-11-24T08:02:27.843198+0000","last_became_active":"2023-11-24T08:02:26.832945+0000","last_became_peered":"2023-11-24T08:02:26.832945+0000","last_unstale":"2023-11-24T08:02:27.843198+0000","last_undegraded":"2023-11-24T08:02:27.843198+0000","last_fullsized":"2023-11-24T08:02:27.843198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:48:38.271397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356425+0000","last_change":"2023-11-24T08:02:27.864432+0000","last_active":"2023-11-24T08:02:30.356425+0000","last_peered":"2023-11-24T08:02:30.356425+0000","last_clean":"2023-11-24T08:02:30.356425+0000","last_became_active":"2023-11-24T08:02:27.863852+0000","last_became_peered":"2023-11-24T08:02:27.863852+0000","last_unstale":"2023-11-24T08:02:30.356425+0000","last_undegraded":"2023-11-24T08:02:30.356425+0000","last_fullsized":"2023-11-24T08:02:30.356425+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:13:08.249067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.840243+0000","last_change":"2023-11-24T08:02:26.840157+0000","last_active":"2023-11-24T08:02:27.840243+0000","last_peered":"2023-11-24T08:02:27.840243+0000","last_clean":"2023-11-24T08:02:27.840243+0000","last_became_active":"2023-11-24T08:02:26.838372+0000","last_became_peered":"2023-11-24T08:02:26.838372+0000","last_unstale":"2023-11-24T08:02:27.840243+0000","last_undegraded":"2023-11-24T08:02:27.840243+0000","last_fullsized":"2023-11-24T08:02:27.840243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:02.489853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357991+0000","last_change":"2023-11-24T08:02:27.866876+0000","last_active":"2023-11-24T08:02:30.357991+0000","last_peered":"2023-11-24T08:02:30.357991+0000","last_clean":"2023-11-24T08:02:30.357991+0000","last_became_active":"2023-11-24T08:02:27.866515+0000","last_became_peered":"2023-11-24T08:02:27.866515+0000","last_unstale":"2023-11-24T08:02:30.357991+0000","last_undegraded":"2023-11-24T08:02:30.357991+0000","last_fullsized":"2023-11-24T08:02:30.357991+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:36.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.848585+0000","last_change":"2023-11-24T08:02:26.838700+0000","last_active":"2023-11-24T08:02:27.848585+0000","last_peered":"2023-11-24T08:02:27.848585+0000","last_clean":"2023-11-24T08:02:27.848585+0000","last_became_active":"2023-11-24T08:02:26.838175+0000","last_became_peered":"2023-11-24T08:02:26.838175+0000","last_unstale":"2023-11-24T08:02:27.848585+0000","last_undegraded":"2023-11-24T08:02:27.848585+0000","last_fullsized":"2023-11-24T08:02:27.848585+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:12:13.258929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046725+0000","last_change":"2023-11-24T08:02:27.865063+0000","last_active":"2023-11-24T08:02:30.046725+0000","last_peered":"2023-11-24T08:02:30.046725+0000","last_clean":"2023-11-24T08:02:30.046725+0000","last_became_active":"2023-11-24T08:02:27.864806+0000","last_became_peered":"2023-11-24T08:02:27.864806+0000","last_unstale":"2023-11-24T08:02:30.046725+0000","last_undegraded":"2023-11-24T08:02:30.046725+0000","last_fullsized":"2023-11-24T08:02:30.046725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:22:40.256737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.783274+0000","last_change":"2023-11-24T08:02:26.841842+0000","last_active":"2023-11-24T08:02:28.783274+0000","last_peered":"2023-11-24T08:02:28.783274+0000","last_clean":"2023-11-24T08:02:28.783274+0000","last_became_active":"2023-11-24T08:02:26.841524+0000","last_became_peered":"2023-11-24T08:02:26.841524+0000","last_unstale":"2023-11-24T08:02:28.783274+0000","last_undegraded":"2023-11-24T08:02:28.783274+0000","last_fullsized":"2023-11-24T08:02:28.783274+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357606+0000","last_change":"2023-11-24T08:02:27.876155+0000","last_active":"2023-11-24T08:02:30.357606+0000","last_peered":"2023-11-24T08:02:30.357606+0000","last_clean":"2023-11-24T08:02:30.357606+0000","last_became_active":"2023-11-24T08:02:27.875932+0000","last_became_peered":"2023-11-24T08:02:27.875932+0000","last_unstale":"2023-11-24T08:02:30.357606+0000","last_undegraded":"2023-11-24T08:02:30.357606+0000","last_fullsized":"2023-11-24T08:02:30.357606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:18.828768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.774893+0000","last_change":"2023-11-24T08:02:26.839195+0000","last_active":"2023-11-24T08:02:28.774893+0000","last_peered":"2023-11-24T08:02:28.774893+0000","last_clean":"2023-11-24T08:02:28.774893+0000","last_became_active":"2023-11-24T08:02:26.838946+0000","last_became_peered":"2023-11-24T08:02:26.838946+0000","last_unstale":"2023-11-24T08:02:28.774893+0000","last_undegraded":"2023-11-24T08:02:28.774893+0000","last_fullsized":"2023-11-24T08:02:28.774893+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:14:17.593030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.867857+0000","last_change":"2023-11-24T08:02:27.863330+0000","last_active":"2023-11-24T08:02:28.867857+0000","last_peered":"2023-11-24T08:02:28.867857+0000","last_clean":"2023-11-24T08:02:28.867857+0000","last_became_active":"2023-11-24T08:02:27.863064+0000","last_became_peered":"2023-11-24T08:02:27.863064+0000","last_unstale":"2023-11-24T08:02:28.867857+0000","last_undegraded":"2023-11-24T08:02:28.867857+0000","last_fullsized":"2023-11-24T08:02:28.867857+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:21:38.345681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.778718+0000","last_change":"2023-11-24T08:02:26.833854+0000","last_active":"2023-11-24T08:02:28.778718+0000","last_peered":"2023-11-24T08:02:28.778718+0000","last_clean":"2023-11-24T08:02:28.778718+0000","last_became_active":"2023-11-24T08:02:26.833026+0000","last_became_peered":"2023-11-24T08:02:26.833026+0000","last_unstale":"2023-11-24T08:02:28.778718+0000","last_undegraded":"2023-11-24T08:02:28.778718+0000","last_fullsized":"2023-11-24T08:02:28.778718+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:18.256936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356297+0000","last_change":"2023-11-24T08:02:27.861826+0000","last_active":"2023-11-24T08:02:30.356297+0000","last_peered":"2023-11-24T08:02:30.356297+0000","last_clean":"2023-11-24T08:02:30.356297+0000","last_became_active":"2023-11-24T08:02:27.861508+0000","last_became_peered":"2023-11-24T08:02:27.861508+0000","last_unstale":"2023-11-24T08:02:30.356297+0000","last_undegraded":"2023-11-24T08:02:30.356297+0000","last_fullsized":"2023-11-24T08:02:30.356297+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:15.759921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.783157+0000","last_change":"2023-11-24T08:02:26.832072+0000","last_active":"2023-11-24T08:02:28.783157+0000","last_peered":"2023-11-24T08:02:28.783157+0000","last_clean":"2023-11-24T08:02:28.783157+0000","last_became_active":"2023-11-24T08:02:26.831711+0000","last_became_peered":"2023-11-24T08:02:26.831711+0000","last_unstale":"2023-11-24T08:02:28.783157+0000","last_undegraded":"2023-11-24T08:02:28.783157+0000","last_fullsized":"2023-11-24T08:02:28.783157+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:35:48.836292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046082+0000","last_change":"2023-11-24T08:02:27.863802+0000","last_active":"2023-11-24T08:02:30.046082+0000","last_peered":"2023-11-24T08:02:30.046082+0000","last_clean":"2023-11-24T08:02:30.046082+0000","last_became_active":"2023-11-24T08:02:27.863505+0000","last_became_peered":"2023-11-24T08:02:27.863505+0000","last_unstale":"2023-11-24T08:02:30.046082+0000","last_undegraded":"2023-11-24T08:02:30.046082+0000","last_fullsized":"2023-11-24T08:02:30.046082+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:23:09.000013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.778632+0000","last_change":"2023-11-24T08:02:26.835308+0000","last_active":"2023-11-24T08:02:28.778632+0000","last_peered":"2023-11-24T08:02:28.778632+0000","last_clean":"2023-11-24T08:02:28.778632+0000","last_became_active":"2023-11-24T08:02:26.835069+0000","last_became_peered":"2023-11-24T08:02:26.835069+0000","last_unstale":"2023-11-24T08:02:28.778632+0000","last_undegraded":"2023-11-24T08:02:28.778632+0000","last_fullsized":"2023-11-24T08:02:28.778632+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:44:26.442470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357484+0000","last_change":"2023-11-24T08:02:27.867003+0000","last_active":"2023-11-24T08:02:30.357484+0000","last_peered":"2023-11-24T08:02:30.357484+0000","last_clean":"2023-11-24T08:02:30.357484+0000","last_became_active":"2023-11-24T08:02:27.865266+0000","last_became_peered":"2023-11-24T08:02:27.865266+0000","last_unstale":"2023-11-24T08:02:30.357484+0000","last_undegraded":"2023-11-24T08:02:30.357484+0000","last_fullsized":"2023-11-24T08:02:30.357484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:54:19.267583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.884499+0000","last_change":"2023-11-24T08:02:26.845056+0000","last_active":"2023-11-24T08:02:27.884499+0000","last_peered":"2023-11-24T08:02:27.884499+0000","last_clean":"2023-11-24T08:02:27.884499+0000","last_became_active":"2023-11-24T08:02:26.844746+0000","last_became_peered":"2023-11-24T08:02:26.844746+0000","last_unstale":"2023-11-24T08:02:27.884499+0000","last_undegraded":"2023-11-24T08:02:27.884499+0000","last_fullsized":"2023-11-24T08:02:27.884499+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:46.183226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355468+0000","last_change":"2023-11-24T08:02:27.851025+0000","last_active":"2023-11-24T08:02:30.355468+0000","last_peered":"2023-11-24T08:02:30.355468+0000","last_clean":"2023-11-24T08:02:30.355468+0000","last_became_active":"2023-11-24T08:02:27.850749+0000","last_became_peered":"2023-11-24T08:02:27.850749+0000","last_unstale":"2023-11-24T08:02:30.355468+0000","last_undegraded":"2023-11-24T08:02:30.355468+0000","last_fullsized":"2023-11-24T08:02:30.355468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:51:20.310254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.774931+0000","last_change":"2023-11-24T08:02:26.834787+0000","last_active":"2023-11-24T08:02:28.774931+0000","last_peered":"2023-11-24T08:02:28.774931+0000","last_clean":"2023-11-24T08:02:28.774931+0000","last_became_active":"2023-11-24T08:02:26.834159+0000","last_became_peered":"2023-11-24T08:02:26.834159+0000","last_unstale":"2023-11-24T08:02:28.774931+0000","last_undegraded":"2023-11-24T08:02:28.774931+0000","last_fullsized":"2023-11-24T08:02:28.774931+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:20:04.530498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357131+0000","last_change":"2023-11-24T08:02:27.870758+0000","last_active":"2023-11-24T08:02:30.357131+0000","last_peered":"2023-11-24T08:02:30.357131+0000","last_clean":"2023-11-24T08:02:30.357131+0000","last_became_active":"2023-11-24T08:02:27.870315+0000","last_became_peered":"2023-11-24T08:02:27.870315+0000","last_unstale":"2023-11-24T08:02:30.357131+0000","last_undegraded":"2023-11-24T08:02:30.357131+0000","last_fullsized":"2023-11-24T08:02:30.357131+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:33:14.299335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.870857+0000","last_change":"2023-11-24T08:02:26.842806+0000","last_active":"2023-11-24T08:02:27.870857+0000","last_peered":"2023-11-24T08:02:27.870857+0000","last_clean":"2023-11-24T08:02:27.870857+0000","last_became_active":"2023-11-24T08:02:26.842317+0000","last_became_peered":"2023-11-24T08:02:26.842317+0000","last_unstale":"2023-11-24T08:02:27.870857+0000","last_undegraded":"2023-11-24T08:02:27.870857+0000","last_fullsized":"2023-11-24T08:02:27.870857+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:53.760058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.868192+0000","last_change":"2023-11-24T08:02:27.868287+0000","last_active":"2023-11-24T08:02:28.868192+0000","last_peered":"2023-11-24T08:02:28.868192+0000","last_clean":"2023-11-24T08:02:28.868192+0000","last_became_active":"2023-11-24T08:02:27.867921+0000","last_became_peered":"2023-11-24T08:02:27.867921+0000","last_unstale":"2023-11-24T08:02:28.868192+0000","last_undegraded":"2023-11-24T08:02:28.868192+0000","last_fullsized":"2023-11-24T08:02:28.868192+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:34.661956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.775177+0000","last_change":"2023-11-24T08:02:26.844242+0000","last_active":"2023-11-24T08:02:28.775177+0000","last_peered":"2023-11-24T08:02:28.775177+0000","last_clean":"2023-11-24T08:02:28.775177+0000","last_became_active":"2023-11-24T08:02:26.843949+0000","last_became_peered":"2023-11-24T08:02:26.843949+0000","last_unstale":"2023-11-24T08:02:28.775177+0000","last_undegraded":"2023-11-24T08:02:28.775177+0000","last_fullsized":"2023-11-24T08:02:28.775177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.868072+0000","last_change":"2023-11-24T08:02:27.866311+0000","last_active":"2023-11-24T08:02:28.868072+0000","last_peered":"2023-11-24T08:02:28.868072+0000","last_clean":"2023-11-24T08:02:28.868072+0000","last_became_active":"2023-11-24T08:02:27.865994+0000","last_became_peered":"2023-11-24T08:02:27.865994+0000","last_unstale":"2023-11-24T08:02:28.868072+0000","last_undegraded":"2023-11-24T08:02:28.868072+0000","last_fullsized":"2023-11-24T08:02:28.868072+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:11:40.272222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.778755+0000","last_change":"2023-11-24T08:02:26.841437+0000","last_active":"2023-11-24T08:02:28.778755+0000","last_peered":"2023-11-24T08:02:28.778755+0000","last_clean":"2023-11-24T08:02:28.778755+0000","last_became_active":"2023-11-24T08:02:26.841101+0000","last_became_peered":"2023-11-24T08:02:26.841101+0000","last_unstale":"2023-11-24T08:02:28.778755+0000","last_undegraded":"2023-11-24T08:02:28.778755+0000","last_fullsized":"2023-11-24T08:02:28.778755+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:19:21.245356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046179+0000","last_change":"2023-11-24T08:02:27.854759+0000","last_active":"2023-11-24T08:02:30.046179+0000","last_peered":"2023-11-24T08:02:30.046179+0000","last_clean":"2023-11-24T08:02:30.046179+0000","last_became_active":"2023-11-24T08:02:27.854463+0000","last_became_peered":"2023-11-24T08:02:27.854463+0000","last_unstale":"2023-11-24T08:02:30.046179+0000","last_undegraded":"2023-11-24T08:02:30.046179+0000","last_fullsized":"2023-11-24T08:02:30.046179+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:11:58.047226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.778731+0000","last_change":"2023-11-24T08:02:26.837311+0000","last_active":"2023-11-24T08:02:28.778731+0000","last_peered":"2023-11-24T08:02:28.778731+0000","last_clean":"2023-11-24T08:02:28.778731+0000","last_became_active":"2023-11-24T08:02:26.836798+0000","last_became_peered":"2023-11-24T08:02:26.836798+0000","last_unstale":"2023-11-24T08:02:28.778731+0000","last_undegraded":"2023-11-24T08:02:28.778731+0000","last_fullsized":"2023-11-24T08:02:28.778731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:17.818121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.865765+0000","last_change":"2023-11-24T08:02:27.861610+0000","last_active":"2023-11-24T08:02:28.865765+0000","last_peered":"2023-11-24T08:02:28.865765+0000","last_clean":"2023-11-24T08:02:28.865765+0000","last_became_active":"2023-11-24T08:02:27.861330+0000","last_became_peered":"2023-11-24T08:02:27.861330+0000","last_unstale":"2023-11-24T08:02:28.865765+0000","last_undegraded":"2023-11-24T08:02:28.865765+0000","last_fullsized":"2023-11-24T08:02:28.865765+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:25.894014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.774977+0000","last_change":"2023-11-24T08:02:26.846707+0000","last_active":"2023-11-24T08:02:28.774977+0000","last_peered":"2023-11-24T08:02:28.774977+0000","last_clean":"2023-11-24T08:02:28.774977+0000","last_became_active":"2023-11-24T08:02:26.846336+0000","last_became_peered":"2023-11-24T08:02:26.846336+0000","last_unstale":"2023-11-24T08:02:28.774977+0000","last_undegraded":"2023-11-24T08:02:28.774977+0000","last_fullsized":"2023-11-24T08:02:28.774977+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:52:33.651309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.354890+0000","last_change":"2023-11-24T08:02:27.853113+0000","last_active":"2023-11-24T08:02:30.354890+0000","last_peered":"2023-11-24T08:02:30.354890+0000","last_clean":"2023-11-24T08:02:30.354890+0000","last_became_active":"2023-11-24T08:02:27.852792+0000","last_became_peered":"2023-11-24T08:02:27.852792+0000","last_unstale":"2023-11-24T08:02:30.354890+0000","last_undegraded":"2023-11-24T08:02:30.354890+0000","last_fullsized":"2023-11-24T08:02:30.354890+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:54.675687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.842886+0000","last_change":"2023-11-24T08:02:26.841551+0000","last_active":"2023-11-24T08:02:27.842886+0000","last_peered":"2023-11-24T08:02:27.842886+0000","last_clean":"2023-11-24T08:02:27.842886+0000","last_became_active":"2023-11-24T08:02:26.840861+0000","last_became_peered":"2023-11-24T08:02:26.840861+0000","last_unstale":"2023-11-24T08:02:27.842886+0000","last_undegraded":"2023-11-24T08:02:27.842886+0000","last_fullsized":"2023-11-24T08:02:27.842886+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:06:03.817756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356695+0000","last_change":"2023-11-24T08:02:27.860098+0000","last_active":"2023-11-24T08:02:30.356695+0000","last_peered":"2023-11-24T08:02:30.356695+0000","last_clean":"2023-11-24T08:02:30.356695+0000","last_became_active":"2023-11-24T08:02:27.859839+0000","last_became_peered":"2023-11-24T08:02:27.859839+0000","last_unstale":"2023-11-24T08:02:30.356695+0000","last_undegraded":"2023-11-24T08:02:30.356695+0000","last_fullsized":"2023-11-24T08:02:30.356695+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:50:51.225317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.783063+0000","last_change":"2023-11-24T08:02:26.831194+0000","last_active":"2023-11-24T08:02:28.783063+0000","last_peered":"2023-11-24T08:02:28.783063+0000","last_clean":"2023-11-24T08:02:28.783063+0000","last_became_active":"2023-11-24T08:02:26.830870+0000","last_became_peered":"2023-11-24T08:02:26.830870+0000","last_unstale":"2023-11-24T08:02:28.783063+0000","last_undegraded":"2023-11-24T08:02:28.783063+0000","last_fullsized":"2023-11-24T08:02:28.783063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:28.971796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.868504+0000","last_change":"2023-11-24T08:02:27.863129+0000","last_active":"2023-11-24T08:02:28.868504+0000","last_peered":"2023-11-24T08:02:28.868504+0000","last_clean":"2023-11-24T08:02:28.868504+0000","last_became_active":"2023-11-24T08:02:27.862818+0000","last_became_peered":"2023-11-24T08:02:27.862818+0000","last_unstale":"2023-11-24T08:02:28.868504+0000","last_undegraded":"2023-11-24T08:02:28.868504+0000","last_fullsized":"2023-11-24T08:02:28.868504+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:22:29.982443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":13,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046953+0000","last_change":"2023-11-24T08:02:26.842429+0000","last_active":"2023-11-24T08:02:30.046953+0000","last_peered":"2023-11-24T08:02:30.046953+0000","last_clean":"2023-11-24T08:02:30.046953+0000","last_became_active":"2023-11-24T08:02:26.842153+0000","last_became_peered":"2023-11-24T08:02:26.842153+0000","last_unstale":"2023-11-24T08:02:30.046953+0000","last_undegraded":"2023-11-24T08:02:30.046953+0000","last_fullsized":"2023-11-24T08:02:30.046953+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:35.629826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.356596+0000","last_change":"2023-11-24T08:02:27.859175+0000","last_active":"2023-11-24T08:02:30.356596+0000","last_peered":"2023-11-24T08:02:30.356596+0000","last_clean":"2023-11-24T08:02:30.356596+0000","last_became_active":"2023-11-24T08:02:27.858897+0000","last_became_peered":"2023-11-24T08:02:27.858897+0000","last_unstale":"2023-11-24T08:02:30.356596+0000","last_undegraded":"2023-11-24T08:02:30.356596+0000","last_fullsized":"2023-11-24T08:02:30.356596+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:42:22.912255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.783297+0000","last_change":"2023-11-24T08:02:26.841087+0000","last_active":"2023-11-24T08:02:28.783297+0000","last_peered":"2023-11-24T08:02:28.783297+0000","last_clean":"2023-11-24T08:02:28.783297+0000","last_became_active":"2023-11-24T08:02:26.840807+0000","last_became_peered":"2023-11-24T08:02:26.840807+0000","last_unstale":"2023-11-24T08:02:28.783297+0000","last_undegraded":"2023-11-24T08:02:28.783297+0000","last_fullsized":"2023-11-24T08:02:28.783297+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:01:59.857911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357768+0000","last_change":"2023-11-24T08:02:27.861891+0000","last_active":"2023-11-24T08:02:30.357768+0000","last_peered":"2023-11-24T08:02:30.357768+0000","last_clean":"2023-11-24T08:02:30.357768+0000","last_became_active":"2023-11-24T08:02:27.861391+0000","last_became_peered":"2023-11-24T08:02:27.861391+0000","last_unstale":"2023-11-24T08:02:30.357768+0000","last_undegraded":"2023-11-24T08:02:30.357768+0000","last_fullsized":"2023-11-24T08:02:30.357768+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:19:22.256003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.845266+0000","last_change":"2023-11-24T08:02:26.845613+0000","last_active":"2023-11-24T08:02:27.845266+0000","last_peered":"2023-11-24T08:02:27.845266+0000","last_clean":"2023-11-24T08:02:27.845266+0000","last_became_active":"2023-11-24T08:02:26.845190+0000","last_became_peered":"2023-11-24T08:02:26.845190+0000","last_unstale":"2023-11-24T08:02:27.845266+0000","last_undegraded":"2023-11-24T08:02:27.845266+0000","last_fullsized":"2023-11-24T08:02:27.845266+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:09:53.760058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046323+0000","last_change":"2023-11-24T08:02:27.874289+0000","last_active":"2023-11-24T08:02:30.046323+0000","last_peered":"2023-11-24T08:02:30.046323+0000","last_clean":"2023-11-24T08:02:30.046323+0000","last_became_active":"2023-11-24T08:02:27.873177+0000","last_became_peered":"2023-11-24T08:02:27.873177+0000","last_unstale":"2023-11-24T08:02:30.046323+0000","last_undegraded":"2023-11-24T08:02:30.046323+0000","last_fullsized":"2023-11-24T08:02:30.046323+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:34:26.855538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.783183+0000","last_change":"2023-11-24T08:02:26.840761+0000","last_active":"2023-11-24T08:02:28.783183+0000","last_peered":"2023-11-24T08:02:28.783183+0000","last_clean":"2023-11-24T08:02:28.783183+0000","last_became_active":"2023-11-24T08:02:26.838173+0000","last_became_peered":"2023-11-24T08:02:26.838173+0000","last_unstale":"2023-11-24T08:02:28.783183+0000","last_undegraded":"2023-11-24T08:02:28.783183+0000","last_fullsized":"2023-11-24T08:02:28.783183+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:50:28.422413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.046605+0000","last_change":"2023-11-24T08:02:27.865925+0000","last_active":"2023-11-24T08:02:30.046605+0000","last_peered":"2023-11-24T08:02:30.046605+0000","last_clean":"2023-11-24T08:02:30.046605+0000","last_became_active":"2023-11-24T08:02:27.865643+0000","last_became_peered":"2023-11-24T08:02:27.865643+0000","last_unstale":"2023-11-24T08:02:30.046605+0000","last_undegraded":"2023-11-24T08:02:30.046605+0000","last_fullsized":"2023-11-24T08:02:30.046605+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:21:17.456368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.841492+0000","last_change":"2023-11-24T08:02:26.842216+0000","last_active":"2023-11-24T08:02:27.841492+0000","last_peered":"2023-11-24T08:02:27.841492+0000","last_clean":"2023-11-24T08:02:27.841492+0000","last_became_active":"2023-11-24T08:02:26.841172+0000","last_became_peered":"2023-11-24T08:02:26.841172+0000","last_unstale":"2023-11-24T08:02:27.841492+0000","last_undegraded":"2023-11-24T08:02:27.841492+0000","last_fullsized":"2023-11-24T08:02:27.841492+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:46.183226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.865891+0000","last_change":"2023-11-24T08:02:27.866805+0000","last_active":"2023-11-24T08:02:28.865891+0000","last_peered":"2023-11-24T08:02:28.865891+0000","last_clean":"2023-11-24T08:02:28.865891+0000","last_became_active":"2023-11-24T08:02:27.866254+0000","last_became_peered":"2023-11-24T08:02:27.866254+0000","last_unstale":"2023-11-24T08:02:28.865891+0000","last_undegraded":"2023-11-24T08:02:28.865891+0000","last_fullsized":"2023-11-24T08:02:28.865891+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:08:08.174968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.845501+0000","last_change":"2023-11-24T08:02:26.837671+0000","last_active":"2023-11-24T08:02:27.845501+0000","last_peered":"2023-11-24T08:02:27.845501+0000","last_clean":"2023-11-24T08:02:27.845501+0000","last_became_active":"2023-11-24T08:02:26.837141+0000","last_became_peered":"2023-11-24T08:02:26.837141+0000","last_unstale":"2023-11-24T08:02:27.845501+0000","last_undegraded":"2023-11-24T08:02:27.845501+0000","last_fullsized":"2023-11-24T08:02:27.845501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:06:03.817756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.355613+0000","last_change":"2023-11-24T08:02:27.863168+0000","last_active":"2023-11-24T08:02:30.355613+0000","last_peered":"2023-11-24T08:02:30.355613+0000","last_clean":"2023-11-24T08:02:30.355613+0000","last_became_active":"2023-11-24T08:02:27.862906+0000","last_became_peered":"2023-11-24T08:02:27.862906+0000","last_unstale":"2023-11-24T08:02:30.355613+0000","last_undegraded":"2023-11-24T08:02:30.355613+0000","last_fullsized":"2023-11-24T08:02:30.355613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:22:25.894014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.845420+0000","last_change":"2023-11-24T08:02:26.834763+0000","last_active":"2023-11-24T08:02:27.845420+0000","last_peered":"2023-11-24T08:02:27.845420+0000","last_clean":"2023-11-24T08:02:27.845420+0000","last_became_active":"2023-11-24T08:02:26.834426+0000","last_became_peered":"2023-11-24T08:02:26.834426+0000","last_unstale":"2023-11-24T08:02:27.845420+0000","last_undegraded":"2023-11-24T08:02:27.845420+0000","last_fullsized":"2023-11-24T08:02:27.845420+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:41:35.851239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-11-24T08:02:30.357548+0000","last_change":"2023-11-24T08:02:27.869847+0000","last_active":"2023-11-24T08:02:30.357548+0000","last_peered":"2023-11-24T08:02:30.357548+0000","last_clean":"2023-11-24T08:02:30.357548+0000","last_became_active":"2023-11-24T08:02:27.862493+0000","last_became_peered":"2023-11-24T08:02:27.862493+0000","last_unstale":"2023-11-24T08:02:30.357548+0000","last_undegraded":"2023-11-24T08:02:30.357548+0000","last_fullsized":"2023-11-24T08:02:30.357548+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:26.799238+0000","last_clean_scrub_stamp":"2023-11-24T08:02:26.799238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:30:52.325952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:28.775225+0000","last_change":"2023-11-24T08:02:26.843331+0000","last_active":"2023-11-24T08:02:28.775225+0000","last_peered":"2023-11-24T08:02:28.775225+0000","last_clean":"2023-11-24T08:02:28.775225+0000","last_became_active":"2023-11-24T08:02:26.843044+0000","last_became_peered":"2023-11-24T08:02:26.843044+0000","last_unstale":"2023-11-24T08:02:28.775225+0000","last_undegraded":"2023-11-24T08:02:28.775225+0000","last_fullsized":"2023-11-24T08:02:28.775225+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:02:25.788591+0000","last_clean_scrub_stamp":"2023-11-24T08:02:25.788591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:46:04.061742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":188,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-11-24T08:02:27.851664+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:02:27.851664+0000","last_peered":"2023-11-24T08:02:27.851664+0000","last_clean":"2023-11-24T08:02:27.851664+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:02:27.851664+0000","last_undegraded":"2023-11-24T08:02:27.851664+0000","last_fullsized":"2023-11-24T08:02:27.851664+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":811819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.997,"5min":1.113,"15min":1.133},"min":{"1min":0.61699999999999999,"5min":0.502,"15min":0.502},"max":{"1min":1.5229999999999999,"5min":1.72,"15min":1.72},"last":1.72},{"interface":"front","average":{"1min":1.093,"5min":1.0489999999999999,"15min":1.042},"min":{"1min":0.70599999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.85999999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.159,"15min":1.161},"min":{"1min":0.79800000000000004,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.5229999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.581},{"interface":"front","average":{"1min":1.147,"5min":1.1899999999999999,"15min":1.1970000000000001},"min":{"1min":0.72899999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5389999999999999,"5min":2.02,"15min":2.02},"last":1.1950000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.117,"15min":1.1080000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.5409999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3759999999999999,"15min":1.383},"min":{"1min":1.0029999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6319999999999999,"5min":1.944,"15min":1.944},"last":1.258}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.1619999999999999,"15min":1.151},"min":{"1min":0.78500000000000003,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6000000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.339},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.405,"15min":1.411},"min":{"1min":0.94599999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.794,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.454}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.4079999999999999,"15min":1.4139999999999999},"min":{"1min":0.98499999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.7709999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.405},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.3300000000000001,"15min":1.3129999999999999},"min":{"1min":0.98399999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.774,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.6759999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.5569999999999999,"15min":1.5620000000000001},"min":{"1min":1.2669999999999999,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.7609999999999999,"5min":2.2210000000000001,"15min":2.2210000000000001},"last":1.8109999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.542,"15min":1.54},"min":{"1min":1.085,"5min":1.01,"15min":1.01},"max":{"1min":1.881,"5min":2.2679999999999998,"15min":2.2679999999999998},"last":1.5129999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.657,"5min":1.6160000000000001,"15min":1.609},"min":{"1min":1.2210000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.141,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.583,"5min":1.5349999999999999,"15min":1.5269999999999999},"min":{"1min":1.2529999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.839,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.754}]}]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":552960,"data_stored":222033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":0.94599999999999995,"15min":0.93200000000000005},"min":{"1min":0.72199999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0409999999999999,"15min":1.048},"min":{"1min":0.73399999999999999,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.3080000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.1970000000000001,"15min":1.1950000000000001},"min":{"1min":0.68700000000000006,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.766,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.081},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.238,"15min":1.244},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.5109999999999999,"5min":2.597,"15min":2.597},"last":1.468}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.2390000000000001,"15min":1.2589999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.623,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.181},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2849999999999999,"15min":1.29},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.706,"5min":2.831,"15min":2.831},"last":1.1180000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.294,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.605,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.236},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3129999999999999,"15min":1.3109999999999999},"min":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":1.974,"5min":1.974,"15min":1.974},"last":1.3779999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.3879999999999999,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.0950000000000002,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.28},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.4019999999999999,"15min":1.4119999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5920000000000001,"15min":1.5960000000000001},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.5249999999999999},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.546,"15min":1.54},"min":{"1min":1.016,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4330000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.6060000000000001,"15min":1.6180000000000001},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.9159999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.649,"5min":1.6020000000000001,"15min":1.5940000000000001},"min":{"1min":1.202,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.498}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":548864,"data_stored":221431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.63700000000000001,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.72,"5min":2.431,"15min":2.431},"last":1.748},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.02,"15min":1.0129999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.361}]},{"osd":1,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0640000000000001,"15min":1.056},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.179,"15min":1.1850000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.5149999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.6499999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.196,"15min":1.2010000000000001},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.113},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4139999999999999,"5min":1.768,"15min":1.768},"last":1.3149999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.335,"15min":1.351},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.6339999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.054},{"interface":"front","average":{"1min":1.319,"5min":1.319,"15min":1.319},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.7330000000000001,"5min":1.7330000000000001,"15min":1.7330000000000001},"last":1.4590000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.339,"15min":1.373},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.7789999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.5009999999999999,"15min":1.5329999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.7569999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.8200000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.423,"15min":1.4359999999999999},"min":{"1min":0.72699999999999998,"5min":0.629,"15min":0.629},"max":{"1min":1.849,"5min":2.569,"15min":2.569},"last":1.5740000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.5129999999999999,"15min":1.538},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.502}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.665,"15min":1.7130000000000001},"min":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"max":{"1min":1.96,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.913},{"interface":"front","average":{"1min":1.4670000000000001,"5min":1.5609999999999999,"15min":1.577},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.9419999999999999,"5min":2.113,"15min":2.113},"last":1.7210000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509471,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31724,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":557056,"data_stored":221999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.35899999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.383,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.169},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.50900000000000001,"5min":0.442,"15min":0.442},"max":{"1min":1.2390000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.76200000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.82599999999999996,"15min":0.81200000000000006},"min":{"1min":0.46899999999999997,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.875,"5min":0.93700000000000006,"15min":0.94699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.871}]},{"osd":2,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0189999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.486,"5min":1.601,"15min":1.601},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0029999999999999,"15min":0.998},"min":{"1min":0.59699999999999998,"5min":0.501,"15min":0.501},"max":{"1min":1.526,"5min":1.569,"15min":1.569},"last":1.5229999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.111,"15min":1.105},"min":{"1min":0.75700000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5429999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":1.218},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.1799999999999999},"min":{"1min":0.77500000000000002,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.419}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.288,"15min":1.2789999999999999},"min":{"1min":0.95599999999999996,"5min":0.745,"15min":0.745},"max":{"1min":2.2839999999999998,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2470000000000001,"15min":1.2450000000000001},"min":{"1min":0.77400000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.9610000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2370000000000001,"15min":1.24},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6699999999999999,"5min":1.861,"15min":1.861},"last":1.726},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3680000000000001,"15min":1.3640000000000001},"min":{"1min":0.91000000000000003,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.921,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.8260000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3,"15min":1.294},"min":{"1min":0.76800000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.262},"min":{"1min":0.85499999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.746,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.6279999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":222995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.98899999999999999,"15min":1.0209999999999999},"min":{"1min":0.41899999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.27,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.526,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.80800000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.127,"15min":1.165},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.504,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.113,"15min":1.137},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.3089999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":1.0589999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96599999999999997,"15min":0.97099999999999997},"min":{"1min":0.47499999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.236,"5min":1.637,"15min":1.637},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.196,"15min":1.218},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.409,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.4910000000000001,"15min":1.5169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.794,"5min":6.452,"15min":6.452},"last":1.127},{"interface":"front","average":{"1min":1.349,"5min":1.548,"15min":1.581},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7370000000000001,"5min":6.306,"15min":6.306},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.5189999999999999,"15min":1.5369999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.7889999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.23,"5min":1.296,"15min":1.3069999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.708,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":0.996}]},{"osd":6,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.381,"15min":1.3879999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.857,"5min":2.069,"15min":2.069},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.577,"15min":1.6160000000000001},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.8779999999999999,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.042}]},{"osd":7,"last update":"Fri Nov 24 08:02:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3859999999999999,"15min":1.3919999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.786,"5min":1.948,"15min":1.948},"last":1.145},{"interface":"front","average":{"1min":1.454,"5min":1.5900000000000001,"15min":1.6120000000000001},"min":{"1min":0.93200000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.921,"5min":6.399,"15min":6.399},"last":1.327}]}]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":222973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.099},"min":{"1min":0.60199999999999998,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.629,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.099,"15min":1.1200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.536,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.98999999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:02:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1639999999999999,"15min":1.159},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.8340000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.51,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.391}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2150000000000001,"15min":1.2270000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3959999999999999,"5min":1.518,"15min":1.518},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.4279999999999999,"15min":1.446},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.794,"5min":1.966,"15min":1.966},"last":1.784}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8420000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.339},{"interface":"front","average":{"1min":1.282,"5min":1.4059999999999999,"15min":1.4259999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.8959999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.274}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.492,"15min":1.508},"min":{"1min":1.0609999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.056,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.163},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.532,"15min":1.52},"min":{"1min":1.149,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.986,"5min":2.073,"15min":2.073},"last":1.853}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5009999999999999,"5min":1.5549999999999999,"15min":1.5640000000000001},"min":{"1min":1.1519999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7589999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.6000000000000001,"15min":1.6240000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.968,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.542}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5820000000000001,"5min":1.6080000000000001,"15min":1.6120000000000001},"min":{"1min":1.208,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.897,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.9059999999999999},{"interface":"front","average":{"1min":1.575,"5min":1.6870000000000001,"15min":1.706},"min":{"1min":1.262,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0099999999999998,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.5860000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":221431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94199999999999995,"15min":0.95599999999999996},"min":{"1min":0.40100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.5109999999999999,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.97899999999999998,"15min":1.012},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.268,"5min":3.266,"15min":3.266},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.90100000000000002,"15min":0.90800000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.48999999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.117,"15min":1.1359999999999999},"min":{"1min":0.53800000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.006}]},{"osd":3,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1819999999999999,"15min":1.196},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.5780000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.079,"15min":1.101},"min":{"1min":0.48599999999999999,"5min":0.435,"15min":0.435},"max":{"1min":1.597,"5min":1.976,"15min":1.976},"last":1.421}]},{"osd":4,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.4710000000000001,"15min":1.5189999999999999},"min":{"1min":0.73099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.1139999999999999,"5min":4.367,"15min":4.367},"last":1.389},{"interface":"front","average":{"1min":1.331,"5min":1.4370000000000001,"15min":1.4550000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.8939999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":0.95099999999999996}]},{"osd":5,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.5289999999999999,"15min":1.583},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.6890000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.085},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.4830000000000001,"15min":1.5029999999999999},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.7170000000000001,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.472}]},{"osd":6,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3919999999999999,"15min":1.403},"min":{"1min":0.82799999999999996,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.9570000000000001,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.538},{"interface":"front","average":{"1min":1.419,"5min":1.639,"15min":1.675},"min":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.0059999999999998,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.4330000000000001,"15min":1.4430000000000001},"min":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8220000000000001,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.377,"5min":1.657,"15min":1.704},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0739999999999998,"5min":4.452,"15min":4.452},"last":1.2210000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28136,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343704,"statfs":{"total":96636764160,"available":96607952896,"internally_reserved":0,"allocated":1142784,"data_stored":811763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0660000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.875,"15min":0.89100000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.1299999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.80800000000000005}]},{"osd":2,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.876,"5min":1.0149999999999999,"15min":1.038},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.466,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":1.2529999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.04,"15min":1.046},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.512,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.1060000000000001},"min":{"1min":0.622,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5600000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.747}]},{"osd":4,"last update":"Fri Nov 24 08:02:19 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2170000000000001,"15min":1.2250000000000001},"min":{"1min":0.91900000000000004,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.431,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.3129999999999999,"15min":1.3280000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.6439999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.2210000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.476,"15min":1.5089999999999999},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.895,"5min":2.839,"15min":2.839},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.3660000000000001,"15min":1.3879999999999999},"min":{"1min":0.97299999999999998,"5min":0.94299999999999995,"15min":0.94299999999999995},"max":{"1min":1.5389999999999999,"5min":2.823,"15min":2.823},"last":0.98699999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3460000000000001,"15min":1.355},"min":{"1min":0.91800000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.72,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86499999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.0539999999999998,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.1890000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:02:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":2.1480000000000001,"5min":2.875,"15min":2.875},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.268,"5min":1.3440000000000001,"15min":1.3560000000000001},"min":{"1min":0.89500000000000002,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.776,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":0.93200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:02:37.830 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:02:37.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:02:38.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.092+0000 7f101851d640 1 Processor -- start 2023-11-24T08:02:38.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.092+0000 7f101851d640 1 -- start start 2023-11-24T08:02:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.093+0000 7f101851d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1010157dc0 0x7f1010070cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.093+0000 7f101851d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101015ba40 con 0x7f1010071230 2023-11-24T08:02:38.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.093+0000 7f101851d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101015eb10 con 0x7f101015e450 2023-11-24T08:02:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.093+0000 7f101851d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10101581a0 con 0x7f1010157dc0 2023-11-24T08:02:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.094+0000 7f10162b9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1010157dc0 0x7f1010070cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.094+0000 7f10162b9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1010157dc0 0x7f1010070cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54000/0 (socket says 172.21.15.161:54000) 2023-11-24T08:02:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.094+0000 7f10162b9640 1 -- 172.21.15.161:0/2932891528 learned_addr learned my addr 172.21.15.161:0/2932891528 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.094+0000 7f10162b9640 1 -- 172.21.15.161:0/2932891528 >> v1:172.21.15.175:6789/0 conn(0x7f101015e450 legacy=0x7f101015bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.094+0000 7f10162b9640 1 -- 172.21.15.161:0/2932891528 >> v1:172.21.15.161:6789/0 conn(0x7f1010071230 legacy=0x7f101015dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.094+0000 7f10162b9640 1 -- 172.21.15.161:0/2932891528 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010071860 con 0x7f1010157dc0 2023-11-24T08:02:38.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.095+0000 7f10162b9640 1 --2- 172.21.15.161:0/2932891528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f1010070cf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f100c009870 tx=0x7f100c02dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d23e3d3e9f70f7a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:38.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f10152b7640 1 -- 172.21.15.161:0/2932891528 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02e960 con 0x7f1010157dc0 2023-11-24T08:02:38.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f10152b7640 1 -- 172.21.15.161:0/2932891528 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c02eac0 con 0x7f1010157dc0 2023-11-24T08:02:38.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f10152b7640 1 -- 172.21.15.161:0/2932891528 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c02ee50 con 0x7f1010157dc0 2023-11-24T08:02:38.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 -- 172.21.15.161:0/2932891528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 msgr2=0x7f1010070cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 --2- 172.21.15.161:0/2932891528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f1010070cf0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f100c009870 tx=0x7f100c02dbb0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 -- 172.21.15.161:0/2932891528 shutdown_connections 2023-11-24T08:02:38.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 --2- 172.21.15.161:0/2932891528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f1010070cf0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 -- 172.21.15.161:0/2932891528 >> 172.21.15.161:0/2932891528 conn(0x7f10100b0be0 msgr2=0x7f10100b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:38.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 -- 172.21.15.161:0/2932891528 shutdown_connections 2023-11-24T08:02:38.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.096+0000 7f101851d640 1 -- 172.21.15.161:0/2932891528 wait complete. 2023-11-24T08:02:38.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.098+0000 7f101851d640 1 Processor -- start 2023-11-24T08:02:38.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.098+0000 7f101851d640 1 -- start start 2023-11-24T08:02:38.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.099+0000 7f101851d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1010071230 0x7f10101e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.099+0000 7f101851d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f10101e62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.099+0000 7f101851d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f101015e450 0x7f1010149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.099+0000 7f101851d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101e3b60 con 0x7f1010157dc0 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.099+0000 7f101851d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10101e49c0 con 0x7f101015e450 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.099+0000 7f101851d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10101e3db0 con 0x7f1010071230 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f10101e62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f10101e62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54016/0 (socket says 172.21.15.161:54016) 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 -- 172.21.15.161:0/3100733148 learned_addr learned my addr 172.21.15.161:0/3100733148 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f10162b9640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1010071230 0x7f10101e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1016aba640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f101015e450 0x7f1010149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 -- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1010071230 msgr2=0x7f10101e4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1010071230 0x7f10101e4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 -- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f101015e450 msgr2=0x7f1010149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f101015e450 0x7f1010149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1015ab8640 1 -- 172.21.15.161:0/3100733148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c0094d0 con 0x7f1010157dc0 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f10162b9640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1010071230 0x7f10101e4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.100+0000 7f1016aba640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f101015e450 0x7f1010149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.101+0000 7f1015ab8640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f10101e62e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f100000c430 tx=0x7f100000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.101+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10000052d0 con 0x7f1010157dc0 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.101+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1000005450 con 0x7f1010157dc0 2023-11-24T08:02:38.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.101+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10101e4090 con 0x7f1010157dc0 2023-11-24T08:02:38.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.101+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1000007260 con 0x7f1010157dc0 2023-11-24T08:02:38.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.101+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10101e4650 con 0x7f1010157dc0 2023-11-24T08:02:38.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.102+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10101e4b50 con 0x7f1010157dc0 2023-11-24T08:02:38.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.104+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f10000073c0 con 0x7f1010157dc0 2023-11-24T08:02:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.104+0000 7f1006ffd640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0ff406b020 0x7f0ff406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.105+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1000088df0 con 0x7f1010157dc0 2023-11-24T08:02:38.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.105+0000 7f10162b9640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0ff406b020 0x7f0ff406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.106+0000 7f10162b9640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0ff406b020 0x7f0ff406d4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f100c038000 tx=0x7f100c032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:38.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.109+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1000053b90 con 0x7f1010157dc0 2023-11-24T08:02:38.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.377+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f1010067670 con 0x7f1010157dc0 2023-11-24T08:02:38.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.381+0000 7f1006ffd640 1 -- 172.21.15.161:0/3100733148 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f10000571b0 con 0x7f1010157dc0 2023-11-24T08:02:38.384 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-11-24T08:02:38.384 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA== 2023-11-24T08:02:38.384 INFO:teuthology.orchestra.run.smithi161.stdout: caps mds = "allow" 2023-11-24T08:02:38.384 INFO:teuthology.orchestra.run.smithi161.stdout: caps mon = "allow r" 2023-11-24T08:02:38.384 INFO:teuthology.orchestra.run.smithi161.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:02:38.385 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.0 2023-11-24T08:02:38.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0ff406b020 msgr2=0x7f0ff406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0ff406b020 0x7f0ff406d4e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f100c038000 tx=0x7f100c032000 comp rx=0 tx=0).stop 2023-11-24T08:02:38.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 msgr2=0x7f10101e62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f10101e62e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f100000c430 tx=0x7f100000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 shutdown_connections 2023-11-24T08:02:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0ff406b020 0x7f0ff406d4e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f101015e450 0x7f1010149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1010157dc0 0x7f10101e62e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 --2- 172.21.15.161:0/3100733148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1010071230 0x7f10101e4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 >> 172.21.15.161:0/3100733148 conn(0x7f10100b0be0 msgr2=0x7f101006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:38.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 shutdown_connections 2023-11-24T08:02:38.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.385+0000 7f101851d640 1 -- 172.21.15.161:0/3100733148 wait complete. 2023-11-24T08:02:38.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:02:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.610+0000 7f63cb890640 1 Processor -- start 2023-11-24T08:02:38.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.610+0000 7f63cb890640 1 -- start start 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63cb890640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f63c413df80 0x7f63c415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63cb890640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c413e360 0x7f63c40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63cb890640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c406c470 con 0x7f63c415f9c0 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63cb890640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c406c750 con 0x7f63c413e360 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63cb890640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c406ca30 con 0x7f63c413df80 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c413e360 0x7f63c40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f63c413e360 0x7f63c40cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54028/0 (socket says 172.21.15.161:54028) 2023-11-24T08:02:38.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 -- 172.21.15.161:0/3131537063 learned_addr learned my addr 172.21.15.161:0/3131537063 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:38.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 -- 172.21.15.161:0/3131537063 >> v2:172.21.15.175:3300/0 conn(0x7f63c413df80 msgr2=0x7f63c415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:38.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 --2- 172.21.15.161:0/3131537063 >> v2:172.21.15.175:3300/0 conn(0x7f63c413df80 0x7f63c415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 -- 172.21.15.161:0/3131537063 >> v1:172.21.15.175:6789/0 conn(0x7f63c415f9c0 legacy=0x7f63c41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:38.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.612+0000 7f63c8e2b640 1 -- 172.21.15.161:0/3131537063 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c406cd10 con 0x7f63c413e360 2023-11-24T08:02:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.613+0000 7f63c8e2b640 1 --2- 172.21.15.161:0/3131537063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c413e360 0x7f63c40cf290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f63c4072770 tx=0x7f63b402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8be300139c0361 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.614+0000 7f63bbfff640 1 -- 172.21.15.161:0/3131537063 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4031870 con 0x7f63c413e360 2023-11-24T08:02:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.614+0000 7f63bbfff640 1 -- 172.21.15.161:0/3131537063 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b40319d0 con 0x7f63c413e360 2023-11-24T08:02:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.614+0000 7f63bbfff640 1 -- 172.21.15.161:0/3131537063 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4031d60 con 0x7f63c413e360 2023-11-24T08:02:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.614+0000 7f63cb890640 1 -- 172.21.15.161:0/3131537063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c413e360 msgr2=0x7f63c40cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.614+0000 7f63cb890640 1 --2- 172.21.15.161:0/3131537063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c413e360 0x7f63c40cf290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f63c4072770 tx=0x7f63b402b910 comp rx=0 tx=0).stop 2023-11-24T08:02:38.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.615+0000 7f63cb890640 1 -- 172.21.15.161:0/3131537063 shutdown_connections 2023-11-24T08:02:38.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.615+0000 7f63cb890640 1 --2- 172.21.15.161:0/3131537063 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c413e360 0x7f63c40cf290 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.615+0000 7f63cb890640 1 --2- 172.21.15.161:0/3131537063 >> v2:172.21.15.175:3300/0 conn(0x7f63c413df80 0x7f63c415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.615+0000 7f63cb890640 1 -- 172.21.15.161:0/3131537063 >> 172.21.15.161:0/3131537063 conn(0x7f63c406a800 msgr2=0x7f63c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:38.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.615+0000 7f63cb890640 1 -- 172.21.15.161:0/3131537063 shutdown_connections 2023-11-24T08:02:38.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.615+0000 7f63cb890640 1 -- 172.21.15.161:0/3131537063 wait complete. 2023-11-24T08:02:38.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.616+0000 7f63cb890640 1 Processor -- start 2023-11-24T08:02:38.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 -- start start 2023-11-24T08:02:38.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63c413df80 0x7f63c413d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63c413e360 0x7f63c40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 0x7f63c415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c414ad60 con 0x7f63c415f9c0 2023-11-24T08:02:38.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c4071720 con 0x7f63c413e360 2023-11-24T08:02:38.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.617+0000 7f63cb890640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c413d720 con 0x7f63c413df80 2023-11-24T08:02:38.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 0x7f63c415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 0x7f63c415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54034/0 (socket says 172.21.15.161:54034) 2023-11-24T08:02:38.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 -- 172.21.15.161:0/384308228 learned_addr learned my addr 172.21.15.161:0/384308228 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:38.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 -- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63c413df80 msgr2=0x7f63c413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63c413df80 0x7f63c413d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 -- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63c413e360 msgr2=0x7f63c40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63c413e360 0x7f63c40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 -- 172.21.15.161:0/384308228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b40094d0 con 0x7f63c415f9c0 2023-11-24T08:02:38.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.618+0000 7f63c9e2d640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 0x7f63c415a180 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00c7b0 tx=0x7f63bc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:38.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.619+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc003d80 con 0x7f63c415f9c0 2023-11-24T08:02:38.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.619+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc00ce60 con 0x7f63c415f9c0 2023-11-24T08:02:38.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.619+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0052b0 con 0x7f63c415f9c0 2023-11-24T08:02:38.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.619+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c4070b10 con 0x7f63c415f9c0 2023-11-24T08:02:38.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.619+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c40710d0 con 0x7f63c415f9c0 2023-11-24T08:02:38.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.620+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40675d0 con 0x7f63c415f9c0 2023-11-24T08:02:38.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.621+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f63bc006b10 con 0x7f63c415f9c0 2023-11-24T08:02:38.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.622+0000 7f63b9ffb640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f63a806b020 0x7f63a806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:38.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.622+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63bc088ca0 con 0x7f63c415f9c0 2023-11-24T08:02:38.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.623+0000 7f63c962c640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f63a806b020 0x7f63a806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:38.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.624+0000 7f63c962c640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f63a806b020 0x7f63a806d4e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009670 tx=0x7f63c0006bf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:38.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.626+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63bc053af0 con 0x7f63c415f9c0 2023-11-24T08:02:38.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.857+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63c406df00 con 0x7f63c415f9c0 2023-11-24T08:02:38.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.858+0000 7f63b9ffb640 1 -- 172.21.15.161:0/384308228 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f63bc017030 con 0x7f63c415f9c0 2023-11-24T08:02:38.861 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:38.861 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:02:38.862 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 26 2023-11-24T08:02:38.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f63a806b020 msgr2=0x7f63a806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f63a806b020 0x7f63a806d4e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63c0009670 tx=0x7f63c0006bf0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 msgr2=0x7f63c415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:38.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 0x7f63c415a180 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00c7b0 tx=0x7f63bc00cc70 comp rx=0 tx=0).stop 2023-11-24T08:02:38.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 shutdown_connections 2023-11-24T08:02:38.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f63a806b020 0x7f63a806d4e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f63c415f9c0 0x7f63c415a180 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f63c413e360 0x7f63c40702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 --2- 172.21.15.161:0/384308228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f63c413df80 0x7f63c413d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:38.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 >> 172.21.15.161:0/384308228 conn(0x7f63c406a800 msgr2=0x7f63c40cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:38.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 shutdown_connections 2023-11-24T08:02:38.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:38.861+0000 7f63cb890640 1 -- 172.21.15.161:0/384308228 wait complete. 2023-11-24T08:02:39.285 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:02:27.275368+0000', 'modified': '2023-11-24T08:02:30.365578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5688}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5688': {'gid': 5688, 'name': 'b', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6837/2376580130', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6836', 'nonce': 2376580130}, {'type': 'v1', 'addr': '172.21.15.175:6837', 'nonce': 2376580130}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:02:39.285 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:02:39.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T08:02:39.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:02:39.388 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:02:39.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.500+0000 7f7c3961c640 1 Processor -- start 2023-11-24T08:02:39.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.500+0000 7f7c3961c640 1 -- start start 2023-11-24T08:02:39.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c3961c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340d17e0 0x7f7c340d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c3961c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7c340b3890 0x7f7c340b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c3961c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340d2180 con 0x7f7c3415d610 2023-11-24T08:02:39.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c3961c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340d1390 con 0x7f7c340b3890 2023-11-24T08:02:39.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c3961c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340b3400 con 0x7f7c340d17e0 2023-11-24T08:02:39.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c32ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7c3415d610 0x7f7c340ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:34492/0 (socket says 172.21.15.161:34492) 2023-11-24T08:02:39.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.502+0000 7f7c32ffd640 1 -- 172.21.15.161:0/2661571631 learned_addr learned my addr 172.21.15.161:0/2661571631 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:39.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c337fe640 1 --2- 172.21.15.161:0/2661571631 >> v2:172.21.15.175:3300/0 conn(0x7f7c340b3890 0x7f7c340b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c327fc640 1 -- 172.21.15.161:0/2661571631 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741437381 0 0) 0x7f7c340d2180 con 0x7f7c3415d610 2023-11-24T08:02:39.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340d17e0 0x7f7c340d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c327fc640 1 -- 172.21.15.161:0/2661571631 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c20003520 con 0x7f7c3415d610 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c327fc640 1 -- 172.21.15.161:0/2661571631 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852978159 0 0) 0x7f7c20003520 con 0x7f7c3415d610 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c337fe640 1 -- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340d17e0 msgr2=0x7f7c340d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c337fe640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340d17e0 0x7f7c340d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c337fe640 1 -- 172.21.15.161:0/2661571631 >> v1:172.21.15.161:6789/0 conn(0x7f7c3415d610 legacy=0x7f7c340ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c337fe640 1 -- 172.21.15.161:0/2661571631 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340b27f0 con 0x7f7c340b3890 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.503+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340d17e0 0x7f7c340d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:39.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.505+0000 7f7c337fe640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340b3890 0x7f7c340b3d20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009d90 tx=0x7f7c2c02bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=971534a28612c4fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.505+0000 7f7c327fc640 1 -- 172.21.15.161:0/2661571631 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24001670 con 0x7f7c340b3890 2023-11-24T08:02:39.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.505+0000 7f7c327fc640 1 -- 172.21.15.161:0/2661571631 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c02c8a0 con 0x7f7c340b3890 2023-11-24T08:02:39.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.505+0000 7f7c327fc640 1 -- 172.21.15.161:0/2661571631 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c02cc30 con 0x7f7c340b3890 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 -- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340b3890 msgr2=0x7f7c340b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340b3890 0x7f7c340b3d20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009d90 tx=0x7f7c2c02bd70 comp rx=0 tx=0).stop 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 -- 172.21.15.161:0/2661571631 shutdown_connections 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340b3890 0x7f7c340b3d20 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2661571631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340d17e0 0x7f7c340d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 -- 172.21.15.161:0/2661571631 >> 172.21.15.161:0/2661571631 conn(0x7f7c3409c540 msgr2=0x7f7c340d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 -- 172.21.15.161:0/2661571631 shutdown_connections 2023-11-24T08:02:39.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.506+0000 7f7c3961c640 1 -- 172.21.15.161:0/2661571631 wait complete. 2023-11-24T08:02:39.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.508+0000 7f7c3961c640 1 Processor -- start 2023-11-24T08:02:39.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.508+0000 7f7c3961c640 1 -- start start 2023-11-24T08:02:39.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c3961c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340b3890 0x7f7c340b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c3961c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340d17e0 0x7f7c34159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c3961c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 0x7f7c341f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c3961c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3415e190 con 0x7f7c3415d610 2023-11-24T08:02:39.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c3961c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3415de60 con 0x7f7c340d17e0 2023-11-24T08:02:39.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c3961c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340b88b0 con 0x7f7c340b3890 2023-11-24T08:02:39.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c337fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 0x7f7c341f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c337fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 0x7f7c341f2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54050/0 (socket says 172.21.15.161:54050) 2023-11-24T08:02:39.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c337fe640 1 -- 172.21.15.161:0/2739554440 learned_addr learned my addr 172.21.15.161:0/2739554440 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340d17e0 0x7f7c34159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.510+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340b3890 0x7f7c340b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c337fe640 1 -- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340b3890 msgr2=0x7f7c340b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c337fe640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340b3890 0x7f7c340b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c337fe640 1 -- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340d17e0 msgr2=0x7f7c34159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c337fe640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340d17e0 0x7f7c34159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c337fe640 1 -- 172.21.15.161:0/2739554440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c009a70 con 0x7f7c3415d610 2023-11-24T08:02:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c337fe640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 0x7f7c341f2d10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009d90 tx=0x7f7c2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c2b7fe640 1 -- 172.21.15.161:0/2739554440 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c02ce90 con 0x7f7c3415d610 2023-11-24T08:02:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c2b7fe640 1 -- 172.21.15.161:0/2739554440 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c009450 con 0x7f7c3415d610 2023-11-24T08:02:39.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c2b7fe640 1 -- 172.21.15.161:0/2739554440 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c040690 con 0x7f7c3415d610 2023-11-24T08:02:39.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.511+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340b8b90 con 0x7f7c3415d610 2023-11-24T08:02:39.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.512+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c340b61a0 con 0x7f7c3415d610 2023-11-24T08:02:39.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.514+0000 7f7c2b7fe640 1 -- 172.21.15.161:0/2739554440 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7c2c0407f0 con 0x7f7c3415d610 2023-11-24T08:02:39.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.515+0000 7f7c2b7fe640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c1406aff0 0x7f7c1406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.515+0000 7f7c2b7fe640 1 -- 172.21.15.161:0/2739554440 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c2c0ac4a0 con 0x7f7c3415d610 2023-11-24T08:02:39.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.515+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c1406aff0 0x7f7c1406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.516+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c1406aff0 0x7f7c1406d4b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7c24001af0 tx=0x7f7c24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.517+0000 7f7c3c1b4740 1 Processor -- start 2023-11-24T08:02:39.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.517+0000 7f7c3c1b4740 1 -- start start 2023-11-24T08:02:39.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.517+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9c0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8c9bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8ca03560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c91e880 con 0x55ff8c9baba0 2023-11-24T08:02:39.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c92dae0 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c92b1d0 con 0x55ff8c9bfea0 2023-11-24T08:02:39.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8c9bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8c9bf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54062/0 (socket says 172.21.15.161:54062) 2023-11-24T08:02:39.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 -- 172.21.15.161:0/3234356575 learned_addr learned my addr 172.21.15.161:0/3234356575 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c337fe640 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8ca03560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 -- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 msgr2=0x55ff8c9c0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9c0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 -- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 msgr2=0x55ff8ca03560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8ca03560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c2bfff640 1 -- 172.21.15.161:0/3234356575 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff8c8ee860 con 0x55ff8c9baba0 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.518+0000 7f7c337fe640 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8ca03560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.519+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8c9bf0a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009a70 tx=0x7f7c1c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f958a5927307c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.519+0000 7f7c28ff9640 1 -- 172.21.15.161:0/3234356575 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004440 con 0x55ff8c9baba0 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.519+0000 7f7c28ff9640 1 -- 172.21.15.161:0/3234356575 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00c050 con 0x55ff8c9baba0 2023-11-24T08:02:39.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.519+0000 7f7c28ff9640 1 -- 172.21.15.161:0/3234356575 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c010b50 con 0x55ff8c9baba0 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3234356575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 msgr2=0x55ff8c9bf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8c9bf0a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009a70 tx=0x7f7c1c009f30 comp rx=0 tx=0).stop 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3234356575 shutdown_connections 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8ca03560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8c9bf0a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3234356575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9c0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3234356575 >> 172.21.15.161:0/3234356575 conn(0x55ff8c981c70 msgr2=0x55ff8ca05990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3234356575 shutdown_connections 2023-11-24T08:02:39.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.520+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3234356575 wait complete. 2023-11-24T08:02:39.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.521+0000 7f7c3c1b4740 1 -- start start 2023-11-24T08:02:39.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.521+0000 7f7c3c1b4740 1 Processor -- start 2023-11-24T08:02:39.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9baba0 0x55ff8ca01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9e5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c926ac0 con 0x55ff8c9bfea0 2023-11-24T08:02:39.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c8c32f0 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c8e0c70 con 0x55ff8c9baba0 2023-11-24T08:02:39.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c3c1b4740 10 client.0 _ll_register_callbacks cb 0x55ff8c8e53b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:02:39.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c337fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9e5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c337fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9e5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54070/0 (socket says 172.21.15.161:54070) 2023-11-24T08:02:39.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c337fe640 1 -- 172.21.15.161:0/1315160472 learned_addr learned my addr 172.21.15.161:0/1315160472 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.522+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9baba0 0x55ff8ca01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c337fe640 1 -- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9baba0 msgr2=0x55ff8ca01ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c337fe640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9baba0 0x55ff8ca01ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c337fe640 1 -- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 msgr2=0x55ff8c9e82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c337fe640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9e82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c337fe640 1 -- 172.21.15.161:0/1315160472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c1c009640 con 0x55ff8c9bfea0 2023-11-24T08:02:39.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9baba0 0x55ff8ca01ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:39.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c337fe640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9e5c30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c082cc0 tx=0x7f7c2c07aef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56eb0733e4a110c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:02:39.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c11ffb640 1 -- 172.21.15.161:0/1315160472 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0aaa90 con 0x55ff8c9bfea0 2023-11-24T08:02:39.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c11ffb640 1 -- 172.21.15.161:0/1315160472 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c2c0831f0 con 0x55ff8c9bfea0 2023-11-24T08:02:39.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff8c91faa0 con 0x55ff8c9bfea0 2023-11-24T08:02:39.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c11ffb640 1 -- 172.21.15.161:0/1315160472 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c2c0ac0b0 con 0x55ff8c9bfea0 2023-11-24T08:02:39.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c3c1b4740 10 client.5859 fetch_fsmap learned FSMap version 26 2023-11-24T08:02:39.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ff8c925140 con 0x55ff8c9bfea0 2023-11-24T08:02:39.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.523+0000 7f7c11ffb640 1 -- 172.21.15.161:0/1315160472 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ff8c91faa0 con 0x55ff8c9bfea0 2023-11-24T08:02:39.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c11ffb640 1 -- 172.21.15.161:0/1315160472 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7c2c050020 con 0x55ff8c9bfea0 2023-11-24T08:02:39.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c3c1b4740 10 client.5859 fetch_fsmap finished waiting for FSMap version 26 2023-11-24T08:02:39.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c3c1b4740 10 client.5859 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:02:39.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c3c1b4740 20 client.5859 populate_metadata read hostname 'smithi161' 2023-11-24T08:02:39.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca19300 0x55ff8ca0c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c3c1b4740 4 client.5859 mds_command: new command op to 5688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:02:39.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 --> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff8c91f7c0 con 0x55ff8ca19300 2023-11-24T08:02:39.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.524+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca19300 0x55ff8ca0c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.525+0000 7f7c11ffb640 10 client.5859 ms_handle_connect on v2:172.21.15.175:6836/2376580130 2023-11-24T08:02:39.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.525+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca19300 0x55ff8ca0c940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=880eb9aadd4641e3 server_cookie=e33aaa3834139767 in_seq=0 out_seq=0 2023-11-24T08:02:39.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c11ffb640 1 -- 172.21.15.161:0/1315160472 <== mds.0 v2:172.21.15.175:6836/2376580130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff8c91f7c0 con 0x55ff8ca19300 2023-11-24T08:02:39.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c11ffb640 10 client.5859 handle_command_reply: tid=0 2023-11-24T08:02:39.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 client.5859 shutdown 2023-11-24T08:02:39.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 msgr2=0x55ff8c9e5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9e5c30 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c082cc0 tx=0x7f7c2c07aef0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 shutdown_connections 2023-11-24T08:02:39.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca19300 0x55ff8ca0c940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9e5c30 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1315160472 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9baba0 0x55ff8ca01ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 >> 172.21.15.161:0/1315160472 conn(0x55ff8c981c70 msgr2=0x55ff8ca062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c11ffb640 0 client.5859 ms_handle_reset on v2:172.21.15.175:6836/2376580130 2023-11-24T08:02:39.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 shutdown_connections 2023-11-24T08:02:39.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.527+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1315160472 wait complete. 2023-11-24T08:02:39.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.528+0000 7f7c3c1b4740 20 client.5859 trim_cache size 0 max 16384 2023-11-24T08:02:39.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.544+0000 7f7c3c1b4740 1 Processor -- start 2023-11-24T08:02:39.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 -- start start 2023-11-24T08:02:39.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9baba0 0x55ff8c9be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c689f20 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8ca197e0 con 0x55ff8c9baba0 2023-11-24T08:02:39.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.545+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c8aa510 con 0x55ff8c9bfea0 2023-11-24T08:02:39.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9b9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54078/0 (socket says 172.21.15.161:54078) 2023-11-24T08:02:39.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 -- 172.21.15.161:0/1444228570 learned_addr learned my addr 172.21.15.161:0/1444228570 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 -- 172.21.15.161:0/1444228570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 msgr2=0x55ff8c9ba0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 -- 172.21.15.161:0/1444228570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9baba0 msgr2=0x55ff8c9be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9baba0 0x55ff8c9be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 -- 172.21.15.161:0/1444228570 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff8c8c2b80 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.546+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9b9b80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c010680 tx=0x7f7c1c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829e0a2d20e64988 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c297fa640 1 -- 172.21.15.161:0/1444228570 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c024070 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c297fa640 1 -- 172.21.15.161:0/1444228570 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c004240 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c297fa640 1 -- 172.21.15.161:0/1444228570 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c010950 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1444228570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 msgr2=0x55ff8c9b9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9b9b80 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c010680 tx=0x7f7c1c00e000 comp rx=0 tx=0).stop 2023-11-24T08:02:39.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1444228570 shutdown_connections 2023-11-24T08:02:39.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bfea0 0x55ff8c9ba0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9bf5e0 0x55ff8c9b9b80 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/1444228570 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9baba0 0x55ff8c9be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1444228570 >> 172.21.15.161:0/1444228570 conn(0x55ff8c981c70 msgr2=0x55ff8ca01350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.547+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1444228570 shutdown_connections 2023-11-24T08:02:39.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.548+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/1444228570 wait complete. 2023-11-24T08:02:39.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.548+0000 7f7c3c1b4740 1 -- start start 2023-11-24T08:02:39.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.548+0000 7f7c3c1b4740 1 Processor -- start 2023-11-24T08:02:39.561 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8ca6f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bf5e0 0x55ff8c9ed550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9b9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8ca1c540 con 0x55ff8c9baba0 2023-11-24T08:02:39.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff8c9e7490 con 0x55ff8c9bfea0 2023-11-24T08:02:39.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff8ca05a20 con 0x55ff8c9bf5e0 2023-11-24T08:02:39.562 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.549+0000 7f7c3c1b4740 10 client.0 _ll_register_callbacks cb 0x7f7c2c0aa580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8ca6f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8ca6f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54092/0 (socket says 172.21.15.161:54092) 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 -- 172.21.15.161:0/3010919993 learned_addr learned my addr 172.21.15.161:0/3010919993 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 -- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bf5e0 msgr2=0x55ff8c9ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bf5e0 0x55ff8c9ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 -- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bfea0 msgr2=0x55ff8c9b9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9b9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.563 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 -- 172.21.15.161:0/3010919993 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff8c8ee860 con 0x55ff8c9baba0 2023-11-24T08:02:39.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c32ffd640 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8ca6f800 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55ff8ca0ad10 tx=0x7f7c24001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57dbdc60e7898b6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.550+0000 7f7c11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:02:39.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c11ffb640 1 -- 172.21.15.161:0/3010919993 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240248b0 con 0x55ff8c9baba0 2023-11-24T08:02:39.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c11ffb640 1 -- 172.21.15.161:0/3010919993 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c24007520 con 0x55ff8c9baba0 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c1c00c050 con 0x55ff8c9baba0 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c11ffb640 1 -- 172.21.15.161:0/3010919993 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c240076e0 con 0x55ff8c9baba0 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 10 client.5865 fetch_fsmap learned FSMap version 26 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ff8c8e8170 con 0x55ff8c9baba0 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c11ffb640 1 -- 172.21.15.161:0/3010919993 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c00c050 con 0x55ff8c9baba0 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c11ffb640 1 -- 172.21.15.161:0/3010919993 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7c2400e6d0 con 0x55ff8c9baba0 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 10 client.5865 fetch_fsmap finished waiting for FSMap version 26 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 10 client.5865 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 20 client.5865 populate_metadata read hostname 'smithi161' 2023-11-24T08:02:39.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca06210 0x55ff8ca08ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 4 client.5865 mds_command: new command op to 5688 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.551+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 --> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ff8c6276c0 con 0x55ff8ca06210 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.552+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca06210 0x55ff8ca08ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c2bfff640 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca06210 0x55ff8ca08ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=822caf117e82e0a1 server_cookie=92d1deb955a5b044 in_seq=0 out_seq=0 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c11ffb640 10 client.5865 ms_handle_connect on v2:172.21.15.175:6836/2376580130 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c11ffb640 1 -- 172.21.15.161:0/3010919993 <== mds.0 v2:172.21.15.175:6836/2376580130 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55ff8c6276c0 con 0x55ff8ca06210 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c11ffb640 10 client.5865 handle_command_reply: tid=0 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c3c1b4740 1 client.5865 shutdown 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 msgr2=0x55ff8ca6f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.553+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8ca6f800 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x55ff8ca0ad10 tx=0x7f7c24001a80 comp rx=0 tx=0).stop 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 shutdown_connections 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:6836/2376580130,v1:172.21.15.175:6837/2376580130] conn(0x55ff8ca06210 0x55ff8ca08ad0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x55ff8c9bfea0 0x55ff8c9b9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x55ff8c9bf5e0 0x55ff8c9ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 --2- 172.21.15.161:0/3010919993 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55ff8c9baba0 0x55ff8ca6f800 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c11ffb640 0 client.5865 ms_handle_reset on v2:172.21.15.175:6836/2376580130 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 >> 172.21.15.161:0/3010919993 conn(0x55ff8c981c70 msgr2=0x55ff8ca0b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 shutdown_connections 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 1 -- 172.21.15.161:0/3010919993 wait complete. 2023-11-24T08:02:39.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3c1b4740 20 client.5865 trim_cache size 0 max 16384 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "2e355083-a16f-42dd-a3ed-5276a3fda4f7", 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 5688, 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 11.723352689, 2023-11-24T08:02:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 26, 2023-11-24T08:02:39.569 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 47, 2023-11-24T08:02:39.569 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 47, 2023-11-24T08:02:39.569 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 18.097701481000001 2023-11-24T08:02:39.569 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c1406aff0 msgr2=0x7f7c1406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c1406aff0 0x7f7c1406d4b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7c24001af0 tx=0x7f7c24009040 comp rx=0 tx=0).stop 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 msgr2=0x7f7c341f2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.554+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 0x7f7c341f2d10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009d90 tx=0x7f7c2c004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 shutdown_connections 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7c1406aff0 0x7f7c1406d4b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c3415d610 0x7f7c341f2d10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c340d17e0 0x7f7c34159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 --2- 172.21.15.161:0/2739554440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c340b3890 0x7f7c340b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 >> 172.21.15.161:0/2739554440 conn(0x7f7c3409c540 msgr2=0x7f7c340ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 shutdown_connections 2023-11-24T08:02:39.571 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.555+0000 7f7c3961c640 1 -- 172.21.15.161:0/2739554440 wait complete. 2023-11-24T08:02:39.577 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:02:39.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.831+0000 7f5f6f778640 1 Processor -- start 2023-11-24T08:02:39.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.831+0000 7f5f6f778640 1 -- start start 2023-11-24T08:02:39.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.832+0000 7f5f6f778640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f6813e360 0x7f5f680cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.832+0000 7f5f6f778640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f6815f9c0 0x7f5f680cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.832+0000 7f5f6f778640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6815c5f0 con 0x7f5f6813df80 2023-11-24T08:02:39.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.832+0000 7f5f6f778640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6806c470 con 0x7f5f6815f9c0 2023-11-24T08:02:39.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.832+0000 7f5f6f778640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6806c750 con 0x7f5f6813e360 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f6815f9c0 0x7f5f680cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f6815f9c0 0x7f5f680cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54094/0 (socket says 172.21.15.161:54094) 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 -- 172.21.15.161:0/489742833 learned_addr learned my addr 172.21.15.161:0/489742833 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 -- 172.21.15.161:0/489742833 >> v2:172.21.15.175:3300/0 conn(0x7f5f6813e360 msgr2=0x7f5f680cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 --2- 172.21.15.161:0/489742833 >> v2:172.21.15.175:3300/0 conn(0x7f5f6813e360 0x7f5f680cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 -- 172.21.15.161:0/489742833 >> v1:172.21.15.175:6789/0 conn(0x7f5f6813df80 legacy=0x7f5f6815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:39.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.833+0000 7f5f6dd15640 1 -- 172.21.15.161:0/489742833 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6806ca30 con 0x7f5f6815f9c0 2023-11-24T08:02:39.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.834+0000 7f5f6dd15640 1 --2- 172.21.15.161:0/489742833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680cf7d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ccae0 tx=0x7f5f6002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd49b45cee9d8fd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.834+0000 7f5f5ffff640 1 -- 172.21.15.161:0/489742833 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6002ca70 con 0x7f5f6815f9c0 2023-11-24T08:02:39.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.834+0000 7f5f5ffff640 1 -- 172.21.15.161:0/489742833 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6002cbd0 con 0x7f5f6815f9c0 2023-11-24T08:02:39.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.834+0000 7f5f5ffff640 1 -- 172.21.15.161:0/489742833 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f600343f0 con 0x7f5f6815f9c0 2023-11-24T08:02:39.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 -- 172.21.15.161:0/489742833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 msgr2=0x7f5f680cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 --2- 172.21.15.161:0/489742833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680cf7d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5f680ccae0 tx=0x7f5f6002bed0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 -- 172.21.15.161:0/489742833 shutdown_connections 2023-11-24T08:02:39.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 --2- 172.21.15.161:0/489742833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680cf7d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 --2- 172.21.15.161:0/489742833 >> v2:172.21.15.175:3300/0 conn(0x7f5f6813e360 0x7f5f680cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 -- 172.21.15.161:0/489742833 >> 172.21.15.161:0/489742833 conn(0x7f5f6806a800 msgr2=0x7f5f6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:39.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.835+0000 7f5f6f778640 1 -- 172.21.15.161:0/489742833 shutdown_connections 2023-11-24T08:02:39.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.836+0000 7f5f6f778640 1 -- 172.21.15.161:0/489742833 wait complete. 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.837+0000 7f5f6f778640 1 Processor -- start 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.837+0000 7f5f6f778640 1 -- start start 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.838+0000 7f5f6f778640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6813df80 0x7f5f68136c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.838+0000 7f5f6f778640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6813e360 0x7f5f6814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.838+0000 7f5f6f778640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.838+0000 7f5f6f778640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6814df50 con 0x7f5f6815f9c0 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.838+0000 7f5f6f778640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6814e230 con 0x7f5f6813df80 2023-11-24T08:02:39.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.838+0000 7f5f6f778640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6814e510 con 0x7f5f6813e360 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:54100/0 (socket says 172.21.15.161:54100) 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 -- 172.21.15.161:0/4258923764 learned_addr learned my addr 172.21.15.161:0/4258923764 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 -- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6813e360 msgr2=0x7f5f6814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6813e360 0x7f5f6814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 -- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6813df80 msgr2=0x7f5f68136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6813df80 0x7f5f68136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 -- 172.21.15.161:0/4258923764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f60009b30 con 0x7f5f6815f9c0 2023-11-24T08:02:39.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.839+0000 7f5f6dd15640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680b3290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5f60036040 tx=0x7f5f60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.840+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6003e450 con 0x7f5f6815f9c0 2023-11-24T08:02:39.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.840+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6003e5b0 con 0x7f5f6815f9c0 2023-11-24T08:02:39.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.840+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6003e960 con 0x7f5f6815f9c0 2023-11-24T08:02:39.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.840+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6814e7f0 con 0x7f5f6815f9c0 2023-11-24T08:02:39.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.840+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f68137150 con 0x7f5f6815f9c0 2023-11-24T08:02:39.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.841+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6814ed10 con 0x7f5f6815f9c0 2023-11-24T08:02:39.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.842+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f5f6003eac0 con 0x7f5f6815f9c0 2023-11-24T08:02:39.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.843+0000 7f5f5dffb640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5f4c06aff0 0x7f5f4c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:39.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.843+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f600ac900 con 0x7f5f6815f9c0 2023-11-24T08:02:39.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.843+0000 7f5f6d514640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5f4c06aff0 0x7f5f4c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:39.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.844+0000 7f5f6d514640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5f4c06aff0 0x7f5f4c06d4b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009650 tx=0x7f5f64006ba0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:39.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:39.847+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f6814ed10 con 0x7f5f6815f9c0 2023-11-24T08:02:40.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.075+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f6814ed10 con 0x7f5f6815f9c0 2023-11-24T08:02:40.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.076+0000 7f5f5dffb640 1 -- 172.21.15.161:0/4258923764 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f60043060 con 0x7f5f6815f9c0 2023-11-24T08:02:40.078 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:02:40.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5f4c06aff0 msgr2=0x7f5f4c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:40.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5f4c06aff0 0x7f5f4c06d4b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009650 tx=0x7f5f64006ba0 comp rx=0 tx=0).stop 2023-11-24T08:02:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 msgr2=0x7f5f680b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680b3290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5f60036040 tx=0x7f5f60004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 shutdown_connections 2023-11-24T08:02:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5f4c06aff0 0x7f5f4c06d4b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:40.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f6815f9c0 0x7f5f680b3290 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:40.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f6813e360 0x7f5f6814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:40.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 --2- 172.21.15.161:0/4258923764 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f6813df80 0x7f5f68136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:40.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 >> 172.21.15.161:0/4258923764 conn(0x7f5f6806a800 msgr2=0x7f5f6815dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:40.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 shutdown_connections 2023-11-24T08:02:40.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:40.079+0000 7f5f6f778640 1 -- 172.21.15.161:0/4258923764 wait complete. 2023-11-24T08:02:40.100 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:02:40.100 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:02:40.100 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-24T08:02:40.100 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:02:40.100 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:40.101 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:02:40.101 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:02:40.101 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:02:40.101 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:02:40.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.101 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:40.153 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42242sec preferred_lft 42242sec 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.154 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8039:e9ff:fe5c:58ac/64 scope link 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::f4:2aff:fe75:db23/64 scope link 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:02:40.155 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether ca:62:f1:ec:2f:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:02:40.156 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c862:f1ff:feec:2f57/64 scope link 2023-11-24T08:02:40.156 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:40.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.157 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:02:40.250 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-24T08:02:40.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.255 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-24T08:02:40.308 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-24T08:02:40.309 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:02:40.309 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:02:40.309 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:02:40.309 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:02:40.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.309 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:02:40.310 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:02:40.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:02:40.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:02:40.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:02:40.310 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:02:40.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.497 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:02:40.548 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:02:40.549 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:02:40.550 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:02:40.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.550 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-24T08:02:40.650 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T08:02:40.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:02:40.651 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:40.705 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:02:40.705 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:02:40.706 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:40.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:02:40.854 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:02:40.911 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:02:40.911 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:02:40.911 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:02:40.911 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:02:40.911 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:02:40.912 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:02:40.913 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:02:40.914 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:02:40.914 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:02:40.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:40.915 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:02:40.966 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:02:40.966 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T08:02:40.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:02:41.055 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:02:41.100 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:02:41.100 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:02:41.100 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:02:41.100 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:02:41.101 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:02:41.102 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:02:41.103 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:02:41.103 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:02:41.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:41.104 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:02:41.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:2023-11-24T08:02:41.163+0000 7f3e5143a480 -1 init, newargv = 0x55f1c9bedb80 newargc=15 2023-11-24T08:02:41.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[105161]: starting ceph client 2023-11-24T08:02:41.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[105161]: starting fuse 2023-11-24T08:02:41.190 INFO:teuthology.orchestra.run.smithi161.stdout:39 2023-11-24T08:02:41.191 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> import re 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> import os 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:02:41.191 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:02:41.192 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2023-11-24T08:02:41.193 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2023-11-24T08:02:41.193 DEBUG:teuthology.orchestra.run.smithi161:> return f 2023-11-24T08:02:41.193 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:02:41.193 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:02:41.193 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.0")) 2023-11-24T08:02:41.193 DEBUG:teuthology.orchestra.run.smithi161:> ' 2023-11-24T08:02:41.399 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.0.105161.asok 2023-11-24T08:02:41.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:02:41.416 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.105161.asok 2023-11-24T08:02:41.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:41.417 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.105161.asok status 2023-11-24T08:02:41.641 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:02:41.641 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2023-11-24T08:02:41.641 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:02:41.641 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:02:41.641 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "0", 2023-11-24T08:02:41.641 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "105161", 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 5877, 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2023-11-24T08:02:41.642 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 5877 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 406294762 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:02:41.643 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 406294762 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.5877 192.168.0.1:0/406294762", 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/406294762", 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 26, 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 47, 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2023-11-24T08:02:41.644 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:02:41.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:41.656 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2023-11-24T08:02:41.656 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:41.711 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2023-11-24T08:02:41.711 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:41.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:41.711 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:41.809 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:02:42.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.014+0000 7f41787b0640 1 Processor -- start 2023-11-24T08:02:42.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.014+0000 7f41787b0640 1 -- start start 2023-11-24T08:02:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f41787b0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f417013e360 0x7f41700cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f41787b0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417015c5f0 con 0x7f417015f9c0 2023-11-24T08:02:42.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f41787b0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417006c470 con 0x7f417013df80 2023-11-24T08:02:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f41787b0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417006c750 con 0x7f417013e360 2023-11-24T08:02:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f4176d4d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f417015f9c0 0x7f41700cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44640/0 (socket says 172.21.15.161:44640) 2023-11-24T08:02:42.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f4176d4d640 1 -- 172.21.15.161:0/2961068634 learned_addr learned my addr 172.21.15.161:0/2961068634 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:42.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.016+0000 7f4175d4b640 1 --2- 172.21.15.161:0/2961068634 >> v2:172.21.15.175:3300/0 conn(0x7f417013e360 0x7f41700cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:42.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670631021 0 0) 0x7f417015c5f0 con 0x7f417015f9c0 2023-11-24T08:02:42.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4158003520 con 0x7f417015f9c0 2023-11-24T08:02:42.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3237236616 0 0) 0x7f4158003520 con 0x7f417015f9c0 2023-11-24T08:02:42.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 >> v2:172.21.15.175:3300/0 conn(0x7f417013e360 msgr2=0x7f41700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 --2- 172.21.15.161:0/2961068634 >> v2:172.21.15.175:3300/0 conn(0x7f417013e360 0x7f41700cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 >> v1:172.21.15.175:6789/0 conn(0x7f417013df80 legacy=0x7f417015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417006ca30 con 0x7f417015f9c0 2023-11-24T08:02:42.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f4168001a10 con 0x7f417015f9c0 2023-11-24T08:02:42.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 >> v1:172.21.15.161:6789/0 conn(0x7f417015f9c0 legacy=0x7f41700cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158003970 0x7f4158003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4158004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158005180 0x7f415800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417006c750 con 0x7f41580047c0 2023-11-24T08:02:42.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415800c020 con 0x7f4158005180 2023-11-24T08:02:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.017+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415800c1e0 con 0x7f4158003970 2023-11-24T08:02:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4175d4b640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4158004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4176d4d640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158005180 0x7f415800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f417654c640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158003970 0x7f4158003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4175d4b640 1 -- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158003970 msgr2=0x7f4158003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4175d4b640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4158003970 0x7f4158003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4175d4b640 1 -- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158005180 msgr2=0x7f415800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4175d4b640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158005180 0x7f415800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4175d4b640 1 -- 172.21.15.161:0/2961068634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4158003520 con 0x7f41580047c0 2023-11-24T08:02:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4176d4d640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4158005180 0x7f415800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.018+0000 7f4176d4d640 1 -- 172.21.15.161:0/2961068634 reap_dead start 2023-11-24T08:02:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.019+0000 7f4175d4b640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4158004c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4164009a90 tx=0x7f41580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c11ff5f52e41bbd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.019+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416402c680 con 0x7f41580047c0 2023-11-24T08:02:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.019+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416402c7e0 con 0x7f41580047c0 2023-11-24T08:02:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.019+0000 7f417554a640 1 -- 172.21.15.161:0/2961068634 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416402cb90 con 0x7f41580047c0 2023-11-24T08:02:42.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 -- 172.21.15.161:0/2961068634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 msgr2=0x7f4158004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4158004c40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4164009a90 tx=0x7f41580057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 -- 172.21.15.161:0/2961068634 shutdown_connections 2023-11-24T08:02:42.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 --2- 172.21.15.161:0/2961068634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4158004c40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 -- 172.21.15.161:0/2961068634 >> 172.21.15.161:0/2961068634 conn(0x7f417006a800 msgr2=0x7f417006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:42.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 -- 172.21.15.161:0/2961068634 shutdown_connections 2023-11-24T08:02:42.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.020+0000 7f41787b0640 1 -- 172.21.15.161:0/2961068634 wait complete. 2023-11-24T08:02:42.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.022+0000 7f41787b0640 1 Processor -- start 2023-11-24T08:02:42.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.022+0000 7f41787b0640 1 -- start start 2023-11-24T08:02:42.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f41787b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4170071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f41787b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41701f7130 0x7f41701f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.035 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f41787b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4170159a30 0x7f4170159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f41787b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417015a3f0 con 0x7f41580047c0 2023-11-24T08:02:42.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f41787b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417014a990 con 0x7f41701f7130 2023-11-24T08:02:42.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f41787b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4170070dc0 con 0x7f4170159a30 2023-11-24T08:02:42.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f417654c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4170071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:42.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f417654c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4170071680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42866/0 (socket says 172.21.15.161:42866) 2023-11-24T08:02:42.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.023+0000 7f417654c640 1 -- 172.21.15.161:0/4178873610 learned_addr learned my addr 172.21.15.161:0/4178873610 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:42.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f417654c640 1 -- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4170159a30 msgr2=0x7f4170159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f417654c640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4170159a30 0x7f4170159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f417654c640 1 -- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41701f7130 msgr2=0x7f41701f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f417654c640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41701f7130 0x7f41701f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f417654c640 1 -- 172.21.15.161:0/4178873610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41700710a0 con 0x7f41580047c0 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f417654c640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4170071680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f416000d4c0 tx=0x7f416000d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4160005480 con 0x7f41580047c0 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4160003610 con 0x7f41580047c0 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41600039e0 con 0x7f41580047c0 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.024+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4170071380 con 0x7f41580047c0 2023-11-24T08:02:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.025+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41701f75b0 con 0x7f41580047c0 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.026+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41700675d0 con 0x7f41580047c0 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.027+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4160003b40 con 0x7f41580047c0 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.027+0000 7f416effd640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f415c06aff0 0x7f415c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.028+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4160089a10 con 0x7f41580047c0 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.028+0000 7f4175d4b640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f415c06aff0 0x7f415c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.029+0000 7f4175d4b640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f415c06aff0 0x7f415c06d4b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4164036000 tx=0x7f416402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.032+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4160054600 con 0x7f41580047c0 2023-11-24T08:02:42.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.259+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f417006df00 con 0x7f41580047c0 2023-11-24T08:02:42.261 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.259+0000 7f416effd640 1 -- 172.21.15.161:0/4178873610 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4160057c20 con 0x7f41580047c0 2023-11-24T08:02:42.262 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:02:42.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f415c06aff0 msgr2=0x7f415c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.264 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f415c06aff0 0x7f415c06d4b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4164036000 tx=0x7f416402e000 comp rx=0 tx=0).stop 2023-11-24T08:02:42.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 msgr2=0x7f4170071680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:42.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4170071680 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f416000d4c0 tx=0x7f416000d980 comp rx=0 tx=0).stop 2023-11-24T08:02:42.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 shutdown_connections 2023-11-24T08:02:42.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f415c06aff0 0x7f415c06d4b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4170159a30 0x7f4170159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41701f7130 0x7f41701f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 --2- 172.21.15.161:0/4178873610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f41580047c0 0x7f4170071680 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:42.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.262+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 >> 172.21.15.161:0/4178873610 conn(0x7f417006a800 msgr2=0x7f417015d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:42.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.263+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 shutdown_connections 2023-11-24T08:02:42.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:42.263+0000 7f41787b0640 1 -- 172.21.15.161:0/4178873610 wait complete. 2023-11-24T08:02:42.283 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:02:42.284 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:02:42.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:42.285 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-24T08:02:42.344 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:02:42.344 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:02:42.344 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:02:42.344 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:02:42.345 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42246sec preferred_lft 42246sec 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::aca0:d6ff:fe4f:fbed/64 scope link 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:02:42.346 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:02:42.347 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::3004:f3ff:fea7:6a6b/64 scope link 2023-11-24T08:02:42.347 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.347 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:02:42.347 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 7e:b6:55:83:e4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:02:42.347 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7cb6:55ff:fe83:e4c9/64 scope link 2023-11-24T08:02:42.347 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:02:42.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:42.348 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:02:42.440 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-24T08:02:42.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:42.444 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-24T08:02:42.498 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-24T08:02:42.498 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:02:42.499 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:02:42.499 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:02:42.499 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:02:42.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:42.499 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:02:42.499 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:02:42.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:02:42.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:02:42.499 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:02:42.500 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:02:42.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:42.679 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:02:42.725 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:02:42.725 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:02:42.726 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:02:42.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:42.726 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-11-24T08:02:42.815 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T08:02:42.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:02:42.816 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:42.872 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:02:42.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:02:42.873 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:42.922 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:02:43.017 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:02:43.074 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:02:43.074 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:02:43.074 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:02:43.074 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:02:43.075 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:02:43.076 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:02:43.077 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:02:43.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:43.078 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:02:43.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:02:43.132 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T08:02:43.141 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:02:43.220 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:02:43.260 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:02:43.260 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:02:43.261 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:02:43.262 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:02:43.263 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:02:43.263 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:02:43.263 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:02:43.263 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:02:43.263 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:02:43.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:43.264 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:02:43.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2023-11-24T08:02:43.322+0000 7f5b5f839480 -1 init, newargv = 0x56399be849b0 newargc=15 2023-11-24T08:02:43.323 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[95893]: starting ceph client 2023-11-24T08:02:43.332 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[95893]: starting fuse 2023-11-24T08:02:43.352 INFO:teuthology.orchestra.run.smithi175.stdout:39 2023-11-24T08:02:43.353 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-24T08:02:43.353 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T08:02:43.354 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:02:43.354 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-24T08:02:43.354 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-24T08:02:43.354 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-24T08:02:43.354 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-24T08:02:43.354 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-24T08:02:43.355 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:02:43.356 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:02:43.356 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2023-11-24T08:02:43.356 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-24T08:02:43.561 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.95893.asok 2023-11-24T08:02:43.565 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:02:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:02:43.579 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95893.asok 2023-11-24T08:02:43.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:43.579 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95893.asok status 2023-11-24T08:02:43.821 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-24T08:02:43.906 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-24T08:02:43.906 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "95893", 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 4865, 2023-11-24T08:02:43.907 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 4865 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2466691496 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:02:43.908 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 2466691496 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.4865 192.168.0.1:0/2466691496", 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/2466691496", 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 26, 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 47, 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-24T08:02:43.909 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-24T08:02:43.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:43.911 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-24T08:02:43.911 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:43.967 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-24T08:02:43.967 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:43.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:43.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:02:44.057 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:02:44.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.280+0000 7f792e901640 1 Processor -- start 2023-11-24T08:02:44.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.281+0000 7f792e901640 1 -- start start 2023-11-24T08:02:44.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.282+0000 7f792e901640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f792813df80 0x7f792815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.282+0000 7f792e901640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f792813e360 0x7f79280cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.282+0000 7f792e901640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792815f9c0 0x7f79280cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.282+0000 7f792e901640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792806c470 con 0x7f792813e360 2023-11-24T08:02:44.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.282+0000 7f792e901640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f792806c750 con 0x7f792813df80 2023-11-24T08:02:44.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.282+0000 7f792e901640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792806ca30 con 0x7f792815f9c0 2023-11-24T08:02:44.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f792813e360 0x7f79280cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:44.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f792813e360 0x7f79280cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42870/0 (socket says 172.21.15.161:42870) 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 -- 172.21.15.161:0/356621660 learned_addr learned my addr 172.21.15.161:0/356621660 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 -- 172.21.15.161:0/356621660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792815f9c0 msgr2=0x7f79280cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 --2- 172.21.15.161:0/356621660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792815f9c0 0x7f79280cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 -- 172.21.15.161:0/356621660 >> v2:172.21.15.175:3300/0 conn(0x7f792813df80 msgr2=0x7f792815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f7927fff640 1 --2- 172.21.15.161:0/356621660 >> v2:172.21.15.175:3300/0 conn(0x7f792813df80 0x7f792815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 --2- 172.21.15.161:0/356621660 >> v2:172.21.15.175:3300/0 conn(0x7f792813df80 0x7f792815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.283+0000 7f791ffff640 1 -- 172.21.15.161:0/356621660 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792806cd10 con 0x7f792813e360 2023-11-24T08:02:44.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.284+0000 7f791ffff640 1 --2- 172.21.15.161:0/356621660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f79280cf290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7928072770 tx=0x7f791002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d2590d46627026 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:44.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f79277fe640 1 -- 172.21.15.161:0/356621660 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910031870 con 0x7f792813e360 2023-11-24T08:02:44.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f79277fe640 1 -- 172.21.15.161:0/356621660 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100319d0 con 0x7f792813e360 2023-11-24T08:02:44.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f79277fe640 1 -- 172.21.15.161:0/356621660 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910031d60 con 0x7f792813e360 2023-11-24T08:02:44.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 -- 172.21.15.161:0/356621660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 msgr2=0x7f79280cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:44.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 --2- 172.21.15.161:0/356621660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f79280cf290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7928072770 tx=0x7f791002b910 comp rx=0 tx=0).stop 2023-11-24T08:02:44.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 -- 172.21.15.161:0/356621660 shutdown_connections 2023-11-24T08:02:44.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 --2- 172.21.15.161:0/356621660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792815f9c0 0x7f79280cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 --2- 172.21.15.161:0/356621660 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f79280cf290 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 --2- 172.21.15.161:0/356621660 >> v2:172.21.15.175:3300/0 conn(0x7f792813df80 0x7f792815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.285+0000 7f792e901640 1 -- 172.21.15.161:0/356621660 >> 172.21.15.161:0/356621660 conn(0x7f792806a800 msgr2=0x7f792806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:44.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.286+0000 7f792e901640 1 -- 172.21.15.161:0/356621660 shutdown_connections 2023-11-24T08:02:44.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.286+0000 7f792e901640 1 -- 172.21.15.161:0/356621660 wait complete. 2023-11-24T08:02:44.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.287+0000 7f792e901640 1 Processor -- start 2023-11-24T08:02:44.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.288+0000 7f792e901640 1 -- start start 2023-11-24T08:02:44.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792e901640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792813df80 0x7f79281f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792e901640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f792813d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792e901640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f792815f9c0 0x7f79281f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792e901640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281f64f0 con 0x7f792813e360 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792e901640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79281f6ab0 con 0x7f792815f9c0 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792e901640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79281f39c0 con 0x7f792813df80 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f792813d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f792813d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42880/0 (socket says 172.21.15.161:42880) 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 -- 172.21.15.161:0/3233207773 learned_addr learned my addr 172.21.15.161:0/3233207773 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f7927fff640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792813df80 0x7f79281f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 -- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792813df80 msgr2=0x7f79281f6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792813df80 0x7f79281f6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 -- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f792815f9c0 msgr2=0x7f79281f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:44.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f792ce9e640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f792815f9c0 0x7f79281f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:44.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f792815f9c0 0x7f79281f2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:44.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.289+0000 7f791ffff640 1 -- 172.21.15.161:0/3233207773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79100094d0 con 0x7f792813e360 2023-11-24T08:02:44.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.290+0000 7f791ffff640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f792813d630 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f791002b950 tx=0x7f79100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.290+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910031840 con 0x7f792813e360 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.290+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79100443f0 con 0x7f792813e360 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.290+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100447a0 con 0x7f792813e360 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.290+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79281f3ca0 con 0x7f792813e360 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.290+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792813db70 con 0x7f792813e360 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.291+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79281f6c40 con 0x7f792813e360 2023-11-24T08:02:44.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.292+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7910044900 con 0x7f792813e360 2023-11-24T08:02:44.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.294+0000 7f79257fa640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f790806aff0 0x7f790806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:44.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.294+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f791002d040 con 0x7f792813e360 2023-11-24T08:02:44.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.295+0000 7f7927fff640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f790806aff0 0x7f790806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:44.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.296+0000 7f7927fff640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f790806aff0 0x7f790806d4b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f79280a9d00 tx=0x7f7918008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:44.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.299+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79100770b0 con 0x7f792813e360 2023-11-24T08:02:44.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:44.527+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f79281f3e60 con 0x7f792813e360 2023-11-24T08:02:45.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.526+0000 7f79257fa640 1 -- 172.21.15.161:0/3233207773 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 136+0+0 (secure 0 0 0) 0x7f791007a6d0 con 0x7f792813e360 2023-11-24T08:02:45.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f790806aff0 msgr2=0x7f790806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f790806aff0 0x7f790806d4b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f79280a9d00 tx=0x7f7918008040 comp rx=0 tx=0).stop 2023-11-24T08:02:45.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 msgr2=0x7f792813d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f792813d630 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f791002b950 tx=0x7f79100046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 shutdown_connections 2023-11-24T08:02:45.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f790806aff0 0x7f790806d4b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f792815f9c0 0x7f79281f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f792813e360 0x7f792813d630 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 --2- 172.21.15.161:0/3233207773 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f792813df80 0x7f79281f6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.530+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 >> 172.21.15.161:0/3233207773 conn(0x7f792806a800 msgr2=0x7f792813f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:45.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.531+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 shutdown_connections 2023-11-24T08:02:45.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.531+0000 7f792e901640 1 -- 172.21.15.161:0/3233207773 wait complete. 2023-11-24T08:02:45.554 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:02:45.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.762+0000 7f8f761dc640 1 Processor -- start 2023-11-24T08:02:45.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.763+0000 7f8f761dc640 1 -- start start 2023-11-24T08:02:45.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.764+0000 7f8f761dc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8f700cf9a0 0x7f8f7015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.764+0000 7f8f761dc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f70070c40 con 0x7f8f700ae5a0 2023-11-24T08:02:45.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.764+0000 7f8f761dc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7006c470 con 0x7f8f700b3ae0 2023-11-24T08:02:45.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.764+0000 7f8f761dc640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f70071450 con 0x7f8f700cf9a0 2023-11-24T08:02:45.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8f700ae5a0 0x7f8f7006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44652/0 (socket says 172.21.15.161:44652) 2023-11-24T08:02:45.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6f7fe640 1 -- 172.21.15.161:0/744565243 learned_addr learned my addr 172.21.15.161:0/744565243 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:45.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038724116 0 0) 0x7f8f70070c40 con 0x7f8f700ae5a0 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f5c003520 con 0x7f8f700ae5a0 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6ffff640 1 --2- 172.21.15.161:0/744565243 >> v2:172.21.15.175:3300/0 conn(0x7f8f700cf9a0 0x7f8f7015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3897094536 0 0) 0x7f8f5c003520 con 0x7f8f700ae5a0 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 >> v2:172.21.15.175:3300/0 conn(0x7f8f700cf9a0 msgr2=0x7f8f7015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 --2- 172.21.15.161:0/744565243 >> v2:172.21.15.175:3300/0 conn(0x7f8f700cf9a0 0x7f8f7015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 >> v1:172.21.15.175:6789/0 conn(0x7f8f700b3ae0 legacy=0x7f8f700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7006c750 con 0x7f8f700ae5a0 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.765+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f8f600019f0 con 0x7f8f700ae5a0 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 >> v1:172.21.15.161:6789/0 conn(0x7f8f700ae5a0 legacy=0x7f8f7006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f5c003970 0x7f8f5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f5c0047c0 0x7f8f5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c005180 0x7f8f5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f70071450 con 0x7f8f5c003970 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c00c0b0 con 0x7f8f5c0047c0 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5c00c270 con 0x7f8f5c005180 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6f7fe640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f5c003970 0x7f8f5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6effd640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f5c0047c0 0x7f8f5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6f7fe640 1 -- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c005180 msgr2=0x7f8f5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6f7fe640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c005180 0x7f8f5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6f7fe640 1 -- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f5c0047c0 msgr2=0x7f8f5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6f7fe640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f5c0047c0 0x7f8f5c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6f7fe640 1 -- 172.21.15.161:0/744565243 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c003520 con 0x7f8f5c003970 2023-11-24T08:02:45.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.766+0000 7f8f6ffff640 1 -- 172.21.15.161:0/744565243 reap_dead start 2023-11-24T08:02:45.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.767+0000 7f8f6f7fe640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f5c003970 0x7f8f5c003d90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000a820 tx=0x7f8f5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6390baabd75d6672 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f600072d0 con 0x7f8f5c003970 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6002f070 con 0x7f8f5c003970 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f6e7fc640 1 -- 172.21.15.161:0/744565243 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f60007730 con 0x7f8f5c003970 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 -- 172.21.15.161:0/744565243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f5c003970 msgr2=0x7f8f5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f5c003970 0x7f8f5c003d90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000a820 tx=0x7f8f5c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 -- 172.21.15.161:0/744565243 shutdown_connections 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 --2- 172.21.15.161:0/744565243 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f5c003970 0x7f8f5c003d90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 -- 172.21.15.161:0/744565243 >> 172.21.15.161:0/744565243 conn(0x7f8f7006a800 msgr2=0x7f8f7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 -- 172.21.15.161:0/744565243 shutdown_connections 2023-11-24T08:02:45.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.768+0000 7f8f761dc640 1 -- 172.21.15.161:0/744565243 wait complete. 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.770+0000 7f8f761dc640 1 Processor -- start 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.770+0000 7f8f761dc640 1 -- start start 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.771+0000 7f8f761dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c003970 0x7f8f700c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.771+0000 7f8f761dc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 0x7f8f7015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.771+0000 7f8f761dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f7015f060 0x7f8f7015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.771+0000 7f8f761dc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700c4d40 con 0x7f8f7014af30 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.771+0000 7f8f761dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700cc510 con 0x7f8f7015f060 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.771+0000 7f8f761dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700cc7f0 con 0x7f8f5c003970 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 0x7f8f7015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:45.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 0x7f8f7015eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42904/0 (socket says 172.21.15.161:42904) 2023-11-24T08:02:45.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 -- 172.21.15.161:0/44194506 learned_addr learned my addr 172.21.15.161:0/44194506 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:45.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 -- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c003970 msgr2=0x7f8f700c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c003970 0x7f8f700c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 -- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f7015f060 msgr2=0x7f8f7015f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:45.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f7015f060 0x7f8f7015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:45.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 -- 172.21.15.161:0/44194506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700c3e50 con 0x7f8f7014af30 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.772+0000 7f8f6effd640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 0x7f8f7015eb20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e4d0 tx=0x7f8f5800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.773+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580053a0 con 0x7f8f7014af30 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.773+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f580035f0 con 0x7f8f7014af30 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.773+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58003980 con 0x7f8f7014af30 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.773+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f700c4130 con 0x7f8f7014af30 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.773+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f70149cb0 con 0x7f8f7014af30 2023-11-24T08:02:45.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.774+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f700cc370 con 0x7f8f7014af30 2023-11-24T08:02:45.777 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.775+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8f58003ae0 con 0x7f8f7014af30 2023-11-24T08:02:45.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.776+0000 7f8f67fff640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f5006b020 0x7f8f5006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:45.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.776+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f58089770 con 0x7f8f7014af30 2023-11-24T08:02:45.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.776+0000 7f8f6f7fe640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f5006b020 0x7f8f5006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:45.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.778+0000 7f8f6f7fe640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f5006b020 0x7f8f5006d4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8f60034000 tx=0x7f8f6002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:45.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.781+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f700cc370 con 0x7f8f7014af30 2023-11-24T08:02:45.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.994+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f70070550 con 0x7f8f5006b020 2023-11-24T08:02:46.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:45.998+0000 7f8f67fff640 1 -- 172.21.15.161:0/44194506 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8f600070d0 con 0x7f8f5006b020 2023-11-24T08:02:46.000 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:02:46.000 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:02:46.000 INFO:teuthology.orchestra.run.smithi161.stdout: "name": "cephfs" 2023-11-24T08:02:46.000 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:02:46.000 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:02:46.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.000+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f5006b020 msgr2=0x7f8f5006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.000+0000 7f8f761dc640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f5006b020 0x7f8f5006d4e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8f60034000 tx=0x7f8f6002f000 comp rx=0 tx=0).stop 2023-11-24T08:02:46.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.000+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 msgr2=0x7f8f7015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.000+0000 7f8f761dc640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 0x7f8f7015eb20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e4d0 tx=0x7f8f5800e990 comp rx=0 tx=0).stop 2023-11-24T08:02:46.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 shutdown_connections 2023-11-24T08:02:46.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8f5006b020 0x7f8f5006d4e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f7015f060 0x7f8f7015f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f7014af30 0x7f8f7015eb20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 --2- 172.21.15.161:0/44194506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f5c003970 0x7f8f700c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 >> 172.21.15.161:0/44194506 conn(0x7f8f7006a800 msgr2=0x7f8f70161610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:46.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 shutdown_connections 2023-11-24T08:02:46.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.001+0000 7f8f761dc640 1 -- 172.21.15.161:0/44194506 wait complete. 2023-11-24T08:02:46.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:02:46.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.223+0000 7f644fcee640 1 Processor -- start 2023-11-24T08:02:46.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.223+0000 7f644fcee640 1 -- start start 2023-11-24T08:02:46.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644fcee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f644814b2c0 0x7f64480cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644fcee640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64480cf7d0 0x7f6448070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644fcee640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480cfbf0 con 0x7f6448070ea0 2023-11-24T08:02:46.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644fcee640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644814b6a0 con 0x7f644814b2c0 2023-11-24T08:02:46.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644fcee640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6448071690 con 0x7f64480cf7d0 2023-11-24T08:02:46.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644da8a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f644814b2c0 0x7f64480cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644da8a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f644814b2c0 0x7f64480cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42906/0 (socket says 172.21.15.161:42906) 2023-11-24T08:02:46.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.225+0000 7f644da8a640 1 -- 172.21.15.161:0/3802080330 learned_addr learned my addr 172.21.15.161:0/3802080330 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:46.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.226+0000 7f644da8a640 1 -- 172.21.15.161:0/3802080330 >> v2:172.21.15.175:3300/0 conn(0x7f64480cf7d0 msgr2=0x7f6448070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:46.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.226+0000 7f644d289640 1 --2- 172.21.15.161:0/3802080330 >> v2:172.21.15.175:3300/0 conn(0x7f64480cf7d0 0x7f6448070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.226+0000 7f644da8a640 1 --2- 172.21.15.161:0/3802080330 >> v2:172.21.15.175:3300/0 conn(0x7f64480cf7d0 0x7f6448070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.226+0000 7f644da8a640 1 -- 172.21.15.161:0/3802080330 >> v1:172.21.15.175:6789/0 conn(0x7f6448070ea0 legacy=0x7f64480b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:46.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.226+0000 7f644da8a640 1 -- 172.21.15.161:0/3802080330 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448071970 con 0x7f644814b2c0 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.227+0000 7f644da8a640 1 --2- 172.21.15.161:0/3802080330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64480cf290 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f64480cfea0 tx=0x7f644402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cc58e1808f77ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.227+0000 7f644ca88640 1 -- 172.21.15.161:0/3802080330 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444031870 con 0x7f644814b2c0 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.227+0000 7f644ca88640 1 -- 172.21.15.161:0/3802080330 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440319d0 con 0x7f644814b2c0 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.227+0000 7f644ca88640 1 -- 172.21.15.161:0/3802080330 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444031d60 con 0x7f644814b2c0 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 -- 172.21.15.161:0/3802080330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 msgr2=0x7f64480cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 --2- 172.21.15.161:0/3802080330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64480cf290 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f64480cfea0 tx=0x7f644402b910 comp rx=0 tx=0).stop 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 -- 172.21.15.161:0/3802080330 shutdown_connections 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 --2- 172.21.15.161:0/3802080330 >> v2:172.21.15.175:3300/0 conn(0x7f64480cf7d0 0x7f6448070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 --2- 172.21.15.161:0/3802080330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64480cf290 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 -- 172.21.15.161:0/3802080330 >> 172.21.15.161:0/3802080330 conn(0x7f644806a800 msgr2=0x7f644806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:46.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 -- 172.21.15.161:0/3802080330 shutdown_connections 2023-11-24T08:02:46.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.228+0000 7f644fcee640 1 -- 172.21.15.161:0/3802080330 wait complete. 2023-11-24T08:02:46.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.230+0000 7f644fcee640 1 Processor -- start 2023-11-24T08:02:46.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.230+0000 7f644fcee640 1 -- start start 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644fcee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448070ea0 0x7f6448160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644fcee640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64480cf7d0 0x7f6448144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644fcee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64481646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644fcee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448143e70 con 0x7f644814b2c0 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644fcee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448144110 con 0x7f6448070ea0 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644fcee640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64481443f0 con 0x7f64480cf7d0 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644e28b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64481646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644e28b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64481646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42910/0 (socket says 172.21.15.161:42910) 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644e28b640 1 -- 172.21.15.161:0/2810997898 learned_addr learned my addr 172.21.15.161:0/2810997898 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.231+0000 7f644da8a640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448070ea0 0x7f6448160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644d289640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64480cf7d0 0x7f6448144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644e28b640 1 -- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64480cf7d0 msgr2=0x7f6448144ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644e28b640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64480cf7d0 0x7f6448144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644e28b640 1 -- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448070ea0 msgr2=0x7f6448160930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644e28b640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448070ea0 0x7f6448160930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644e28b640 1 -- 172.21.15.161:0/2810997898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440094d0 con 0x7f644814b2c0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644e28b640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64481646a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f644000c780 tx=0x7f644000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6440004b60 con 0x7f644814b2c0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000ce90 con 0x7f644814b2c0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000a850 con 0x7f644814b2c0 2023-11-24T08:02:46.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64481446d0 con 0x7f644814b2c0 2023-11-24T08:02:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.232+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6448160e70 con 0x7f644814b2c0 2023-11-24T08:02:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.234+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6448144bf0 con 0x7f644814b2c0 2023-11-24T08:02:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.235+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f644000a9b0 con 0x7f644814b2c0 2023-11-24T08:02:46.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.235+0000 7f643e7fc640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f642c06aff0 0x7f642c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.236+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6440089ba0 con 0x7f644814b2c0 2023-11-24T08:02:46.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.236+0000 7f644da8a640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f642c06aff0 0x7f642c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.237+0000 7f644da8a640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f642c06aff0 0x7f642c06d4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6444036000 tx=0x7f644403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:46.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.240+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6448144bf0 con 0x7f644814b2c0 2023-11-24T08:02:46.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.429+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6448144bf0 con 0x7f644814b2c0 2023-11-24T08:02:46.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.430+0000 7f643e7fc640 1 -- 172.21.15.161:0/2810997898 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6448144bf0 con 0x7f644814b2c0 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f642c06aff0 msgr2=0x7f642c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f642c06aff0 0x7f642c06d4b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6444036000 tx=0x7f644403c040 comp rx=0 tx=0).stop 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 msgr2=0x7f64481646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64481646a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f644000c780 tx=0x7f644000cc40 comp rx=0 tx=0).stop 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 shutdown_connections 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f642c06aff0 0x7f642c06d4b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f644814b2c0 0x7f64481646a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64480cf7d0 0x7f6448144ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.432+0000 7f644fcee640 1 --2- 172.21.15.161:0/2810997898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6448070ea0 0x7f6448160930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.433+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 >> 172.21.15.161:0/2810997898 conn(0x7f644806a800 msgr2=0x7f6448149030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:46.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.433+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 shutdown_connections 2023-11-24T08:02:46.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.433+0000 7f644fcee640 1 -- 172.21.15.161:0/2810997898 wait complete. 2023-11-24T08:02:46.453 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:02:46.453 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:46.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:46.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.755+0000 7f4c0c26b640 1 Processor -- start 2023-11-24T08:02:46.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.755+0000 7f4c0c26b640 1 -- start start 2023-11-24T08:02:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0c26b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0413e360 0x7f4c040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0c26b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4c0415f9c0 0x7f4c040cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0c26b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0415c5f0 con 0x7f4c0413df80 2023-11-24T08:02:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0c26b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0406c470 con 0x7f4c0415f9c0 2023-11-24T08:02:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0c26b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0406c750 con 0x7f4c0413e360 2023-11-24T08:02:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0a007640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4c0413df80 0x7f4c0415bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44666/0 (socket says 172.21.15.161:44666) 2023-11-24T08:02:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0a007640 1 -- 172.21.15.161:0/2194328592 learned_addr learned my addr 172.21.15.161:0/2194328592 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c0a808640 1 --2- 172.21.15.161:0/2194328592 >> v2:172.21.15.161:3300/0 conn(0x7f4c0415f9c0 0x7f4c040cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c09806640 1 --2- 172.21.15.161:0/2194328592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0413e360 0x7f4c040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.757+0000 7f4c09005640 1 -- 172.21.15.161:0/2194328592 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182459155 0 0) 0x7f4c0415c5f0 con 0x7f4c0413df80 2023-11-24T08:02:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.758+0000 7f4c0a808640 1 -- 172.21.15.161:0/2194328592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0413e360 msgr2=0x7f4c040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.758+0000 7f4c0a808640 1 --2- 172.21.15.161:0/2194328592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0413e360 0x7f4c040cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.758+0000 7f4c0a808640 1 -- 172.21.15.161:0/2194328592 >> v1:172.21.15.161:6789/0 conn(0x7f4c0413df80 legacy=0x7f4c0415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.758+0000 7f4c0a808640 1 -- 172.21.15.161:0/2194328592 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0406ca30 con 0x7f4c0415f9c0 2023-11-24T08:02:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.759+0000 7f4c0a808640 1 --2- 172.21.15.161:0/2194328592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0415f9c0 0x7f4c040cf7d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009d90 tx=0x7f4bfc02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e65711b523642f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.759+0000 7f4c09005640 1 -- 172.21.15.161:0/2194328592 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc02cc50 con 0x7f4c0415f9c0 2023-11-24T08:02:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.759+0000 7f4c09005640 1 -- 172.21.15.161:0/2194328592 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc02cdb0 con 0x7f4c0415f9c0 2023-11-24T08:02:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.759+0000 7f4c09005640 1 -- 172.21.15.161:0/2194328592 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc034660 con 0x7f4c0415f9c0 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.759+0000 7f4c0c26b640 1 -- 172.21.15.161:0/2194328592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0415f9c0 msgr2=0x7f4c040cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.759+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/2194328592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0415f9c0 0x7f4c040cf7d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc009d90 tx=0x7f4bfc02bea0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.760+0000 7f4c0c26b640 1 -- 172.21.15.161:0/2194328592 shutdown_connections 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.760+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/2194328592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0415f9c0 0x7f4c040cf7d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.760+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/2194328592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0413e360 0x7f4c040cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.760+0000 7f4c0c26b640 1 -- 172.21.15.161:0/2194328592 >> 172.21.15.161:0/2194328592 conn(0x7f4c0406a800 msgr2=0x7f4c0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.760+0000 7f4c0c26b640 1 -- 172.21.15.161:0/2194328592 shutdown_connections 2023-11-24T08:02:46.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.760+0000 7f4c0c26b640 1 -- 172.21.15.161:0/2194328592 wait complete. 2023-11-24T08:02:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.761+0000 7f4c0c26b640 1 Processor -- start 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 -- start start 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 0x7f4c041f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0413e360 0x7f4c04152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0415f9c0 0x7f4c04153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c041f4c20 con 0x7f4c0413df80 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c041580b0 con 0x7f4c0413e360 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.762+0000 7f4c0c26b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c04158390 con 0x7f4c0415f9c0 2023-11-24T08:02:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 0x7f4c041f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 0x7f4c041f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42930/0 (socket says 172.21.15.161:42930) 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 -- 172.21.15.161:0/1302883991 learned_addr learned my addr 172.21.15.161:0/1302883991 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 -- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0415f9c0 msgr2=0x7f4c04153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0415f9c0 0x7f4c04153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 -- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0413e360 msgr2=0x7f4c04152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0413e360 0x7f4c04152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 -- 172.21.15.161:0/1302883991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc009a70 con 0x7f4c0413df80 2023-11-24T08:02:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.763+0000 7f4c0a007640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 0x7f4c041f46e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000c430 tx=0x7f4c0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.764+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000074e0 con 0x7f4c0413df80 2023-11-24T08:02:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.764+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c00007660 con 0x7f4c0413df80 2023-11-24T08:02:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.764+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00004a20 con 0x7f4c0413df80 2023-11-24T08:02:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.764+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c04158670 con 0x7f4c0413df80 2023-11-24T08:02:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.764+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c04158c30 con 0x7f4c0413df80 2023-11-24T08:02:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.765+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c04158e50 con 0x7f4c0413df80 2023-11-24T08:02:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.766+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4c00004b80 con 0x7f4c0413df80 2023-11-24T08:02:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.767+0000 7f4bfaffd640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4be806aff0 0x7f4be806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.767+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c00089820 con 0x7f4c0413df80 2023-11-24T08:02:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.768+0000 7f4c09806640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4be806aff0 0x7f4be806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:46.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.769+0000 7f4c09806640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4be806aff0 0x7f4be806d4b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c04152e80 tx=0x7f4bf4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:46.774 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.772+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c00054650 con 0x7f4c0413df80 2023-11-24T08:02:46.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.962+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c040675d0 con 0x7f4c0413df80 2023-11-24T08:02:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.965+0000 7f4bfaffd640 1 -- 172.21.15.161:0/1302883991 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f4c00089030 con 0x7f4c0413df80 2023-11-24T08:02:46.968 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:46.968 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":47,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:28.848473+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.968+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4be806aff0 msgr2=0x7f4be806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.968+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4be806aff0 0x7f4be806d4b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4c04152e80 tx=0x7f4bf4008040 comp rx=0 tx=0).stop 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.968+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 msgr2=0x7f4c041f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.968+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 0x7f4c041f46e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4c0000c430 tx=0x7f4c0000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 shutdown_connections 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4be806aff0 0x7f4be806d4b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c0415f9c0 0x7f4c04153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c0413e360 0x7f4c04152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 --2- 172.21.15.161:0/1302883991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c0413df80 0x7f4c041f46e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:46.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 >> 172.21.15.161:0/1302883991 conn(0x7f4c0406a800 msgr2=0x7f4c040b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:46.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 shutdown_connections 2023-11-24T08:02:46.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:46.969+0000 7f4c0c26b640 1 -- 172.21.15.161:0/1302883991 wait complete. 2023-11-24T08:02:46.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:02:25.158735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:02:26.286978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:46.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.188+0000 7f93a6a27640 1 Processor -- start 2023-11-24T08:02:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.188+0000 7f93a6a27640 1 -- start start 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.189+0000 7f93a6a27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a015d4b0 0x7f93a00d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6a27640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f93a00cf9a0 0x7f93a00cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6a27640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93a00cddf0 0x7f93a00ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6a27640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00d0320 con 0x7f93a00cf9a0 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6a27640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a00b2730 con 0x7f93a00cddf0 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6a27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a00d1ec0 con 0x7f93a015d4b0 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f93a00cf9a0 0x7f93a00cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f93a00cf9a0 0x7f93a00cfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42942/0 (socket says 172.21.15.161:42942) 2023-11-24T08:02:47.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 -- 172.21.15.161:0/785663170 learned_addr learned my addr 172.21.15.161:0/785663170 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:47.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5a25640 1 --2- 172.21.15.161:0/785663170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a015d4b0 0x7f93a00d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 -- 172.21.15.161:0/785663170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a015d4b0 msgr2=0x7f93a00d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:47.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 --2- 172.21.15.161:0/785663170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a015d4b0 0x7f93a00d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6226640 1 --2- 172.21.15.161:0/785663170 >> v2:172.21.15.175:3300/0 conn(0x7f93a00cddf0 0x7f93a00ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 -- 172.21.15.161:0/785663170 >> v2:172.21.15.175:3300/0 conn(0x7f93a00cddf0 msgr2=0x7f93a00ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 --2- 172.21.15.161:0/785663170 >> v2:172.21.15.175:3300/0 conn(0x7f93a00cddf0 0x7f93a00ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a5224640 1 -- 172.21.15.161:0/785663170 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a00b29d0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.190+0000 7f93a6226640 1 --2- 172.21.15.161:0/785663170 >> v2:172.21.15.175:3300/0 conn(0x7f93a00cddf0 0x7f93a00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.191+0000 7f93a5224640 1 --2- 172.21.15.161:0/785663170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00cfde0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f939002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301bb0239323c968 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.192+0000 7f93a4a23640 1 -- 172.21.15.161:0/785663170 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390031640 con 0x7f93a00cf9a0 2023-11-24T08:02:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.192+0000 7f93a4a23640 1 -- 172.21.15.161:0/785663170 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93900317a0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.192+0000 7f93a4a23640 1 -- 172.21.15.161:0/785663170 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390031b30 con 0x7f93a00cf9a0 2023-11-24T08:02:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 -- 172.21.15.161:0/785663170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 msgr2=0x7f93a00cfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 --2- 172.21.15.161:0/785663170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00cfde0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9390009870 tx=0x7f939002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 -- 172.21.15.161:0/785663170 shutdown_connections 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 --2- 172.21.15.161:0/785663170 >> v2:172.21.15.175:3300/0 conn(0x7f93a00cddf0 0x7f93a00ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 --2- 172.21.15.161:0/785663170 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00cfde0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 --2- 172.21.15.161:0/785663170 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a015d4b0 0x7f93a00d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 -- 172.21.15.161:0/785663170 >> 172.21.15.161:0/785663170 conn(0x7f93a00d3000 msgr2=0x7f93a00d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 -- 172.21.15.161:0/785663170 shutdown_connections 2023-11-24T08:02:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.193+0000 7f93a6a27640 1 -- 172.21.15.161:0/785663170 wait complete. 2023-11-24T08:02:47.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.194+0000 7f93a6a27640 1 Processor -- start 2023-11-24T08:02:47.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.195+0000 7f93a6a27640 1 -- start start 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.195+0000 7f93a6a27640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a00cddf0 0x7f93a015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a6a27640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00b81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a6a27640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93a015d4b0 0x7f93a00b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a6a27640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a015f1a0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a6a27640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a01f6fe0 con 0x7f93a015d4b0 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a6a27640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a015f3f0 con 0x7f93a00cddf0 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00b81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00b81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42950/0 (socket says 172.21.15.161:42950) 2023-11-24T08:02:47.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 -- 172.21.15.161:0/2562829580 learned_addr learned my addr 172.21.15.161:0/2562829580 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 -- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a00cddf0 msgr2=0x7f93a015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5a25640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a00cddf0 0x7f93a015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a00cddf0 0x7f93a015c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 -- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93a015d4b0 msgr2=0x7f93a00b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93a015d4b0 0x7f93a00b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.196+0000 7f93a5224640 1 -- 172.21.15.161:0/2562829580 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93900094d0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.197+0000 7f93a5224640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00b81c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9390000c00 tx=0x7f93900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.197+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939003ac60 con 0x7f93a00cf9a0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.197+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939003ade0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.197+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9390044630 con 0x7f93a00cf9a0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.197+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a015da10 con 0x7f93a00cf9a0 2023-11-24T08:02:47.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.197+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a015f9b0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.198+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a0067450 con 0x7f93a00cf9a0 2023-11-24T08:02:47.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.199+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f939002f050 con 0x7f93a00cf9a0 2023-11-24T08:02:47.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.200+0000 7f93967fc640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f938406aff0 0x7f938406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.200+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93900ab8f0 con 0x7f93a00cf9a0 2023-11-24T08:02:47.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.200+0000 7f93a5a25640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f938406aff0 0x7f938406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.201+0000 7f93a5a25640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f938406aff0 0x7f938406d4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f939c006fd0 tx=0x7f939c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:47.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.204+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9390076720 con 0x7f93a00cf9a0 2023-11-24T08:02:47.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.394+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93a0073e10 con 0x7f93a00cf9a0 2023-11-24T08:02:47.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.394+0000 7f93967fc640 1 -- 172.21.15.161:0/2562829580 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9390035020 con 0x7f93a00cf9a0 2023-11-24T08:02:47.397 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f938406aff0 msgr2=0x7f938406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f938406aff0 0x7f938406d4b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f939c006fd0 tx=0x7f939c008040 comp rx=0 tx=0).stop 2023-11-24T08:02:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 msgr2=0x7f93a00b81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00b81c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9390000c00 tx=0x7f93900046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 shutdown_connections 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f938406aff0 0x7f938406d4b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93a015d4b0 0x7f93a00b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93a00cf9a0 0x7f93a00b81c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 --2- 172.21.15.161:0/2562829580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93a00cddf0 0x7f93a015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 >> 172.21.15.161:0/2562829580 conn(0x7f93a00d3000 msgr2=0x7f93a00b49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 shutdown_connections 2023-11-24T08:02:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.397+0000 7f93a6a27640 1 -- 172.21.15.161:0/2562829580 wait complete. 2023-11-24T08:02:47.418 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:02:47.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.627+0000 7f102683d640 1 Processor -- start 2023-11-24T08:02:47.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.627+0000 7f102683d640 1 -- start start 2023-11-24T08:02:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.629+0000 7f102683d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 0x7f1020164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.629+0000 7f102683d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10200b1ee0 con 0x7f10200cf9a0 2023-11-24T08:02:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.629+0000 7f102683d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10200b2780 con 0x7f1020143ae0 2023-11-24T08:02:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.629+0000 7f102683d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102015e990 con 0x7f102015e3b0 2023-11-24T08:02:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.629+0000 7f10177fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f10200cf9a0 0x7f102015dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44678/0 (socket says 172.21.15.161:44678) 2023-11-24T08:02:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.629+0000 7f10177fe640 1 -- 172.21.15.161:0/706558894 learned_addr learned my addr 172.21.15.161:0/706558894 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f1024dda640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 0x7f1020164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973087564 0 0) 0x7f10200b1ee0 con 0x7f10200cf9a0 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f100c003520 con 0x7f10200cf9a0 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208718942 0 0) 0x7f100c003520 con 0x7f10200cf9a0 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 msgr2=0x7f1020164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 0x7f1020164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 >> v1:172.21.15.175:6789/0 conn(0x7f1020143ae0 legacy=0x7f10200cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10200b2130 con 0x7f10200cf9a0 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f1008001670 con 0x7f10200cf9a0 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 >> v1:172.21.15.161:6789/0 conn(0x7f10200cf9a0 legacy=0x7f102015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100c0039a0 0x7f100c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 0x7f100c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f100c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102015e990 con 0x7f100c004d00 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f100c00ba60 con 0x7f100c0039a0 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.630+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100c00bc20 con 0x7f102015e3b0 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f1024dda640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f100c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f101ffff640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100c0039a0 0x7f100c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f10177fe640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 0x7f100c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f1024dda640 1 -- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 msgr2=0x7f100c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f1024dda640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f102015e3b0 0x7f100c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f1024dda640 1 -- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100c0039a0 msgr2=0x7f100c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f1024dda640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f100c0039a0 0x7f100c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.631+0000 7f1024dda640 1 -- 172.21.15.161:0/706558894 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c003520 con 0x7f100c004d00 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.632+0000 7f1024dda640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f100c005180 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1018009f90 tx=0x7f100c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2362c561c5b8670 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101802cbd0 con 0x7f100c004d00 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101800f040 con 0x7f100c004d00 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f101f7fe640 1 -- 172.21.15.161:0/706558894 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018034440 con 0x7f100c004d00 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f102683d640 1 -- 172.21.15.161:0/706558894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 msgr2=0x7f100c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f102683d640 1 --2- 172.21.15.161:0/706558894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f100c005180 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1018009f90 tx=0x7f100c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f1024dda640 1 -- 172.21.15.161:0/706558894 reap_dead start 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f102683d640 1 -- 172.21.15.161:0/706558894 shutdown_connections 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f102683d640 1 -- 172.21.15.161:0/706558894 >> 172.21.15.161:0/706558894 conn(0x7f102006a800 msgr2=0x7f102006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:47.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f102683d640 1 -- 172.21.15.161:0/706558894 shutdown_connections 2023-11-24T08:02:47.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.633+0000 7f102683d640 1 -- 172.21.15.161:0/706558894 wait complete. 2023-11-24T08:02:47.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.635+0000 7f102683d640 1 Processor -- start 2023-11-24T08:02:47.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.635+0000 7f102683d640 1 -- start start 2023-11-24T08:02:47.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f102683d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f10200acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f102683d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10201f4720 0x7f10200aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f102683d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10200aafe0 0x7f10201f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f102683d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1020160560 con 0x7f100c004d00 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f102683d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10201f40a0 con 0x7f10201f4720 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f102683d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10200ab460 con 0x7f10200aafe0 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f101ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f10200acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f101ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f10200acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42972/0 (socket says 172.21.15.161:42972) 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.636+0000 7f101ffff640 1 -- 172.21.15.161:0/4139848422 learned_addr learned my addr 172.21.15.161:0/4139848422 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f10177fe640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10201f4720 0x7f10200aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101ffff640 1 -- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10200aafe0 msgr2=0x7f10201f0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101ffff640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10200aafe0 0x7f10201f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101ffff640 1 -- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10201f4720 msgr2=0x7f10200aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101ffff640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10201f4720 0x7f10200aaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101ffff640 1 -- 172.21.15.161:0/4139848422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10201f1400 con 0x7f100c004d00 2023-11-24T08:02:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101ffff640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f10200acb00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f101000e450 tx=0x7f101000e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100053a0 con 0x7f100c004d00 2023-11-24T08:02:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10100035f0 con 0x7f100c004d00 2023-11-24T08:02:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10100039a0 con 0x7f100c004d00 2023-11-24T08:02:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.637+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10201f16e0 con 0x7f100c004d00 2023-11-24T08:02:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.638+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1020160180 con 0x7f100c004d00 2023-11-24T08:02:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.639+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10200675d0 con 0x7f100c004d00 2023-11-24T08:02:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.640+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1010003b00 con 0x7f100c004d00 2023-11-24T08:02:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.640+0000 7f101d7fa640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f100006b020 0x7f100006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.641+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10100895d0 con 0x7f100c004d00 2023-11-24T08:02:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.641+0000 7f10177fe640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f100006b020 0x7f100006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.642+0000 7f10177fe640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f100006b020 0x7f100006d4e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1008001eb0 tx=0x7f1008009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.645+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10100543f0 con 0x7f100c004d00 2023-11-24T08:02:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.835+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10200cb4b0 con 0x7f100c004d00 2023-11-24T08:02:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.835+0000 7f101d7fa640 1 -- 172.21.15.161:0/4139848422 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1010003db0 con 0x7f100c004d00 2023-11-24T08:02:47.838 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:02:47.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f100006b020 msgr2=0x7f100006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f100006b020 0x7f100006d4e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1008001eb0 tx=0x7f1008009040 comp rx=0 tx=0).stop 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 msgr2=0x7f10200acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f10200acb00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f101000e450 tx=0x7f101000e910 comp rx=0 tx=0).stop 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 shutdown_connections 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f100006b020 0x7f100006d4e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10200aafe0 0x7f10201f0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10201f4720 0x7f10200aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 --2- 172.21.15.161:0/4139848422 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f100c004d00 0x7f10200acb00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 >> 172.21.15.161:0/4139848422 conn(0x7f102006a800 msgr2=0x7f10200cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 shutdown_connections 2023-11-24T08:02:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:47.838+0000 7f102683d640 1 -- 172.21.15.161:0/4139848422 wait complete. 2023-11-24T08:02:47.859 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:02:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.064+0000 7f93c8fbc640 1 Processor -- start 2023-11-24T08:02:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.065+0000 7f93c8fbc640 1 -- start start 2023-11-24T08:02:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.066+0000 7f93c8fbc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f93c413fcb0 0x7f93c40cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.066+0000 7f93c8fbc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40cdc20 0x7f93c40b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.066+0000 7f93c8fbc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c40ce440 con 0x7f93c413cf10 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.066+0000 7f93c8fbc640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c40ce720 con 0x7f93c413fcb0 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.066+0000 7f93c8fbc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40cea00 con 0x7f93c40cdc20 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c37fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f93c413cf10 0x7f93c413f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44682/0 (socket says 172.21.15.161:44682) 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c37fe640 1 -- 172.21.15.161:0/2553362209 learned_addr learned my addr 172.21.15.161:0/2553362209 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c2ffd640 1 --2- 172.21.15.161:0/2553362209 >> v2:172.21.15.161:3300/0 conn(0x7f93c413fcb0 0x7f93c40cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c2ffd640 1 -- 172.21.15.161:0/2553362209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40cdc20 msgr2=0x7f93c40b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c3fff640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40cdc20 0x7f93c40b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c2ffd640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40cdc20 0x7f93c40b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c2ffd640 1 -- 172.21.15.161:0/2553362209 >> v1:172.21.15.161:6789/0 conn(0x7f93c413cf10 legacy=0x7f93c413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c27fc640 1 -- 172.21.15.161:0/2553362209 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739560690 0 0) 0x7f93c40ce440 con 0x7f93c413cf10 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c2ffd640 1 -- 172.21.15.161:0/2553362209 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c40b1d90 con 0x7f93c413fcb0 2023-11-24T08:02:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.067+0000 7f93c3fff640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40cdc20 0x7f93c40b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.068+0000 7f93c2ffd640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413fcb0 0x7f93c40cd6e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f93b80097a0 tx=0x7f93b802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c67452dee40d7ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c27fc640 1 -- 172.21.15.161:0/2553362209 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b802d040 con 0x7f93c413fcb0 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c27fc640 1 -- 172.21.15.161:0/2553362209 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b8031810 con 0x7f93c413fcb0 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c27fc640 1 -- 172.21.15.161:0/2553362209 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8031ba0 con 0x7f93c413fcb0 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 -- 172.21.15.161:0/2553362209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413fcb0 msgr2=0x7f93c40cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413fcb0 0x7f93c40cd6e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f93b80097a0 tx=0x7f93b802b8b0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 -- 172.21.15.161:0/2553362209 shutdown_connections 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40cdc20 0x7f93c40b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/2553362209 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413fcb0 0x7f93c40cd6e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 -- 172.21.15.161:0/2553362209 >> 172.21.15.161:0/2553362209 conn(0x7f93c406a7d0 msgr2=0x7f93c406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 -- 172.21.15.161:0/2553362209 shutdown_connections 2023-11-24T08:02:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.069+0000 7f93c8fbc640 1 -- 172.21.15.161:0/2553362209 wait complete. 2023-11-24T08:02:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.071+0000 7f93c8fbc640 1 Processor -- start 2023-11-24T08:02:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.071+0000 7f93c8fbc640 1 -- start start 2023-11-24T08:02:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.072+0000 7f93c8fbc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40cdc20 0x7f93c415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.072+0000 7f93c8fbc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 0x7f93c4158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.072+0000 7f93c8fbc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c413fcb0 0x7f93c4134540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.072+0000 7f93c8fbc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c4070f10 con 0x7f93c413cf10 2023-11-24T08:02:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.072+0000 7f93c8fbc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40711f0 con 0x7f93c40cdc20 2023-11-24T08:02:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.072+0000 7f93c8fbc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c40714d0 con 0x7f93c413fcb0 2023-11-24T08:02:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 0x7f93c4158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 0x7f93c4158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42982/0 (socket says 172.21.15.161:42982) 2023-11-24T08:02:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 -- 172.21.15.161:0/3442979225 learned_addr learned my addr 172.21.15.161:0/3442979225 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 -- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c413fcb0 msgr2=0x7f93c4134540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c3fff640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c413fcb0 0x7f93c4134540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c413fcb0 0x7f93c4134540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 -- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40cdc20 msgr2=0x7f93c415a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40cdc20 0x7f93c415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 -- 172.21.15.161:0/3442979225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8009400 con 0x7f93c413cf10 2023-11-24T08:02:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.073+0000 7f93c2ffd640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 0x7f93c4158a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000c00 tx=0x7f93b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.074+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b803ad60 con 0x7f93c413cf10 2023-11-24T08:02:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.074+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b80443f0 con 0x7f93c413cf10 2023-11-24T08:02:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.074+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b80447a0 con 0x7f93c413cf10 2023-11-24T08:02:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.074+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c40717b0 con 0x7f93c413cf10 2023-11-24T08:02:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.074+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c41363a0 con 0x7f93c413cf10 2023-11-24T08:02:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.075+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c4067450 con 0x7f93c413cf10 2023-11-24T08:02:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.076+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f93b804d450 con 0x7f93c413cf10 2023-11-24T08:02:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.077+0000 7f93abfff640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f93b006aff0 0x7f93b006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.077+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93b80abdb0 con 0x7f93c413cf10 2023-11-24T08:02:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.077+0000 7f93c37fe640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f93b006aff0 0x7f93b006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.079+0000 7f93c37fe640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f93b006aff0 0x7f93b006d4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f93b4007fd0 tx=0x7f93b4007920 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:48.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.081+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f93b80b0070 con 0x7f93c413cf10 2023-11-24T08:02:48.265 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.263+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93c413d8c0 con 0x7f93c413cf10 2023-11-24T08:02:48.266 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.264+0000 7f93abfff640 1 -- 172.21.15.161:0/3442979225 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f93b8035020 con 0x7f93c413cf10 2023-11-24T08:02:48.266 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.266+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f93b006aff0 msgr2=0x7f93b006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.266+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f93b006aff0 0x7f93b006d4b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f93b4007fd0 tx=0x7f93b4007920 comp rx=0 tx=0).stop 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.266+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 msgr2=0x7f93c4158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.266+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 0x7f93c4158a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f93b8000c00 tx=0x7f93b80046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 shutdown_connections 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f93b006aff0 0x7f93b006d4b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c413fcb0 0x7f93c4134540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f93c413cf10 0x7f93c4158a40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 --2- 172.21.15.161:0/3442979225 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40cdc20 0x7f93c415a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 >> 172.21.15.161:0/3442979225 conn(0x7f93c406a7d0 msgr2=0x7f93c40aeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:48.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 shutdown_connections 2023-11-24T08:02:48.270 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.267+0000 7f93c8fbc640 1 -- 172.21.15.161:0/3442979225 wait complete. 2023-11-24T08:02:48.286 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:02:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.491+0000 7f238c400640 1 Processor -- start 2023-11-24T08:02:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.492+0000 7f238c400640 1 -- start start 2023-11-24T08:02:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238c400640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2384143ae0 0x7f23840cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238c400640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f238415e3b0 0x7f23840702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238c400640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840cfc30 con 0x7f23840cf7d0 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238c400640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840b1ee0 con 0x7f2384143ae0 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238c400640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840b2780 con 0x7f238415e3b0 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238a19c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2384143ae0 0x7f23840cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.493+0000 7f238a19c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2384143ae0 0x7f23840cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42984/0 (socket says 172.21.15.161:42984) 2023-11-24T08:02:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238a19c640 1 -- 172.21.15.161:0/3627809571 learned_addr learned my addr 172.21.15.161:0/3627809571 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238a99d640 1 --2- 172.21.15.161:0/3627809571 >> v2:172.21.15.175:3300/0 conn(0x7f238415e3b0 0x7f23840702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238a19c640 1 -- 172.21.15.161:0/3627809571 >> v2:172.21.15.175:3300/0 conn(0x7f238415e3b0 msgr2=0x7f23840702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238a19c640 1 --2- 172.21.15.161:0/3627809571 >> v2:172.21.15.175:3300/0 conn(0x7f238415e3b0 0x7f23840702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238a19c640 1 -- 172.21.15.161:0/3627809571 >> v1:172.21.15.161:6789/0 conn(0x7f23840cf7d0 legacy=0x7f238415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238a19c640 1 -- 172.21.15.161:0/3627809571 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238415e990 con 0x7f2384143ae0 2023-11-24T08:02:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.494+0000 7f238919a640 1 -- 172.21.15.161:0/3627809571 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667031983 0 0) 0x7f23840cfc30 con 0x7f23840cf7d0 2023-11-24T08:02:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.495+0000 7f238a19c640 1 --2- 172.21.15.161:0/3627809571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2384143ae0 0x7f23840cf290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f238406e4f0 tx=0x7f237402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6051b65e27f27c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.495+0000 7f238919a640 1 -- 172.21.15.161:0/3627809571 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237402cb20 con 0x7f2384143ae0 2023-11-24T08:02:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.495+0000 7f238919a640 1 -- 172.21.15.161:0/3627809571 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237402cc80 con 0x7f2384143ae0 2023-11-24T08:02:48.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.495+0000 7f238919a640 1 -- 172.21.15.161:0/3627809571 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740343f0 con 0x7f2384143ae0 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 -- 172.21.15.161:0/3627809571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2384143ae0 msgr2=0x7f23840cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 --2- 172.21.15.161:0/3627809571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2384143ae0 0x7f23840cf290 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f238406e4f0 tx=0x7f237402bf80 comp rx=0 tx=0).stop 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 -- 172.21.15.161:0/3627809571 shutdown_connections 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 --2- 172.21.15.161:0/3627809571 >> v2:172.21.15.175:3300/0 conn(0x7f238415e3b0 0x7f23840702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 --2- 172.21.15.161:0/3627809571 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2384143ae0 0x7f23840cf290 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 -- 172.21.15.161:0/3627809571 >> 172.21.15.161:0/3627809571 conn(0x7f238406a800 msgr2=0x7f238406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 -- 172.21.15.161:0/3627809571 shutdown_connections 2023-11-24T08:02:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.496+0000 7f238c400640 1 -- 172.21.15.161:0/3627809571 wait complete. 2023-11-24T08:02:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.498+0000 7f238c400640 1 Processor -- start 2023-11-24T08:02:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.498+0000 7f238c400640 1 -- start start 2023-11-24T08:02:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238c400640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23840cf7d0 0x7f23840b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238c400640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384143ae0 0x7f23841f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238c400640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 0x7f23840cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238c400640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238415b540 con 0x7f238415e3b0 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238c400640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841f6fe0 con 0x7f23840cf7d0 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238c400640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840afb80 con 0x7f2384143ae0 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238a99d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 0x7f23840cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238a99d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 0x7f23840cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42992/0 (socket says 172.21.15.161:42992) 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.499+0000 7f238a99d640 1 -- 172.21.15.161:0/909675026 learned_addr learned my addr 172.21.15.161:0/909675026 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a19c640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23840cf7d0 0x7f23840b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238999b640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384143ae0 0x7f23841f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a99d640 1 -- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384143ae0 msgr2=0x7f23841f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a99d640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384143ae0 0x7f23841f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a99d640 1 -- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23840cf7d0 msgr2=0x7f23840b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a99d640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23840cf7d0 0x7f23840b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a99d640 1 -- 172.21.15.161:0/909675026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374009b30 con 0x7f238415e3b0 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238999b640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384143ae0 0x7f23841f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238a99d640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 0x7f23840cc880 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c550 tx=0x7f237c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c004220 con 0x7f238415e3b0 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237c004380 con 0x7f238415e3b0 2023-11-24T08:02:48.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c003830 con 0x7f238415e3b0 2023-11-24T08:02:48.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23840aef70 con 0x7f238415e3b0 2023-11-24T08:02:48.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.500+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23840af530 con 0x7f238415e3b0 2023-11-24T08:02:48.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.502+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23840afd30 con 0x7f238415e3b0 2023-11-24T08:02:48.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.502+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f237c003990 con 0x7f238415e3b0 2023-11-24T08:02:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.504+0000 7f2382ffd640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f237006b020 0x7f237006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.504+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f237c089690 con 0x7f238415e3b0 2023-11-24T08:02:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.504+0000 7f238a19c640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f237006b020 0x7f237006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.505+0000 7f238a19c640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f237006b020 0x7f237006d4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2374035000 tx=0x7f2374030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:48.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.508+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f23840afd30 con 0x7f238415e3b0 2023-11-24T08:02:48.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.714+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23840afcf0 con 0x7f238415e3b0 2023-11-24T08:02:48.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.715+0000 7f2382ffd640 1 -- 172.21.15.161:0/909675026 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f237c05ce60 con 0x7f238415e3b0 2023-11-24T08:02:48.717 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:02:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f237006b020 msgr2=0x7f237006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f237006b020 0x7f237006d4e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2374035000 tx=0x7f2374030000 comp rx=0 tx=0).stop 2023-11-24T08:02:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 msgr2=0x7f23840cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 0x7f23840cc880 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c550 tx=0x7f237c00ca10 comp rx=0 tx=0).stop 2023-11-24T08:02:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 shutdown_connections 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f237006b020 0x7f237006d4e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f238415e3b0 0x7f23840cc880 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2384143ae0 0x7f23841f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 --2- 172.21.15.161:0/909675026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f23840cf7d0 0x7f23840b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 >> 172.21.15.161:0/909675026 conn(0x7f238406a800 msgr2=0x7f238406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 shutdown_connections 2023-11-24T08:02:48.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:48.718+0000 7f238c400640 1 -- 172.21.15.161:0/909675026 wait complete. 2023-11-24T08:02:48.740 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:02:48.740 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:48.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.007+0000 7f3da7ffb640 1 Processor -- start 2023-11-24T08:02:49.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.007+0000 7f3da7ffb640 1 -- start start 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.008+0000 7f3da7ffb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3da00cd240 0x7f3da00b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.008+0000 7f3da7ffb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3da009a170 0x7f3da00cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.008+0000 7f3da7ffb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da006cea0 con 0x7f3da006c6b0 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.008+0000 7f3da7ffb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da006cbc0 con 0x7f3da00cd240 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.008+0000 7f3da7ffb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da006f350 con 0x7f3da009a170 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3da00cd240 0x7f3da00b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3da00cd240 0x7f3da00b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:42998/0 (socket says 172.21.15.161:42998) 2023-11-24T08:02:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 -- 172.21.15.161:0/2271841127 learned_addr learned my addr 172.21.15.161:0/2271841127 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da6598640 1 --2- 172.21.15.161:0/2271841127 >> v2:172.21.15.175:3300/0 conn(0x7f3da009a170 0x7f3da00cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 -- 172.21.15.161:0/2271841127 >> v2:172.21.15.175:3300/0 conn(0x7f3da009a170 msgr2=0x7f3da00cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 --2- 172.21.15.161:0/2271841127 >> v2:172.21.15.175:3300/0 conn(0x7f3da009a170 0x7f3da00cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 -- 172.21.15.161:0/2271841127 >> v1:172.21.15.175:6789/0 conn(0x7f3da006c6b0 legacy=0x7f3da0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.009+0000 7f3da5d97640 1 -- 172.21.15.161:0/2271841127 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da006f630 con 0x7f3da00cd240 2023-11-24T08:02:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.010+0000 7f3da5d97640 1 --2- 172.21.15.161:0/2271841127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b3820 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3da00cb7f0 tx=0x7f3d9c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76527e046a567c6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da4d95640 1 -- 172.21.15.161:0/2271841127 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c031870 con 0x7f3da00cd240 2023-11-24T08:02:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da4d95640 1 -- 172.21.15.161:0/2271841127 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c0319d0 con 0x7f3da00cd240 2023-11-24T08:02:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da4d95640 1 -- 172.21.15.161:0/2271841127 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c031d60 con 0x7f3da00cd240 2023-11-24T08:02:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2271841127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 msgr2=0x7f3da00b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2271841127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b3820 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3da00cb7f0 tx=0x7f3d9c02b910 comp rx=0 tx=0).stop 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2271841127 shutdown_connections 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2271841127 >> v2:172.21.15.175:3300/0 conn(0x7f3da009a170 0x7f3da00cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.011+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2271841127 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b3820 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.012+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2271841127 >> 172.21.15.161:0/2271841127 conn(0x7f3da00b2d00 msgr2=0x7f3da00b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.012+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2271841127 shutdown_connections 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.012+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2271841127 wait complete. 2023-11-24T08:02:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.013+0000 7f3da7ffb640 1 Processor -- start 2023-11-24T08:02:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.013+0000 7f3da7ffb640 1 -- start start 2023-11-24T08:02:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.014+0000 7f3da7ffb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3da006c6b0 0x7f3da00c5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.014+0000 7f3da7ffb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3da009a170 0x7f3da0154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.014+0000 7f3da7ffb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.014+0000 7f3da7ffb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00c4da0 con 0x7f3da00cd240 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.014+0000 7f3da7ffb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00c5040 con 0x7f3da006c6b0 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.014+0000 7f3da7ffb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00c5320 con 0x7f3da009a170 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43004/0 (socket says 172.21.15.161:43004) 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 -- 172.21.15.161:0/2159519463 learned_addr learned my addr 172.21.15.161:0/2159519463 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da5d97640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3da006c6b0 0x7f3da00c5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 -- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3da009a170 msgr2=0x7f3da0154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3da009a170 0x7f3da0154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 -- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3da006c6b0 msgr2=0x7f3da00c5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3da006c6b0 0x7f3da00c5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 -- 172.21.15.161:0/2159519463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c0094d0 con 0x7f3da00cd240 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.015+0000 7f3da6598640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b66b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800cd90 tx=0x7f3d9800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.016+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98003b90 con 0x7f3da00cd240 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.016+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d98003d10 con 0x7f3da00cd240 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.016+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d98004260 con 0x7f3da00cd240 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.016+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da00c5600 con 0x7f3da00cd240 2023-11-24T08:02:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.016+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00b6bf0 con 0x7f3da00cd240 2023-11-24T08:02:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.017+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00c5b20 con 0x7f3da00cd240 2023-11-24T08:02:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.018+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3d980043c0 con 0x7f3da00cd240 2023-11-24T08:02:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.019+0000 7f3d967fc640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d8406aff0 0x7f3d8406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.019+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d98012070 con 0x7f3da00cd240 2023-11-24T08:02:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.019+0000 7f3da5d97640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d8406aff0 0x7f3d8406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.020+0000 7f3da5d97640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d8406aff0 0x7f3d8406d4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c036000 tx=0x7f3d9c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.023+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3da00c5b20 con 0x7f3da00cd240 2023-11-24T08:02:49.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.199+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3da00c5b20 con 0x7f3da00cd240 2023-11-24T08:02:49.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.201+0000 7f3d967fc640 1 -- 172.21.15.161:0/2159519463 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f3da00c5b20 con 0x7f3da00cd240 2023-11-24T08:02:49.204 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:49.204 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":47,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:28.848473+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:49.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d8406aff0 msgr2=0x7f3d8406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d8406aff0 0x7f3d8406d4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c036000 tx=0x7f3d9c03c040 comp rx=0 tx=0).stop 2023-11-24T08:02:49.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 msgr2=0x7f3da00b66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b66b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800cd90 tx=0x7f3d9800a660 comp rx=0 tx=0).stop 2023-11-24T08:02:49.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 shutdown_connections 2023-11-24T08:02:49.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3d8406aff0 0x7f3d8406d4b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3da00cd240 0x7f3da00b66b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3da009a170 0x7f3da0154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 --2- 172.21.15.161:0/2159519463 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3da006c6b0 0x7f3da00c5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 >> 172.21.15.161:0/2159519463 conn(0x7f3da00b2d00 msgr2=0x7f3da00b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:49.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 shutdown_connections 2023-11-24T08:02:49.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.204+0000 7f3da7ffb640 1 -- 172.21.15.161:0/2159519463 wait complete. 2023-11-24T08:02:49.225 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:02:25.158735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:02:26.286978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:49.226 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.430+0000 7fe71440e640 1 Processor -- start 2023-11-24T08:02:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.430+0000 7fe71440e640 1 -- start start 2023-11-24T08:02:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.432+0000 7fe71440e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe70c099a60 0x7fe70c099ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.432+0000 7fe71440e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c06e7c0 0x7fe70c06ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.432+0000 7fe71440e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c0cfa70 con 0x7fe70c15e880 2023-11-24T08:02:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.432+0000 7fe71440e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c09a3e0 con 0x7fe70c099a60 2023-11-24T08:02:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.432+0000 7fe71440e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0cff00 con 0x7fe70c06e7c0 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.432+0000 7fe7119a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe70c099a60 0x7fe70c099ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7119a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe70c099a60 0x7fe70c099ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43008/0 (socket says 172.21.15.161:43008) 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7119a9640 1 -- 172.21.15.161:0/3748743427 learned_addr learned my addr 172.21.15.161:0/3748743427 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7129ab640 1 --2- 172.21.15.161:0/3748743427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c06e7c0 0x7fe70c06ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7119a9640 1 -- 172.21.15.161:0/3748743427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c06e7c0 msgr2=0x7fe70c06ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7119a9640 1 --2- 172.21.15.161:0/3748743427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c06e7c0 0x7fe70c06ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7119a9640 1 -- 172.21.15.161:0/3748743427 >> v1:172.21.15.175:6789/0 conn(0x7fe70c15e880 legacy=0x7fe70c06ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.433+0000 7fe7119a9640 1 -- 172.21.15.161:0/3748743427 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c06fc70 con 0x7fe70c099a60 2023-11-24T08:02:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.434+0000 7fe7119a9640 1 --2- 172.21.15.161:0/3748743427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c099a60 0x7fe70c099ea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe700009870 tx=0x7fe70002ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f186a5adb8edc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.434+0000 7fe7111a8640 1 -- 172.21.15.161:0/3748743427 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70002f830 con 0x7fe70c099a60 2023-11-24T08:02:49.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.434+0000 7fe7111a8640 1 -- 172.21.15.161:0/3748743427 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70002f990 con 0x7fe70c099a60 2023-11-24T08:02:49.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.434+0000 7fe7111a8640 1 -- 172.21.15.161:0/3748743427 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70002fd20 con 0x7fe70c099a60 2023-11-24T08:02:49.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 -- 172.21.15.161:0/3748743427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c099a60 msgr2=0x7fe70c099ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 --2- 172.21.15.161:0/3748743427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c099a60 0x7fe70c099ea0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe700009870 tx=0x7fe70002ba10 comp rx=0 tx=0).stop 2023-11-24T08:02:49.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 -- 172.21.15.161:0/3748743427 shutdown_connections 2023-11-24T08:02:49.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 --2- 172.21.15.161:0/3748743427 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c06e7c0 0x7fe70c06ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 --2- 172.21.15.161:0/3748743427 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c099a60 0x7fe70c099ea0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 -- 172.21.15.161:0/3748743427 >> 172.21.15.161:0/3748743427 conn(0x7fe70c0b2d00 msgr2=0x7fe70c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:49.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 -- 172.21.15.161:0/3748743427 shutdown_connections 2023-11-24T08:02:49.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.435+0000 7fe71440e640 1 -- 172.21.15.161:0/3748743427 wait complete. 2023-11-24T08:02:49.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.437+0000 7fe71440e640 1 Processor -- start 2023-11-24T08:02:49.439 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.437+0000 7fe71440e640 1 -- start start 2023-11-24T08:02:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe71440e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c06e7c0 0x7fe70c0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe71440e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c099a60 0x7fe70c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe71440e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 0x7fe70c0adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe71440e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b1380 con 0x7fe70c15e880 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe71440e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b1660 con 0x7fe70c06e7c0 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe71440e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b1940 con 0x7fe70c099a60 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe7129ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 0x7fe70c0adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe7129ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 0x7fe70c0adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43012/0 (socket says 172.21.15.161:43012) 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe7129ab640 1 -- 172.21.15.161:0/3641296396 learned_addr learned my addr 172.21.15.161:0/3641296396 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe7121aa640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c06e7c0 0x7fe70c0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe7129ab640 1 -- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c099a60 msgr2=0x7fe70c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.438+0000 7fe7129ab640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c099a60 0x7fe70c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe7129ab640 1 -- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c06e7c0 msgr2=0x7fe70c0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe7129ab640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c06e7c0 0x7fe70c0b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe7129ab640 1 -- 172.21.15.161:0/3641296396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7000094d0 con 0x7fe70c15e880 2023-11-24T08:02:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe7129ab640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 0x7fe70c0adf80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe70400d800 tx=0x7fe70400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400b6c0 con 0x7fe70c15e880 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400b840 con 0x7fe70c15e880 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c0b1c20 con 0x7fe70c15e880 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400bbf0 con 0x7fe70c15e880 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.439+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0b67b0 con 0x7fe70c15e880 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.440+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c1534a0 con 0x7fe70c15e880 2023-11-24T08:02:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.441+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe70400bd50 con 0x7fe70c15e880 2023-11-24T08:02:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.443+0000 7fe70affd640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6f806aff0 0x7fe6f806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.443+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe704089cb0 con 0x7fe70c15e880 2023-11-24T08:02:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.443+0000 7fe7121aa640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6f806aff0 0x7fe6f806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.444+0000 7fe7121aa640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6f806aff0 0x7fe6f806d4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc007fd0 tx=0x7fe6fc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.447+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe70c1534a0 con 0x7fe70c15e880 2023-11-24T08:02:49.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.631+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe70c0b67b0 con 0x7fe70c15e880 2023-11-24T08:02:49.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.632+0000 7fe70affd640 1 -- 172.21.15.161:0/3641296396 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe70c0b67b0 con 0x7fe70c15e880 2023-11-24T08:02:49.634 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:49.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.634+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6f806aff0 msgr2=0x7fe6f806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6f806aff0 0x7fe6f806d4b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc007fd0 tx=0x7fe6fc009040 comp rx=0 tx=0).stop 2023-11-24T08:02:49.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 msgr2=0x7fe70c0adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 0x7fe70c0adf80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fe70400d800 tx=0x7fe70400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 shutdown_connections 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe6f806aff0 0x7fe6f806d4b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe70c15e880 0x7fe70c0adf80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe70c099a60 0x7fe70c155990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 --2- 172.21.15.161:0/3641296396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe70c06e7c0 0x7fe70c0b59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 >> 172.21.15.161:0/3641296396 conn(0x7fe70c0b2d00 msgr2=0x7fe70c06feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 shutdown_connections 2023-11-24T08:02:49.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.635+0000 7fe71440e640 1 -- 172.21.15.161:0/3641296396 wait complete. 2023-11-24T08:02:49.654 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:02:49.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.865+0000 7f589afe9640 1 Processor -- start 2023-11-24T08:02:49.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.865+0000 7f589afe9640 1 -- start start 2023-11-24T08:02:49.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589afe9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f589406c6d0 0x7f58940cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589afe9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 0x7f58940b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589afe9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589406b670 con 0x7f589415d2a0 2023-11-24T08:02:49.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589afe9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58940ce2b0 con 0x7f589406c6d0 2023-11-24T08:02:49.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589afe9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589406b910 con 0x7f58940cde00 2023-11-24T08:02:49.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589a7e8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 0x7f58940b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589a7e8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 0x7f58940b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:51564/0 (socket says 172.21.15.161:51564) 2023-11-24T08:02:49.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f589a7e8640 1 -- 172.21.15.161:0/556149772 learned_addr learned my addr 172.21.15.161:0/556149772 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:49.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.867+0000 7f58997e6640 1 --2- 172.21.15.161:0/556149772 >> v2:172.21.15.175:3300/0 conn(0x7f589406c6d0 0x7f58940cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f5898fe5640 1 -- 172.21.15.161:0/556149772 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603080262 0 0) 0x7f589406b670 con 0x7f589415d2a0 2023-11-24T08:02:49.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f5898fe5640 1 -- 172.21.15.161:0/556149772 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5880003520 con 0x7f589415d2a0 2023-11-24T08:02:49.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f58997e6640 1 -- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 msgr2=0x7f58940b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:49.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f58997e6640 1 --2- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 0x7f58940b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f58997e6640 1 -- 172.21.15.161:0/556149772 >> v1:172.21.15.175:6789/0 conn(0x7f589415d2a0 legacy=0x7f58940cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f58997e6640 1 -- 172.21.15.161:0/556149772 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589406bbf0 con 0x7f589406c6d0 2023-11-24T08:02:49.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.868+0000 7f589a7e8640 1 --2- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 0x7f58940b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:02:49.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.870+0000 7f58997e6640 1 --2- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f589406c6d0 0x7f58940cd8c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894c6d90cc2af5a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.870+0000 7f5898fe5640 1 -- 172.21.15.161:0/556149772 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884031830 con 0x7f589406c6d0 2023-11-24T08:02:49.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f5898fe5640 1 -- 172.21.15.161:0/556149772 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884031990 con 0x7f589406c6d0 2023-11-24T08:02:49.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f5898fe5640 1 -- 172.21.15.161:0/556149772 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5884031d20 con 0x7f589406c6d0 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 -- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f589406c6d0 msgr2=0x7f58940cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 --2- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f589406c6d0 0x7f58940cd8c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f58840097a0 tx=0x7f588402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 -- 172.21.15.161:0/556149772 shutdown_connections 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 --2- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58940cde00 0x7f58940b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 --2- 172.21.15.161:0/556149772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f589406c6d0 0x7f58940cd8c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 -- 172.21.15.161:0/556149772 >> 172.21.15.161:0/556149772 conn(0x7f58940b2a30 msgr2=0x7f58940b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 -- 172.21.15.161:0/556149772 shutdown_connections 2023-11-24T08:02:49.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.871+0000 7f589afe9640 1 -- 172.21.15.161:0/556149772 wait complete. 2023-11-24T08:02:49.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.873+0000 7f589afe9640 1 Processor -- start 2023-11-24T08:02:49.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.873+0000 7f589afe9640 1 -- start start 2023-11-24T08:02:49.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589afe9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f589406c6d0 0x7f58940af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589afe9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58940cde00 0x7f58941f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589afe9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 0x7f589415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589afe9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b4b10 con 0x7f589415d2a0 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589afe9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b3f00 con 0x7f58940cde00 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589afe9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58940b41e0 con 0x7f589406c6d0 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589a7e8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 0x7f589415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589a7e8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 0x7f589415d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43016/0 (socket says 172.21.15.161:43016) 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.874+0000 7f589a7e8640 1 -- 172.21.15.161:0/4043126860 learned_addr learned my addr 172.21.15.161:0/4043126860 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:49.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f58997e6640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58940cde00 0x7f58941f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f589a7e8640 1 -- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f589406c6d0 msgr2=0x7f58940af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f5899fe7640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f589406c6d0 0x7f58940af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f589a7e8640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f589406c6d0 0x7f58940af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f589a7e8640 1 -- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58940cde00 msgr2=0x7f58941f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f589a7e8640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58940cde00 0x7f58941f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f589a7e8640 1 -- 172.21.15.161:0/4043126860 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c009b30 con 0x7f589415d2a0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f58997e6640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58940cde00 0x7f58941f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.875+0000 7f589a7e8640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 0x7f589415d9e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f588c00efc0 tx=0x7f588c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.876+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c018070 con 0x7f589415d2a0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.876+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5884009400 con 0x7f589415d2a0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.876+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00f040 con 0x7f589415d2a0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.876+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00ce00 con 0x7f589415d2a0 2023-11-24T08:02:49.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.876+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58940b47a0 con 0x7f589415d2a0 2023-11-24T08:02:49.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.877+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5894067450 con 0x7f589415d2a0 2023-11-24T08:02:49.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.878+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f588c014480 con 0x7f589415d2a0 2023-11-24T08:02:49.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.879+0000 7f588a7fc640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f587806aff0 0x7f587806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:49.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.879+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f588c089e90 con 0x7f589415d2a0 2023-11-24T08:02:49.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.879+0000 7f5899fe7640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f587806aff0 0x7f587806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:49.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.880+0000 7f5899fe7640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f587806aff0 0x7f587806d4b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58900010e0 tx=0x7f5890009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:49.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:49.884+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f588c054b20 con 0x7f589415d2a0 2023-11-24T08:02:50.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.065+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58940b6e60 con 0x7f589415d2a0 2023-11-24T08:02:50.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.066+0000 7f588a7fc640 1 -- 172.21.15.161:0/4043126860 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f588c058140 con 0x7f589415d2a0 2023-11-24T08:02:50.068 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:02:50.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f587806aff0 msgr2=0x7f587806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f587806aff0 0x7f587806d4b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f58900010e0 tx=0x7f5890009040 comp rx=0 tx=0).stop 2023-11-24T08:02:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 msgr2=0x7f589415d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 0x7f589415d9e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f588c00efc0 tx=0x7f588c00c490 comp rx=0 tx=0).stop 2023-11-24T08:02:50.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 shutdown_connections 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f587806aff0 0x7f587806d4b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f589415d2a0 0x7f589415d9e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58940cde00 0x7f58941f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 --2- 172.21.15.161:0/4043126860 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f589406c6d0 0x7f58940af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.068+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 >> 172.21.15.161:0/4043126860 conn(0x7f58940b2a30 msgr2=0x7f58940b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.069+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 shutdown_connections 2023-11-24T08:02:50.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.069+0000 7f589afe9640 1 -- 172.21.15.161:0/4043126860 wait complete. 2023-11-24T08:02:50.089 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:02:50.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.282+0000 7fc7cb7a9640 1 Processor -- start 2023-11-24T08:02:50.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.282+0000 7fc7cb7a9640 1 -- start start 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7cb7a9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7c4160f80 0x7fc7c4161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7cb7a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc7c40ced50 0x7fc7c40d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7cb7a9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c41618a0 con 0x7fc7c40ce8f0 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7cb7a9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40cf1e0 con 0x7fc7c4160f80 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7cb7a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c40d0de0 con 0x7fc7c40ced50 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7c9545640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7c4160f80 0x7fc7c4161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7c9545640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc7c4160f80 0x7fc7c4161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43026/0 (socket says 172.21.15.161:43026) 2023-11-24T08:02:50.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.284+0000 7fc7c9545640 1 -- 172.21.15.161:0/2004694826 learned_addr learned my addr 172.21.15.161:0/2004694826 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:50.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.285+0000 7fc7c9545640 1 -- 172.21.15.161:0/2004694826 >> v2:172.21.15.175:3300/0 conn(0x7fc7c40ced50 msgr2=0x7fc7c40d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:50.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.285+0000 7fc7c9545640 1 --2- 172.21.15.161:0/2004694826 >> v2:172.21.15.175:3300/0 conn(0x7fc7c40ced50 0x7fc7c40d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.285+0000 7fc7c9545640 1 -- 172.21.15.161:0/2004694826 >> v1:172.21.15.175:6789/0 conn(0x7fc7c40ce8f0 legacy=0x7fc7c40cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:50.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.285+0000 7fc7c9545640 1 -- 172.21.15.161:0/2004694826 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40d10c0 con 0x7fc7c4160f80 2023-11-24T08:02:50.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.286+0000 7fc7c9545640 1 --2- 172.21.15.161:0/2004694826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c4161360 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40cfb50 tx=0x7fc7b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6a06c6021e0987 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:50.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.286+0000 7fc7c3fff640 1 -- 172.21.15.161:0/2004694826 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b802ca80 con 0x7fc7c4160f80 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.286+0000 7fc7c3fff640 1 -- 172.21.15.161:0/2004694826 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b802cbe0 con 0x7fc7c4160f80 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.286+0000 7fc7c3fff640 1 -- 172.21.15.161:0/2004694826 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80343f0 con 0x7fc7c4160f80 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/2004694826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 msgr2=0x7fc7c4161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/2004694826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c4161360 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40cfb50 tx=0x7fc7b802bee0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/2004694826 shutdown_connections 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/2004694826 >> v2:172.21.15.175:3300/0 conn(0x7fc7c40ced50 0x7fc7c40d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/2004694826 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c4161360 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/2004694826 >> 172.21.15.161:0/2004694826 conn(0x7fc7c409c550 msgr2=0x7fc7c40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:50.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/2004694826 shutdown_connections 2023-11-24T08:02:50.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.287+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/2004694826 wait complete. 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.288+0000 7fc7cb7a9640 1 Processor -- start 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 -- start start 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c40ce8f0 0x7fc7c414e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c40ced50 0x7fc7c415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c41f7390 con 0x7fc7c4160f80 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40c9bf0 con 0x7fc7c40ced50 2023-11-24T08:02:50.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.289+0000 7fc7cb7a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c414eb80 con 0x7fc7c40ce8f0 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c415dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43036/0 (socket says 172.21.15.161:43036) 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 -- 172.21.15.161:0/3416190219 learned_addr learned my addr 172.21.15.161:0/3416190219 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 -- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c40ce8f0 msgr2=0x7fc7c414e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c40ce8f0 0x7fc7c414e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 -- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c40ced50 msgr2=0x7fc7c415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c40ced50 0x7fc7c415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 -- 172.21.15.161:0/3416190219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8009b30 con 0x7fc7c4160f80 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.290+0000 7fc7c9d46640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c415dc00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009fd0 tx=0x7fc7bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.291+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc011830 con 0x7fc7c4160f80 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.291+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc011990 con 0x7fc7c4160f80 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.291+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc011d20 con 0x7fc7c4160f80 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.291+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c41f70b0 con 0x7fc7c4160f80 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.291+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c41f4440 con 0x7fc7c4160f80 2023-11-24T08:02:50.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.292+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c41f3fa0 con 0x7fc7c4160f80 2023-11-24T08:02:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.293+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc7bc01b460 con 0x7fc7c4160f80 2023-11-24T08:02:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.294+0000 7fc7c1ffb640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc7a806aff0 0x7fc7a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.294+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7bc089720 con 0x7fc7c4160f80 2023-11-24T08:02:50.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.295+0000 7fc7c9545640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc7a806aff0 0x7fc7a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.296+0000 7fc7c9545640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc7a806aff0 0x7fc7a806d4b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8035000 tx=0x7fc7b802e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:50.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.299+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7bc054550 con 0x7fc7c4160f80 2023-11-24T08:02:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.486+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7c40675d0 con 0x7fc7c4160f80 2023-11-24T08:02:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.487+0000 7fc7c1ffb640 1 -- 172.21.15.161:0/3416190219 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7bc057b70 con 0x7fc7c4160f80 2023-11-24T08:02:50.489 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:02:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc7a806aff0 msgr2=0x7fc7a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc7a806aff0 0x7fc7a806d4b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8035000 tx=0x7fc7b802e000 comp rx=0 tx=0).stop 2023-11-24T08:02:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 msgr2=0x7fc7c415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c415dc00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009fd0 tx=0x7fc7bc00b8e0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 shutdown_connections 2023-11-24T08:02:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc7a806aff0 0x7fc7a806d4b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc7c4160f80 0x7fc7c415dc00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc7c40ced50 0x7fc7c415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 --2- 172.21.15.161:0/3416190219 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc7c40ce8f0 0x7fc7c414e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 >> 172.21.15.161:0/3416190219 conn(0x7fc7c409c550 msgr2=0x7fc7c40b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:50.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 shutdown_connections 2023-11-24T08:02:50.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.490+0000 7fc7cb7a9640 1 -- 172.21.15.161:0/3416190219 wait complete. 2023-11-24T08:02:50.509 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:02:50.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.711+0000 7fd512778640 1 Processor -- start 2023-11-24T08:02:50.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.712+0000 7fd512778640 1 -- start start 2023-11-24T08:02:50.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.713+0000 7fd512778640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd50c09a170 0x7fd50c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.713+0000 7fd512778640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.713+0000 7fd512778640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50c06cea0 con 0x7fd50c0cd240 2023-11-24T08:02:50.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.713+0000 7fd512778640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50c06cbc0 con 0x7fd50c09a170 2023-11-24T08:02:50.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.713+0000 7fd512778640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c06f350 con 0x7fd50c06c6b0 2023-11-24T08:02:50.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.713+0000 7fd50b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd50c09a170 0x7fd50c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd50c09a170 0x7fd50c0b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43048/0 (socket says 172.21.15.161:43048) 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50b7fe640 1 -- 172.21.15.161:0/4107204249 learned_addr learned my addr 172.21.15.161:0/4107204249 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50bfff640 1 --1- 172.21.15.161:0/4107204249 >> v1:172.21.15.161:6789/0 conn(0x7fd50c0cd240 0x7fd50c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:44700/0 (socket says 172.21.15.161:44700) 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd510d15640 1 --2- 172.21.15.161:0/4107204249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50affd640 1 -- 172.21.15.161:0/4107204249 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570747439 0 0) 0x7fd50c06cea0 con 0x7fd50c0cd240 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50affd640 1 -- 172.21.15.161:0/4107204249 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4f8003520 con 0x7fd50c0cd240 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50b7fe640 1 -- 172.21.15.161:0/4107204249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 msgr2=0x7fd50c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50b7fe640 1 --2- 172.21.15.161:0/4107204249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50b7fe640 1 -- 172.21.15.161:0/4107204249 >> v1:172.21.15.161:6789/0 conn(0x7fd50c0cd240 legacy=0x7fd50c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.714+0000 7fd50b7fe640 1 -- 172.21.15.161:0/4107204249 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c06f630 con 0x7fd50c09a170 2023-11-24T08:02:50.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.715+0000 7fd50b7fe640 1 --2- 172.21.15.161:0/4107204249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c09a170 0x7fd50c0b3820 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009870 tx=0x7fd4f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14723490d9e9bb8a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd50affd640 1 -- 172.21.15.161:0/4107204249 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4030840 con 0x7fd50c09a170 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd50affd640 1 -- 172.21.15.161:0/4107204249 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f40309a0 con 0x7fd50c09a170 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd50affd640 1 -- 172.21.15.161:0/4107204249 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4030d30 con 0x7fd50c09a170 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd512778640 1 -- 172.21.15.161:0/4107204249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c09a170 msgr2=0x7fd50c0b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd512778640 1 --2- 172.21.15.161:0/4107204249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c09a170 0x7fd50c0b3820 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009870 tx=0x7fd4f402b980 comp rx=0 tx=0).stop 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd512778640 1 -- 172.21.15.161:0/4107204249 shutdown_connections 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd512778640 1 --2- 172.21.15.161:0/4107204249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd512778640 1 --2- 172.21.15.161:0/4107204249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c09a170 0x7fd50c0b3820 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.716+0000 7fd512778640 1 -- 172.21.15.161:0/4107204249 >> 172.21.15.161:0/4107204249 conn(0x7fd50c0b2d00 msgr2=0x7fd50c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:50.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.717+0000 7fd512778640 1 -- 172.21.15.161:0/4107204249 shutdown_connections 2023-11-24T08:02:50.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.717+0000 7fd512778640 1 -- 172.21.15.161:0/4107204249 wait complete. 2023-11-24T08:02:50.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.718+0000 7fd512778640 1 Processor -- start 2023-11-24T08:02:50.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.718+0000 7fd512778640 1 -- start start 2023-11-24T08:02:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.719+0000 7fd512778640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.719+0000 7fd512778640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd50c09a170 0x7fd50c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.719+0000 7fd512778640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 0x7fd50c1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.719+0000 7fd512778640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0c4ea0 con 0x7fd50c0cd240 2023-11-24T08:02:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.719+0000 7fd512778640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0c7950 con 0x7fd50c09a170 2023-11-24T08:02:50.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.719+0000 7fd512778640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c0c5160 con 0x7fd50c06c6b0 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 0x7fd50c1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 0x7fd50c1f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:43062/0 (socket says 172.21.15.161:43062) 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 -- 172.21.15.161:0/3954831443 learned_addr learned my addr 172.21.15.161:0/3954831443 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd50bfff640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd50b7fe640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd50c09a170 0x7fd50c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 -- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 msgr2=0x7fd50c14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 -- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd50c09a170 msgr2=0x7fd50c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd50c09a170 0x7fd50c0c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 -- 172.21.15.161:0/3954831443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40094d0 con 0x7fd50c0cd240 2023-11-24T08:02:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.720+0000 7fd510d15640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 0x7fd50c1f26e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d5a0 tx=0x7fd50400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.721+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040125f0 con 0x7fd50c0cd240 2023-11-24T08:02:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.721+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504012750 con 0x7fd50c0cd240 2023-11-24T08:02:50.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.721+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c0c5440 con 0x7fd50c0cd240 2023-11-24T08:02:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.721+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504012ae0 con 0x7fd50c0cd240 2023-11-24T08:02:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.721+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c0c5960 con 0x7fd50c0cd240 2023-11-24T08:02:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.722+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c0c5680 con 0x7fd50c0cd240 2023-11-24T08:02:50.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.723+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd504012c40 con 0x7fd50c0cd240 2023-11-24T08:02:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.724+0000 7fd508ff9640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4ec06b020 0x7fd4ec06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.724+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd504089d80 con 0x7fd50c0cd240 2023-11-24T08:02:50.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.725+0000 7fd50bfff640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4ec06b020 0x7fd4ec06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:50.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.726+0000 7fd50bfff640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4ec06b020 0x7fd4ec06d4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001560 tx=0x7fd4fc007ed0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.728+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd50c0c5680 con 0x7fd50c0cd240 2023-11-24T08:02:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.934+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd50c0c5680 con 0x7fd50c0cd240 2023-11-24T08:02:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.935+0000 7fd508ff9640 1 -- 172.21.15.161:0/3954831443 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd50c0c5680 con 0x7fd50c0cd240 2023-11-24T08:02:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.937+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4ec06b020 msgr2=0x7fd4ec06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.937+0000 7fd512778640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4ec06b020 0x7fd4ec06d4e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc001560 tx=0x7fd4fc007ed0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.937+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 msgr2=0x7fd50c1f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.937+0000 7fd512778640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 0x7fd50c1f26e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd50400d5a0 tx=0x7fd50400da60 comp rx=0 tx=0).stop 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 shutdown_connections 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd4ec06b020 0x7fd4ec06d4e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd50c0cd240 0x7fd50c1f26e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd50c09a170 0x7fd50c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 --2- 172.21.15.161:0/3954831443 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd50c06c6b0 0x7fd50c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 >> 172.21.15.161:0/3954831443 conn(0x7fd50c0b2d00 msgr2=0x7fd50c1605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 shutdown_connections 2023-11-24T08:02:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:50.938+0000 7fd512778640 1 -- 172.21.15.161:0/3954831443 wait complete. 2023-11-24T08:02:50.959 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2023-11-24T08:02:50.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:50.959 DEBUG:teuthology.orchestra.run.smithi161:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T08:02:51.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[105161]: fuse finished with error 0 and tester_r 0 2023-11-24T08:02:51.052 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:02:57.154 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:02:57.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:02:57.154 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:02:57.216 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:02:57.217 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:57.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:57.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.499+0000 7ff493fff640 1 Processor -- start 2023-11-24T08:02:57.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.500+0000 7ff493fff640 1 -- start start 2023-11-24T08:02:57.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff493fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff494160890 0x7ff4940d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff493fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160c70 0x7ff4940d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff493fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4940c6be0 0x7ff4940d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff493fff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940d20f0 con 0x7ff4940c6be0 2023-11-24T08:02:57.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff493fff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4940cf6a0 con 0x7ff494160890 2023-11-24T08:02:57.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff493fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4940d1430 con 0x7ff494160c70 2023-11-24T08:02:57.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff4937fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4940c6be0 0x7ff4940d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff4937fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff4940c6be0 0x7ff4940d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53834/0 (socket says 172.21.15.161:53834) 2023-11-24T08:02:57.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.501+0000 7ff4937fe640 1 -- 172.21.15.161:0/1335289612 learned_addr learned my addr 172.21.15.161:0/1335289612 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:57.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.502+0000 7ff4937fe640 1 -- 172.21.15.161:0/1335289612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160c70 msgr2=0x7ff4940d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:57.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.502+0000 7ff4937fe640 1 --2- 172.21.15.161:0/1335289612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160c70 0x7ff4940d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.502+0000 7ff4937fe640 1 -- 172.21.15.161:0/1335289612 >> v2:172.21.15.175:3300/0 conn(0x7ff494160890 msgr2=0x7ff4940d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:57.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.502+0000 7ff4937fe640 1 --2- 172.21.15.161:0/1335289612 >> v2:172.21.15.175:3300/0 conn(0x7ff494160890 0x7ff4940d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.507 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.502+0000 7ff4937fe640 1 -- 172.21.15.161:0/1335289612 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4940b4370 con 0x7ff4940c6be0 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.503+0000 7ff4937fe640 1 --2- 172.21.15.161:0/1335289612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff4940d1bb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff4940b5c10 tx=0x7ff48c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71fe270201bcbe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.503+0000 7ff491ffb640 1 -- 172.21.15.161:0/1335289612 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c031750 con 0x7ff4940c6be0 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.503+0000 7ff491ffb640 1 -- 172.21.15.161:0/1335289612 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c0318b0 con 0x7ff4940c6be0 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.503+0000 7ff491ffb640 1 -- 172.21.15.161:0/1335289612 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c031c40 con 0x7ff4940c6be0 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.503+0000 7ff493fff640 1 -- 172.21.15.161:0/1335289612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 msgr2=0x7ff4940d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.503+0000 7ff493fff640 1 --2- 172.21.15.161:0/1335289612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff4940d1bb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff4940b5c10 tx=0x7ff48c02b7f0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 -- 172.21.15.161:0/1335289612 shutdown_connections 2023-11-24T08:02:57.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 --2- 172.21.15.161:0/1335289612 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff4940d1bb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 --2- 172.21.15.161:0/1335289612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160c70 0x7ff4940d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 --2- 172.21.15.161:0/1335289612 >> v2:172.21.15.175:3300/0 conn(0x7ff494160890 0x7ff4940d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 -- 172.21.15.161:0/1335289612 >> 172.21.15.161:0/1335289612 conn(0x7ff4940d3090 msgr2=0x7ff4940d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:57.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 -- 172.21.15.161:0/1335289612 shutdown_connections 2023-11-24T08:02:57.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.504+0000 7ff493fff640 1 -- 172.21.15.161:0/1335289612 wait complete. 2023-11-24T08:02:57.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.505+0000 7ff493fff640 1 Processor -- start 2023-11-24T08:02:57.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.505+0000 7ff493fff640 1 -- start start 2023-11-24T08:02:57.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.506+0000 7ff493fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff49415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.506+0000 7ff493fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160890 0x7ff4940b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.506+0000 7ff493fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff494160c70 0x7ff49409ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.506+0000 7ff493fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49415ca60 con 0x7ff4940c6be0 2023-11-24T08:02:57.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.506+0000 7ff493fff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49415f580 con 0x7ff494160c70 2023-11-24T08:02:57.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.506+0000 7ff493fff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49415cfb0 con 0x7ff494160890 2023-11-24T08:02:57.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff49415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff49415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53842/0 (socket says 172.21.15.161:53842) 2023-11-24T08:02:57.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 -- 172.21.15.161:0/2501520113 learned_addr learned my addr 172.21.15.161:0/2501520113 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:57.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 -- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160890 msgr2=0x7ff4940b7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160890 0x7ff4940b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 -- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff494160c70 msgr2=0x7ff49409ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff494160c70 0x7ff49409ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 -- 172.21.15.161:0/2501520113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0094d0 con 0x7ff4940c6be0 2023-11-24T08:02:57.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.507+0000 7ff492ffd640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff49415f040 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff48400ba80 tx=0x7ff48400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:57.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.508+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48400cc00 con 0x7ff4940c6be0 2023-11-24T08:02:57.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.508+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48400cd80 con 0x7ff4940c6be0 2023-11-24T08:02:57.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.508+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff484014680 con 0x7ff4940c6be0 2023-11-24T08:02:57.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.508+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4940b8170 con 0x7ff4940c6be0 2023-11-24T08:02:57.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.508+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49415cc40 con 0x7ff4940c6be0 2023-11-24T08:02:57.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.509+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4940b8690 con 0x7ff4940c6be0 2023-11-24T08:02:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.510+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff48401d3b0 con 0x7ff4940c6be0 2023-11-24T08:02:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.511+0000 7ff48b7fe640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff47406aff0 0x7ff47406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.511+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff484089990 con 0x7ff4940c6be0 2023-11-24T08:02:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.511+0000 7ff4927fc640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff47406aff0 0x7ff47406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.513+0000 7ff4927fc640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff47406aff0 0x7ff47406d4b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff49415c5f0 tx=0x7ff47c006c10 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:57.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.516+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff484054720 con 0x7ff4940c6be0 2023-11-24T08:02:57.709 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.707+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff494067450 con 0x7ff4940c6be0 2023-11-24T08:02:57.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.710+0000 7ff48b7fe640 1 -- 172.21.15.161:0/2501520113 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16537 (secure 0 0 0) 0x7ff484019020 con 0x7ff4940c6be0 2023-11-24T08:02:57.712 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:02:57.712 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":47,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:28.848473+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff47406aff0 msgr2=0x7ff47406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff47406aff0 0x7ff47406d4b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff49415c5f0 tx=0x7ff47c006c10 comp rx=0 tx=0).stop 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 msgr2=0x7ff49415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff49415f040 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ff48400ba80 tx=0x7ff48400bf40 comp rx=0 tx=0).stop 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 shutdown_connections 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff47406aff0 0x7ff47406d4b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.715 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff494160c70 0x7ff49409ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff494160890 0x7ff4940b7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.712+0000 7ff493fff640 1 --2- 172.21.15.161:0/2501520113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4940c6be0 0x7ff49415f040 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.713+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 >> 172.21.15.161:0/2501520113 conn(0x7ff4940d3090 msgr2=0x7ff4940c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.713+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 shutdown_connections 2023-11-24T08:02:57.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.713+0000 7ff493fff640 1 -- 172.21.15.161:0/2501520113 wait complete. 2023-11-24T08:02:57.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:02:25.158735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:02:26.286978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:02:57.735 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:02:57.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.957+0000 7fe35f232640 1 Processor -- start 2023-11-24T08:02:57.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.958+0000 7fe35f232640 1 -- start start 2023-11-24T08:02:57.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.959+0000 7fe35f232640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3580adf20 0x7fe358070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.959+0000 7fe35f232640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35815f4e0 con 0x7fe35815bf10 2023-11-24T08:02:57.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.959+0000 7fe35f232640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe358071130 con 0x7fe3580ccb50 2023-11-24T08:02:57.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.959+0000 7fe35f232640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35815f970 con 0x7fe3580adf20 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.959+0000 7fe35e230640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3580adf20 0x7fe358070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35da2f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe35815bf10 0x7fe3580cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58594/0 (socket says 172.21.15.161:58594) 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35e230640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe3580adf20 0x7fe358070a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53850/0 (socket says 172.21.15.161:53850) 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35da2f640 1 -- 172.21.15.161:0/1178352970 learned_addr learned my addr 172.21.15.161:0/1178352970 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35e230640 1 -- 172.21.15.161:0/1178352970 >> v1:172.21.15.175:6789/0 conn(0x7fe3580ccb50 legacy=0x7fe358143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35e230640 1 -- 172.21.15.161:0/1178352970 >> v1:172.21.15.161:6789/0 conn(0x7fe35815bf10 legacy=0x7fe3580cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35e230640 1 -- 172.21.15.161:0/1178352970 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35815c390 con 0x7fe3580adf20 2023-11-24T08:02:57.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.960+0000 7fe35d22e640 1 -- 172.21.15.161:0/1178352970 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122526729 0 0) 0x7fe35815f4e0 con 0x7fe35815bf10 2023-11-24T08:02:57.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.961+0000 7fe35e230640 1 --2- 172.21.15.161:0/1178352970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe358070a30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe3540097a0 tx=0x7fe35402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ecaba848434cec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35d22e640 1 -- 172.21.15.161:0/1178352970 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35402e070 con 0x7fe3580adf20 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35d22e640 1 -- 172.21.15.161:0/1178352970 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3540315a0 con 0x7fe3580adf20 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35d22e640 1 -- 172.21.15.161:0/1178352970 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354031930 con 0x7fe3580adf20 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 -- 172.21.15.161:0/1178352970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 msgr2=0x7fe358070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 --2- 172.21.15.161:0/1178352970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe358070a30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe3540097a0 tx=0x7fe35402b840 comp rx=0 tx=0).stop 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 -- 172.21.15.161:0/1178352970 shutdown_connections 2023-11-24T08:02:57.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 --2- 172.21.15.161:0/1178352970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe358070a30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 -- 172.21.15.161:0/1178352970 >> 172.21.15.161:0/1178352970 conn(0x7fe35806a7d0 msgr2=0x7fe35806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:57.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 -- 172.21.15.161:0/1178352970 shutdown_connections 2023-11-24T08:02:57.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.962+0000 7fe35f232640 1 -- 172.21.15.161:0/1178352970 wait complete. 2023-11-24T08:02:57.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.964+0000 7fe35f232640 1 Processor -- start 2023-11-24T08:02:57.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.964+0000 7fe35f232640 1 -- start start 2023-11-24T08:02:57.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35f232640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe3580cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35f232640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3580ccb50 0x7fe3580b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35f232640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe35815bf10 0x7fe3580b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35f232640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580aada0 con 0x7fe3580adf20 2023-11-24T08:02:57.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35f232640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580abd30 con 0x7fe35815bf10 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35f232640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3580ac230 con 0x7fe3580ccb50 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35e230640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe3580cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35e230640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe3580cb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53862/0 (socket says 172.21.15.161:53862) 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.965+0000 7fe35e230640 1 -- 172.21.15.161:0/2148065833 learned_addr learned my addr 172.21.15.161:0/2148065833 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35da2f640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3580ccb50 0x7fe3580b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35e230640 1 -- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3580ccb50 msgr2=0x7fe3580b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35e230640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3580ccb50 0x7fe3580b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35ea31640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe35815bf10 0x7fe3580b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35e230640 1 -- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe35815bf10 msgr2=0x7fe3580b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:57.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35e230640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe35815bf10 0x7fe3580b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:57.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35e230640 1 -- 172.21.15.161:0/2148065833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe354009400 con 0x7fe3580adf20 2023-11-24T08:02:57.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35da2f640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3580ccb50 0x7fe3580b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:57.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35ea31640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe35815bf10 0x7fe3580b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:57.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe35e230640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe3580cb280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe354000c00 tx=0x7fe3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.966+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354004230 con 0x7fe3580adf20 2023-11-24T08:02:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.967+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354004390 con 0x7fe3580adf20 2023-11-24T08:02:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.967+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354032880 con 0x7fe3580adf20 2023-11-24T08:02:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.967+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3580aa220 con 0x7fe3580adf20 2023-11-24T08:02:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.967+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3580aa7e0 con 0x7fe3580adf20 2023-11-24T08:02:57.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.968+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3580cd8d0 con 0x7fe3580adf20 2023-11-24T08:02:57.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.969+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe3540329e0 con 0x7fe3580adf20 2023-11-24T08:02:57.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.970+0000 7fe34effd640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe33c06aff0 0x7fe33c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:57.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.970+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3540abb70 con 0x7fe3580adf20 2023-11-24T08:02:57.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.970+0000 7fe35da2f640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe33c06aff0 0x7fe33c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:57.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.972+0000 7fe35da2f640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe33c06aff0 0x7fe33c06d4b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe348000f60 tx=0x7fe348009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:57.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:57.975+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe354076920 con 0x7fe3580adf20 2023-11-24T08:02:58.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.163+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3580cd8d0 con 0x7fe3580adf20 2023-11-24T08:02:58.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.164+0000 7fe34effd640 1 -- 172.21.15.161:0/2148065833 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe354044340 con 0x7fe3580adf20 2023-11-24T08:02:58.166 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:02:58.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe33c06aff0 msgr2=0x7fe33c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe33c06aff0 0x7fe33c06d4b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe348000f60 tx=0x7fe348009040 comp rx=0 tx=0).stop 2023-11-24T08:02:58.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 msgr2=0x7fe3580cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe3580cb280 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe354000c00 tx=0x7fe3540046c0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 shutdown_connections 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe33c06aff0 0x7fe33c06d4b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe35815bf10 0x7fe3580b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3580ccb50 0x7fe3580b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 --2- 172.21.15.161:0/2148065833 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3580adf20 0x7fe3580cb280 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 >> 172.21.15.161:0/2148065833 conn(0x7fe35806a7d0 msgr2=0x7fe35815c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 shutdown_connections 2023-11-24T08:02:58.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.167+0000 7fe35f232640 1 -- 172.21.15.161:0/2148065833 wait complete. 2023-11-24T08:02:58.189 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:02:58.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.409+0000 7f8b79fb7640 1 Processor -- start 2023-11-24T08:02:58.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.409+0000 7f8b79fb7640 1 -- start start 2023-11-24T08:02:58.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b79fb7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b74161780 0x7f8b7406b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b79fb7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b74161b60 0x7f8b7406b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b79fb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74162ac0 0x7f8b741653c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b79fb7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7406d200 con 0x7f8b74161b60 2023-11-24T08:02:58.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b79fb7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b741626a0 con 0x7f8b74161780 2023-11-24T08:02:58.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b79fb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7406cf20 con 0x7f8b74162ac0 2023-11-24T08:02:58.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b74161b60 0x7f8b7406b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8b74161b60 0x7f8b7406b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53874/0 (socket says 172.21.15.161:53874) 2023-11-24T08:02:58.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 -- 172.21.15.161:0/1024080520 learned_addr learned my addr 172.21.15.161:0/1024080520 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:58.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b73fff640 1 --2- 172.21.15.161:0/1024080520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74162ac0 0x7f8b741653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b737fe640 1 --2- 172.21.15.161:0/1024080520 >> v2:172.21.15.175:3300/0 conn(0x7f8b74161780 0x7f8b7406b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 -- 172.21.15.161:0/1024080520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74162ac0 msgr2=0x7f8b741653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 --2- 172.21.15.161:0/1024080520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74162ac0 0x7f8b741653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 -- 172.21.15.161:0/1024080520 >> v2:172.21.15.175:3300/0 conn(0x7f8b74161780 msgr2=0x7f8b7406b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 --2- 172.21.15.161:0/1024080520 >> v2:172.21.15.175:3300/0 conn(0x7f8b74161780 0x7f8b7406b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.411+0000 7f8b72ffd640 1 -- 172.21.15.161:0/1024080520 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b74161fe0 con 0x7f8b74161b60 2023-11-24T08:02:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.412+0000 7f8b72ffd640 1 --2- 172.21.15.161:0/1024080520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74161b60 0x7f8b7406b930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8b74071c20 tx=0x7f8b5c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae0b3c260f33a31 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.412+0000 7f8b727fc640 1 -- 172.21.15.161:0/1024080520 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c0317e0 con 0x7f8b74161b60 2023-11-24T08:02:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.412+0000 7f8b727fc640 1 -- 172.21.15.161:0/1024080520 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c031940 con 0x7f8b74161b60 2023-11-24T08:02:58.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.412+0000 7f8b727fc640 1 -- 172.21.15.161:0/1024080520 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c031cd0 con 0x7f8b74161b60 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 -- 172.21.15.161:0/1024080520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74161b60 msgr2=0x7f8b7406b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/1024080520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74161b60 0x7f8b7406b930 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8b74071c20 tx=0x7f8b5c02b880 comp rx=0 tx=0).stop 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 -- 172.21.15.161:0/1024080520 shutdown_connections 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/1024080520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74162ac0 0x7f8b741653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/1024080520 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74161b60 0x7f8b7406b930 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/1024080520 >> v2:172.21.15.175:3300/0 conn(0x7f8b74161780 0x7f8b7406b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 -- 172.21.15.161:0/1024080520 >> 172.21.15.161:0/1024080520 conn(0x7f8b74070b10 msgr2=0x7f8b74070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:58.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 -- 172.21.15.161:0/1024080520 shutdown_connections 2023-11-24T08:02:58.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.413+0000 7f8b79fb7640 1 -- 172.21.15.161:0/1024080520 wait complete. 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.415+0000 7f8b79fb7640 1 Processor -- start 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.415+0000 7f8b79fb7640 1 -- start start 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b79fb7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b74161780 0x7f8b741559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b79fb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74161b60 0x7f8b7415fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b79fb7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 0x7f8b74160300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b79fb7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74159fe0 con 0x7f8b74162ac0 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b79fb7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74159360 con 0x7f8b74161780 2023-11-24T08:02:58.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b79fb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b74159640 con 0x7f8b74161b60 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b73fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 0x7f8b74160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b73fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 0x7f8b74160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53886/0 (socket says 172.21.15.161:53886) 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.416+0000 7f8b73fff640 1 -- 172.21.15.161:0/2150578615 learned_addr learned my addr 172.21.15.161:0/2150578615 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b737fe640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b74161780 0x7f8b741559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b73fff640 1 -- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74161b60 msgr2=0x7f8b7415fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b72ffd640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74161b60 0x7f8b7415fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b73fff640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74161b60 0x7f8b7415fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b73fff640 1 -- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b74161780 msgr2=0x7f8b741559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b73fff640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b74161780 0x7f8b741559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b73fff640 1 -- 172.21.15.161:0/2150578615 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5c0094d0 con 0x7f8b74162ac0 2023-11-24T08:02:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b737fe640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b74161780 0x7f8b741559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b72ffd640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74161b60 0x7f8b7415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:02:58.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b73fff640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 0x7f8b74160300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00d5d0 tx=0x7f8b6c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0125f0 con 0x7f8b74162ac0 2023-11-24T08:02:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c012770 con 0x7f8b74162ac0 2023-11-24T08:02:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.417+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b74159920 con 0x7f8b74162ac0 2023-11-24T08:02:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.418+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c012b20 con 0x7f8b74162ac0 2023-11-24T08:02:58.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.418+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b74155f30 con 0x7f8b74162ac0 2023-11-24T08:02:58.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.419+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b740675d0 con 0x7f8b74162ac0 2023-11-24T08:02:58.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.420+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8b6c012c80 con 0x7f8b74162ac0 2023-11-24T08:02:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.420+0000 7f8b6bfff640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b5406aff0 0x7f8b5406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.421+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b6c089e60 con 0x7f8b74162ac0 2023-11-24T08:02:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.421+0000 7f8b737fe640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b5406aff0 0x7f8b5406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.422+0000 7f8b737fe640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b5406aff0 0x7f8b5406d4b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009f70 tx=0x7f8b6400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:58.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.425+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b6c054c00 con 0x7f8b74162ac0 2023-11-24T08:02:58.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.620+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b74163f40 con 0x7f8b74162ac0 2023-11-24T08:02:58.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.621+0000 7f8b6bfff640 1 -- 172.21.15.161:0/2150578615 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b6c058220 con 0x7f8b74162ac0 2023-11-24T08:02:58.623 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:02:58.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b5406aff0 msgr2=0x7f8b5406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b5406aff0 0x7f8b5406d4b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8b64009f70 tx=0x7f8b6400b040 comp rx=0 tx=0).stop 2023-11-24T08:02:58.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 msgr2=0x7f8b74160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 0x7f8b74160300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00d5d0 tx=0x7f8b6c00da90 comp rx=0 tx=0).stop 2023-11-24T08:02:58.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 shutdown_connections 2023-11-24T08:02:58.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8b5406aff0 0x7f8b5406d4b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8b74162ac0 0x7f8b74160300 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b74161b60 0x7f8b7415fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 --2- 172.21.15.161:0/2150578615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b74161780 0x7f8b741559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 >> 172.21.15.161:0/2150578615 conn(0x7f8b74070b10 msgr2=0x7f8b7406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 shutdown_connections 2023-11-24T08:02:58.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.624+0000 7f8b79fb7640 1 -- 172.21.15.161:0/2150578615 wait complete. 2023-11-24T08:02:58.646 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:02:58.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.865+0000 7f96db933640 1 Processor -- start 2023-11-24T08:02:58.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.865+0000 7f96db933640 1 -- start start 2023-11-24T08:02:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.867+0000 7f96db933640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96d413e360 0x7f96d40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.867+0000 7f96db933640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 0x7f96d40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.867+0000 7f96db933640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d415c5f0 con 0x7f96d413df80 2023-11-24T08:02:58.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.867+0000 7f96db933640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d406c470 con 0x7f96d413e360 2023-11-24T08:02:58.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.867+0000 7f96db933640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d406c750 con 0x7f96d415f9c0 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.867+0000 7f96d9ed0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 0x7f96d40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d9ed0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 0x7f96d40cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:50442/0 (socket says 172.21.15.161:50442) 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d9ed0640 1 -- 172.21.15.161:0/3481152979 learned_addr learned my addr 172.21.15.161:0/3481152979 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d8ece640 1 --2- 172.21.15.161:0/3481152979 >> v2:172.21.15.175:3300/0 conn(0x7f96d413e360 0x7f96d40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d9ed0640 1 -- 172.21.15.161:0/3481152979 >> v2:172.21.15.175:3300/0 conn(0x7f96d413e360 msgr2=0x7f96d40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d9ed0640 1 --2- 172.21.15.161:0/3481152979 >> v2:172.21.15.175:3300/0 conn(0x7f96d413e360 0x7f96d40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d9ed0640 1 -- 172.21.15.161:0/3481152979 >> v1:172.21.15.175:6789/0 conn(0x7f96d413df80 legacy=0x7f96d415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.868+0000 7f96d9ed0640 1 -- 172.21.15.161:0/3481152979 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d406ca30 con 0x7f96d415f9c0 2023-11-24T08:02:58.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.870+0000 7f96d9ed0640 1 --2- 172.21.15.161:0/3481152979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 0x7f96d40cf7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009e50 tx=0x7f96cc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e4eae4f85f6d4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:58.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.870+0000 7f96cbfff640 1 -- 172.21.15.161:0/3481152979 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc02cb00 con 0x7f96d415f9c0 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.870+0000 7f96cbfff640 1 -- 172.21.15.161:0/3481152979 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc02cc60 con 0x7f96d415f9c0 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.870+0000 7f96cbfff640 1 -- 172.21.15.161:0/3481152979 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0343f0 con 0x7f96d415f9c0 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 -- 172.21.15.161:0/3481152979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 msgr2=0x7f96d40cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 --2- 172.21.15.161:0/3481152979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 0x7f96d40cf7d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009e50 tx=0x7f96cc02bf60 comp rx=0 tx=0).stop 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 -- 172.21.15.161:0/3481152979 shutdown_connections 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 --2- 172.21.15.161:0/3481152979 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d415f9c0 0x7f96d40cf7d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 --2- 172.21.15.161:0/3481152979 >> v2:172.21.15.175:3300/0 conn(0x7f96d413e360 0x7f96d40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 -- 172.21.15.161:0/3481152979 >> 172.21.15.161:0/3481152979 conn(0x7f96d406a800 msgr2=0x7f96d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 -- 172.21.15.161:0/3481152979 shutdown_connections 2023-11-24T08:02:58.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.871+0000 7f96db933640 1 -- 172.21.15.161:0/3481152979 wait complete. 2023-11-24T08:02:58.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.874+0000 7f96db933640 1 Processor -- start 2023-11-24T08:02:58.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.874+0000 7f96db933640 1 -- start start 2023-11-24T08:02:58.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96db933640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d413df80 0x7f96d413d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96db933640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d413e360 0x7f96d40a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96db933640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 0x7f96d40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96db933640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d41f3e90 con 0x7f96d415f9c0 2023-11-24T08:02:58.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96db933640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40a9000 con 0x7f96d413df80 2023-11-24T08:02:58.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96db933640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d41f4100 con 0x7f96d413e360 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96d9ed0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 0x7f96d40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96d9ed0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 0x7f96d40b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53900/0 (socket says 172.21.15.161:53900) 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.875+0000 7f96d9ed0640 1 -- 172.21.15.161:0/4286025604 learned_addr learned my addr 172.21.15.161:0/4286025604 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d96cf640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d413df80 0x7f96d413d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d8ece640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d413e360 0x7f96d40a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d9ed0640 1 -- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d413e360 msgr2=0x7f96d40a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d9ed0640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d413e360 0x7f96d40a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d9ed0640 1 -- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d413df80 msgr2=0x7f96d413d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:58.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d9ed0640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d413df80 0x7f96d413d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:58.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d9ed0640 1 -- 172.21.15.161:0/4286025604 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc009b30 con 0x7f96d415f9c0 2023-11-24T08:02:58.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.876+0000 7f96d9ed0640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 0x7f96d40b2cf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009e50 tx=0x7f96cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:58.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.877+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc03e450 con 0x7f96d415f9c0 2023-11-24T08:02:58.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.877+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc03e5b0 con 0x7f96d415f9c0 2023-11-24T08:02:58.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.877+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d41f43e0 con 0x7f96d415f9c0 2023-11-24T08:02:58.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.877+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc03e960 con 0x7f96d415f9c0 2023-11-24T08:02:58.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.877+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d413dca0 con 0x7f96d415f9c0 2023-11-24T08:02:58.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.878+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d41f48a0 con 0x7f96d415f9c0 2023-11-24T08:02:58.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.879+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f96cc03eac0 con 0x7f96d415f9c0 2023-11-24T08:02:58.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.880+0000 7f96c9ffb640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f96b806aff0 0x7f96b806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:58.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.880+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96cc0ac5e0 con 0x7f96d415f9c0 2023-11-24T08:02:58.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.880+0000 7f96d96cf640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f96b806aff0 0x7f96b806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:58.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.882+0000 7f96d96cf640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f96b806aff0 0x7f96b806d4b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000f60 tx=0x7f96d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:58.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:58.886+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96cc077380 con 0x7f96d415f9c0 2023-11-24T08:02:59.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.078+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96d40675d0 con 0x7f96d415f9c0 2023-11-24T08:02:59.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.079+0000 7f96c9ffb640 1 -- 172.21.15.161:0/4286025604 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96cc07a9a0 con 0x7f96d415f9c0 2023-11-24T08:02:59.080 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:02:59.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f96b806aff0 msgr2=0x7f96b806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f96b806aff0 0x7f96b806d4b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f96d0000f60 tx=0x7f96d0009040 comp rx=0 tx=0).stop 2023-11-24T08:02:59.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 msgr2=0x7f96d40b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 0x7f96d40b2cf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009e50 tx=0x7f96cc004a40 comp rx=0 tx=0).stop 2023-11-24T08:02:59.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 shutdown_connections 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f96b806aff0 0x7f96b806d4b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d415f9c0 0x7f96d40b2cf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96d413e360 0x7f96d40a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 --2- 172.21.15.161:0/4286025604 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96d413df80 0x7f96d413d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 >> 172.21.15.161:0/4286025604 conn(0x7f96d406a800 msgr2=0x7f96d4070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 shutdown_connections 2023-11-24T08:02:59.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.082+0000 7f96db933640 1 -- 172.21.15.161:0/4286025604 wait complete. 2023-11-24T08:02:59.103 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:02:59.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.312+0000 7f9e67856640 1 Processor -- start 2023-11-24T08:02:59.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.312+0000 7f9e67856640 1 -- start start 2023-11-24T08:02:59.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.313+0000 7f9e67856640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 0x7f9e600b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.313+0000 7f9e67856640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e6006c6b0 0x7f9e600cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.313+0000 7f9e67856640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6006cea0 con 0x7f9e600cd240 2023-11-24T08:02:59.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.313+0000 7f9e67856640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6006cbc0 con 0x7f9e6006c6b0 2023-11-24T08:02:59.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.313+0000 7f9e67856640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6006f350 con 0x7f9e6009a170 2023-11-24T08:02:59.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.314+0000 7f9e64df1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 0x7f9e600b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.314+0000 7f9e64df1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 0x7f9e600b3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:50462/0 (socket says 172.21.15.161:50462) 2023-11-24T08:02:59.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.314+0000 7f9e64df1640 1 -- 172.21.15.161:0/4220983953 learned_addr learned my addr 172.21.15.161:0/4220983953 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:59.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.314+0000 7f9e65df3640 1 --2- 172.21.15.161:0/4220983953 >> v2:172.21.15.175:3300/0 conn(0x7f9e6006c6b0 0x7f9e600cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.315+0000 7f9e64df1640 1 -- 172.21.15.161:0/4220983953 >> v2:172.21.15.175:3300/0 conn(0x7f9e6006c6b0 msgr2=0x7f9e600cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:59.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.315+0000 7f9e64df1640 1 --2- 172.21.15.161:0/4220983953 >> v2:172.21.15.175:3300/0 conn(0x7f9e6006c6b0 0x7f9e600cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.315+0000 7f9e64df1640 1 -- 172.21.15.161:0/4220983953 >> v1:172.21.15.175:6789/0 conn(0x7f9e600cd240 legacy=0x7f9e60099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.315+0000 7f9e64df1640 1 -- 172.21.15.161:0/4220983953 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6006f630 con 0x7f9e6009a170 2023-11-24T08:02:59.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.316+0000 7f9e64df1640 1 --2- 172.21.15.161:0/4220983953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 0x7f9e600b3820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009870 tx=0x7f9e5402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67fc9a4451f7db9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:59.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.317+0000 7f9e5ffff640 1 -- 172.21.15.161:0/4220983953 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54030840 con 0x7f9e6009a170 2023-11-24T08:02:59.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.317+0000 7f9e5ffff640 1 -- 172.21.15.161:0/4220983953 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e540309a0 con 0x7f9e6009a170 2023-11-24T08:02:59.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.317+0000 7f9e5ffff640 1 -- 172.21.15.161:0/4220983953 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54030d30 con 0x7f9e6009a170 2023-11-24T08:02:59.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.317+0000 7f9e67856640 1 -- 172.21.15.161:0/4220983953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 msgr2=0x7f9e600b3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.317+0000 7f9e67856640 1 --2- 172.21.15.161:0/4220983953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 0x7f9e600b3820 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009870 tx=0x7f9e5402b980 comp rx=0 tx=0).stop 2023-11-24T08:02:59.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.317+0000 7f9e67856640 1 -- 172.21.15.161:0/4220983953 shutdown_connections 2023-11-24T08:02:59.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.318+0000 7f9e67856640 1 --2- 172.21.15.161:0/4220983953 >> v2:172.21.15.175:3300/0 conn(0x7f9e6006c6b0 0x7f9e600cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.318+0000 7f9e67856640 1 --2- 172.21.15.161:0/4220983953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e6009a170 0x7f9e600b3820 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.318+0000 7f9e67856640 1 -- 172.21.15.161:0/4220983953 >> 172.21.15.161:0/4220983953 conn(0x7f9e600b2d00 msgr2=0x7f9e600b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:59.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.318+0000 7f9e67856640 1 -- 172.21.15.161:0/4220983953 shutdown_connections 2023-11-24T08:02:59.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.318+0000 7f9e67856640 1 -- 172.21.15.161:0/4220983953 wait complete. 2023-11-24T08:02:59.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.319+0000 7f9e67856640 1 Processor -- start 2023-11-24T08:02:59.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.319+0000 7f9e67856640 1 -- start start 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.320+0000 7f9e67856640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e6006c6b0 0x7f9e600b6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.320+0000 7f9e67856640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 0x7f9e601f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.320+0000 7f9e67856640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e600cd240 0x7f9e601f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.320+0000 7f9e67856640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601f3da0 con 0x7f9e6009a170 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.320+0000 7f9e67856640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601f3710 con 0x7f9e6006c6b0 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.320+0000 7f9e67856640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e601f39f0 con 0x7f9e600cd240 2023-11-24T08:02:59.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 0x7f9e601f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 0x7f9e601f2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53914/0 (socket says 172.21.15.161:53914) 2023-11-24T08:02:59.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 -- 172.21.15.161:0/3788609348 learned_addr learned my addr 172.21.15.161:0/3788609348 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:59.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e65df3640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e600cd240 0x7f9e601f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e655f2640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e6006c6b0 0x7f9e600b6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 -- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e600cd240 msgr2=0x7f9e601f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e600cd240 0x7f9e601f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 -- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e6006c6b0 msgr2=0x7f9e600b6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e6006c6b0 0x7f9e600b6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.321+0000 7f9e64df1640 1 -- 172.21.15.161:0/3788609348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540094d0 con 0x7f9e6009a170 2023-11-24T08:02:59.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.322+0000 7f9e64df1640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 0x7f9e601f2be0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000c00 tx=0x7f9e54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:59.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.322+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54039c90 con 0x7f9e6009a170 2023-11-24T08:02:59.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.322+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e54039e10 con 0x7f9e6009a170 2023-11-24T08:02:59.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.322+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e54043640 con 0x7f9e6009a170 2023-11-24T08:02:59.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.322+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e601f3fb0 con 0x7f9e6009a170 2023-11-24T08:02:59.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.322+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e600b4950 con 0x7f9e6009a170 2023-11-24T08:02:59.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.323+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e601f44d0 con 0x7f9e6009a170 2023-11-24T08:02:59.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.324+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9e540437a0 con 0x7f9e6009a170 2023-11-24T08:02:59.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.325+0000 7f9e5dffb640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9e4c06aff0 0x7f9e4c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.326+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e5403e070 con 0x7f9e6009a170 2023-11-24T08:02:59.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.326+0000 7f9e655f2640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9e4c06aff0 0x7f9e4c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.327+0000 7f9e655f2640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9e4c06aff0 0x7f9e4c06d4b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9e50001d40 tx=0x7f9e50009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:59.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.330+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e601f44d0 con 0x7f9e6009a170 2023-11-24T08:02:59.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.534+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9e601f44d0 con 0x7f9e6009a170 2023-11-24T08:02:59.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.535+0000 7f9e5dffb640 1 -- 172.21.15.161:0/3788609348 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9e601f44d0 con 0x7f9e6009a170 2023-11-24T08:02:59.536 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:02:59.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9e4c06aff0 msgr2=0x7f9e4c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9e4c06aff0 0x7f9e4c06d4b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9e50001d40 tx=0x7f9e50009040 comp rx=0 tx=0).stop 2023-11-24T08:02:59.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 msgr2=0x7f9e601f2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 0x7f9e601f2be0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9e54000c00 tx=0x7f9e54004730 comp rx=0 tx=0).stop 2023-11-24T08:02:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 shutdown_connections 2023-11-24T08:02:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9e4c06aff0 0x7f9e4c06d4b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e600cd240 0x7f9e601f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9e6009a170 0x7f9e601f2be0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 --2- 172.21.15.161:0/3788609348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e6006c6b0 0x7f9e600b6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 >> 172.21.15.161:0/3788609348 conn(0x7f9e600b2d00 msgr2=0x7f9e60099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 shutdown_connections 2023-11-24T08:02:59.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.537+0000 7f9e67856640 1 -- 172.21.15.161:0/3788609348 wait complete. 2023-11-24T08:02:59.558 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:02:59.558 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:02:59.617 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:02:59.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.834+0000 7fde84202640 1 Processor -- start 2023-11-24T08:02:59.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.834+0000 7fde84202640 1 -- start start 2023-11-24T08:02:59.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.836+0000 7fde84202640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.836+0000 7fde84202640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fde7c0ae220 0x7fde7c071cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.836+0000 7fde84202640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde7c072210 0x7fde7c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.836+0000 7fde84202640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0ae6b0 con 0x7fde7c0ae220 2023-11-24T08:02:59.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.836+0000 7fde84202640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c072640 con 0x7fde7c072210 2023-11-24T08:02:59.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.836+0000 7fde84202640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0ae8a0 con 0x7fde7c15b3f0 2023-11-24T08:02:59.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fde7c0ae220 0x7fde7c071cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fde7c0ae220 0x7fde7c071cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53918/0 (socket says 172.21.15.161:53918) 2023-11-24T08:02:59.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde81f9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 -- 172.21.15.161:0/3404988536 learned_addr learned my addr 172.21.15.161:0/3404988536 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:59.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8279f640 1 --2- 172.21.15.161:0/3404988536 >> v2:172.21.15.175:3300/0 conn(0x7fde7c072210 0x7fde7c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 -- 172.21.15.161:0/3404988536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 msgr2=0x7fde7c0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:59.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 --2- 172.21.15.161:0/3404988536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c0adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 -- 172.21.15.161:0/3404988536 >> v2:172.21.15.175:3300/0 conn(0x7fde7c072210 msgr2=0x7fde7c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:02:59.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 --2- 172.21.15.161:0/3404988536 >> v2:172.21.15.175:3300/0 conn(0x7fde7c072210 0x7fde7c15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.837+0000 7fde8179d640 1 -- 172.21.15.161:0/3404988536 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c15fd40 con 0x7fde7c0ae220 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.839+0000 7fde8179d640 1 --2- 172.21.15.161:0/3404988536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c0ae220 0x7fde7c071cd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0703a0 tx=0x7fde6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2399f8ff94ed602c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.839+0000 7fde80f9c640 1 -- 172.21.15.161:0/3404988536 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c031870 con 0x7fde7c0ae220 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.839+0000 7fde80f9c640 1 -- 172.21.15.161:0/3404988536 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c0319d0 con 0x7fde7c0ae220 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.839+0000 7fde80f9c640 1 -- 172.21.15.161:0/3404988536 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c031d60 con 0x7fde7c0ae220 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 -- 172.21.15.161:0/3404988536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c0ae220 msgr2=0x7fde7c071cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 --2- 172.21.15.161:0/3404988536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c0ae220 0x7fde7c071cd0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fde7c0703a0 tx=0x7fde6c02b910 comp rx=0 tx=0).stop 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 -- 172.21.15.161:0/3404988536 shutdown_connections 2023-11-24T08:02:59.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 --2- 172.21.15.161:0/3404988536 >> v2:172.21.15.175:3300/0 conn(0x7fde7c072210 0x7fde7c15b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 --2- 172.21.15.161:0/3404988536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c0ae220 0x7fde7c071cd0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 --2- 172.21.15.161:0/3404988536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 -- 172.21.15.161:0/3404988536 >> 172.21.15.161:0/3404988536 conn(0x7fde7c0b0c00 msgr2=0x7fde7c0b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 -- 172.21.15.161:0/3404988536 shutdown_connections 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.840+0000 7fde84202640 1 -- 172.21.15.161:0/3404988536 wait complete. 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.842+0000 7fde84202640 1 Processor -- start 2023-11-24T08:02:59.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.842+0000 7fde84202640 1 -- start start 2023-11-24T08:02:59.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde84202640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 0x7fde7c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde84202640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7c0ae220 0x7fde7c13e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde84202640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde84202640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0cde80 con 0x7fde7c072210 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde84202640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0b2550 con 0x7fde7c0ae220 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde84202640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0cdba0 con 0x7fde7c15b3f0 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 0x7fde7c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 0x7fde7c14d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53932/0 (socket says 172.21.15.161:53932) 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 -- 172.21.15.161:0/1701350806 learned_addr learned my addr 172.21.15.161:0/1701350806 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 -- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 msgr2=0x7fde7c155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 -- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7c0ae220 msgr2=0x7fde7c13e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7c0ae220 0x7fde7c13e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.843+0000 7fde81f9e640 1 -- 172.21.15.161:0/1701350806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c0094d0 con 0x7fde7c072210 2023-11-24T08:02:59.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.844+0000 7fde81f9e640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 0x7fde7c14d460 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fde7800e8a0 tx=0x7fde7800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:59.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.844+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde780094f0 con 0x7fde7c072210 2023-11-24T08:02:59.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.844+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800c8c0 con 0x7fde7c072210 2023-11-24T08:02:59.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.844+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800cc70 con 0x7fde7c072210 2023-11-24T08:02:59.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.844+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c0b1e90 con 0x7fde7c072210 2023-11-24T08:02:59.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.844+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c14d9a0 con 0x7fde7c072210 2023-11-24T08:02:59.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.845+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c0b1cf0 con 0x7fde7c072210 2023-11-24T08:02:59.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.846+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fde78013470 con 0x7fde7c072210 2023-11-24T08:02:59.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.847+0000 7fde727fc640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde6006aff0 0x7fde6006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:02:59.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.847+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde78089970 con 0x7fde7c072210 2023-11-24T08:02:59.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.848+0000 7fde8179d640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde6006aff0 0x7fde6006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:02:59.849 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.849+0000 7fde8179d640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde6006aff0 0x7fde6006d4b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde6c036000 tx=0x7fde6c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:02:59.853 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:02:59.852+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde7c0b1cf0 con 0x7fde7c072210 2023-11-24T08:03:00.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.046+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7c0b1cf0 con 0x7fde7c072210 2023-11-24T08:03:00.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.049+0000 7fde727fc640 1 -- 172.21.15.161:0/1701350806 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16537 (secure 0 0 0) 0x7fde7c0b1cf0 con 0x7fde7c072210 2023-11-24T08:03:00.050 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:00.051 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":47,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:02:28.848473+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:03:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde6006aff0 msgr2=0x7fde6006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde6006aff0 0x7fde6006d4b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde6c036000 tx=0x7fde6c030000 comp rx=0 tx=0).stop 2023-11-24T08:03:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 msgr2=0x7fde7c14d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 0x7fde7c14d460 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fde7800e8a0 tx=0x7fde7800ed60 comp rx=0 tx=0).stop 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 shutdown_connections 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde6006aff0 0x7fde6006d4b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde7c15b3f0 0x7fde7c155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde7c0ae220 0x7fde7c13e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 --2- 172.21.15.161:0/1701350806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fde7c072210 0x7fde7c14d460 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 >> 172.21.15.161:0/1701350806 conn(0x7fde7c0b0c00 msgr2=0x7fde7c0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 shutdown_connections 2023-11-24T08:03:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.052+0000 7fde84202640 1 -- 172.21.15.161:0/1701350806 wait complete. 2023-11-24T08:03:00.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:02:25.158735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:02:26.286978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:03:00.071 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:03:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.285+0000 7f0050973640 1 Processor -- start 2023-11-24T08:03:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.285+0000 7f0050973640 1 -- start start 2023-11-24T08:03:00.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.286+0000 7f0050973640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f004c13fcb0 0x7f004c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.286+0000 7f0050973640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f004c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.286+0000 7f0050973640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c0ce440 con 0x7f004c13cf10 2023-11-24T08:03:00.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.286+0000 7f0050973640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c0ce720 con 0x7f004c13fcb0 2023-11-24T08:03:00.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.286+0000 7f0050973640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0cea00 con 0x7f004c0cdc20 2023-11-24T08:03:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.287+0000 7f004b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f004c13cf10 0x7f004c13f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58608/0 (socket says 172.21.15.161:58608) 2023-11-24T08:03:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.287+0000 7f004b7fe640 1 -- 172.21.15.161:0/1767862212 learned_addr learned my addr 172.21.15.161:0/1767862212 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:00.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.287+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260499671 0 0) 0x7f004c0ce440 con 0x7f004c13cf10 2023-11-24T08:03:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.287+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0038003520 con 0x7f004c13cf10 2023-11-24T08:03:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.287+0000 7f0043fff640 1 --2- 172.21.15.161:0/1767862212 >> v2:172.21.15.175:3300/0 conn(0x7f004c13fcb0 0x7f004c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.287+0000 7f004bfff640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f004c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 500255495 0 0) 0x7f0038003520 con 0x7f004c13cf10 2023-11-24T08:03:00.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 msgr2=0x7f004c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:00.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f004c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 >> v2:172.21.15.175:3300/0 conn(0x7f004c13fcb0 msgr2=0x7f004c0cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:00.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 --2- 172.21.15.161:0/1767862212 >> v2:172.21.15.175:3300/0 conn(0x7f004c13fcb0 0x7f004c0cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0b1d90 con 0x7f004c13cf10 2023-11-24T08:03:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f003c001670 con 0x7f004c13cf10 2023-11-24T08:03:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 >> v1:172.21.15.161:6789/0 conn(0x7f004c13cf10 legacy=0x7f004c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f0038003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0038003f40 0x7f00380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f0038005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0ce720 con 0x7f0038004d00 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0cea00 con 0x7f0038003f40 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003800b980 con 0x7f004c0cdc20 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f004bfff640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f0038005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.288+0000 7f0043fff640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0038003f40 0x7f00380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004b7fe640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f0038003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004bfff640 1 -- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 msgr2=0x7f0038003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:00.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004bfff640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f0038003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004bfff640 1 -- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0038003f40 msgr2=0x7f00380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:00.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004bfff640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0038003f40 0x7f00380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004bfff640 1 -- 172.21.15.161:0/1767862212 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0038003520 con 0x7f0038004d00 2023-11-24T08:03:00.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.289+0000 7f004b7fe640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c0cdc20 0x7f0038003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.290+0000 7f004bfff640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f0038005180 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f004400e170 tx=0x7f00380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f628e21a138ee16 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.290+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004402cbf0 con 0x7f0038004d00 2023-11-24T08:03:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.290+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004400f040 con 0x7f0038004d00 2023-11-24T08:03:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.290+0000 7f004affd640 1 -- 172.21.15.161:0/1767862212 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044034440 con 0x7f0038004d00 2023-11-24T08:03:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f0050973640 1 -- 172.21.15.161:0/1767862212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 msgr2=0x7f0038005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f0050973640 1 --2- 172.21.15.161:0/1767862212 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f0038005180 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f004400e170 tx=0x7f00380057f0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f004bfff640 1 -- 172.21.15.161:0/1767862212 reap_dead start 2023-11-24T08:03:00.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f0050973640 1 -- 172.21.15.161:0/1767862212 shutdown_connections 2023-11-24T08:03:00.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f0050973640 1 -- 172.21.15.161:0/1767862212 >> 172.21.15.161:0/1767862212 conn(0x7f004c06a7d0 msgr2=0x7f004c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:00.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f0050973640 1 -- 172.21.15.161:0/1767862212 shutdown_connections 2023-11-24T08:03:00.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.291+0000 7f0050973640 1 -- 172.21.15.161:0/1767862212 wait complete. 2023-11-24T08:03:00.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.293+0000 7f0050973640 1 Processor -- start 2023-11-24T08:03:00.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.293+0000 7f0050973640 1 -- start start 2023-11-24T08:03:00.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0050973640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f004c136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0050973640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c13a160 0x7f004c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0050973640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c13a5e0 0x7f004c15dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0050973640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c1393a0 con 0x7f0038004d00 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0050973640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c139680 con 0x7f004c13a5e0 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0050973640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c139960 con 0x7f004c13a160 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f004c136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f004c136760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53956/0 (socket says 172.21.15.161:53956) 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 -- 172.21.15.161:0/1586197816 learned_addr learned my addr 172.21.15.161:0/1586197816 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004bfff640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c13a5e0 0x7f004c15dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f0043fff640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c13a160 0x7f004c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 -- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c13a160 msgr2=0x7f004c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c13a160 0x7f004c15d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 -- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c13a5e0 msgr2=0x7f004c15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c13a5e0 0x7f004c15dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004b7fe640 1 -- 172.21.15.161:0/1586197816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c139c40 con 0x7f0038004d00 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.294+0000 7f004bfff640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c13a5e0 0x7f004c15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.295+0000 7f004b7fe640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f004c136760 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f003c00d8d0 tx=0x7f003c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:00.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.295+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0074e0 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.295+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c007640 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.295+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c136ca0 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.295+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0049e0 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.295+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c13b0a0 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.297+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c067450 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.297+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f003c004b40 con 0x7f0038004d00 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.298+0000 7f0048ff9640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f002c06b020 0x7f002c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.298+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f003c0898b0 con 0x7f0038004d00 2023-11-24T08:03:00.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.299+0000 7f0043fff640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f002c06b020 0x7f002c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.300+0000 7f0043fff640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f002c06b020 0x7f002c06d4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f004c13c920 tx=0x7f0034008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:00.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.303+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f003c0545d0 con 0x7f0038004d00 2023-11-24T08:03:00.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.494+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f004c1394e0 con 0x7f0038004d00 2023-11-24T08:03:00.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.495+0000 7f0048ff9640 1 -- 172.21.15.161:0/1586197816 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f004c1394e0 con 0x7f0038004d00 2023-11-24T08:03:00.496 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:03:00.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f002c06b020 msgr2=0x7f002c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f002c06b020 0x7f002c06d4e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f004c13c920 tx=0x7f0034008040 comp rx=0 tx=0).stop 2023-11-24T08:03:00.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 msgr2=0x7f004c136760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f004c136760 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f003c00d8d0 tx=0x7f003c00dd90 comp rx=0 tx=0).stop 2023-11-24T08:03:00.501 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 shutdown_connections 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f002c06b020 0x7f002c06d4e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f004c13a5e0 0x7f004c15dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f004c13a160 0x7f004c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 --2- 172.21.15.161:0/1586197816 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0038004d00 0x7f004c136760 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 >> 172.21.15.161:0/1586197816 conn(0x7f004c06a7d0 msgr2=0x7f004c0b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 shutdown_connections 2023-11-24T08:03:00.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.498+0000 7f0050973640 1 -- 172.21.15.161:0/1586197816 wait complete. 2023-11-24T08:03:00.519 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:03:00.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.724+0000 7fca8a0cf640 1 Processor -- start 2023-11-24T08:03:00.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.724+0000 7fca8a0cf640 1 -- start start 2023-11-24T08:03:00.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.725+0000 7fca8a0cf640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca84143ae0 0x7fca840cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca8a0cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca8a0cf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca840cfc30 con 0x7fca840cf7d0 2023-11-24T08:03:00.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca8a0cf640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca840b1ee0 con 0x7fca84143ae0 2023-11-24T08:03:00.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca8a0cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca840b2780 con 0x7fca8415e3b0 2023-11-24T08:03:00.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca837fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fca84143ae0 0x7fca840cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca7bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fca840cf7d0 0x7fca8415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:58616/0 (socket says 172.21.15.161:58616) 2023-11-24T08:03:00.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca7bfff640 1 -- 172.21.15.161:0/3598838614 learned_addr learned my addr 172.21.15.161:0/3598838614 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:00.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.726+0000 7fca83fff640 1 --2- 172.21.15.161:0/3598838614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.727+0000 7fca837fe640 1 -- 172.21.15.161:0/3598838614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 msgr2=0x7fca840702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:00.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.727+0000 7fca837fe640 1 --2- 172.21.15.161:0/3598838614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.727+0000 7fca837fe640 1 -- 172.21.15.161:0/3598838614 >> v1:172.21.15.161:6789/0 conn(0x7fca840cf7d0 legacy=0x7fca8415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.727+0000 7fca837fe640 1 -- 172.21.15.161:0/3598838614 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8415e990 con 0x7fca84143ae0 2023-11-24T08:03:00.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.728+0000 7fca837fe640 1 --2- 172.21.15.161:0/3598838614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca84143ae0 0x7fca840cf290 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fca7400ba40 tx=0x7fca7402e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32941f346b02463 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:00.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.728+0000 7fca82ffd640 1 -- 172.21.15.161:0/3598838614 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7402ee30 con 0x7fca84143ae0 2023-11-24T08:03:00.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca82ffd640 1 -- 172.21.15.161:0/3598838614 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74036440 con 0x7fca84143ae0 2023-11-24T08:03:00.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca82ffd640 1 -- 172.21.15.161:0/3598838614 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740367d0 con 0x7fca84143ae0 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 -- 172.21.15.161:0/3598838614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca84143ae0 msgr2=0x7fca840cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/3598838614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca84143ae0 0x7fca840cf290 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fca7400ba40 tx=0x7fca7402e080 comp rx=0 tx=0).stop 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 -- 172.21.15.161:0/3598838614 shutdown_connections 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/3598838614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/3598838614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca84143ae0 0x7fca840cf290 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 -- 172.21.15.161:0/3598838614 >> 172.21.15.161:0/3598838614 conn(0x7fca8406a800 msgr2=0x7fca8406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:00.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 -- 172.21.15.161:0/3598838614 shutdown_connections 2023-11-24T08:03:00.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.729+0000 7fca8a0cf640 1 -- 172.21.15.161:0/3598838614 wait complete. 2023-11-24T08:03:00.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.731+0000 7fca8a0cf640 1 Processor -- start 2023-11-24T08:03:00.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.731+0000 7fca8a0cf640 1 -- start start 2023-11-24T08:03:00.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.732+0000 7fca8a0cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 0x7fca840c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.732+0000 7fca8a0cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca84143ae0 0x7fca840ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.732+0000 7fca8a0cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.732+0000 7fca8a0cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca841f3c90 con 0x7fca840cf7d0 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.732+0000 7fca8a0cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca840af480 con 0x7fca84143ae0 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.732+0000 7fca8a0cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca840aeb50 con 0x7fca8415e3b0 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 0x7fca840c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 0x7fca840c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53970/0 (socket says 172.21.15.161:53970) 2023-11-24T08:03:00.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 -- 172.21.15.161:0/4039249910 learned_addr learned my addr 172.21.15.161:0/4039249910 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:00.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 -- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 msgr2=0x7fca840ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 -- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca84143ae0 msgr2=0x7fca840ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca84143ae0 0x7fca840ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 -- 172.21.15.161:0/4039249910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7400b6a0 con 0x7fca840cf7d0 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.733+0000 7fca837fe640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 0x7fca840c6860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fca74039040 tx=0x7fca740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.734+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740348d0 con 0x7fca840cf7d0 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.734+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74034a50 con 0x7fca840cf7d0 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.734+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca840aee30 con 0x7fca840cf7d0 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.734+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74034e00 con 0x7fca840cf7d0 2023-11-24T08:03:00.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.734+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca840c6da0 con 0x7fca840cf7d0 2023-11-24T08:03:00.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.735+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca840675d0 con 0x7fca840cf7d0 2023-11-24T08:03:00.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.736+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fca7403d070 con 0x7fca840cf7d0 2023-11-24T08:03:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.737+0000 7fca80ff9640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fca6406aff0 0x7fca6406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:00.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.737+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca740ac0e0 con 0x7fca840cf7d0 2023-11-24T08:03:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.738+0000 7fca7bfff640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fca6406aff0 0x7fca6406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:00.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.739+0000 7fca7bfff640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fca6406aff0 0x7fca6406d4b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca840c80b0 tx=0x7fca6c007a40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:00.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.742+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca74076fa0 con 0x7fca840cf7d0 2023-11-24T08:03:00.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.932+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca8415cd30 con 0x7fca840cf7d0 2023-11-24T08:03:00.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.933+0000 7fca80ff9640 1 -- 172.21.15.161:0/4039249910 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca7407a5c0 con 0x7fca840cf7d0 2023-11-24T08:03:00.934 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.935+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fca6406aff0 msgr2=0x7fca6406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.935+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fca6406aff0 0x7fca6406d4b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca840c80b0 tx=0x7fca6c007a40 comp rx=0 tx=0).stop 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 msgr2=0x7fca840c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 0x7fca840c6860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fca74039040 tx=0x7fca740046c0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 shutdown_connections 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fca6406aff0 0x7fca6406d4b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fca8415e3b0 0x7fca840ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fca84143ae0 0x7fca840ad920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 --2- 172.21.15.161:0/4039249910 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fca840cf7d0 0x7fca840c6860 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:00.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 >> 172.21.15.161:0/4039249910 conn(0x7fca8406a800 msgr2=0x7fca8415b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:00.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 shutdown_connections 2023-11-24T08:03:00.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:00.936+0000 7fca8a0cf640 1 -- 172.21.15.161:0/4039249910 wait complete. 2023-11-24T08:03:00.955 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:03:01.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.173+0000 7fc0c42c2640 1 Processor -- start 2023-11-24T08:03:01.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.173+0000 7fc0c42c2640 1 -- start start 2023-11-24T08:03:01.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.175+0000 7fc0c42c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0bc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.175+0000 7fc0c42c2640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc070c40 con 0x7fc0bc0cf290 2023-11-24T08:03:01.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.175+0000 7fc0c42c2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0bc06c470 con 0x7fc0bc0b3ae0 2023-11-24T08:03:01.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.175+0000 7fc0c42c2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc071450 con 0x7fc0bc0ae5a0 2023-11-24T08:03:01.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c285f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc0bc0cf290 0x7fc0bc0b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:56528/0 (socket says 172.21.15.161:56528) 2023-11-24T08:03:01.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c285f640 1 -- 172.21.15.161:0/2836524093 learned_addr learned my addr 172.21.15.161:0/2836524093 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c205e640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0bc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676961050 0 0) 0x7fc0bc070c40 con 0x7fc0bc0cf290 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a4003520 con 0x7fc0bc0cf290 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2289912949 0 0) 0x7fc0a4003520 con 0x7fc0bc0cf290 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 msgr2=0x7fc0bc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0bc15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 >> v1:172.21.15.175:6789/0 conn(0x7fc0bc0b3ae0 legacy=0x7fc0bc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc06c750 con 0x7fc0bc0cf290 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.176+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc0b4001670 con 0x7fc0bc0cf290 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 >> v1:172.21.15.161:6789/0 conn(0x7fc0bc0cf290 legacy=0x7fc0bc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40039a0 0x7fc0a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a4004d00 0x7fc0a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc071450 con 0x7fc0a40039a0 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a400bbf0 con 0x7fc0a4004d00 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a400bdb0 con 0x7fc0bc0ae5a0 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c205e640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40039a0 0x7fc0a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c285f640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a4004d00 0x7fc0a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c185d640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c205e640 1 -- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 msgr2=0x7fc0a40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:01.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c205e640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0a40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c205e640 1 -- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a4004d00 msgr2=0x7fc0a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:01.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c205e640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0a4004d00 0x7fc0a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c205e640 1 -- 172.21.15.161:0/2836524093 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4003520 con 0x7fc0a40039a0 2023-11-24T08:03:01.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.177+0000 7fc0c185d640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0bc0ae5a0 0x7fc0a40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:01.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c205e640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40039a0 0x7fc0a4003dc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac007360 tx=0x7fc0a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe6dd4c53fcdb22 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:01.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac02ccb0 con 0x7fc0a40039a0 2023-11-24T08:03:01.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac02ce10 con 0x7fc0a40039a0 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c105c640 1 -- 172.21.15.161:0/2836524093 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac034660 con 0x7fc0a40039a0 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c42c2640 1 -- 172.21.15.161:0/2836524093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40039a0 msgr2=0x7fc0a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/2836524093 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0a40039a0 0x7fc0a4003dc0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac007360 tx=0x7fc0a40057f0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.179+0000 7fc0c285f640 1 -- 172.21.15.161:0/2836524093 reap_dead start 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.180+0000 7fc0c42c2640 1 -- 172.21.15.161:0/2836524093 shutdown_connections 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.180+0000 7fc0c42c2640 1 -- 172.21.15.161:0/2836524093 >> 172.21.15.161:0/2836524093 conn(0x7fc0bc06a800 msgr2=0x7fc0bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.180+0000 7fc0c42c2640 1 -- 172.21.15.161:0/2836524093 shutdown_connections 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.180+0000 7fc0c42c2640 1 -- 172.21.15.161:0/2836524093 wait complete. 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.181+0000 7fc0c42c2640 1 Processor -- start 2023-11-24T08:03:01.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.182+0000 7fc0c42c2640 1 -- start start 2023-11-24T08:03:01.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c42c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40039a0 0x7fc0bc157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c42c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0bc0cc380 0x7fc0bc15da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c42c2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 0x7fc0bc15df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c42c2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc1582d0 con 0x7fc0bc0cc800 2023-11-24T08:03:01.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c42c2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc160490 con 0x7fc0bc0cc380 2023-11-24T08:03:01.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c42c2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0bc1f3a20 con 0x7fc0a40039a0 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 0x7fc0bc15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 0x7fc0bc15df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60426/0 (socket says 172.21.15.161:60426) 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 -- 172.21.15.161:0/3541600349 learned_addr learned my addr 172.21.15.161:0/3541600349 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 -- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40039a0 msgr2=0x7fc0bc157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40039a0 0x7fc0bc157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 -- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0bc0cc380 msgr2=0x7fc0bc15da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0bc0cc380 0x7fc0bc15da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.183+0000 7fc0c285f640 1 -- 172.21.15.161:0/3541600349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc1f3d00 con 0x7fc0bc0cc800 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.184+0000 7fc0c285f640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 0x7fc0bc15df60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4001050 tx=0x7fc0b400e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.184+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4010510 con 0x7fc0bc0cc800 2023-11-24T08:03:01.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.184+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4010670 con 0x7fc0bc0cc800 2023-11-24T08:03:01.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.184+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4010a20 con 0x7fc0bc0cc800 2023-11-24T08:03:01.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.184+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0bc0cb8a0 con 0x7fc0bc0cc800 2023-11-24T08:03:01.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.184+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0bc0cbe60 con 0x7fc0bc0cc800 2023-11-24T08:03:01.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.185+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0bc06d2d0 con 0x7fc0bc0cc800 2023-11-24T08:03:01.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.186+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc0b4010b80 con 0x7fc0bc0cc800 2023-11-24T08:03:01.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.187+0000 7fc0baffd640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0a806b020 0x7fc0a806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.187+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0b4089030 con 0x7fc0bc0cc800 2023-11-24T08:03:01.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.188+0000 7fc0c205e640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0a806b020 0x7fc0a806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.189+0000 7fc0c205e640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0a806b020 0x7fc0a806d4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac036000 tx=0x7fc0ac02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:01.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.192+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0bc06d2d0 con 0x7fc0bc0cc800 2023-11-24T08:03:01.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.378+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0bc06d2d0 con 0x7fc0bc0cc800 2023-11-24T08:03:01.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.379+0000 7fc0baffd640 1 -- 172.21.15.161:0/3541600349 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc0bc06d2d0 con 0x7fc0bc0cc800 2023-11-24T08:03:01.380 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:03:01.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0a806b020 msgr2=0x7fc0a806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0a806b020 0x7fc0a806d4e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac036000 tx=0x7fc0ac02e000 comp rx=0 tx=0).stop 2023-11-24T08:03:01.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 msgr2=0x7fc0bc15df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 0x7fc0bc15df60 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4001050 tx=0x7fc0b400e910 comp rx=0 tx=0).stop 2023-11-24T08:03:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 shutdown_connections 2023-11-24T08:03:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc0a806b020 0x7fc0a806d4e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0bc0cc800 0x7fc0bc15df60 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0bc0cc380 0x7fc0bc15da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 --2- 172.21.15.161:0/3541600349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0a40039a0 0x7fc0bc157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 >> 172.21.15.161:0/3541600349 conn(0x7fc0bc06a800 msgr2=0x7fc0bc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:01.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 shutdown_connections 2023-11-24T08:03:01.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.381+0000 7fc0c42c2640 1 -- 172.21.15.161:0/3541600349 wait complete. 2023-11-24T08:03:01.402 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:03:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.610+0000 7f07ea64b640 1 Processor -- start 2023-11-24T08:03:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.610+0000 7f07ea64b640 1 -- start start 2023-11-24T08:03:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.612+0000 7f07ea64b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f07e4071f00 0x7f07e4146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.612+0000 7f07ea64b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e4166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.612+0000 7f07ea64b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e40b2e10 con 0x7f07e4071410 2023-11-24T08:03:01.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.612+0000 7f07ea64b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e406cc10 con 0x7f07e4071f00 2023-11-24T08:03:01.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.612+0000 7f07ea64b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e406cec0 con 0x7f07e406c7c0 2023-11-24T08:03:01.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.612+0000 7f07e9e4a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e4166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9e4a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e4166cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:42794/0 (socket says 172.21.15.161:42794) 2023-11-24T08:03:01.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9e4a640 1 -- 172.21.15.161:0/2312612518 learned_addr learned my addr 172.21.15.161:0/2312612518 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:01.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9649640 1 --1- 172.21.15.161:0/2312612518 >> v1:172.21.15.175:6789/0 conn(0x7f07e4071410 0x7f07e40717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:43880/0 (socket says 172.21.15.161:43880) 2023-11-24T08:03:01.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e8e48640 1 --2- 172.21.15.161:0/2312612518 >> v2:172.21.15.175:3300/0 conn(0x7f07e4071f00 0x7f07e4146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9e4a640 1 -- 172.21.15.161:0/2312612518 >> v2:172.21.15.175:3300/0 conn(0x7f07e4071f00 msgr2=0x7f07e4146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:01.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9e4a640 1 --2- 172.21.15.161:0/2312612518 >> v2:172.21.15.175:3300/0 conn(0x7f07e4071f00 0x7f07e4146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9e4a640 1 -- 172.21.15.161:0/2312612518 >> v1:172.21.15.175:6789/0 conn(0x7f07e4071410 legacy=0x7f07e40717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07e9e4a640 1 -- 172.21.15.161:0/2312612518 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e406d1a0 con 0x7f07e406c7c0 2023-11-24T08:03:01.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.613+0000 7f07dbfff640 1 -- 172.21.15.161:0/2312612518 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906887881 0 0) 0x7f07e40b2e10 con 0x7f07e4071410 2023-11-24T08:03:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.615+0000 7f07e9e4a640 1 --2- 172.21.15.161:0/2312612518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e4166cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009e50 tx=0x7f07dc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5431542b9455f408 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.615+0000 7f07dbfff640 1 -- 172.21.15.161:0/2312612518 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc02ca70 con 0x7f07e406c7c0 2023-11-24T08:03:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.615+0000 7f07dbfff640 1 -- 172.21.15.161:0/2312612518 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc02cbd0 con 0x7f07e406c7c0 2023-11-24T08:03:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.615+0000 7f07dbfff640 1 -- 172.21.15.161:0/2312612518 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc0343f0 con 0x7f07e406c7c0 2023-11-24T08:03:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 -- 172.21.15.161:0/2312612518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 msgr2=0x7f07e4166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 --2- 172.21.15.161:0/2312612518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e4166cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009e50 tx=0x7f07dc02bed0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 -- 172.21.15.161:0/2312612518 shutdown_connections 2023-11-24T08:03:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 --2- 172.21.15.161:0/2312612518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e4166cf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 --2- 172.21.15.161:0/2312612518 >> v2:172.21.15.175:3300/0 conn(0x7f07e4071f00 0x7f07e4146770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 -- 172.21.15.161:0/2312612518 >> 172.21.15.161:0/2312612518 conn(0x7f07e406a800 msgr2=0x7f07e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 -- 172.21.15.161:0/2312612518 shutdown_connections 2023-11-24T08:03:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.616+0000 7f07ea64b640 1 -- 172.21.15.161:0/2312612518 wait complete. 2023-11-24T08:03:01.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.618+0000 7f07ea64b640 1 Processor -- start 2023-11-24T08:03:01.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.618+0000 7f07ea64b640 1 -- start start 2023-11-24T08:03:01.622 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07ea64b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e41f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07ea64b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4071410 0x7f07e40c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07ea64b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 0x7f07e40c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07ea64b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e40c5130 con 0x7f07e4071f00 2023-11-24T08:03:01.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07ea64b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e4160720 con 0x7f07e4071410 2023-11-24T08:03:01.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07ea64b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e415fb10 con 0x7f07e406c7c0 2023-11-24T08:03:01.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07e9e4a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 0x7f07e40c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07e9e4a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 0x7f07e40c5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60442/0 (socket says 172.21.15.161:60442) 2023-11-24T08:03:01.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07e9e4a640 1 -- 172.21.15.161:0/471595697 learned_addr learned my addr 172.21.15.161:0/471595697 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:01.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.619+0000 7f07e8e48640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4071410 0x7f07e40c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9649640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e41f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9e4a640 1 -- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 msgr2=0x7f07e41f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9e4a640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e41f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9e4a640 1 -- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4071410 msgr2=0x7f07e40c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9e4a640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4071410 0x7f07e40c5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9e4a640 1 -- 172.21.15.161:0/471595697 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc009b30 con 0x7f07e4071f00 2023-11-24T08:03:01.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9649640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e41f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:01.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07e9e4a640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 0x7f07e40c5e80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f07dc036040 tx=0x7f07dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:01.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc009510 con 0x7f07e4071f00 2023-11-24T08:03:01.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc03e450 con 0x7f07e4071f00 2023-11-24T08:03:01.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc03e5e0 con 0x7f07e4071f00 2023-11-24T08:03:01.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.620+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e415fdf0 con 0x7f07e4071f00 2023-11-24T08:03:01.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.621+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e41603b0 con 0x7f07e4071f00 2023-11-24T08:03:01.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.622+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e41608d0 con 0x7f07e4071f00 2023-11-24T08:03:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.623+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f07dc03e740 con 0x7f07e4071f00 2023-11-24T08:03:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.623+0000 7f07d9ffb640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f07c806aff0 0x7f07c806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.624+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07dc0ac2d0 con 0x7f07e4071f00 2023-11-24T08:03:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.624+0000 7f07e9649640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f07c806aff0 0x7f07c806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.625+0000 7f07e9649640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f07c806aff0 0x7f07c806d4b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f07e0000f60 tx=0x7f07e0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:01.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.628+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07e41608d0 con 0x7f07e4071f00 2023-11-24T08:03:01.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.829+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07e4160890 con 0x7f07e4071f00 2023-11-24T08:03:01.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.830+0000 7f07d9ffb640 1 -- 172.21.15.161:0/471595697 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7f07dc077060 con 0x7f07e4071f00 2023-11-24T08:03:01.831 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:03:01.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.832+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f07c806aff0 msgr2=0x7f07c806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.832+0000 7f07ea64b640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f07c806aff0 0x7f07c806d4b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f07e0000f60 tx=0x7f07e0009040 comp rx=0 tx=0).stop 2023-11-24T08:03:01.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.832+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 msgr2=0x7f07e40c5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.832+0000 7f07ea64b640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 0x7f07e40c5e80 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f07dc036040 tx=0x7f07dc004a40 comp rx=0 tx=0).stop 2023-11-24T08:03:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 shutdown_connections 2023-11-24T08:03:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f07c806aff0 0x7f07c806d4b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f07e4071f00 0x7f07e40c5e80 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f07e4071410 0x7f07e40c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 --2- 172.21.15.161:0/471595697 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f07e406c7c0 0x7f07e41f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:01.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 >> 172.21.15.161:0/471595697 conn(0x7f07e406a800 msgr2=0x7f07e40717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:01.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 shutdown_connections 2023-11-24T08:03:01.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:01.833+0000 7f07ea64b640 1 -- 172.21.15.161:0/471595697 wait complete. 2023-11-24T08:03:01.853 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-24T08:03:01.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:03:01.854 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T08:03:01.954 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[95893]: fuse finished with error 0 and tester_r 0 2023-11-24T08:03:01.959 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:03:08.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:03:08.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:03:08.062 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:03:08.127 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.347+0000 7fa6b2c87640 1 Processor -- start 2023-11-24T08:03:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.347+0000 7fa6b2c87640 1 -- start start 2023-11-24T08:03:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b2c87640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13e360 0x7fa6ac0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:08.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b2c87640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6ac15f9c0 0x7fa6ac0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b2c87640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ac15c5f0 con 0x7fa6ac13df80 2023-11-24T08:03:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b2c87640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ac06c470 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b2c87640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac06c750 con 0x7fa6ac13e360 2023-11-24T08:03:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b1224640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6ac15f9c0 0x7fa6ac0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:08.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b1224640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa6ac15f9c0 0x7fa6ac0cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60448/0 (socket says 172.21.15.161:60448) 2023-11-24T08:03:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6b1224640 1 -- 172.21.15.161:0/1727985568 learned_addr learned my addr 172.21.15.161:0/1727985568 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.349+0000 7fa6abfff640 1 --2- 172.21.15.161:0/1727985568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13e360 0x7fa6ac0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.350+0000 7fa6b1224640 1 -- 172.21.15.161:0/1727985568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13e360 msgr2=0x7fa6ac0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.350+0000 7fa6b1224640 1 --2- 172.21.15.161:0/1727985568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13e360 0x7fa6ac0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.364 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.350+0000 7fa6b1224640 1 -- 172.21.15.161:0/1727985568 >> v1:172.21.15.175:6789/0 conn(0x7fa6ac13df80 legacy=0x7fa6ac15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.350+0000 7fa6b1224640 1 -- 172.21.15.161:0/1727985568 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac06ca30 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.351+0000 7fa6b1224640 1 --2- 172.21.15.161:0/1727985568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac0cf7d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009870 tx=0x7fa6a402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb1c8cbbb252f80 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.351+0000 7fa6ab7fe640 1 -- 172.21.15.161:0/1727985568 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4030840 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.351+0000 7fa6ab7fe640 1 -- 172.21.15.161:0/1727985568 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a40309a0 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.351+0000 7fa6ab7fe640 1 -- 172.21.15.161:0/1727985568 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4030d30 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 -- 172.21.15.161:0/1727985568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 msgr2=0x7fa6ac0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:08.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/1727985568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac0cf7d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009870 tx=0x7fa6a402b980 comp rx=0 tx=0).stop 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 -- 172.21.15.161:0/1727985568 shutdown_connections 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/1727985568 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac0cf7d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/1727985568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13e360 0x7fa6ac0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 -- 172.21.15.161:0/1727985568 >> 172.21.15.161:0/1727985568 conn(0x7fa6ac06a800 msgr2=0x7fa6ac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 -- 172.21.15.161:0/1727985568 shutdown_connections 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.352+0000 7fa6b2c87640 1 -- 172.21.15.161:0/1727985568 wait complete. 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.354+0000 7fa6b2c87640 1 Processor -- start 2023-11-24T08:03:08.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.354+0000 7fa6b2c87640 1 -- start start 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b2c87640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13df80 0x7fa6ac15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b2c87640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6ac13e360 0x7fa6ac156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b2c87640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b2c87640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac1575d0 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b2c87640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac0702c0 con 0x7fa6ac13e360 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b2c87640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ac070580 con 0x7fa6ac13df80 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b1224640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b1224640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60454/0 (socket says 172.21.15.161:60454) 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b1224640 1 -- 172.21.15.161:0/3318611614 learned_addr learned my addr 172.21.15.161:0/3318611614 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:08.368 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6b0a23640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13df80 0x7fa6ac15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.355+0000 7fa6abfff640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6ac13e360 0x7fa6ac156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b1224640 1 -- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13df80 msgr2=0x7fa6ac15a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b1224640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13df80 0x7fa6ac15a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b1224640 1 -- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6ac13e360 msgr2=0x7fa6ac156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b1224640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6ac13e360 0x7fa6ac156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b1224640 1 -- 172.21.15.161:0/3318611614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a40094d0 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b1224640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac153170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009870 tx=0x7fa6a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4039c90 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a4039e10 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ac157820 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a4043640 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.356+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ac1536b0 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.357+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ac0675d0 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.358+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa6a40437a0 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.360+0000 7fa6a97fa640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa68c06b040 0x7fa68c06d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.360+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa6a403e070 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.360+0000 7fa6b0a23640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa68c06b040 0x7fa68c06d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:08.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.362+0000 7fa6b0a23640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa68c06b040 0x7fa68c06d500 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa694000f60 tx=0x7fa694009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:08.371 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.365+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa6a4077850 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.590+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6ac153900 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.591+0000 7fa6a97fa640 1 -- 172.21.15.161:0/3318611614 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fa6a407ae70 con 0x7fa6ac15f9c0 2023-11-24T08:03:08.592 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:08.593 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:08.593 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:08.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.593+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa68c06b040 msgr2=0x7fa68c06d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:08.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.593+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa68c06b040 0x7fa68c06d500 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa694000f60 tx=0x7fa694009040 comp rx=0 tx=0).stop 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 msgr2=0x7fa6ac153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac153170 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009870 tx=0x7fa6a4004730 comp rx=0 tx=0).stop 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 shutdown_connections 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa68c06b040 0x7fa68c06d500 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa6ac15f9c0 0x7fa6ac153170 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa6ac13e360 0x7fa6ac156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 --2- 172.21.15.161:0/3318611614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa6ac13df80 0x7fa6ac15a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 >> 172.21.15.161:0/3318611614 conn(0x7fa6ac06a800 msgr2=0x7fa6ac15beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 shutdown_connections 2023-11-24T08:03:08.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:08.594+0000 7fa6b2c87640 1 -- 172.21.15.161:0/3318611614 wait complete. 2023-11-24T08:03:08.613 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:08.853 INFO:teuthology.orchestra.run.smithi175.stdout:[] 2023-11-24T08:03:08.853 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T08:03:08.854 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol6802 2023-11-24T08:03:09.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.079+0000 7f16e34d0640 1 Processor -- start 2023-11-24T08:03:09.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.079+0000 7f16e34d0640 1 -- start start 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.080+0000 7f16e34d0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f16dc150760 0x7f16dc072230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.080+0000 7f16e34d0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f16dc0b32e0 0x7f16dc15d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.080+0000 7f16e34d0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc15dc80 con 0x7f16dc15d300 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.080+0000 7f16e34d0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0b3710 con 0x7f16dc0b32e0 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.080+0000 7f16e34d0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc071190 con 0x7f16dc150760 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f16dc0b32e0 0x7f16dc15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f16dc0b32e0 0x7f16dc15d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60468/0 (socket says 172.21.15.161:60468) 2023-11-24T08:03:09.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 -- 172.21.15.161:0/2984498162 learned_addr learned my addr 172.21.15.161:0/2984498162 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:09.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 -- 172.21.15.161:0/2984498162 >> v2:172.21.15.175:3300/0 conn(0x7f16dc150760 msgr2=0x7f16dc072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:09.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e126c640 1 --2- 172.21.15.161:0/2984498162 >> v2:172.21.15.175:3300/0 conn(0x7f16dc150760 0x7f16dc072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 --2- 172.21.15.161:0/2984498162 >> v2:172.21.15.175:3300/0 conn(0x7f16dc150760 0x7f16dc072230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 -- 172.21.15.161:0/2984498162 >> v1:172.21.15.175:6789/0 conn(0x7f16dc15d300 legacy=0x7f16dc0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:09.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.081+0000 7f16e1a6d640 1 -- 172.21.15.161:0/2984498162 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc071470 con 0x7f16dc0b32e0 2023-11-24T08:03:09.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.082+0000 7f16e1a6d640 1 --2- 172.21.15.161:0/2984498162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc15d740 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f16dc06e420 tx=0x7f16d402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffee791d02f5abc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:09.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.083+0000 7f16d3fff640 1 -- 172.21.15.161:0/2984498162 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d402ca80 con 0x7f16dc0b32e0 2023-11-24T08:03:09.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.083+0000 7f16d3fff640 1 -- 172.21.15.161:0/2984498162 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d402cbe0 con 0x7f16dc0b32e0 2023-11-24T08:03:09.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.083+0000 7f16d3fff640 1 -- 172.21.15.161:0/2984498162 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40343f0 con 0x7f16dc0b32e0 2023-11-24T08:03:09.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.083+0000 7f16e34d0640 1 -- 172.21.15.161:0/2984498162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 msgr2=0x7f16dc15d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.083+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2984498162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc15d740 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f16dc06e420 tx=0x7f16d402bee0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.084+0000 7f16e34d0640 1 -- 172.21.15.161:0/2984498162 shutdown_connections 2023-11-24T08:03:09.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.084+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2984498162 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc15d740 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.084+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2984498162 >> v2:172.21.15.175:3300/0 conn(0x7f16dc150760 0x7f16dc072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.084+0000 7f16e34d0640 1 -- 172.21.15.161:0/2984498162 >> 172.21.15.161:0/2984498162 conn(0x7f16dc06a800 msgr2=0x7f16dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:09.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.084+0000 7f16e34d0640 1 -- 172.21.15.161:0/2984498162 shutdown_connections 2023-11-24T08:03:09.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.084+0000 7f16e34d0640 1 -- 172.21.15.161:0/2984498162 wait complete. 2023-11-24T08:03:09.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.086+0000 7f16e34d0640 1 Processor -- start 2023-11-24T08:03:09.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.086+0000 7f16e34d0640 1 -- start start 2023-11-24T08:03:09.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e34d0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e34d0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16dc150760 0x7f16dc151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e34d0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc15d300 0x7f16dc152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e34d0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc14dc40 con 0x7f16dc0b32e0 2023-11-24T08:03:09.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e34d0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cc700 con 0x7f16dc15d300 2023-11-24T08:03:09.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e34d0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc151780 con 0x7f16dc150760 2023-11-24T08:03:09.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60480/0 (socket says 172.21.15.161:60480) 2023-11-24T08:03:09.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 -- 172.21.15.161:0/2194037893 learned_addr learned my addr 172.21.15.161:0/2194037893 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:09.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e1a6d640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc15d300 0x7f16dc152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 -- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16dc150760 msgr2=0x7f16dc151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16dc150760 0x7f16dc151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 -- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc15d300 msgr2=0x7f16dc152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc15d300 0x7f16dc152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.087+0000 7f16e126c640 1 -- 172.21.15.161:0/2194037893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4009b30 con 0x7f16dc0b32e0 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.088+0000 7f16e126c640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc0cc1c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f16d800c7f0 tx=0x7f16d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:09.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.088+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8004220 con 0x7f16dc0b32e0 2023-11-24T08:03:09.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.088+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d80043a0 con 0x7f16dc0b32e0 2023-11-24T08:03:09.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.088+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8007860 con 0x7f16dc0b32e0 2023-11-24T08:03:09.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.088+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc14d3a0 con 0x7f16dc0b32e0 2023-11-24T08:03:09.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.088+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc14d960 con 0x7f16dc0b32e0 2023-11-24T08:03:09.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.089+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc0675d0 con 0x7f16dc0b32e0 2023-11-24T08:03:09.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.090+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f16d8007bd0 con 0x7f16dc0b32e0 2023-11-24T08:03:09.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.091+0000 7f16d1ffb640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16c006aff0 0x7f16c006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.091+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f16d8089a50 con 0x7f16dc0b32e0 2023-11-24T08:03:09.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.092+0000 7f16e0a6b640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16c006aff0 0x7f16c006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.093+0000 7f16e0a6b640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16c006aff0 0x7f16c006d4b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0cc150 tx=0x7f16cc0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:09.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.095+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16d8054720 con 0x7f16dc0b32e0 2023-11-24T08:03:09.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.316+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol6802", "target": ["mon-mgr", ""]}) v1 -- 0x7f16dc071d10 con 0x7f16c006aff0 2023-11-24T08:03:09.446 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:03:09.326+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:03:09.446 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:03:09.326+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:03:09.446 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:03:09.326+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:03:09.446 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:03:09.326+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:03:09.447 INFO:tasks.ceph.mgr.x.smithi175.stderr:2023-11-24T08:03:09.326+0000 7f17d6013640 -1 client.0 error registering admin socket command: (17) File exists 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.397+0000 7f16d1ffb640 1 -- 172.21.15.161:0/2194037893 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f16cc003950 con 0x7f16c006aff0 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16c006aff0 msgr2=0x7f16c006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16c006aff0 0x7f16c006d4b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0cc150 tx=0x7f16cc0079b0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 msgr2=0x7f16dc0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc0cc1c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f16d800c7f0 tx=0x7f16d800ccb0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 shutdown_connections 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f16c006aff0 0x7f16c006d4b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f16dc15d300 0x7f16dc152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f16dc150760 0x7f16dc151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 --2- 172.21.15.161:0/2194037893 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16dc0b32e0 0x7f16dc0cc1c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 >> 172.21.15.161:0/2194037893 conn(0x7f16dc06a800 msgr2=0x7f16dc0cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:09.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 shutdown_connections 2023-11-24T08:03:09.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.400+0000 7f16e34d0640 1 -- 172.21.15.161:0/2194037893 wait complete. 2023-11-24T08:03:09.449 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:09.532 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:09.545 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:09.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.664+0000 7fccdd6ad640 1 Processor -- start 2023-11-24T08:03:09.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.665+0000 7fccdd6ad640 1 -- start start 2023-11-24T08:03:09.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.666+0000 7fccdd6ad640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fccd80cc990 0x7fccd806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.666+0000 7fccdd6ad640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd8070e50 con 0x7fccd80cc500 2023-11-24T08:03:09.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.666+0000 7fccdd6ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd8144020 con 0x7fccd8143c40 2023-11-24T08:03:09.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.666+0000 7fccdd6ad640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd80723c0 con 0x7fccd80cc990 2023-11-24T08:03:09.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.667+0000 7fccdceac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fccd80cc990 0x7fccd806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.667+0000 7fccdceac640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fccd80cc990 0x7fccd806d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60490/0 (socket says 172.21.15.161:60490) 2023-11-24T08:03:09.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.667+0000 7fccdceac640 1 -- 172.21.15.161:0/1587766099 learned_addr learned my addr 172.21.15.161:0/1587766099 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:09.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.667+0000 7fccdceac640 1 -- 172.21.15.161:0/1587766099 >> v1:172.21.15.175:6789/0 conn(0x7fccd8143c40 legacy=0x7fccd8071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:09.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.667+0000 7fccdceac640 1 -- 172.21.15.161:0/1587766099 >> v1:172.21.15.161:6789/0 conn(0x7fccd80cc500 legacy=0x7fccd806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.667+0000 7fccdceac640 1 -- 172.21.15.161:0/1587766099 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd8071e00 con 0x7fccd80cc990 2023-11-24T08:03:09.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.668+0000 7fccdceac640 1 --2- 172.21.15.161:0/1587766099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd806d870 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009e50 tx=0x7fccd002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e448f69156a497 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:09.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.668+0000 7fccd77fe640 1 -- 172.21.15.161:0/1587766099 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd002ca80 con 0x7fccd80cc990 2023-11-24T08:03:09.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccd77fe640 1 -- 172.21.15.161:0/1587766099 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd002cbe0 con 0x7fccd80cc990 2023-11-24T08:03:09.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccd77fe640 1 -- 172.21.15.161:0/1587766099 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd00343f0 con 0x7fccd80cc990 2023-11-24T08:03:09.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1587766099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 msgr2=0x7fccd806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1587766099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd806d870 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fccd0009e50 tx=0x7fccd002bee0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.679 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1587766099 shutdown_connections 2023-11-24T08:03:09.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1587766099 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd806d870 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1587766099 >> 172.21.15.161:0/1587766099 conn(0x7fccd806a800 msgr2=0x7fccd806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:09.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1587766099 shutdown_connections 2023-11-24T08:03:09.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.669+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1587766099 wait complete. 2023-11-24T08:03:09.680 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.671+0000 7fccdd6ad640 1 Processor -- start 2023-11-24T08:03:09.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.672+0000 7fccdd6ad640 1 -- start start 2023-11-24T08:03:09.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccdd6ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd80cc500 0x7fccd815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccdd6ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd80c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.681 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccdd6ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd8143c40 0x7fccd813e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccdd6ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c4ec0 con 0x7fccd80cc990 2023-11-24T08:03:09.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccdd6ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c5820 con 0x7fccd8143c40 2023-11-24T08:03:09.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccdd6ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80c4240 con 0x7fccd80cc500 2023-11-24T08:03:09.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fcccffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd80c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fcccffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd80c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60498/0 (socket says 172.21.15.161:60498) 2023-11-24T08:03:09.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fcccffff640 1 -- 172.21.15.161:0/1059971052 learned_addr learned my addr 172.21.15.161:0/1059971052 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:09.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fccd7fff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd80cc500 0x7fccd815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.673+0000 7fcccffff640 1 -- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd80cc500 msgr2=0x7fccd815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccdceac640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd8143c40 0x7fccd813e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fcccffff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd80cc500 0x7fccd815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fcccffff640 1 -- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd8143c40 msgr2=0x7fccd813e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fcccffff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd8143c40 0x7fccd813e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fcccffff640 1 -- 172.21.15.161:0/1059971052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd0009b30 con 0x7fccd80cc990 2023-11-24T08:03:09.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccd7fff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd80cc500 0x7fccd815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:09.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccdceac640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd8143c40 0x7fccd813e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:09.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fcccffff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd80c52e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c400 tx=0x7fccc000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:09.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00052d0 con 0x7fccd80cc990 2023-11-24T08:03:09.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc0005430 con 0x7fccd80cc990 2023-11-24T08:03:09.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0003830 con 0x7fccd80cc990 2023-11-24T08:03:09.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd80c4520 con 0x7fccd80cc990 2023-11-24T08:03:09.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.674+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd80c4ae0 con 0x7fccd80cc990 2023-11-24T08:03:09.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.676+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80c5000 con 0x7fccd80cc990 2023-11-24T08:03:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.677+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fccc0003990 con 0x7fccd80cc990 2023-11-24T08:03:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.677+0000 7fccd57fa640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fccb806aff0 0x7fccb806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.678+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fccc0088e60 con 0x7fccd80cc990 2023-11-24T08:03:09.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.678+0000 7fccd7fff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fccb806aff0 0x7fccb806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.679+0000 7fccd7fff640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fccb806aff0 0x7fccb806d4b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fccc8003eb0 tx=0x7fccc8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:09.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.684+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fccd80c5000 con 0x7fccd80cc990 2023-11-24T08:03:09.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.915+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccd80c5000 con 0x7fccd80cc990 2023-11-24T08:03:09.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.916+0000 7fccd57fa640 1 -- 172.21.15.161:0/1059971052 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fccd80c5000 con 0x7fccd80cc990 2023-11-24T08:03:09.917 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:09.918 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:09.918 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fccb806aff0 msgr2=0x7fccb806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.919 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fccb806aff0 0x7fccb806d4b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fccc8003eb0 tx=0x7fccc8009040 comp rx=0 tx=0).stop 2023-11-24T08:03:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 msgr2=0x7fccd80c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd80c52e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fccc000c400 tx=0x7fccc000c8c0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 shutdown_connections 2023-11-24T08:03:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fccb806aff0 0x7fccb806d4b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fccd8143c40 0x7fccd813e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fccd80cc990 0x7fccd80c52e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 --2- 172.21.15.161:0/1059971052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fccd80cc500 0x7fccd815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 >> 172.21.15.161:0/1059971052 conn(0x7fccd806a800 msgr2=0x7fccd806abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 shutdown_connections 2023-11-24T08:03:09.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:09.918+0000 7fccdd6ad640 1 -- 172.21.15.161:0/1059971052 wait complete. 2023-11-24T08:03:09.940 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:10.181 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":0.83198713999999996,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.958919254079117,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:10.182 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.958919254079117 }, "state": "open", "uptime": 0.83198714 } ] 2023-11-24T08:03:10.182 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.407+0000 7ff13e861640 1 Processor -- start 2023-11-24T08:03:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.407+0000 7ff13e861640 1 -- start start 2023-11-24T08:03:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff13e861640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff138164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff13e861640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1380b1ee0 con 0x7ff1380cf9a0 2023-11-24T08:03:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff13e861640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1380b2780 con 0x7ff138143ae0 2023-11-24T08:03:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff13e861640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13815e990 con 0x7ff13815e3b0 2023-11-24T08:03:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff1377fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff1380cf9a0 0x7ff13815dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:56544/0 (socket says 172.21.15.161:56544) 2023-11-24T08:03:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff1377fe640 1 -- 172.21.15.161:0/3714455807 learned_addr learned my addr 172.21.15.161:0/3714455807 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670243678 0 0) 0x7ff1380b1ee0 con 0x7ff1380cf9a0 2023-11-24T08:03:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff120005730 con 0x7ff1380cf9a0 2023-11-24T08:03:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.409+0000 7ff13cdfe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff138164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539022678 0 0) 0x7ff120005730 con 0x7ff1380cf9a0 2023-11-24T08:03:10.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 msgr2=0x7ff138164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:10.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff138164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 >> v1:172.21.15.175:6789/0 conn(0x7ff138143ae0 legacy=0x7ff1380cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380b2130 con 0x7ff1380cf9a0 2023-11-24T08:03:10.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7ff12c001670 con 0x7ff1380cf9a0 2023-11-24T08:03:10.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 >> v1:172.21.15.161:6789/0 conn(0x7ff1380cf9a0 legacy=0x7ff13815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff120005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.415 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1200061e0 0x7ff1200069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff120006f10 0x7ff120007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13815e990 con 0x7ff1200061e0 2023-11-24T08:03:10.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12000dd50 con 0x7ff120006f10 2023-11-24T08:03:10.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12000df10 con 0x7ff13815e3b0 2023-11-24T08:03:10.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.410+0000 7ff1377fe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1200061e0 0x7ff1200069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff1377fe640 1 -- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 msgr2=0x7ff120005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:10.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff13cdfe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff120006f10 0x7ff120007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff137fff640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff120005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff1377fe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff120005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff1377fe640 1 -- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff120006f10 msgr2=0x7ff120007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:10.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff1377fe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff120006f10 0x7ff120007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff1377fe640 1 -- 172.21.15.161:0/3714455807 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff120005730 con 0x7ff1200061e0 2023-11-24T08:03:10.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff13cdfe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff120006f10 0x7ff120007390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:10.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.411+0000 7ff137fff640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff13815e3b0 0x7ff120005bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:10.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff1377fe640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1200061e0 0x7ff1200069d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c190 tx=0x7ff120007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3c98de15c0890f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:10.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c005ad0 con 0x7ff1200061e0 2023-11-24T08:03:10.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c005c30 con 0x7ff1200061e0 2023-11-24T08:03:10.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff136ffd640 1 -- 172.21.15.161:0/3714455807 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c02caf0 con 0x7ff1200061e0 2023-11-24T08:03:10.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff13e861640 1 -- 172.21.15.161:0/3714455807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1200061e0 msgr2=0x7ff1200069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff13e861640 1 --2- 172.21.15.161:0/3714455807 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff1200061e0 0x7ff1200069d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00c190 tx=0x7ff120007a00 comp rx=0 tx=0).stop 2023-11-24T08:03:10.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.412+0000 7ff13cdfe640 1 -- 172.21.15.161:0/3714455807 reap_dead start 2023-11-24T08:03:10.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.413+0000 7ff13e861640 1 -- 172.21.15.161:0/3714455807 shutdown_connections 2023-11-24T08:03:10.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.413+0000 7ff13e861640 1 -- 172.21.15.161:0/3714455807 >> 172.21.15.161:0/3714455807 conn(0x7ff13806a800 msgr2=0x7ff13806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:10.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.413+0000 7ff13e861640 1 -- 172.21.15.161:0/3714455807 shutdown_connections 2023-11-24T08:03:10.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.413+0000 7ff13e861640 1 -- 172.21.15.161:0/3714455807 wait complete. 2023-11-24T08:03:10.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.414+0000 7ff13e861640 1 Processor -- start 2023-11-24T08:03:10.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.414+0000 7ff13e861640 1 -- start start 2023-11-24T08:03:10.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.415+0000 7ff13e861640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1200061e0 0x7ff1381f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.415+0000 7ff13e861640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 0x7ff13813d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.415+0000 7ff13e861640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff138137730 0x7ff1380cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.415+0000 7ff13e861640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381f2720 con 0x7ff13813a0c0 2023-11-24T08:03:10.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.415+0000 7ff13e861640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13815a240 con 0x7ff138137730 2023-11-24T08:03:10.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.415+0000 7ff13e861640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1381f20d0 con 0x7ff1200061e0 2023-11-24T08:03:10.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 0x7ff13813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 0x7ff13813d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:60514/0 (socket says 172.21.15.161:60514) 2023-11-24T08:03:10.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 -- 172.21.15.161:0/1203946316 learned_addr learned my addr 172.21.15.161:0/1203946316 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:10.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 -- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1200061e0 msgr2=0x7ff1381f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff137fff640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1200061e0 0x7ff1381f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff13cdfe640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff138137730 0x7ff1380cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1200061e0 0x7ff1381f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 -- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff138137730 msgr2=0x7ff1380cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff138137730 0x7ff1380cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 -- 172.21.15.161:0/1203946316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13813a630 con 0x7ff13813a0c0 2023-11-24T08:03:10.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.416+0000 7ff1377fe640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 0x7ff13813d510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff12c02c450 tx=0x7ff1380b26f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:10.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.417+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c039070 con 0x7ff13813a0c0 2023-11-24T08:03:10.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.417+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c02ccc0 con 0x7ff13813a0c0 2023-11-24T08:03:10.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.417+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c03c040 con 0x7ff13813a0c0 2023-11-24T08:03:10.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.417+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1381f2340 con 0x7ff13813a0c0 2023-11-24T08:03:10.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.417+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff138137bb0 con 0x7ff13813a0c0 2023-11-24T08:03:10.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.418+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1381f2860 con 0x7ff13813a0c0 2023-11-24T08:03:10.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.419+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 7) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff12c032070 con 0x7ff13813a0c0 2023-11-24T08:03:10.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.420+0000 7ff134ff9640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff12406aff0 0x7ff12406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:10.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.421+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff12c0aacd0 con 0x7ff13813a0c0 2023-11-24T08:03:10.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.421+0000 7ff137fff640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff12406aff0 0x7ff12406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:10.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.422+0000 7ff137fff640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff12406aff0 0x7ff12406d4b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff128001630 tx=0x7ff128009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:10.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.425+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1381f2860 con 0x7ff13813a0c0 2023-11-24T08:03:10.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.660+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1381f2860 con 0x7ff13813a0c0 2023-11-24T08:03:10.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.665+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7ff12c007ce0 con 0x7ff13813a0c0 2023-11-24T08:03:10.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.666+0000 7ff134ff9640 1 -- 172.21.15.161:0/1203946316 <== mon.0 v2:172.21.15.161:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7ff12c071ba0 con 0x7ff13813a0c0 2023-11-24T08:03:10.668 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:10.669 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:10.669 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:10.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff12406aff0 msgr2=0x7ff12406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff12406aff0 0x7ff12406d4b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff128001630 tx=0x7ff128009040 comp rx=0 tx=0).stop 2023-11-24T08:03:10.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 msgr2=0x7ff13813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:10.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 0x7ff13813d510 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff12c02c450 tx=0x7ff1380b26f0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 shutdown_connections 2023-11-24T08:03:10.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff12406aff0 0x7ff12406d4b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff138137730 0x7ff1380cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff13813a0c0 0x7ff13813d510 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 --2- 172.21.15.161:0/1203946316 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1200061e0 0x7ff1381f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:10.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.669+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 >> 172.21.15.161:0/1203946316 conn(0x7ff13806a800 msgr2=0x7ff13815bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:10.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.670+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 shutdown_connections 2023-11-24T08:03:10.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:10.670+0000 7ff13e861640 1 -- 172.21.15.161:0/1203946316 wait complete. 2023-11-24T08:03:10.690 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:10.926 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":1.576975625,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.921154121938358,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:10.926 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.921154121938358 }, "state": "open", "uptime": 1.576975625 } ] 2023-11-24T08:03:10.926 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:15.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:16.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.149+0000 7fcd663fa640 1 Processor -- start 2023-11-24T08:03:16.150 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.149+0000 7fcd663fa640 1 -- start start 2023-11-24T08:03:16.151 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.150+0000 7fcd663fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcd600cc500 0x7fcd600cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.150+0000 7fcd663fa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd60070e50 con 0x7fcd60143c40 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.150+0000 7fcd663fa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd60144020 con 0x7fcd6006d160 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.150+0000 7fcd663fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd600723c0 con 0x7fcd600cc500 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.151+0000 7fcd653f8640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcd60143c40 0x7fcd60071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:36542/0 (socket says 172.21.15.161:36542) 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.151+0000 7fcd653f8640 1 -- 172.21.15.161:0/1724110142 learned_addr learned my addr 172.21.15.161:0/1724110142 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.151+0000 7fcd64bf7640 1 --2- 172.21.15.161:0/1724110142 >> v2:172.21.15.161:3300/0 conn(0x7fcd600cc500 0x7fcd600cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:16.152 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.151+0000 7fcd64bf7640 1 -- 172.21.15.161:0/1724110142 >> v1:172.21.15.175:6789/0 conn(0x7fcd6006d160 legacy=0x7fcd6006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:16.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.151+0000 7fcd64bf7640 1 -- 172.21.15.161:0/1724110142 >> v1:172.21.15.161:6789/0 conn(0x7fcd60143c40 legacy=0x7fcd60071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:16.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.151+0000 7fcd64bf7640 1 -- 172.21.15.161:0/1724110142 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd60071e00 con 0x7fcd600cc500 2023-11-24T08:03:16.153 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.152+0000 7fcd64bf7640 1 --2- 172.21.15.161:0/1724110142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd600cc500 0x7fcd600cc990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcd500097a0 tx=0x7fcd5002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b5cd6496aa87d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:16.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd57fff640 1 -- 172.21.15.161:0/1724110142 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5002e070 con 0x7fcd600cc500 2023-11-24T08:03:16.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd57fff640 1 -- 172.21.15.161:0/1724110142 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd500315a0 con 0x7fcd600cc500 2023-11-24T08:03:16.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd57fff640 1 -- 172.21.15.161:0/1724110142 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50031930 con 0x7fcd600cc500 2023-11-24T08:03:16.154 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 -- 172.21.15.161:0/1724110142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd600cc500 msgr2=0x7fcd600cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:16.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 --2- 172.21.15.161:0/1724110142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd600cc500 0x7fcd600cc990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fcd500097a0 tx=0x7fcd5002b840 comp rx=0 tx=0).stop 2023-11-24T08:03:16.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 -- 172.21.15.161:0/1724110142 shutdown_connections 2023-11-24T08:03:16.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 --2- 172.21.15.161:0/1724110142 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd600cc500 0x7fcd600cc990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 -- 172.21.15.161:0/1724110142 >> 172.21.15.161:0/1724110142 conn(0x7fcd6006a800 msgr2=0x7fcd6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:16.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 -- 172.21.15.161:0/1724110142 shutdown_connections 2023-11-24T08:03:16.155 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.153+0000 7fcd663fa640 1 -- 172.21.15.161:0/1724110142 wait complete. 2023-11-24T08:03:16.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.155+0000 7fcd663fa640 1 Processor -- start 2023-11-24T08:03:16.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.155+0000 7fcd663fa640 1 -- start start 2023-11-24T08:03:16.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd663fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 0x7fcd601f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:16.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd663fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd600cc500 0x7fcd601f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:16.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd663fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd60143c40 0x7fcd60139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:16.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd663fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6013b570 con 0x7fcd6006d160 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd663fa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6013d6b0 con 0x7fcd600cc500 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd663fa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6013acd0 con 0x7fcd60143c40 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd653f8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 0x7fcd601f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd653f8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 0x7fcd601f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:33660/0 (socket says 172.21.15.161:33660) 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.156+0000 7fcd653f8640 1 -- 172.21.15.161:0/121112139 learned_addr learned my addr 172.21.15.161:0/121112139 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd64bf7640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd600cc500 0x7fcd601f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd653f8640 1 -- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd60143c40 msgr2=0x7fcd60139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd653f8640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd60143c40 0x7fcd60139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd653f8640 1 -- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd600cc500 msgr2=0x7fcd601f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd653f8640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd600cc500 0x7fcd601f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.159 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd653f8640 1 -- 172.21.15.161:0/121112139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009400 con 0x7fcd6006d160 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd653f8640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 0x7fcd601f61f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00c4d0 tx=0x7fcd5c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c005ce0 con 0x7fcd6006d160 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5c005e40 con 0x7fcd6006d160 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c007270 con 0x7fcd6006d160 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6013afb0 con 0x7fcd6006d160 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.157+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd60141360 con 0x7fcd6006d160 2023-11-24T08:03:16.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.159+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd60067450 con 0x7fcd6006d160 2023-11-24T08:03:16.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.160+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fcd5c0073d0 con 0x7fcd6006d160 2023-11-24T08:03:16.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.160+0000 7fcd55ffb640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd4406b080 0x7fcd4406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:16.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.161+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcd5c088f30 con 0x7fcd6006d160 2023-11-24T08:03:16.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.161+0000 7fcd64bf7640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd4406b080 0x7fcd4406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:16.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.162+0000 7fcd64bf7640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd4406b080 0x7fcd4406d540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcd50036000 tx=0x7fcd5003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:16.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.165+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd5c053ce0 con 0x7fcd6006d160 2023-11-24T08:03:16.393 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.392+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd600ceb30 con 0x7fcd6006d160 2023-11-24T08:03:16.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.393+0000 7fcd55ffb640 1 -- 172.21.15.161:0/121112139 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fcd5c017020 con 0x7fcd6006d160 2023-11-24T08:03:16.395 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:16.395 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:16.395 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:16.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd4406b080 msgr2=0x7fcd4406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:16.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd4406b080 0x7fcd4406d540 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcd50036000 tx=0x7fcd5003d040 comp rx=0 tx=0).stop 2023-11-24T08:03:16.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 msgr2=0x7fcd601f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:16.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 0x7fcd601f61f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00c4d0 tx=0x7fcd5c00c990 comp rx=0 tx=0).stop 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 shutdown_connections 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcd4406b080 0x7fcd4406d540 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcd60143c40 0x7fcd60139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcd600cc500 0x7fcd601f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 --2- 172.21.15.161:0/121112139 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd6006d160 0x7fcd601f61f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 >> 172.21.15.161:0/121112139 conn(0x7fcd6006a800 msgr2=0x7fcd60144230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 shutdown_connections 2023-11-24T08:03:16.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:16.396+0000 7fcd663fa640 1 -- 172.21.15.161:0/121112139 wait complete. 2023-11-24T08:03:16.417 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:16.654 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":7.3058870760000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.632904589440091,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:16.654 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.63290458944009 }, "state": "open", "uptime": 7.305887076 } ] 2023-11-24T08:03:16.654 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:21.655 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:21.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.878+0000 7fc063a90640 1 Processor -- start 2023-11-24T08:03:21.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.879+0000 7fc063a90640 1 -- start start 2023-11-24T08:03:21.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.880+0000 7fc063a90640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc05c0b3ae0 0x7fc05c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.880+0000 7fc063a90640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc05c0cf290 0x7fc05c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.880+0000 7fc063a90640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c070c40 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.880+0000 7fc063a90640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c071450 con 0x7fc05c0cf290 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.880+0000 7fc063a90640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c0cfc60 con 0x7fc05c0b3ae0 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc05c0cf290 0x7fc05c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc05c0cf290 0x7fc05c0cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59362/0 (socket says 172.21.15.161:59362) 2023-11-24T08:03:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 -- 172.21.15.161:0/2881241318 learned_addr learned my addr 172.21.15.161:0/2881241318 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 -- 172.21.15.161:0/2881241318 >> v2:172.21.15.175:3300/0 conn(0x7fc05c0b3ae0 msgr2=0x7fc05c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06102b640 1 --2- 172.21.15.161:0/2881241318 >> v2:172.21.15.175:3300/0 conn(0x7fc05c0b3ae0 0x7fc05c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 --2- 172.21.15.161:0/2881241318 >> v2:172.21.15.175:3300/0 conn(0x7fc05c0b3ae0 0x7fc05c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 -- 172.21.15.161:0/2881241318 >> v1:172.21.15.175:6789/0 conn(0x7fc05c0ae5a0 legacy=0x7fc05c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06202d640 1 -- 172.21.15.161:0/2881241318 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c06c470 con 0x7fc05c0cf290 2023-11-24T08:03:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.881+0000 7fc06102b640 1 --2- 172.21.15.161:0/2881241318 >> v2:172.21.15.175:3300/0 conn(0x7fc05c0b3ae0 0x7fc05c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.882+0000 7fc06202d640 1 --2- 172.21.15.161:0/2881241318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0cf290 0x7fc05c0cf720 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0cfea0 tx=0x7fc05402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba28441bea80d03c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc06082a640 1 -- 172.21.15.161:0/2881241318 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05402cb10 con 0x7fc05c0cf290 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc06082a640 1 -- 172.21.15.161:0/2881241318 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05402cc70 con 0x7fc05c0cf290 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc06082a640 1 -- 172.21.15.161:0/2881241318 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540343f0 con 0x7fc05c0cf290 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 -- 172.21.15.161:0/2881241318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0cf290 msgr2=0x7fc05c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 --2- 172.21.15.161:0/2881241318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0cf290 0x7fc05c0cf720 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0cfea0 tx=0x7fc05402bf70 comp rx=0 tx=0).stop 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 -- 172.21.15.161:0/2881241318 shutdown_connections 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 --2- 172.21.15.161:0/2881241318 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0cf290 0x7fc05c0cf720 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 --2- 172.21.15.161:0/2881241318 >> v2:172.21.15.175:3300/0 conn(0x7fc05c0b3ae0 0x7fc05c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 -- 172.21.15.161:0/2881241318 >> 172.21.15.161:0/2881241318 conn(0x7fc05c06a800 msgr2=0x7fc05c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 -- 172.21.15.161:0/2881241318 shutdown_connections 2023-11-24T08:03:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.883+0000 7fc063a90640 1 -- 172.21.15.161:0/2881241318 wait complete. 2023-11-24T08:03:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.885+0000 7fc063a90640 1 Processor -- start 2023-11-24T08:03:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.885+0000 7fc063a90640 1 -- start start 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.886+0000 7fc063a90640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 0x7fc05c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.886+0000 7fc063a90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc05c0b3ae0 0x7fc05c14d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.886+0000 7fc063a90640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0cf290 0x7fc05c14db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.886+0000 7fc063a90640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c14e130 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.886+0000 7fc063a90640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c14e410 con 0x7fc05c0cf290 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.886+0000 7fc063a90640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c14e6f0 con 0x7fc05c0b3ae0 2023-11-24T08:03:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 0x7fc05c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 0x7fc05c14f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59372/0 (socket says 172.21.15.161:59372) 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 -- 172.21.15.161:0/522102418 learned_addr learned my addr 172.21.15.161:0/522102418 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06202d640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0cf290 0x7fc05c14db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 -- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc05c0b3ae0 msgr2=0x7fc05c14d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc05c0b3ae0 0x7fc05c14d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 -- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0cf290 msgr2=0x7fc05c14db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0cf290 0x7fc05c14db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:21.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 -- 172.21.15.161:0/522102418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009b30 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.887+0000 7fc06182c640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 0x7fc05c14f1d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c410 tx=0x7fc05800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.888+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580035f0 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.888+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc058003750 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.888+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058003b40 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.888+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c14e9d0 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.888+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c15d360 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.889+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c14eef0 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.890+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fc058003ca0 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.891+0000 7fc0527fc640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc04006b080 0x7fc04006d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.891+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc058088c00 con 0x7fc05c0ae5a0 2023-11-24T08:03:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.891+0000 7fc06102b640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc04006b080 0x7fc04006d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.892+0000 7fc06102b640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc04006b080 0x7fc04006d540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc04c006fd0 tx=0x7fc04c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:21.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:21.895+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc05c14eef0 con 0x7fc05c0ae5a0 2023-11-24T08:03:22.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.126+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc05c14eef0 con 0x7fc05c0ae5a0 2023-11-24T08:03:22.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.127+0000 7fc0527fc640 1 -- 172.21.15.161:0/522102418 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fc05c14eef0 con 0x7fc05c0ae5a0 2023-11-24T08:03:22.129 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:22.129 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:22.130 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:22.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.129+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc04006b080 msgr2=0x7fc04006d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:22.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc04006b080 0x7fc04006d540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc04c006fd0 tx=0x7fc04c008040 comp rx=0 tx=0).stop 2023-11-24T08:03:22.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 msgr2=0x7fc05c14f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:22.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 0x7fc05c14f1d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c410 tx=0x7fc05800c8d0 comp rx=0 tx=0).stop 2023-11-24T08:03:22.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 shutdown_connections 2023-11-24T08:03:22.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc04006b080 0x7fc04006d540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:22.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0cf290 0x7fc05c14db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:22.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc05c0b3ae0 0x7fc05c14d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:22.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 --2- 172.21.15.161:0/522102418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc05c0ae5a0 0x7fc05c14f1d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:22.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 >> 172.21.15.161:0/522102418 conn(0x7fc05c06a800 msgr2=0x7fc05c1618d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:22.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 shutdown_connections 2023-11-24T08:03:22.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:22.130+0000 7fc063a90640 1 -- 172.21.15.161:0/522102418 wait complete. 2023-11-24T08:03:22.152 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:22.395 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":13.046798337,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.34785347187,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:22.396 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.34785347187 }, "state": "open", "uptime": 13.046798337 } ] 2023-11-24T08:03:22.396 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:27.398 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:27.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.612+0000 7f18f9d78640 1 Processor -- start 2023-11-24T08:03:27.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.612+0000 7f18f9d78640 1 -- start start 2023-11-24T08:03:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f9d78640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413e360 0x7f18f40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f9d78640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18f415f9c0 0x7f18f40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f9d78640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f415c5f0 con 0x7f18f413df80 2023-11-24T08:03:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f9d78640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f406c470 con 0x7f18f415f9c0 2023-11-24T08:03:27.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f9d78640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f406c750 con 0x7f18f413e360 2023-11-24T08:03:27.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18f415f9c0 0x7f18f40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:27.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f18f415f9c0 0x7f18f40cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59386/0 (socket says 172.21.15.161:59386) 2023-11-24T08:03:27.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.614+0000 7f18f3fff640 1 -- 172.21.15.161:0/3853007565 learned_addr learned my addr 172.21.15.161:0/3853007565 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:27.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.615+0000 7f18ebfff640 1 --2- 172.21.15.161:0/3853007565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413e360 0x7f18f40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:27.619 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.615+0000 7f18f3fff640 1 -- 172.21.15.161:0/3853007565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413e360 msgr2=0x7f18f40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:27.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.615+0000 7f18f3fff640 1 --2- 172.21.15.161:0/3853007565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413e360 0x7f18f40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.615+0000 7f18f3fff640 1 -- 172.21.15.161:0/3853007565 >> v1:172.21.15.175:6789/0 conn(0x7f18f413df80 legacy=0x7f18f415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:27.620 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.615+0000 7f18f3fff640 1 -- 172.21.15.161:0/3853007565 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f406ca30 con 0x7f18f415f9c0 2023-11-24T08:03:27.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.616+0000 7f18f3fff640 1 --2- 172.21.15.161:0/3853007565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f40cf7d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009e50 tx=0x7f18ec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d30aee31992c0ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:27.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.616+0000 7f18f2ffd640 1 -- 172.21.15.161:0/3853007565 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec02ca70 con 0x7f18f415f9c0 2023-11-24T08:03:27.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.616+0000 7f18f2ffd640 1 -- 172.21.15.161:0/3853007565 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec02cbd0 con 0x7f18f415f9c0 2023-11-24T08:03:27.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.616+0000 7f18f2ffd640 1 -- 172.21.15.161:0/3853007565 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0343f0 con 0x7f18f415f9c0 2023-11-24T08:03:27.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 -- 172.21.15.161:0/3853007565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 msgr2=0x7f18f40cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:27.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 --2- 172.21.15.161:0/3853007565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f40cf7d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009e50 tx=0x7f18ec02bed0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 -- 172.21.15.161:0/3853007565 shutdown_connections 2023-11-24T08:03:27.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 --2- 172.21.15.161:0/3853007565 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f40cf7d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 --2- 172.21.15.161:0/3853007565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413e360 0x7f18f40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 -- 172.21.15.161:0/3853007565 >> 172.21.15.161:0/3853007565 conn(0x7f18f406a800 msgr2=0x7f18f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:27.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 -- 172.21.15.161:0/3853007565 shutdown_connections 2023-11-24T08:03:27.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.617+0000 7f18f9d78640 1 -- 172.21.15.161:0/3853007565 wait complete. 2023-11-24T08:03:27.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.619+0000 7f18f9d78640 1 Processor -- start 2023-11-24T08:03:27.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.619+0000 7f18f9d78640 1 -- start start 2023-11-24T08:03:27.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f9d78640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413df80 0x7f18f414d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:27.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f9d78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f413e360 0x7f18f413d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:27.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f9d78640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:27.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f9d78640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40703e0 con 0x7f18f415f9c0 2023-11-24T08:03:27.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f9d78640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f414dcb0 con 0x7f18f413e360 2023-11-24T08:03:27.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f9d78640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40705f0 con 0x7f18f413df80 2023-11-24T08:03:27.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:27.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f415a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:59394/0 (socket says 172.21.15.161:59394) 2023-11-24T08:03:27.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f3fff640 1 -- 172.21.15.161:0/654788091 learned_addr learned my addr 172.21.15.161:0/654788091 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:27.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18ebfff640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f413e360 0x7f18f413d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:27.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.620+0000 7f18f37fe640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413df80 0x7f18f414d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:27.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f3fff640 1 -- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413df80 msgr2=0x7f18f414d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:27.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f3fff640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413df80 0x7f18f414d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f3fff640 1 -- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f413e360 msgr2=0x7f18f413d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:27.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f3fff640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f413e360 0x7f18f413d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f3fff640 1 -- 172.21.15.161:0/654788091 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec009b30 con 0x7f18f415f9c0 2023-11-24T08:03:27.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18ebfff640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f413e360 0x7f18f413d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:27.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f3fff640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f415a140 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f18ec036040 tx=0x7f18ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:27.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec009510 con 0x7f18f415f9c0 2023-11-24T08:03:27.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec03e450 con 0x7f18f415f9c0 2023-11-24T08:03:27.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec03e7e0 con 0x7f18f415f9c0 2023-11-24T08:03:27.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f40708d0 con 0x7f18f415f9c0 2023-11-24T08:03:27.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.621+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f414d8e0 con 0x7f18f415f9c0 2023-11-24T08:03:27.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.622+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f414da70 con 0x7f18f415f9c0 2023-11-24T08:03:27.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.623+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f18ec03e940 con 0x7f18f415f9c0 2023-11-24T08:03:27.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.624+0000 7f18f0ff9640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18d406b080 0x7f18d406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:27.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.624+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f18ec0ac900 con 0x7f18f415f9c0 2023-11-24T08:03:27.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.625+0000 7f18f37fe640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18d406b080 0x7f18d406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:27.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.626+0000 7f18f37fe640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18d406b080 0x7f18d406d540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f18e400a750 tx=0x7f18e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:27.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.629+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18f414da70 con 0x7f18f415f9c0 2023-11-24T08:03:27.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.855+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18f414da70 con 0x7f18f415f9c0 2023-11-24T08:03:27.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.856+0000 7f18f0ff9640 1 -- 172.21.15.161:0/654788091 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f18f414da70 con 0x7f18f415f9c0 2023-11-24T08:03:27.858 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:27.858 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:27.859 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.858+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18d406b080 msgr2=0x7f18d406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.858+0000 7f18f9d78640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18d406b080 0x7f18d406d540 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f18e400a750 tx=0x7f18e4008040 comp rx=0 tx=0).stop 2023-11-24T08:03:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.858+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 msgr2=0x7f18f415a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:27.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.858+0000 7f18f9d78640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f415a140 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f18ec036040 tx=0x7f18ec004a40 comp rx=0 tx=0).stop 2023-11-24T08:03:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.858+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 shutdown_connections 2023-11-24T08:03:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.858+0000 7f18f9d78640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f18d406b080 0x7f18d406d540 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.859+0000 7f18f9d78640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18f415f9c0 0x7f18f415a140 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.859+0000 7f18f9d78640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18f413e360 0x7f18f413d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.859+0000 7f18f9d78640 1 --2- 172.21.15.161:0/654788091 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18f413df80 0x7f18f414d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.859+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 >> 172.21.15.161:0/654788091 conn(0x7f18f406a800 msgr2=0x7f18f40cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.859+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 shutdown_connections 2023-11-24T08:03:27.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:27.859+0000 7f18f9d78640 1 -- 172.21.15.161:0/654788091 wait complete. 2023-11-24T08:03:27.880 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:28.114 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":18.765709938000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.067629238754272,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:28.115 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.06762923875427 }, "state": "open", "uptime": 18.765709938 } ] 2023-11-24T08:03:28.115 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:33.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:33.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.336+0000 7fc08c0f3640 1 Processor -- start 2023-11-24T08:03:33.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.336+0000 7fc08c0f3640 1 -- start start 2023-11-24T08:03:33.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.337+0000 7fc08c0f3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc08413df80 0x7fc08415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.337+0000 7fc08c0f3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc0840cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.337+0000 7fc08c0f3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08406c470 con 0x7fc08415f9c0 2023-11-24T08:03:33.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.337+0000 7fc08c0f3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08406c750 con 0x7fc08413df80 2023-11-24T08:03:33.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.337+0000 7fc08c0f3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08406ca30 con 0x7fc08413e360 2023-11-24T08:03:33.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc08a690640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc08415f9c0 0x7fc0841408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38244/0 (socket says 172.21.15.161:38244) 2023-11-24T08:03:33.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc08a690640 1 -- 172.21.15.161:0/549988439 learned_addr learned my addr 172.21.15.161:0/549988439 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc089e8f640 1 --2- 172.21.15.161:0/549988439 >> v2:172.21.15.175:3300/0 conn(0x7fc08413df80 0x7fc08415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446871235 0 0) 0x7fc08406c470 con 0x7fc08415f9c0 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc08968e640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc0840cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc070003520 con 0x7fc08415f9c0 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1422529990 0 0) 0x7fc070003520 con 0x7fc08415f9c0 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 msgr2=0x7fc0840cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.338+0000 7fc088e8d640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc0840cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 >> v2:172.21.15.175:3300/0 conn(0x7fc08413df80 msgr2=0x7fc08415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:33.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 --2- 172.21.15.161:0/549988439 >> v2:172.21.15.175:3300/0 conn(0x7fc08413df80 0x7fc08415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08406cd10 con 0x7fc08415f9c0 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc07c0019f0 con 0x7fc08415f9c0 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 >> v1:172.21.15.161:6789/0 conn(0x7fc08415f9c0 legacy=0x7fc0841408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc070003970 0x7fc070003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0700047c0 0x7fc070004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08406c750 con 0x7fc0700047c0 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08406ca30 con 0x7fc070003970 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07000bab0 con 0x7fc08413e360 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc089e8f640 1 --2- 172.21.15.161:0/549988439 >> v2:172.21.15.175:3300/0 conn(0x7fc08413df80 0x7fc08415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08968e640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0700047c0 0x7fc070004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08968e640 1 -- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 msgr2=0x7fc070005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08a690640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc089e8f640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc070003970 0x7fc070003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08968e640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc070005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08968e640 1 -- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc070003970 msgr2=0x7fc070003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08968e640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc070003970 0x7fc070003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08968e640 1 -- 172.21.15.161:0/549988439 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070003520 con 0x7fc0700047c0 2023-11-24T08:03:33.344 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.339+0000 7fc08a690640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc08413e360 0x7fc070005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:33.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.340+0000 7fc08968e640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0700047c0 0x7fc070004c40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc07400ba00 tx=0x7fc0700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab970b59e4a20dd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:33.345 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074033680 con 0x7fc0700047c0 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0740337e0 con 0x7fc0700047c0 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc088e8d640 1 -- 172.21.15.161:0/549988439 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074033b70 con 0x7fc0700047c0 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc08c0f3640 1 -- 172.21.15.161:0/549988439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0700047c0 msgr2=0x7fc070004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/549988439 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0700047c0 0x7fc070004c40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fc07400ba00 tx=0x7fc0700057f0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc08a690640 1 -- 172.21.15.161:0/549988439 reap_dead start 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc08c0f3640 1 -- 172.21.15.161:0/549988439 shutdown_connections 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc08c0f3640 1 -- 172.21.15.161:0/549988439 >> 172.21.15.161:0/549988439 conn(0x7fc08406a800 msgr2=0x7fc08406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.341+0000 7fc08c0f3640 1 -- 172.21.15.161:0/549988439 shutdown_connections 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.342+0000 7fc08c0f3640 1 -- 172.21.15.161:0/549988439 wait complete. 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.343+0000 7fc08c0f3640 1 Processor -- start 2023-11-24T08:03:33.346 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.344+0000 7fc08c0f3640 1 -- start start 2023-11-24T08:03:33.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.344+0000 7fc08c0f3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0700047c0 0x7fc08413d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.344+0000 7fc08c0f3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc084070480 0x7fc084070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.344+0000 7fc08c0f3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 0x7fc0840af370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08c0f3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840af8b0 con 0x7fc0840aeef0 2023-11-24T08:03:33.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08c0f3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc084070ff0 con 0x7fc0700047c0 2023-11-24T08:03:33.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08c0f3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08415a2e0 con 0x7fc084070480 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 0x7fc0840af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 0x7fc0840af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38270/0 (socket says 172.21.15.161:38270) 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 -- 172.21.15.161:0/2406269281 learned_addr learned my addr 172.21.15.161:0/2406269281 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 -- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc084070480 msgr2=0x7fc084070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc084070480 0x7fc084070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 -- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0700047c0 msgr2=0x7fc08413d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc089e8f640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0700047c0 0x7fc08413d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0700047c0 0x7fc08413d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 -- 172.21.15.161:0/2406269281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08415a5c0 con 0x7fc0840aeef0 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.345+0000 7fc08a690640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 0x7fc0840af370 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc08415fda0 tx=0x7fc07c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.346+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004d60 con 0x7fc0840aeef0 2023-11-24T08:03:33.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.346+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c00bb80 con 0x7fc0840aeef0 2023-11-24T08:03:33.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.346+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007070 con 0x7fc0840aeef0 2023-11-24T08:03:33.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.346+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08415a8a0 con 0x7fc0840aeef0 2023-11-24T08:03:33.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.346+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0840b3770 con 0x7fc0840aeef0 2023-11-24T08:03:33.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.347+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08415adc0 con 0x7fc0840aeef0 2023-11-24T08:03:33.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.348+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fc07c0071d0 con 0x7fc0840aeef0 2023-11-24T08:03:33.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.349+0000 7fc07a7fc640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc06806b0b0 0x7fc06806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:33.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.349+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc07c089f20 con 0x7fc0840aeef0 2023-11-24T08:03:33.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.349+0000 7fc089e8f640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc06806b0b0 0x7fc06806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:33.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.350+0000 7fc089e8f640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc06806b0b0 0x7fc06806d570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc080006fd0 tx=0x7fc080008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:33.355 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.354+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc08415adc0 con 0x7fc0840aeef0 2023-11-24T08:03:33.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.580+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc08415adc0 con 0x7fc0840aeef0 2023-11-24T08:03:33.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.581+0000 7fc07a7fc640 1 -- 172.21.15.161:0/2406269281 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fc08415adc0 con 0x7fc0840aeef0 2023-11-24T08:03:33.583 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:33.584 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:33.584 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.583+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc06806b0b0 msgr2=0x7fc06806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.583+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc06806b0b0 0x7fc06806d570 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc080006fd0 tx=0x7fc080008040 comp rx=0 tx=0).stop 2023-11-24T08:03:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.583+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 msgr2=0x7fc0840af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.583+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 0x7fc0840af370 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fc08415fda0 tx=0x7fc07c00b4a0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 shutdown_connections 2023-11-24T08:03:33.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc06806b0b0 0x7fc06806d570 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0840aeef0 0x7fc0840af370 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc084070480 0x7fc084070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 --2- 172.21.15.161:0/2406269281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc0700047c0 0x7fc08413d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 >> 172.21.15.161:0/2406269281 conn(0x7fc08406a800 msgr2=0x7fc08415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 shutdown_connections 2023-11-24T08:03:33.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:33.584+0000 7fc08c0f3640 1 -- 172.21.15.161:0/2406269281 wait complete. 2023-11-24T08:03:33.605 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:33.848 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":24.499621308999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.790362849983051,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:33.849 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.79036284998305 }, "state": "open", "uptime": 24.499621309 } ] 2023-11-24T08:03:33.849 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:38.850 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:39.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.074+0000 7f2b414df640 1 Processor -- start 2023-11-24T08:03:39.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.074+0000 7f2b414df640 1 -- start start 2023-11-24T08:03:39.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.075+0000 7f2b414df640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b3c0ce9e0 0x7f2b3c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:39.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.075+0000 7f2b414df640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c0cef50 con 0x7f2b3c0ccb90 2023-11-24T08:03:39.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.075+0000 7f2b414df640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c0cf230 con 0x7f2b3c15eb80 2023-11-24T08:03:39.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.075+0000 7f2b414df640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3c0cf510 con 0x7f2b3c0ce9e0 2023-11-24T08:03:39.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.075+0000 7f2b40cde640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2b3c0ccb90 0x7f2b3c15aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:38248/0 (socket says 172.21.15.161:38248) 2023-11-24T08:03:39.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.075+0000 7f2b40cde640 1 -- 172.21.15.161:0/2943149961 learned_addr learned my addr 172.21.15.161:0/2943149961 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:39.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.076+0000 7f2b3b7fe640 1 --2- 172.21.15.161:0/2943149961 >> v2:172.21.15.161:3300/0 conn(0x7f2b3c0ce9e0 0x7f2b3c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:39.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.076+0000 7f2b3affd640 1 -- 172.21.15.161:0/2943149961 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908524309 0 0) 0x7f2b3c0cef50 con 0x7f2b3c0ccb90 2023-11-24T08:03:39.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.076+0000 7f2b3affd640 1 -- 172.21.15.161:0/2943149961 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b28003520 con 0x7f2b3c0ccb90 2023-11-24T08:03:39.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.076+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/2943149961 >> v1:172.21.15.175:6789/0 conn(0x7f2b3c15eb80 legacy=0x7f2b3c15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.076+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/2943149961 >> v1:172.21.15.161:6789/0 conn(0x7f2b3c0ccb90 legacy=0x7f2b3c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.076+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/2943149961 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c0cf7f0 con 0x7f2b3c0ce9e0 2023-11-24T08:03:39.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.078+0000 7f2b3b7fe640 1 --2- 172.21.15.161:0/2943149961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ce9e0 0x7f2b3c0cc650 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009d90 tx=0x7f2b2c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6ba8c9ae7e3523 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:39.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.078+0000 7f2b3affd640 1 -- 172.21.15.161:0/2943149961 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c02cc60 con 0x7f2b3c0ce9e0 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.078+0000 7f2b3affd640 1 -- 172.21.15.161:0/2943149961 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c02cdc0 con 0x7f2b3c0ce9e0 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.078+0000 7f2b3affd640 1 -- 172.21.15.161:0/2943149961 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c034660 con 0x7f2b3c0ce9e0 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 -- 172.21.15.161:0/2943149961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ce9e0 msgr2=0x7f2b3c0cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 --2- 172.21.15.161:0/2943149961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ce9e0 0x7f2b3c0cc650 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009d90 tx=0x7f2b2c02beb0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 -- 172.21.15.161:0/2943149961 shutdown_connections 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 --2- 172.21.15.161:0/2943149961 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ce9e0 0x7f2b3c0cc650 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 -- 172.21.15.161:0/2943149961 >> 172.21.15.161:0/2943149961 conn(0x7f2b3c0d0e10 msgr2=0x7f2b3c0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:39.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 -- 172.21.15.161:0/2943149961 shutdown_connections 2023-11-24T08:03:39.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.079+0000 7f2b414df640 1 -- 172.21.15.161:0/2943149961 wait complete. 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.081+0000 7f2b414df640 1 Processor -- start 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.081+0000 7f2b414df640 1 -- start start 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b414df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b3c15eb80 0x7f2b3c0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b414df640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 0x7f2b3c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b414df640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b3c0cd810 0x7f2b3c0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b414df640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0ce200 con 0x7f2b3c0ca890 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b414df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0c7760 con 0x7f2b3c15eb80 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b414df640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0cacf0 con 0x7f2b3c0cd810 2023-11-24T08:03:39.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b3b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 0x7f2b3c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b3b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 0x7f2b3c0c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:38284/0 (socket says 172.21.15.161:38284) 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/405329694 learned_addr learned my addr 172.21.15.161:0/405329694 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.082+0000 7f2b3bfff640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b3c15eb80 0x7f2b3c0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b40cde640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b3c0cd810 0x7f2b3c0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b3c0cd810 msgr2=0x7f2b3c0cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b3b7fe640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b3c0cd810 0x7f2b3c0cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b3c15eb80 msgr2=0x7f2b3c0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b3b7fe640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b3c15eb80 0x7f2b3c0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b3b7fe640 1 -- 172.21.15.161:0/405329694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009a70 con 0x7f2b3c0ca890 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b3b7fe640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 0x7f2b3c0c7220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c02c440 tx=0x7f2b2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:39.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c03e610 con 0x7f2b3c0ca890 2023-11-24T08:03:39.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c03e790 con 0x7f2b3c0ca890 2023-11-24T08:03:39.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c03eb40 con 0x7f2b3c0ca890 2023-11-24T08:03:39.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.083+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c0c4d80 con 0x7f2b3c0ca890 2023-11-24T08:03:39.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.084+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c0c5340 con 0x7f2b3c0ca890 2023-11-24T08:03:39.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.085+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c067b60 con 0x7f2b3c0ca890 2023-11-24T08:03:39.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.086+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f2b2c03b050 con 0x7f2b3c0ca890 2023-11-24T08:03:39.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.087+0000 7f2b38ff9640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b1c06b0b0 0x7f2b1c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:39.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.087+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2b2c0ac2a0 con 0x7f2b3c0ca890 2023-11-24T08:03:39.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.088+0000 7f2b3bfff640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b1c06b0b0 0x7f2b1c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:39.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.089+0000 7f2b3bfff640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b1c06b0b0 0x7f2b1c06d570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2b24000f60 tx=0x7f2b24009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:39.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.092+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b2c076fe0 con 0x7f2b3c0ca890 2023-11-24T08:03:39.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.319+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b3c0c4330 con 0x7f2b3c0ca890 2023-11-24T08:03:39.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.320+0000 7f2b38ff9640 1 -- 172.21.15.161:0/405329694 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f2b2c07a600 con 0x7f2b3c0ca890 2023-11-24T08:03:39.323 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:39.323 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:39.323 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:39.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b1c06b0b0 msgr2=0x7f2b1c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b1c06b0b0 0x7f2b1c06d570 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2b24000f60 tx=0x7f2b24009040 comp rx=0 tx=0).stop 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 msgr2=0x7f2b3c0c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 0x7f2b3c0c7220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c02c440 tx=0x7f2b2c004a40 comp rx=0 tx=0).stop 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 shutdown_connections 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2b1c06b0b0 0x7f2b1c06d570 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2b3c0cd810 0x7f2b3c0cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b3c0ca890 0x7f2b3c0c7220 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 --2- 172.21.15.161:0/405329694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2b3c15eb80 0x7f2b3c0c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 >> 172.21.15.161:0/405329694 conn(0x7f2b3c0d0e10 msgr2=0x7f2b3c0b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:39.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 shutdown_connections 2023-11-24T08:03:39.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:39.323+0000 7f2b414df640 1 -- 172.21.15.161:0/405329694 wait complete. 2023-11-24T08:03:39.343 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:39.593 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":10,"uptime":30.243532523999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.516271477961165,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:39.593 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.516271477961165 }, "state": "open", "uptime": 30.243532524 } ] 2023-11-24T08:03:39.593 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:39.674 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:39.684 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:03:44.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:44.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.818+0000 7f148c675640 1 Processor -- start 2023-11-24T08:03:44.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.818+0000 7f148c675640 1 -- start start 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148c675640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1484143ae0 0x7f14840cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148c675640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14840cf7d0 0x7f148415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148c675640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f148415e1e0 0x7f148415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148c675640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14840cfc30 con 0x7f14840cf7d0 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148c675640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14840b1ee0 con 0x7f1484143ae0 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148c675640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14840b2780 con 0x7f148415e1e0 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14840cf7d0 0x7f148415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14840cf7d0 0x7f148415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45636/0 (socket says 172.21.15.161:45636) 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 -- 172.21.15.161:0/3874985613 learned_addr learned my addr 172.21.15.161:0/3874985613 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:44.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148a411640 1 --2- 172.21.15.161:0/3874985613 >> v2:172.21.15.175:3300/0 conn(0x7f1484143ae0 0x7f14840cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148ac12640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f148415e1e0 0x7f148415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 -- 172.21.15.161:0/3874985613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f148415e1e0 msgr2=0x7f148415a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f148415e1e0 0x7f148415a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 -- 172.21.15.161:0/3874985613 >> v2:172.21.15.175:3300/0 conn(0x7f1484143ae0 msgr2=0x7f14840cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 --2- 172.21.15.161:0/3874985613 >> v2:172.21.15.175:3300/0 conn(0x7f1484143ae0 0x7f14840cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f1489c10640 1 -- 172.21.15.161:0/3874985613 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148415e990 con 0x7f14840cf7d0 2023-11-24T08:03:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.820+0000 7f148ac12640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f148415e1e0 0x7f148415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.821+0000 7f1489c10640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14840cf7d0 0x7f148415dca0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f14840cfea0 tx=0x7f147402e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c775177e12e1a181 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.821+0000 7f148940f640 1 -- 172.21.15.161:0/3874985613 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147402ee80 con 0x7f14840cf7d0 2023-11-24T08:03:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.821+0000 7f148940f640 1 -- 172.21.15.161:0/3874985613 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1474036440 con 0x7f14840cf7d0 2023-11-24T08:03:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.821+0000 7f148940f640 1 -- 172.21.15.161:0/3874985613 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14740367b0 con 0x7f14840cf7d0 2023-11-24T08:03:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 -- 172.21.15.161:0/3874985613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14840cf7d0 msgr2=0x7f148415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14840cf7d0 0x7f148415dca0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f14840cfea0 tx=0x7f147402e0d0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 -- 172.21.15.161:0/3874985613 shutdown_connections 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f148415e1e0 0x7f148415a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 --2- 172.21.15.161:0/3874985613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14840cf7d0 0x7f148415dca0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 --2- 172.21.15.161:0/3874985613 >> v2:172.21.15.175:3300/0 conn(0x7f1484143ae0 0x7f14840cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 -- 172.21.15.161:0/3874985613 >> 172.21.15.161:0/3874985613 conn(0x7f148406a800 msgr2=0x7f148406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 -- 172.21.15.161:0/3874985613 shutdown_connections 2023-11-24T08:03:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.822+0000 7f148c675640 1 -- 172.21.15.161:0/3874985613 wait complete. 2023-11-24T08:03:44.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.824+0000 7f148c675640 1 Processor -- start 2023-11-24T08:03:44.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.825+0000 7f148c675640 1 -- start start 2023-11-24T08:03:44.828 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148c675640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14840cf7d0 0x7f1484141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148c675640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1484143ae0 0x7f1484159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148c675640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 0x7f14840a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148c675640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1484159fb0 con 0x7f148415e1e0 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148c675640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14840a9200 con 0x7f14840cf7d0 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148c675640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148413fa70 con 0x7f1484143ae0 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148ac12640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 0x7f14840a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148ac12640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 0x7f14840a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45644/0 (socket says 172.21.15.161:45644) 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148ac12640 1 -- 172.21.15.161:0/741241282 learned_addr learned my addr 172.21.15.161:0/741241282 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f148a411640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14840cf7d0 0x7f1484141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.826+0000 7f1489c10640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1484143ae0 0x7f1484159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148ac12640 1 -- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1484143ae0 msgr2=0x7f1484159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148ac12640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1484143ae0 0x7f1484159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148ac12640 1 -- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14840cf7d0 msgr2=0x7f1484141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148ac12640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14840cf7d0 0x7f1484141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148ac12640 1 -- 172.21.15.161:0/741241282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147400b770 con 0x7f148415e1e0 2023-11-24T08:03:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148a411640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14840cf7d0 0x7f1484141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148ac12640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 0x7f14840a9690 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f147c00cd80 tx=0x7f147c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00f680 con 0x7f148415e1e0 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c00f800 con 0x7f148415e1e0 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00fbb0 con 0x7f148415e1e0 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.827+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14840a85f0 con 0x7f148415e1e0 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.828+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14840a8bb0 con 0x7f148415e1e0 2023-11-24T08:03:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.829+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14840a93b0 con 0x7f148415e1e0 2023-11-24T08:03:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.829+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f147c00b040 con 0x7f148415e1e0 2023-11-24T08:03:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.830+0000 7f147affd640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f146806b0b0 0x7f146806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:44.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.830+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f147c08a4f0 con 0x7f148415e1e0 2023-11-24T08:03:44.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.831+0000 7f148a411640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f146806b0b0 0x7f146806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:44.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.832+0000 7f148a411640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f146806b0b0 0x7f146806d570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1480006fd0 tx=0x7f1480008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:44.837+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14840a93b0 con 0x7f148415e1e0 2023-11-24T08:03:45.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.063+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14840a93b0 con 0x7f148415e1e0 2023-11-24T08:03:45.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.064+0000 7f147affd640 1 -- 172.21.15.161:0/741241282 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f14840a93b0 con 0x7f148415e1e0 2023-11-24T08:03:45.066 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:45.066 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:45.066 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:45.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f146806b0b0 msgr2=0x7f146806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:45.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f146806b0b0 0x7f146806d570 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1480006fd0 tx=0x7f1480008040 comp rx=0 tx=0).stop 2023-11-24T08:03:45.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 msgr2=0x7f14840a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 0x7f14840a9690 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f147c00cd80 tx=0x7f147c00a650 comp rx=0 tx=0).stop 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 shutdown_connections 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f146806b0b0 0x7f146806d570 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f148415e1e0 0x7f14840a9690 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1484143ae0 0x7f1484159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 --2- 172.21.15.161:0/741241282 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f14840cf7d0 0x7f1484141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 >> 172.21.15.161:0/741241282 conn(0x7f148406a800 msgr2=0x7f148406ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 shutdown_connections 2023-11-24T08:03:45.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:45.067+0000 7f148c675640 1 -- 172.21.15.161:0/741241282 wait complete. 2023-11-24T08:03:45.086 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:45.330 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":35.981442657999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.246074329752457,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:45.330 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.246074329752457 }, "state": "open", "uptime": 35.981442658 } ] 2023-11-24T08:03:45.330 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:50.331 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:50.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.552+0000 7fc90207c640 1 Processor -- start 2023-11-24T08:03:50.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.552+0000 7fc90207c640 1 -- start start 2023-11-24T08:03:50.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc90207c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13e360 0x7fc8fc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:50.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc90207c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8fc15f9c0 0x7fc8fc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:50.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc90207c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc15c5f0 con 0x7fc8fc13df80 2023-11-24T08:03:50.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc90207c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc06c470 con 0x7fc8fc15f9c0 2023-11-24T08:03:50.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc90207c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06c750 con 0x7fc8fc13e360 2023-11-24T08:03:50.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc8fbfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8fc15f9c0 0x7fc8fc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:50.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc8fb7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc8fc13df80 0x7fc8fc15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:41446/0 (socket says 172.21.15.161:41446) 2023-11-24T08:03:50.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.554+0000 7fc8fb7fe640 1 -- 172.21.15.161:0/1156044719 learned_addr learned my addr 172.21.15.161:0/1156044719 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.555+0000 7fc8f3fff640 1 --2- 172.21.15.161:0/1156044719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13e360 0x7fc8fc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.555+0000 7fc8fbfff640 1 -- 172.21.15.161:0/1156044719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13e360 msgr2=0x7fc8fc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.555+0000 7fc8fbfff640 1 --2- 172.21.15.161:0/1156044719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13e360 0x7fc8fc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.555+0000 7fc8fbfff640 1 -- 172.21.15.161:0/1156044719 >> v1:172.21.15.161:6789/0 conn(0x7fc8fc13df80 legacy=0x7fc8fc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.555+0000 7fc8fbfff640 1 -- 172.21.15.161:0/1156044719 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc06ca30 con 0x7fc8fc15f9c0 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.556+0000 7fc8fbfff640 1 --2- 172.21.15.161:0/1156044719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc0cf7d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009d90 tx=0x7fc8f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c899cb56af8ee5c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:50.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.557+0000 7fc8faffd640 1 -- 172.21.15.161:0/1156044719 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f402cc50 con 0x7fc8fc15f9c0 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.557+0000 7fc8faffd640 1 -- 172.21.15.161:0/1156044719 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f402cdb0 con 0x7fc8fc15f9c0 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.557+0000 7fc8faffd640 1 -- 172.21.15.161:0/1156044719 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4034660 con 0x7fc8fc15f9c0 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.557+0000 7fc90207c640 1 -- 172.21.15.161:0/1156044719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc15f9c0 msgr2=0x7fc8fc0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.557+0000 7fc90207c640 1 --2- 172.21.15.161:0/1156044719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc0cf7d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4009d90 tx=0x7fc8f402bea0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.558+0000 7fc90207c640 1 -- 172.21.15.161:0/1156044719 shutdown_connections 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.558+0000 7fc90207c640 1 --2- 172.21.15.161:0/1156044719 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc0cf7d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.558+0000 7fc90207c640 1 --2- 172.21.15.161:0/1156044719 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13e360 0x7fc8fc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.558+0000 7fc90207c640 1 -- 172.21.15.161:0/1156044719 >> 172.21.15.161:0/1156044719 conn(0x7fc8fc06a800 msgr2=0x7fc8fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.558+0000 7fc90207c640 1 -- 172.21.15.161:0/1156044719 shutdown_connections 2023-11-24T08:03:50.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.558+0000 7fc90207c640 1 -- 172.21.15.161:0/1156044719 wait complete. 2023-11-24T08:03:50.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.559+0000 7fc90207c640 1 Processor -- start 2023-11-24T08:03:50.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.560+0000 7fc90207c640 1 -- start start 2023-11-24T08:03:50.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc90207c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13df80 0x7fc8fc0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:50.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc90207c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 0x7fc8fc13d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:50.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc90207c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:50.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc90207c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc1f2f90 con 0x7fc8fc13e360 2023-11-24T08:03:50.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc90207c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc158200 con 0x7fc8fc15f9c0 2023-11-24T08:03:50.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc90207c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc1584e0 con 0x7fc8fc13df80 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 0x7fc8fc13d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 0x7fc8fc13d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:45648/0 (socket says 172.21.15.161:45648) 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 -- 172.21.15.161:0/3326435984 learned_addr learned my addr 172.21.15.161:0/3326435984 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8fb7fe640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13df80 0x7fc8fc0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8fbfff640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 -- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13df80 msgr2=0x7fc8fc0ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13df80 0x7fc8fc0ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 -- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8fc15f9c0 msgr2=0x7fc8fc1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc1575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.561+0000 7fc8f3fff640 1 -- 172.21.15.161:0/3326435984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4009a70 con 0x7fc8fc13e360 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.562+0000 7fc8f3fff640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 0x7fc8fc13d610 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400d800 tx=0x7fc8e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.562+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400b6c0 con 0x7fc8fc13e360 2023-11-24T08:03:50.573 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.562+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e400b820 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.562+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e400bbb0 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.562+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc070aa0 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.562+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc071060 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.563+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc071220 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.564+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fc8e400bd10 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.565+0000 7fc8f8ff9640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8dc06b080 0x7fc8dc06d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.566+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc8e408a0a0 con 0x7fc8fc13e360 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.566+0000 7fc8fb7fe640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8dc06b080 0x7fc8dc06d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:50.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.567+0000 7fc8fb7fe640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8dc06b080 0x7fc8dc06d540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005880 tx=0x7fc8ec009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:50.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.571+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8e4054d10 con 0x7fc8fc13e360 2023-11-24T08:03:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.799+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8fc0675d0 con 0x7fc8fc13e360 2023-11-24T08:03:50.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.800+0000 7fc8f8ff9640 1 -- 172.21.15.161:0/3326435984 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fc8e4058330 con 0x7fc8fc13e360 2023-11-24T08:03:50.801 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:50.801 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:50.802 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:50.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8dc06b080 msgr2=0x7fc8dc06d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:50.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8dc06b080 0x7fc8dc06d540 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec005880 tx=0x7fc8ec009040 comp rx=0 tx=0).stop 2023-11-24T08:03:50.804 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 msgr2=0x7fc8fc13d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 0x7fc8fc13d610 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400d800 tx=0x7fc8e400dcc0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 shutdown_connections 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc8dc06b080 0x7fc8dc06d540 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8fc15f9c0 0x7fc8fc1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8fc13e360 0x7fc8fc13d610 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 --2- 172.21.15.161:0/3326435984 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8fc13df80 0x7fc8fc0ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 >> 172.21.15.161:0/3326435984 conn(0x7fc8fc06a800 msgr2=0x7fc8fc15beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 shutdown_connections 2023-11-24T08:03:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:50.803+0000 7fc90207c640 1 -- 172.21.15.161:0/3326435984 wait complete. 2023-11-24T08:03:50.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:51.064 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":41.715351509000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.979620358981073,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:51.065 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.979620358981073 }, "state": "open", "uptime": 41.715351509 } ] 2023-11-24T08:03:51.065 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:03:56.067 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:03:56.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.288+0000 7fcee314c640 1 Processor -- start 2023-11-24T08:03:56.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.289+0000 7fcee314c640 1 -- start start 2023-11-24T08:03:56.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.290+0000 7fcee314c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcedc13df80 0x7fcedc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.290+0000 7fcee314c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc0cf9a0 0x7fcedc0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.290+0000 7fcee314c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc06c470 con 0x7fcedc13e360 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.290+0000 7fcee314c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc06c750 con 0x7fcedc13df80 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.290+0000 7fcee314c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc06ca30 con 0x7fcedc0cf9a0 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcedc13df80 0x7fcedc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcedc13df80 0x7fcedc15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57878/0 (socket says 172.21.15.161:57878) 2023-11-24T08:03:56.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 -- 172.21.15.161:0/2061622247 learned_addr learned my addr 172.21.15.161:0/2061622247 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:56.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee16e9640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc0cf9a0 0x7fcedc0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 -- 172.21.15.161:0/2061622247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc0cf9a0 msgr2=0x7fcedc0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:03:56.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc0cf9a0 0x7fcedc0cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 -- 172.21.15.161:0/2061622247 >> v1:172.21.15.161:6789/0 conn(0x7fcedc13e360 legacy=0x7fcedc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee0ee8640 1 -- 172.21.15.161:0/2061622247 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc06cd10 con 0x7fcedc13df80 2023-11-24T08:03:56.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.291+0000 7fcee16e9640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc0cf9a0 0x7fcedc0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:56.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.292+0000 7fcee0ee8640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13df80 0x7fcedc15bee0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009870 tx=0x7fcecc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aabc41a5b00fea4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcedb7fe640 1 -- 172.21.15.161:0/2061622247 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc030840 con 0x7fcedc13df80 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcedb7fe640 1 -- 172.21.15.161:0/2061622247 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc0309a0 con 0x7fcedc13df80 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcedb7fe640 1 -- 172.21.15.161:0/2061622247 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc030d30 con 0x7fcedc13df80 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcee314c640 1 -- 172.21.15.161:0/2061622247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13df80 msgr2=0x7fcedc15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcee314c640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13df80 0x7fcedc15bee0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009870 tx=0x7fcecc02b980 comp rx=0 tx=0).stop 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcee314c640 1 -- 172.21.15.161:0/2061622247 shutdown_connections 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcee314c640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc0cf9a0 0x7fcedc0cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.295 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcee314c640 1 --2- 172.21.15.161:0/2061622247 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13df80 0x7fcedc15bee0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.293+0000 7fcee314c640 1 -- 172.21.15.161:0/2061622247 >> 172.21.15.161:0/2061622247 conn(0x7fcedc06a800 msgr2=0x7fcedc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.294+0000 7fcee314c640 1 -- 172.21.15.161:0/2061622247 shutdown_connections 2023-11-24T08:03:56.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.294+0000 7fcee314c640 1 -- 172.21.15.161:0/2061622247 wait complete. 2023-11-24T08:03:56.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.295+0000 7fcee314c640 1 Processor -- start 2023-11-24T08:03:56.296 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.295+0000 7fcee314c640 1 -- start start 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.296+0000 7fcee314c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcedc0cf9a0 0x7fcedc13cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.296+0000 7fcee314c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc13df80 0x7fcedc150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.296+0000 7fcee314c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 0x7fcedc0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.296+0000 7fcee314c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc13d470 con 0x7fcedc13e360 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.296+0000 7fcee314c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc151ea0 con 0x7fcedc0cf9a0 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.296+0000 7fcee314c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1518e0 con 0x7fcedc13df80 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 0x7fcedc0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 0x7fcedc0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57882/0 (socket says 172.21.15.161:57882) 2023-11-24T08:03:56.299 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 -- 172.21.15.161:0/3554625408 learned_addr learned my addr 172.21.15.161:0/3554625408 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee0ee8640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcedc0cf9a0 0x7fcedc13cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 -- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc13df80 msgr2=0x7fcedc150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc13df80 0x7fcedc150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 -- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcedc0cf9a0 msgr2=0x7fcedc13cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcedc0cf9a0 0x7fcedc13cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee16e9640 1 -- 172.21.15.161:0/3554625408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0094d0 con 0x7fcedc13e360 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.297+0000 7fcee0ee8640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcedc0cf9a0 0x7fcedc13cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.298+0000 7fcee16e9640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 0x7fcedc0b2cf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fced400cd80 tx=0x7fced400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.298+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400f680 con 0x7fcedc13e360 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.298+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400f800 con 0x7fcedc13e360 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.298+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400fbb0 con 0x7fcedc13e360 2023-11-24T08:03:56.300 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.298+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc151bc0 con 0x7fcedc13e360 2023-11-24T08:03:56.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.298+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc152dd0 con 0x7fcedc13e360 2023-11-24T08:03:56.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.299+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc15f120 con 0x7fcedc13e360 2023-11-24T08:03:56.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.300+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fced400b040 con 0x7fcedc13e360 2023-11-24T08:03:56.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.301+0000 7fced97fa640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcec806b080 0x7fcec806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:03:56.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.301+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fced408a550 con 0x7fcedc13e360 2023-11-24T08:03:56.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.301+0000 7fcee0ee8640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcec806b080 0x7fcec806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:03:56.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.303+0000 7fcee0ee8640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcec806b080 0x7fcec806d540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcecc036000 tx=0x7fcecc03b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:03:56.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.306+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fced4055140 con 0x7fcedc13e360 2023-11-24T08:03:56.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.533+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcedc0675d0 con 0x7fcedc13e360 2023-11-24T08:03:56.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.534+0000 7fced97fa640 1 -- 172.21.15.161:0/3554625408 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fced4058760 con 0x7fcedc13e360 2023-11-24T08:03:56.535 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:03:56.535 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:03:56.535 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:03:56.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.536+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcec806b080 msgr2=0x7fcec806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.536+0000 7fcee314c640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcec806b080 0x7fcec806d540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcecc036000 tx=0x7fcecc03b040 comp rx=0 tx=0).stop 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.536+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 msgr2=0x7fcedc0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.536+0000 7fcee314c640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 0x7fcedc0b2cf0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fced400cd80 tx=0x7fced400a650 comp rx=0 tx=0).stop 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 shutdown_connections 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcec806b080 0x7fcec806d540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcedc13e360 0x7fcedc0b2cf0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcedc13df80 0x7fcedc150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 --2- 172.21.15.161:0/3554625408 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcedc0cf9a0 0x7fcedc13cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:03:56.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 >> 172.21.15.161:0/3554625408 conn(0x7fcedc06a800 msgr2=0x7fcedc0afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:03:56.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 shutdown_connections 2023-11-24T08:03:56.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:03:56.537+0000 7fcee314c640 1 -- 172.21.15.161:0/3554625408 wait complete. 2023-11-24T08:03:56.556 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:03:56.790 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":47.442260470000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.716992012085363,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:03:56.791 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.716992012085363 }, "state": "open", "uptime": 47.44226047 } ] 2023-11-24T08:03:56.791 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:01.792 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:02.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.006+0000 7f76a6e9b640 1 Processor -- start 2023-11-24T08:04:02.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.006+0000 7f76a6e9b640 1 -- start start 2023-11-24T08:04:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a6e9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76a0143ae0 0x7f76a00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a6e9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a6e9b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a00cfc30 con 0x7f76a015e1e0 2023-11-24T08:04:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a6e9b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a00b1ee0 con 0x7f76a0143ae0 2023-11-24T08:04:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a6e9b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00b2780 con 0x7f76a00cf7d0 2023-11-24T08:04:02.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a4c37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76a0143ae0 0x7f76a00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a4c37640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f76a0143ae0 0x7f76a00cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39070/0 (socket says 172.21.15.161:39070) 2023-11-24T08:04:02.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f76a4c37640 1 -- 172.21.15.161:0/2882738088 learned_addr learned my addr 172.21.15.161:0/2882738088 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:02.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.008+0000 7f769ffff640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.009+0000 7f76a4c37640 1 -- 172.21.15.161:0/2882738088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 msgr2=0x7f76a015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.009+0000 7f76a4c37640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a015dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.009+0000 7f76a4c37640 1 -- 172.21.15.161:0/2882738088 >> v1:172.21.15.175:6789/0 conn(0x7f76a015e1e0 legacy=0x7f76a015a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.009+0000 7f76a4c37640 1 -- 172.21.15.161:0/2882738088 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a015e990 con 0x7f76a0143ae0 2023-11-24T08:04:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.009+0000 7f769ffff640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.010+0000 7f76a4c37640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00cf290 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7690009e50 tx=0x7f769002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc1a173ef99542 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:02.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.010+0000 7f769f7fe640 1 -- 172.21.15.161:0/2882738088 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769002ca70 con 0x7f76a0143ae0 2023-11-24T08:04:02.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.010+0000 7f769f7fe640 1 -- 172.21.15.161:0/2882738088 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769002cbd0 con 0x7f76a0143ae0 2023-11-24T08:04:02.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.010+0000 7f769f7fe640 1 -- 172.21.15.161:0/2882738088 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76900343f0 con 0x7f76a0143ae0 2023-11-24T08:04:02.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 -- 172.21.15.161:0/2882738088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 msgr2=0x7f76a00cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00cf290 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f7690009e50 tx=0x7f769002bed0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 -- 172.21.15.161:0/2882738088 shutdown_connections 2023-11-24T08:04:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/2882738088 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00cf290 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 -- 172.21.15.161:0/2882738088 >> 172.21.15.161:0/2882738088 conn(0x7f76a006a800 msgr2=0x7f76a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 -- 172.21.15.161:0/2882738088 shutdown_connections 2023-11-24T08:04:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.011+0000 7f76a6e9b640 1 -- 172.21.15.161:0/2882738088 wait complete. 2023-11-24T08:04:02.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.013+0000 7f76a6e9b640 1 Processor -- start 2023-11-24T08:04:02.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.013+0000 7f76a6e9b640 1 -- start start 2023-11-24T08:04:02.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f76a6e9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a0159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f76a6e9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f76a6e9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76a015e1e0 0x7f76a006c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f76a6e9b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00abf90 con 0x7f76a0143ae0 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f76a6e9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a00a9f60 con 0x7f76a015e1e0 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f76a6e9b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a0141b50 con 0x7f76a00cf7d0 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f769ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f769ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00aa200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39082/0 (socket says 172.21.15.161:39082) 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.014+0000 7f769ffff640 1 -- 172.21.15.161:0/544391648 learned_addr learned my addr 172.21.15.161:0/544391648 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f76a4c37640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a0159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f76a5438640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76a015e1e0 0x7f76a006c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769ffff640 1 -- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 msgr2=0x7f76a0159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769ffff640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a0159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769ffff640 1 -- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76a015e1e0 msgr2=0x7f76a006c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769ffff640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76a015e1e0 0x7f76a006c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769ffff640 1 -- 172.21.15.161:0/544391648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009b30 con 0x7f76a0143ae0 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769ffff640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00aa200 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f769400c7f0 tx=0x7f769400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694007a30 con 0x7f76a0143ae0 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694007b90 con 0x7f76a0143ae0 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.015+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400ce40 con 0x7f76a0143ae0 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.016+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a0141e30 con 0x7f76a0143ae0 2023-11-24T08:04:02.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.016+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a01423f0 con 0x7f76a0143ae0 2023-11-24T08:04:02.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.017+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a00b2bf0 con 0x7f76a0143ae0 2023-11-24T08:04:02.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.018+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f76940113f0 con 0x7f76a0143ae0 2023-11-24T08:04:02.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.019+0000 7f769d7fa640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f768c06b0b0 0x7f768c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:02.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.019+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7694089dc0 con 0x7f76a0143ae0 2023-11-24T08:04:02.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.019+0000 7f76a4c37640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f768c06b0b0 0x7f768c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:02.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.020+0000 7f76a4c37640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f768c06b0b0 0x7f768c06d570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7690035000 tx=0x7f7690030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:02.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.023+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76a00b2bf0 con 0x7f76a0143ae0 2023-11-24T08:04:02.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.242+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a00ac0d0 con 0x7f76a0143ae0 2023-11-24T08:04:02.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.244+0000 7f769d7fa640 1 -- 172.21.15.161:0/544391648 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f76a00ac0d0 con 0x7f76a0143ae0 2023-11-24T08:04:02.245 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:02.245 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:02.246 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.246+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f768c06b0b0 msgr2=0x7f768c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.246+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f768c06b0b0 0x7f768c06d570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7690035000 tx=0x7f7690030000 comp rx=0 tx=0).stop 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.246+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 msgr2=0x7f76a00aa200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.246+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00aa200 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f769400c7f0 tx=0x7f769400cbf0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 shutdown_connections 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f768c06b0b0 0x7f768c06d570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76a015e1e0 0x7f76a006c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f76a0143ae0 0x7f76a00aa200 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 --2- 172.21.15.161:0/544391648 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76a00cf7d0 0x7f76a0159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:02.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 >> 172.21.15.161:0/544391648 conn(0x7f76a006a800 msgr2=0x7f76a006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:02.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 shutdown_connections 2023-11-24T08:04:02.249 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:02.247+0000 7f76a6e9b640 1 -- 172.21.15.161:0/544391648 wait complete. 2023-11-24T08:04:02.265 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:02.504 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":53.156169634999998,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.45840030726411,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:04:02.505 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.45840030726411 }, "state": "open", "uptime": 53.156169635 } ] 2023-11-24T08:04:02.505 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:07.506 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:07.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.730+0000 7fd8f7b1d640 1 Processor -- start 2023-11-24T08:04:07.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.730+0000 7fd8f7b1d640 1 -- start start 2023-11-24T08:04:07.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f7b1d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8f013df80 0x7fd8f015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f7b1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f013e360 0x7fd8f00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f7b1d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd8f015f9c0 0x7fd8f00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f7b1d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f006c470 con 0x7fd8f013df80 2023-11-24T08:04:07.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f7b1d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f006c750 con 0x7fd8f015f9c0 2023-11-24T08:04:07.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f7b1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f006ca30 con 0x7fd8f013e360 2023-11-24T08:04:07.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f58b9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8f013df80 0x7fd8f015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f58b9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8f013df80 0x7fd8f015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39090/0 (socket says 172.21.15.161:39090) 2023-11-24T08:04:07.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.732+0000 7fd8f58b9640 1 -- 172.21.15.161:0/2322668760 learned_addr learned my addr 172.21.15.161:0/2322668760 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:07.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.733+0000 7fd8f58b9640 1 -- 172.21.15.161:0/2322668760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f013e360 msgr2=0x7fd8f00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.733+0000 7fd8f58b9640 1 --2- 172.21.15.161:0/2322668760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f013e360 0x7fd8f00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.733+0000 7fd8f60ba640 1 --2- 172.21.15.161:0/2322668760 >> v2:172.21.15.175:3300/0 conn(0x7fd8f015f9c0 0x7fd8f00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.733+0000 7fd8f58b9640 1 -- 172.21.15.161:0/2322668760 >> v2:172.21.15.175:3300/0 conn(0x7fd8f015f9c0 msgr2=0x7fd8f00cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:07.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.733+0000 7fd8f58b9640 1 --2- 172.21.15.161:0/2322668760 >> v2:172.21.15.175:3300/0 conn(0x7fd8f015f9c0 0x7fd8f00cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.733+0000 7fd8f58b9640 1 -- 172.21.15.161:0/2322668760 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f006cd10 con 0x7fd8f013df80 2023-11-24T08:04:07.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.734+0000 7fd8f58b9640 1 --2- 172.21.15.161:0/2322668760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f015bee0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd8f006e6d0 tx=0x7fd8ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f421d814e35f01a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.734+0000 7fd8f48b7640 1 -- 172.21.15.161:0/2322668760 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec031870 con 0x7fd8f013df80 2023-11-24T08:04:07.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.734+0000 7fd8f48b7640 1 -- 172.21.15.161:0/2322668760 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0319d0 con 0x7fd8f013df80 2023-11-24T08:04:07.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.734+0000 7fd8f48b7640 1 -- 172.21.15.161:0/2322668760 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec031d60 con 0x7fd8f013df80 2023-11-24T08:04:07.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/2322668760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 msgr2=0x7fd8f015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/2322668760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f015bee0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd8f006e6d0 tx=0x7fd8ec02b910 comp rx=0 tx=0).stop 2023-11-24T08:04:07.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/2322668760 shutdown_connections 2023-11-24T08:04:07.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/2322668760 >> v2:172.21.15.175:3300/0 conn(0x7fd8f015f9c0 0x7fd8f00cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/2322668760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f013e360 0x7fd8f00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/2322668760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f015bee0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/2322668760 >> 172.21.15.161:0/2322668760 conn(0x7fd8f006a800 msgr2=0x7fd8f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/2322668760 shutdown_connections 2023-11-24T08:04:07.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.735+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/2322668760 wait complete. 2023-11-24T08:04:07.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.737+0000 7fd8f7b1d640 1 Processor -- start 2023-11-24T08:04:07.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.737+0000 7fd8f7b1d640 1 -- start start 2023-11-24T08:04:07.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f7b1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f01e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f7b1d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f013e360 0x7fd8f013b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.741 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f7b1d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f015f9c0 0x7fd8f0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f7b1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0158e70 con 0x7fd8f013df80 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f7b1d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0159150 con 0x7fd8f013e360 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f7b1d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0159430 con 0x7fd8f015f9c0 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f58b9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f01e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f58b9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f01e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:39102/0 (socket says 172.21.15.161:39102) 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.738+0000 7fd8f58b9640 1 -- 172.21.15.161:0/994072446 learned_addr learned my addr 172.21.15.161:0/994072446 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f58b9640 1 -- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f015f9c0 msgr2=0x7fd8f0158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f58b9640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f015f9c0 0x7fd8f0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f50b8640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f013e360 0x7fd8f013b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f58b9640 1 -- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f013e360 msgr2=0x7fd8f013b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.742 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f58b9640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f013e360 0x7fd8f013b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f58b9640 1 -- 172.21.15.161:0/994072446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec0094d0 con 0x7fd8f013df80 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f50b8640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f013e360 0x7fd8f013b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f58b9640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f01e4b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec000c00 tx=0x7fd8ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec031840 con 0x7fd8f013df80 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0443f0 con 0x7fd8f013df80 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f0159710 con 0x7fd8f013df80 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.739+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0447a0 con 0x7fd8f013df80 2023-11-24T08:04:07.743 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.740+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f013bc30 con 0x7fd8f013df80 2023-11-24T08:04:07.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.741+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f006d920 con 0x7fd8f013df80 2023-11-24T08:04:07.744 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.742+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fd8ec04d450 con 0x7fd8f013df80 2023-11-24T08:04:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.743+0000 7fd8e67fc640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8d406b0d0 0x7fd8d406d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.743+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd8ec02d040 con 0x7fd8f013df80 2023-11-24T08:04:07.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.744+0000 7fd8f50b8640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8d406b0d0 0x7fd8d406d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:07.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.745+0000 7fd8f50b8640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8d406b0d0 0x7fd8d406d590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0006fd0 tx=0x7fd8e0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:07.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.748+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8ec076f40 con 0x7fd8f013df80 2023-11-24T08:04:07.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.976+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8f00675d0 con 0x7fd8f013df80 2023-11-24T08:04:07.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.977+0000 7fd8e67fc640 1 -- 172.21.15.161:0/994072446 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fd8ec07a560 con 0x7fd8f013df80 2023-11-24T08:04:07.979 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:07.979 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:07.979 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:07.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8d406b0d0 msgr2=0x7fd8d406d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8d406b0d0 0x7fd8d406d590 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0006fd0 tx=0x7fd8e0008040 comp rx=0 tx=0).stop 2023-11-24T08:04:07.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 msgr2=0x7fd8f01e4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:07.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f01e4b00 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec000c00 tx=0x7fd8ec0046c0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 shutdown_connections 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8d406b0d0 0x7fd8d406d590 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f015f9c0 0x7fd8f0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f013e360 0x7fd8f013b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 --2- 172.21.15.161:0/994072446 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8f013df80 0x7fd8f01e4b00 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 >> 172.21.15.161:0/994072446 conn(0x7fd8f006a800 msgr2=0x7fd8f015d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 shutdown_connections 2023-11-24T08:04:07.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:07.980+0000 7fd8f7b1d640 1 -- 172.21.15.161:0/994072446 wait complete. 2023-11-24T08:04:08.003 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:08.242 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":58.892078454,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.2021796371166,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:04:08.243 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.2021796371166 }, "state": "open", "uptime": 58.892078454 } ] 2023-11-24T08:04:08.243 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:09.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:09.835 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:13.244 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:13.468 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.466+0000 7f5b29ffb640 1 Processor -- start 2023-11-24T08:04:13.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.467+0000 7f5b29ffb640 1 -- start start 2023-11-24T08:04:13.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.468+0000 7f5b29ffb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2415c300 0x7f5b2415f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.468+0000 7f5b29ffb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b240b34e0 0x7f5b2415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.468+0000 7f5b29ffb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2415fe60 con 0x7f5b24159040 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.468+0000 7f5b29ffb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b240c6060 con 0x7f5b240b34e0 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.468+0000 7f5b29ffb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240cf710 con 0x7f5b2415c300 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.468+0000 7f5b237fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f5b24159040 0x7f5b240cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:37564/0 (socket says 172.21.15.161:37564) 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b237fe640 1 -- 172.21.15.161:0/1545653536 learned_addr learned my addr 172.21.15.161:0/1545653536 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b23fff640 1 --2- 172.21.15.161:0/1545653536 >> v2:172.21.15.161:3300/0 conn(0x7f5b240b34e0 0x7f5b2415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b22ffd640 1 --2- 172.21.15.161:0/1545653536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2415c300 0x7f5b2415f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b23fff640 1 -- 172.21.15.161:0/1545653536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2415c300 msgr2=0x7f5b2415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b23fff640 1 --2- 172.21.15.161:0/1545653536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2415c300 0x7f5b2415f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b23fff640 1 -- 172.21.15.161:0/1545653536 >> v1:172.21.15.161:6789/0 conn(0x7f5b24159040 legacy=0x7f5b240cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.469+0000 7f5b23fff640 1 -- 172.21.15.161:0/1545653536 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240c62d0 con 0x7f5b240b34e0 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.470+0000 7f5b23fff640 1 --2- 172.21.15.161:0/1545653536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b2415f920 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0097a0 tx=0x7f5b1c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353a78e7cec664f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.470+0000 7f5b227fc640 1 -- 172.21.15.161:0/1545653536 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c02d040 con 0x7f5b240b34e0 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b227fc640 1 -- 172.21.15.161:0/1545653536 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c031810 con 0x7f5b240b34e0 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b227fc640 1 -- 172.21.15.161:0/1545653536 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c031ba0 con 0x7f5b240b34e0 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 -- 172.21.15.161:0/1545653536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 msgr2=0x7f5b2415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/1545653536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b2415f920 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0097a0 tx=0x7f5b1c02b8b0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 -- 172.21.15.161:0/1545653536 shutdown_connections 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/1545653536 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b2415f920 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/1545653536 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2415c300 0x7f5b2415f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 -- 172.21.15.161:0/1545653536 >> 172.21.15.161:0/1545653536 conn(0x7f5b24066690 msgr2=0x7f5b2406a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 -- 172.21.15.161:0/1545653536 shutdown_connections 2023-11-24T08:04:13.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.471+0000 7f5b29ffb640 1 -- 172.21.15.161:0/1545653536 wait complete. 2023-11-24T08:04:13.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.473+0000 7f5b29ffb640 1 Processor -- start 2023-11-24T08:04:13.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.473+0000 7f5b29ffb640 1 -- start start 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.474+0000 7f5b29ffb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b240b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.474+0000 7f5b29ffb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b24159040 0x7f5b24157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.474+0000 7f5b29ffb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2415c300 0x7f5b2415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.474+0000 7f5b29ffb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b24158010 con 0x7f5b240b34e0 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.474+0000 7f5b29ffb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2415eb60 con 0x7f5b2415c300 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.474+0000 7f5b29ffb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b240b4360 con 0x7f5b24159040 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b240b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b240b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57684/0 (socket says 172.21.15.161:57684) 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 -- 172.21.15.161:0/815103805 learned_addr learned my addr 172.21.15.161:0/815103805 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 -- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b24159040 msgr2=0x7f5b24157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b24159040 0x7f5b24157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 -- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2415c300 msgr2=0x7f5b2415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2415c300 0x7f5b2415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 -- 172.21.15.161:0/815103805 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c009400 con 0x7f5b240b34e0 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.475+0000 7f5b237fe640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b240b3d80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00c4a0 tx=0x7f5b0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.476+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c005ce0 con 0x7f5b240b34e0 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.476+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c005e40 con 0x7f5b240b34e0 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.476+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c007270 con 0x7f5b240b34e0 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.476+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b240b4640 con 0x7f5b240b34e0 2023-11-24T08:04:13.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.476+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b240b4c00 con 0x7f5b240b34e0 2023-11-24T08:04:13.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.477+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b24074a50 con 0x7f5b240b34e0 2023-11-24T08:04:13.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.478+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f5b0c007490 con 0x7f5b240b34e0 2023-11-24T08:04:13.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.479+0000 7f5b1bfff640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5b0406b080 0x7f5b0406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:13.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.479+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5b0c088fe0 con 0x7f5b240b34e0 2023-11-24T08:04:13.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.479+0000 7f5b22ffd640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5b0406b080 0x7f5b0406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:13.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.481+0000 7f5b22ffd640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5b0406b080 0x7f5b0406d540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b140070b0 tx=0x7f5b14007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:13.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.483+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b0c053d00 con 0x7f5b240b34e0 2023-11-24T08:04:13.714 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.712+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b240b3250 con 0x7f5b240b34e0 2023-11-24T08:04:13.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.714+0000 7f5b1bfff640 1 -- 172.21.15.161:0/815103805 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f5b0c017020 con 0x7f5b240b34e0 2023-11-24T08:04:13.716 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:13.716 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:13.716 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5b0406b080 msgr2=0x7f5b0406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5b0406b080 0x7f5b0406d540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5b140070b0 tx=0x7f5b14007040 comp rx=0 tx=0).stop 2023-11-24T08:04:13.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 msgr2=0x7f5b240b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b240b3d80 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00c4a0 tx=0x7f5b0c00c960 comp rx=0 tx=0).stop 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 shutdown_connections 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f5b0406b080 0x7f5b0406d540 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2415c300 0x7f5b2415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b24159040 0x7f5b24157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 --2- 172.21.15.161:0/815103805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b240b34e0 0x7f5b240b3d80 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 >> 172.21.15.161:0/815103805 conn(0x7f5b24066690 msgr2=0x7f5b240b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.717+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 shutdown_connections 2023-11-24T08:04:13.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:13.718+0000 7f5b29ffb640 1 -- 172.21.15.161:0/815103805 wait complete. 2023-11-24T08:04:13.738 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:13.984 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":64.634987159000005,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.949113874980728,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:04:13.984 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.94911387498073 }, "state": "open", "uptime": 64.634987159 } ] 2023-11-24T08:04:13.985 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:18.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:19.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.213+0000 7fdfce66b640 1 Processor -- start 2023-11-24T08:04:19.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.213+0000 7fdfce66b640 1 -- start start 2023-11-24T08:04:19.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.215+0000 7fdfce66b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdfc806aaf0 0x7fdfc80cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.215+0000 7fdfce66b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc80cfcc0 con 0x7fdfc80cc940 2023-11-24T08:04:19.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.215+0000 7fdfce66b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc8071a20 con 0x7fdfc8144c60 2023-11-24T08:04:19.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.215+0000 7fdfce66b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc80ccd80 con 0x7fdfc806aaf0 2023-11-24T08:04:19.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.215+0000 7fdfccc08640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdfc806aaf0 0x7fdfc80cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.215+0000 7fdfccc08640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdfc806aaf0 0x7fdfc80cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57690/0 (socket says 172.21.15.161:57690) 2023-11-24T08:04:19.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.216+0000 7fdfccc08640 1 -- 172.21.15.161:0/1157966257 learned_addr learned my addr 172.21.15.161:0/1157966257 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:19.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.216+0000 7fdfccc08640 1 -- 172.21.15.161:0/1157966257 >> v1:172.21.15.175:6789/0 conn(0x7fdfc8144c60 legacy=0x7fdfc806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:19.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.216+0000 7fdfccc08640 1 -- 172.21.15.161:0/1157966257 >> v1:172.21.15.161:6789/0 conn(0x7fdfc80cc940 legacy=0x7fdfc806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.216+0000 7fdfccc08640 1 -- 172.21.15.161:0/1157966257 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc806eef0 con 0x7fdfc806aaf0 2023-11-24T08:04:19.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.217+0000 7fdfccc08640 1 --2- 172.21.15.161:0/1157966257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc806aaf0 0x7fdfc80cf780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009e50 tx=0x7fdfc002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4033038fa992be6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.217+0000 7fdfc77fe640 1 -- 172.21.15.161:0/1157966257 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc002cb20 con 0x7fdfc806aaf0 2023-11-24T08:04:19.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.217+0000 7fdfc77fe640 1 -- 172.21.15.161:0/1157966257 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc002cc80 con 0x7fdfc806aaf0 2023-11-24T08:04:19.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.217+0000 7fdfc77fe640 1 -- 172.21.15.161:0/1157966257 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc00343f0 con 0x7fdfc806aaf0 2023-11-24T08:04:19.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 -- 172.21.15.161:0/1157966257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc806aaf0 msgr2=0x7fdfc80cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 --2- 172.21.15.161:0/1157966257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc806aaf0 0x7fdfc80cf780 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009e50 tx=0x7fdfc002bf80 comp rx=0 tx=0).stop 2023-11-24T08:04:19.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 -- 172.21.15.161:0/1157966257 shutdown_connections 2023-11-24T08:04:19.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 --2- 172.21.15.161:0/1157966257 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc806aaf0 0x7fdfc80cf780 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 -- 172.21.15.161:0/1157966257 >> 172.21.15.161:0/1157966257 conn(0x7fdfc80cfef0 msgr2=0x7fdfc80d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 -- 172.21.15.161:0/1157966257 shutdown_connections 2023-11-24T08:04:19.221 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.218+0000 7fdfce66b640 1 -- 172.21.15.161:0/1157966257 wait complete. 2023-11-24T08:04:19.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.220+0000 7fdfce66b640 1 Processor -- start 2023-11-24T08:04:19.222 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.221+0000 7fdfce66b640 1 -- start start 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfce66b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc806aaf0 0x7fdfc8138fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfce66b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 0x7fdfc8157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfce66b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfc8144c60 0x7fdfc81581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfce66b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81551f0 con 0x7fdfc80cc940 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfce66b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81554d0 con 0x7fdfc806aaf0 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfce66b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc81557b0 con 0x7fdfc8144c60 2023-11-24T08:04:19.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 0x7fdfc8157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 0x7fdfc8157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:57704/0 (socket says 172.21.15.161:57704) 2023-11-24T08:04:19.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 -- 172.21.15.161:0/381886414 learned_addr learned my addr 172.21.15.161:0/381886414 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfc7fff640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc806aaf0 0x7fdfc8138fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 -- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfc8144c60 msgr2=0x7fdfc81581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfc8144c60 0x7fdfc81581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 -- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc806aaf0 msgr2=0x7fdfc8138fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc806aaf0 0x7fdfc8138fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.222+0000 7fdfbffff640 1 -- 172.21.15.161:0/381886414 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009b30 con 0x7fdfc80cc940 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.223+0000 7fdfbffff640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 0x7fdfc8157c60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c450 tx=0x7fdfb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.223+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00052d0 con 0x7fdfc80cc940 2023-11-24T08:04:19.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.223+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0005430 con 0x7fdfc80cc940 2023-11-24T08:04:19.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.223+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc8155a90 con 0x7fdfc80cc940 2023-11-24T08:04:19.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.223+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0012870 con 0x7fdfc80cc940 2023-11-24T08:04:19.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.223+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc8156050 con 0x7fdfc80cc940 2023-11-24T08:04:19.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.225+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc80675d0 con 0x7fdfc80cc940 2023-11-24T08:04:19.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.225+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7fdfb00129d0 con 0x7fdfc80cc940 2023-11-24T08:04:19.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.226+0000 7fdfc57fa640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdfa806b080 0x7fdfa806d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:19.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.226+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdfb0089450 con 0x7fdfc80cc940 2023-11-24T08:04:19.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.227+0000 7fdfc7fff640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdfa806b080 0x7fdfa806d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:19.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.228+0000 7fdfc7fff640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdfa806b080 0x7fdfa806d540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800a730 tx=0x7fdfb8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:19.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.232+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfb0054160 con 0x7fdfc80cc940 2023-11-24T08:04:19.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.457+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfc80cfcc0 con 0x7fdfc80cc940 2023-11-24T08:04:19.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.459+0000 7fdfc57fa640 1 -- 172.21.15.161:0/381886414 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fdfc80cfcc0 con 0x7fdfc80cc940 2023-11-24T08:04:19.461 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:19.461 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:19.461 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdfa806b080 msgr2=0x7fdfa806d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdfa806b080 0x7fdfa806d540 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800a730 tx=0x7fdfb8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 msgr2=0x7fdfc8157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 0x7fdfc8157c60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c450 tx=0x7fdfb000c910 comp rx=0 tx=0).stop 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 shutdown_connections 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdfa806b080 0x7fdfa806d540 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfc8144c60 0x7fdfc81581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.461+0000 7fdfce66b640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdfc80cc940 0x7fdfc8157c60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.462+0000 7fdfce66b640 1 --2- 172.21.15.161:0/381886414 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfc806aaf0 0x7fdfc8138fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:19.464 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.462+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 >> 172.21.15.161:0/381886414 conn(0x7fdfc80cfef0 msgr2=0x7fdfc806e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:19.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.462+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 shutdown_connections 2023-11-24T08:04:19.465 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:19.462+0000 7fdfce66b640 1 -- 172.21.15.161:0/381886414 wait complete. 2023-11-24T08:04:19.483 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:19.728 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":70.378895847999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.699296861727081,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:04:19.729 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.69929686172708 }, "state": "open", "uptime": 70.378895848 } ] 2023-11-24T08:04:19.730 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:24.731 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:24.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.950+0000 7f3a49fa5640 1 Processor -- start 2023-11-24T08:04:24.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.950+0000 7f3a49fa5640 1 -- start start 2023-11-24T08:04:24.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a49fa5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 0x7f3a440cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a49fa5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 0x7f3a440702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a49fa5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a440cfc30 con 0x7f3a440cf7d0 2023-11-24T08:04:24.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a49fa5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a440b1ee0 con 0x7f3a4415e3b0 2023-11-24T08:04:24.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a49fa5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440b2780 con 0x7f3a44143ae0 2023-11-24T08:04:24.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a43fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 0x7f3a440702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.952+0000 7f3a437fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 0x7f3a440cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a437fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 0x7f3a440cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:36830/0 (socket says 172.21.15.161:36830) 2023-11-24T08:04:24.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a437fe640 1 -- 172.21.15.161:0/655406837 learned_addr learned my addr 172.21.15.161:0/655406837 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:24.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a43fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 0x7f3a440702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:44200/0 (socket says 172.21.15.161:44200) 2023-11-24T08:04:24.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a437fe640 1 -- 172.21.15.161:0/655406837 >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 msgr2=0x7f3a440702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:24.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a437fe640 1 --2- 172.21.15.161:0/655406837 >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 0x7f3a440702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a437fe640 1 -- 172.21.15.161:0/655406837 >> v1:172.21.15.175:6789/0 conn(0x7f3a440cf7d0 legacy=0x7f3a4415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a437fe640 1 -- 172.21.15.161:0/655406837 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4415e990 con 0x7f3a44143ae0 2023-11-24T08:04:24.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.953+0000 7f3a43fff640 1 --2- 172.21.15.161:0/655406837 >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 0x7f3a440702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:24.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.955+0000 7f3a437fe640 1 --2- 172.21.15.161:0/655406837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 0x7f3a440cf290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400bb10 tx=0x7f3a3402e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d49f91511d7fdf00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.955+0000 7f3a42ffd640 1 -- 172.21.15.161:0/655406837 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34036440 con 0x7f3a44143ae0 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.955+0000 7f3a42ffd640 1 -- 172.21.15.161:0/655406837 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a340365a0 con 0x7f3a44143ae0 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.955+0000 7f3a42ffd640 1 -- 172.21.15.161:0/655406837 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34036930 con 0x7f3a44143ae0 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 -- 172.21.15.161:0/655406837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 msgr2=0x7f3a440cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/655406837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 0x7f3a440cf290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a3400bb10 tx=0x7f3a3402e150 comp rx=0 tx=0).stop 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 -- 172.21.15.161:0/655406837 shutdown_connections 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/655406837 >> v2:172.21.15.175:3300/0 conn(0x7f3a4415e3b0 0x7f3a440702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/655406837 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a44143ae0 0x7f3a440cf290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 -- 172.21.15.161:0/655406837 >> 172.21.15.161:0/655406837 conn(0x7f3a4406a800 msgr2=0x7f3a4406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:24.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 -- 172.21.15.161:0/655406837 shutdown_connections 2023-11-24T08:04:24.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.956+0000 7f3a49fa5640 1 -- 172.21.15.161:0/655406837 wait complete. 2023-11-24T08:04:24.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.958+0000 7f3a49fa5640 1 Processor -- start 2023-11-24T08:04:24.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.958+0000 7f3a49fa5640 1 -- start start 2023-11-24T08:04:24.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a49fa5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a440cf7d0 0x7f3a44159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a49fa5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a44143ae0 0x7f3a4415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a49fa5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 0x7f3a4413cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a49fa5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44159eb0 con 0x7f3a4415e3b0 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a49fa5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440afba0 con 0x7f3a44143ae0 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a49fa5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a440aef90 con 0x7f3a440cf7d0 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a43fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 0x7f3a4413cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a43fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 0x7f3a4413cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40522/0 (socket says 172.21.15.161:40522) 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a43fff640 1 -- 172.21.15.161:0/1469221132 learned_addr learned my addr 172.21.15.161:0/1469221132 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a437fe640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a440cf7d0 0x7f3a44159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.959+0000 7f3a3bfff640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a44143ae0 0x7f3a4415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a43fff640 1 -- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a440cf7d0 msgr2=0x7f3a44159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a43fff640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a440cf7d0 0x7f3a44159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a43fff640 1 -- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a44143ae0 msgr2=0x7f3a4415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:24.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a43fff640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a44143ae0 0x7f3a4415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:24.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a43fff640 1 -- 172.21.15.161:0/1469221132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c009a70 con 0x7f3a4415e3b0 2023-11-24T08:04:24.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a43fff640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 0x7f3a4413cac0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00efc0 tx=0x7f3a3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c009cd0 con 0x7f3a4415e3b0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00f040 con 0x7f3a4415e3b0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c003990 con 0x7f3a4415e3b0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3400b770 con 0x7f3a4415e3b0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.960+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a440af550 con 0x7f3a4415e3b0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.962+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4413e740 con 0x7f3a4415e3b0 2023-11-24T08:04:24.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.962+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7f3a3c014480 con 0x7f3a4415e3b0 2023-11-24T08:04:24.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.963+0000 7f3a40ff9640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3a2406b0b0 0x7f3a2406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:24.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.963+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3a3c08a680 con 0x7f3a4415e3b0 2023-11-24T08:04:24.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.964+0000 7f3a437fe640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3a2406b0b0 0x7f3a2406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:24.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.965+0000 7f3a437fe640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3a2406b0b0 0x7f3a2406d570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a34038000 tx=0x7f3a34008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:24.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:24.968+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3a4413e740 con 0x7f3a4415e3b0 2023-11-24T08:04:25.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.194+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a4413e720 con 0x7f3a4415e3b0 2023-11-24T08:04:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.196+0000 7f3a40ff9640 1 -- 172.21.15.161:0/1469221132 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3a3c05de60 con 0x7f3a4415e3b0 2023-11-24T08:04:25.198 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:25.198 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:25.198 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:25.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3a2406b0b0 msgr2=0x7f3a2406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3a2406b0b0 0x7f3a2406d570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a34038000 tx=0x7f3a34008040 comp rx=0 tx=0).stop 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 msgr2=0x7f3a4413cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 0x7f3a4413cac0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00efc0 tx=0x7f3a3c00c490 comp rx=0 tx=0).stop 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 shutdown_connections 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3a2406b0b0 0x7f3a2406d570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a4415e3b0 0x7f3a4413cac0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3a44143ae0 0x7f3a4415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 --2- 172.21.15.161:0/1469221132 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3a440cf7d0 0x7f3a44159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 >> 172.21.15.161:0/1469221132 conn(0x7f3a4406a800 msgr2=0x7f3a440b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:25.201 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 shutdown_connections 2023-11-24T08:04:25.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:25.198+0000 7f3a49fa5640 1 -- 172.21.15.161:0/1469221132 wait complete. 2023-11-24T08:04:25.219 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:25.458 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":6,"uptime":76.109804745000005,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.45332758306278,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:04:25.458 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 6, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.45332758306278 }, "state": "open", "uptime": 76.109804745 } ] 2023-11-24T08:04:25.459 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:30.460 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:30.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.681+0000 7efdd17dc640 1 Processor -- start 2023-11-24T08:04:30.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.682+0000 7efdd17dc640 1 -- start start 2023-11-24T08:04:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdd17dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 0x7efdcc15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdd17dc640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc070c40 con 0x7efdcc0b3ae0 2023-11-24T08:04:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdd17dc640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdcc06c470 con 0x7efdcc0ae5a0 2023-11-24T08:04:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdd17dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc071450 con 0x7efdcc0cf9a0 2023-11-24T08:04:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdca7fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efdcc0b3ae0 0x7efdcc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:42946/0 (socket says 172.21.15.161:42946) 2023-11-24T08:04:30.686 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdca7fc640 1 -- 172.21.15.161:0/2704165616 learned_addr learned my addr 172.21.15.161:0/2704165616 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdcb7fe640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 0x7efdcc15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946968089 0 0) 0x7efdcc070c40 con 0x7efdcc0b3ae0 2023-11-24T08:04:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.684+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb4003520 con 0x7efdcc0b3ae0 2023-11-24T08:04:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708504814 0 0) 0x7efdb4003520 con 0x7efdcc0b3ae0 2023-11-24T08:04:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 msgr2=0x7efdcc15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:30.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 0x7efdcc15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 >> v1:172.21.15.175:6789/0 conn(0x7efdcc0ae5a0 legacy=0x7efdcc06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc06c750 con 0x7efdcc0b3ae0 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7efdc00019f0 con 0x7efdcc0b3ae0 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 >> v1:172.21.15.161:6789/0 conn(0x7efdcc0b3ae0 legacy=0x7efdcc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb40039a0 0x7efdb4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 0x7efdb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb4004d00 0x7efdb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc071450 con 0x7efdb40039a0 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb400bb20 con 0x7efdb4004d00 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb400bce0 con 0x7efdcc0cf9a0 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.685+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb40039a0 0x7efdb4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdca7fc640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 0x7efdb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdcaffd640 1 -- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 msgr2=0x7efdb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:30.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdcb7fe640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb4004d00 0x7efdb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdcc0cf9a0 0x7efdb40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdcaffd640 1 -- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb4004d00 msgr2=0x7efdb4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:30.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdb4004d00 0x7efdb4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.686+0000 7efdcaffd640 1 -- 172.21.15.161:0/2704165616 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb4003520 con 0x7efdb40039a0 2023-11-24T08:04:30.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.687+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb40039a0 0x7efdb4003dc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7efdbc001720 tx=0x7efdb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754f5bfb0503c821 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.687+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0052d0 con 0x7efdb40039a0 2023-11-24T08:04:30.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.687+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc02e050 con 0x7efdb40039a0 2023-11-24T08:04:30.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.687+0000 7efdc9ffb640 1 -- 172.21.15.161:0/2704165616 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0035f0 con 0x7efdb40039a0 2023-11-24T08:04:30.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdd17dc640 1 -- 172.21.15.161:0/2704165616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb40039a0 msgr2=0x7efdb4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2704165616 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdb40039a0 0x7efdb4003dc0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7efdbc001720 tx=0x7efdb40057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdcb7fe640 1 -- 172.21.15.161:0/2704165616 reap_dead start 2023-11-24T08:04:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdd17dc640 1 -- 172.21.15.161:0/2704165616 shutdown_connections 2023-11-24T08:04:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdd17dc640 1 -- 172.21.15.161:0/2704165616 >> 172.21.15.161:0/2704165616 conn(0x7efdcc06a800 msgr2=0x7efdcc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdd17dc640 1 -- 172.21.15.161:0/2704165616 shutdown_connections 2023-11-24T08:04:30.692 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.688+0000 7efdd17dc640 1 -- 172.21.15.161:0/2704165616 wait complete. 2023-11-24T08:04:30.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.690+0000 7efdd17dc640 1 Processor -- start 2023-11-24T08:04:30.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.690+0000 7efdd17dc640 1 -- start start 2023-11-24T08:04:30.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdd17dc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdb40039a0 0x7efdcc1f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdd17dc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 0x7efdcc156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdd17dc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdcc1f2b40 0x7efdcc1f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdd17dc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc0cc5c0 con 0x7efdcc15ab60 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdd17dc640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc1f7020 con 0x7efdcc1f2b40 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdd17dc640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc15d3e0 con 0x7efdb40039a0 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdca7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 0x7efdcc156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdca7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 0x7efdcc156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:40538/0 (socket says 172.21.15.161:40538) 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdca7fc640 1 -- 172.21.15.161:0/2595819251 learned_addr learned my addr 172.21.15.161:0/2595819251 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdb40039a0 0x7efdcc1f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdca7fc640 1 -- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdb40039a0 msgr2=0x7efdcc1f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdca7fc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdb40039a0 0x7efdcc1f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdca7fc640 1 -- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdcc1f2b40 msgr2=0x7efdcc1f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.691+0000 7efdcb7fe640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdcc1f2b40 0x7efdcc1f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdca7fc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdcc1f2b40 0x7efdcc1f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdca7fc640 1 -- 172.21.15.161:0/2595819251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc1572c0 con 0x7efdcc15ab60 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdb40039a0 0x7efdcc1f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdca7fc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 0x7efdcc156d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efdc00079e0 tx=0x7efdc000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc000ee50 con 0x7efdcc15ab60 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc0013420 con 0x7efdcc15ab60 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc0cb940 con 0x7efdcc15ab60 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00137d0 con 0x7efdcc15ab60 2023-11-24T08:04:30.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.692+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc0cbf00 con 0x7efdcc15ab60 2023-11-24T08:04:30.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.693+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc0cc700 con 0x7efdcc15ab60 2023-11-24T08:04:30.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.694+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 8) v1 ==== 89435+0+0 (secure 0 0 0) 0x7efdc0013930 con 0x7efdcc15ab60 2023-11-24T08:04:30.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.695+0000 7efdb37fe640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efdb806b0b0 0x7efdb806d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:30.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.695+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efdc008a140 con 0x7efdcc15ab60 2023-11-24T08:04:30.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.696+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efdb806b0b0 0x7efdb806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:30.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.697+0000 7efdcaffd640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efdb806b0b0 0x7efdb806d570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efdbc033000 tx=0x7efdbc009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:30.702 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.700+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdcc0cc700 con 0x7efdcc15ab60 2023-11-24T08:04:30.927 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.925+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdcc0cc700 con 0x7efdcc15ab60 2023-11-24T08:04:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.926+0000 7efdb37fe640 1 -- 172.21.15.161:0/2595819251 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7efdcc0cc700 con 0x7efdcc15ab60 2023-11-24T08:04:30.928 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:30.928 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:30.928 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:30.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efdb806b0b0 msgr2=0x7efdb806d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efdb806b0b0 0x7efdb806d570 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7efdbc033000 tx=0x7efdbc009030 comp rx=0 tx=0).stop 2023-11-24T08:04:30.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 msgr2=0x7efdcc156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 0x7efdcc156d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7efdc00079e0 tx=0x7efdc000e530 comp rx=0 tx=0).stop 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 shutdown_connections 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efdb806b0b0 0x7efdb806d570 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdcc1f2b40 0x7efdcc1f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efdcc15ab60 0x7efdcc156d80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 --2- 172.21.15.161:0/2595819251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdb40039a0 0x7efdcc1f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 >> 172.21.15.161:0/2595819251 conn(0x7efdcc06a800 msgr2=0x7efdcc0b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 shutdown_connections 2023-11-24T08:04:30.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:30.928+0000 7efdd17dc640 1 -- 172.21.15.161:0/2595819251 wait complete. 2023-11-24T08:04:30.951 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:31.190 INFO:teuthology.orchestra.run.smithi175.stdout:[{"id":5230,"entity":{"name":{"type":"client","num":5230},"addr":{"type":"any","addr":"172.21.15.175:0","nonce":4187095625}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":5,"uptime":81.841713626000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":18.210551692870936,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":14,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5230 172.21.15.175:0/4187095625","completed_requests":[{"tid":14,"created_ino":"0x0"},{"tid":15,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"a13ea5ff00cb4df7a9cc941166ddeb358881144c","ceph_version":"ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)","entity_id":"x","hostname":"smithi175","pid":"88672","root":"/"}}] 2023-11-24T08:04:31.191 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi175", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "88672", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 14 }, { "created_ino": "0x100000001f9", "tid": 15 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.175:0", "nonce": 4187095625, "type": "any" }, "name": { "num": 5230, "type": "client" } }, "id": 5230, "inst": "client.5230 172.21.15.175:0/4187095625", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 14, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 5, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 18.210551692870936 }, "state": "open", "uptime": 81.841713626 } ] 2023-11-24T08:04:31.191 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2023-11-24T08:04:36.192 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.415+0000 7f597c47c640 1 Processor -- start 2023-11-24T08:04:36.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.415+0000 7f597c47c640 1 -- start start 2023-11-24T08:04:36.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.417+0000 7f597c47c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59740ae5a0 0x7f597415e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.417+0000 7f597c47c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5974070c40 con 0x7f59740cf290 2023-11-24T08:04:36.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.417+0000 7f597c47c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597406c470 con 0x7f59740b3ae0 2023-11-24T08:04:36.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.417+0000 7f597c47c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5974071450 con 0x7f59740ae5a0 2023-11-24T08:04:36.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.417+0000 7f597aa19640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f59740cf290 0x7f59740b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59660/0 (socket says 172.21.15.161:59660) 2023-11-24T08:04:36.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.417+0000 7f597aa19640 1 -- 172.21.15.161:0/2422215367 learned_addr learned my addr 172.21.15.161:0/2422215367 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231362883 0 0) 0x7f5974070c40 con 0x7f59740cf290 2023-11-24T08:04:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f597a218640 1 --2- 172.21.15.161:0/2422215367 >> v2:172.21.15.175:3300/0 conn(0x7f59740ae5a0 0x7f597415e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5960003520 con 0x7f59740cf290 2023-11-24T08:04:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1169756645 0 0) 0x7f5960003520 con 0x7f59740cf290 2023-11-24T08:04:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 >> v2:172.21.15.175:3300/0 conn(0x7f59740ae5a0 msgr2=0x7f597415e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 --2- 172.21.15.161:0/2422215367 >> v2:172.21.15.175:3300/0 conn(0x7f59740ae5a0 0x7f597415e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 >> v1:172.21.15.175:6789/0 conn(0x7f59740b3ae0 legacy=0x7f597406cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597406c750 con 0x7f59740cf290 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f596c0019f0 con 0x7f59740cf290 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 >> v1:172.21.15.161:6789/0 conn(0x7f59740cf290 legacy=0x7f59740b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600039c0 0x7f5960003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59600047c0 0x7f5960004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600051d0 0x7f596000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974071450 con 0x7f59600047c0 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596000c110 con 0x7f59600051d0 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596000c2d0 con 0x7f59600039c0 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.418+0000 7f5979a17640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59600047c0 0x7f5960004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f597aa19640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600051d0 0x7f596000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f5979a17640 1 -- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600039c0 msgr2=0x7f5960003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f5979a17640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59600039c0 0x7f5960003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f5979a17640 1 -- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600051d0 msgr2=0x7f596000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f5979a17640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600051d0 0x7f596000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f5979a17640 1 -- 172.21.15.161:0/2422215367 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960003520 con 0x7f59600047c0 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.419+0000 7f597aa19640 1 -- 172.21.15.161:0/2422215367 reap_dead start 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.420+0000 7f5979a17640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59600047c0 0x7f5960004c40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5968001750 tx=0x7f59600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ae899022dbda2b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.420+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680052d0 con 0x7f59600047c0 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.420+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596802e050 con 0x7f59600047c0 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.420+0000 7f5979216640 1 -- 172.21.15.161:0/2422215367 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968003830 con 0x7f59600047c0 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 -- 172.21.15.161:0/2422215367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59600047c0 msgr2=0x7f5960004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59600047c0 0x7f5960004c40 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f5968001750 tx=0x7f59600057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 -- 172.21.15.161:0/2422215367 shutdown_connections 2023-11-24T08:04:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 --2- 172.21.15.161:0/2422215367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59600047c0 0x7f5960004c40 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 -- 172.21.15.161:0/2422215367 >> 172.21.15.161:0/2422215367 conn(0x7f597406a800 msgr2=0x7f597406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 -- 172.21.15.161:0/2422215367 shutdown_connections 2023-11-24T08:04:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.421+0000 7f597c47c640 1 -- 172.21.15.161:0/2422215367 wait complete. 2023-11-24T08:04:36.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.423+0000 7f597c47c640 1 Processor -- start 2023-11-24T08:04:36.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.423+0000 7f597c47c640 1 -- start start 2023-11-24T08:04:36.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597c47c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600047c0 0x7f597414f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597c47c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5974153140 0x7f59741535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597c47c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 0x7f5974153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597c47c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597415fdb0 con 0x7f5974153b70 2023-11-24T08:04:36.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597c47c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597414fec0 con 0x7f59600047c0 2023-11-24T08:04:36.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597c47c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974158760 con 0x7f5974153140 2023-11-24T08:04:36.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 0x7f5974153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 0x7f5974153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52948/0 (socket says 172.21.15.161:52948) 2023-11-24T08:04:36.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 -- 172.21.15.161:0/3164780641 learned_addr learned my addr 172.21.15.161:0/3164780641 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:36.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f5979a17640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5974153140 0x7f59741535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 -- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5974153140 msgr2=0x7f59741535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597a218640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600047c0 0x7f597414f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5974153140 0x7f59741535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 -- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600047c0 msgr2=0x7f597414f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600047c0 0x7f597414f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.424+0000 7f597aa19640 1 -- 172.21.15.161:0/3164780641 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5974158a40 con 0x7f5974153b70 2023-11-24T08:04:36.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.425+0000 7f597aa19640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 0x7f5974153ff0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f596c007c40 tx=0x7f596c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.425+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c004d60 con 0x7f5974153b70 2023-11-24T08:04:36.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.425+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c00bb80 con 0x7f5974153b70 2023-11-24T08:04:36.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.425+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974158d20 con 0x7f5974153b70 2023-11-24T08:04:36.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.425+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596c007110 con 0x7f5974153b70 2023-11-24T08:04:36.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.425+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59741601d0 con 0x7f5974153b70 2023-11-24T08:04:36.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.426+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597415fef0 con 0x7f5974153b70 2023-11-24T08:04:36.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.427+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f596c007270 con 0x7f5974153b70 2023-11-24T08:04:36.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.429+0000 7f5966ffd640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f595806aff0 0x7f595806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:36.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.429+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f596c089bf0 con 0x7f5974153b70 2023-11-24T08:04:36.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.429+0000 7f597a218640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f595806aff0 0x7f595806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:36.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.430+0000 7f597a218640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f595806aff0 0x7f595806d4b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5970006fd0 tx=0x7f5970008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:36.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.433+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f597415fef0 con 0x7f5974153b70 2023-11-24T08:04:36.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.661+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f597415fef0 con 0x7f5974153b70 2023-11-24T08:04:36.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.662+0000 7f5966ffd640 1 -- 172.21.15.161:0/3164780641 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f597415fef0 con 0x7f5974153b70 2023-11-24T08:04:36.664 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:36.664 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f595806aff0 msgr2=0x7f595806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f595806aff0 0x7f595806d4b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5970006fd0 tx=0x7f5970008040 comp rx=0 tx=0).stop 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 msgr2=0x7f5974153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 0x7f5974153ff0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f596c007c40 tx=0x7f596c00b4a0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 shutdown_connections 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f595806aff0 0x7f595806d4b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5974153b70 0x7f5974153ff0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5974153140 0x7f59741535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 --2- 172.21.15.161:0/3164780641 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59600047c0 0x7f597414f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 >> 172.21.15.161:0/3164780641 conn(0x7f597406a800 msgr2=0x7f59740acd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 shutdown_connections 2023-11-24T08:04:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:36.665+0000 7f597c47c640 1 -- 172.21.15.161:0/3164780641 wait complete. 2023-11-24T08:04:36.686 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2023-11-24T08:04:36.927 INFO:teuthology.orchestra.run.smithi175.stdout:[] 2023-11-24T08:04:36.928 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2023-11-24T08:04:36.928 DEBUG:tasks.ceph_test_case:wait_until_true: success in 75s and 0 retries 2023-11-24T08:04:36.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:04:36.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:37.056 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:37.177 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:04:37.177 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:04:37.177 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:37.236 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:04:37.236 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:04:37.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:37.236 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:04:37.286 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-11-24T08:04:37.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:37.287 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:04:37.287 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:37.347 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:04:37.347 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:04:37.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:37.348 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:04:37.400 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-24T08:04:37.401 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:37.401 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:04:37.401 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:37.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:04:37.462 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:04:37.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:37.463 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:04:37.518 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T08:04:37.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:37.519 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:04:37.519 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:37.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:04:37.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:04:37.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:04:37.578 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:04:37.632 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T08:04:37.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:04:37.634 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:37.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.854+0000 7f59f0da5640 1 Processor -- start 2023-11-24T08:04:37.855 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.854+0000 7f59f0da5640 1 -- start start 2023-11-24T08:04:37.857 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.855+0000 7f59f0da5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59ec13df80 0x7f59ec15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59f0da5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec13e360 0x7f59ec0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59f0da5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec06c470 con 0x7f59ec15f9c0 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59f0da5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec06c750 con 0x7f59ec13df80 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59f0da5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec06ca30 con 0x7f59ec13e360 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59ec13df80 0x7f59ec15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f59ec13df80 0x7f59ec15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52950/0 (socket says 172.21.15.161:52950) 2023-11-24T08:04:37.858 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 -- 172.21.15.161:0/1127936689 learned_addr learned my addr 172.21.15.161:0/1127936689 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:37.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 -- 172.21.15.161:0/1127936689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec13e360 msgr2=0x7f59ec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:37.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 --2- 172.21.15.161:0/1127936689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec13e360 0x7f59ec0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 -- 172.21.15.161:0/1127936689 >> v1:172.21.15.161:6789/0 conn(0x7f59ec15f9c0 legacy=0x7f59ec1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.859 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.856+0000 7f59ea59c640 1 -- 172.21.15.161:0/1127936689 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec06cd10 con 0x7f59ec13df80 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.857+0000 7f59ea59c640 1 --2- 172.21.15.161:0/1127936689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec15bee0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009870 tx=0x7f59dc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1948ff05ab5d39 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59e9d9b640 1 -- 172.21.15.161:0/1127936689 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc030840 con 0x7f59ec13df80 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59e9d9b640 1 -- 172.21.15.161:0/1127936689 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc0309a0 con 0x7f59ec13df80 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59e9d9b640 1 -- 172.21.15.161:0/1127936689 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc030d30 con 0x7f59ec13df80 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59f0da5640 1 -- 172.21.15.161:0/1127936689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 msgr2=0x7f59ec15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1127936689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec15bee0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009870 tx=0x7f59dc02b980 comp rx=0 tx=0).stop 2023-11-24T08:04:37.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59f0da5640 1 -- 172.21.15.161:0/1127936689 shutdown_connections 2023-11-24T08:04:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1127936689 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec13e360 0x7f59ec0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1127936689 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec15bee0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.858+0000 7f59f0da5640 1 -- 172.21.15.161:0/1127936689 >> 172.21.15.161:0/1127936689 conn(0x7f59ec06a800 msgr2=0x7f59ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.859+0000 7f59f0da5640 1 -- 172.21.15.161:0/1127936689 shutdown_connections 2023-11-24T08:04:37.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.859+0000 7f59f0da5640 1 -- 172.21.15.161:0/1127936689 wait complete. 2023-11-24T08:04:37.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.860+0000 7f59f0da5640 1 Processor -- start 2023-11-24T08:04:37.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.860+0000 7f59f0da5640 1 -- start start 2023-11-24T08:04:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.861+0000 7f59f0da5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.861+0000 7f59f0da5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59ec13e360 0x7f59ec071a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.861+0000 7f59f0da5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec15f9c0 0x7f59ec13ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.861+0000 7f59f0da5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec070a30 con 0x7f59ec13df80 2023-11-24T08:04:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.861+0000 7f59f0da5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec070ca0 con 0x7f59ec13e360 2023-11-24T08:04:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.861+0000 7f59f0da5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec070f80 con 0x7f59ec15f9c0 2023-11-24T08:04:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52960/0 (socket says 172.21.15.161:52960) 2023-11-24T08:04:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 -- 172.21.15.161:0/1709898092 learned_addr learned my addr 172.21.15.161:0/1709898092 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 -- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec15f9c0 msgr2=0x7f59ec13ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec15f9c0 0x7f59ec13ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 -- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59ec13e360 msgr2=0x7f59ec071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59ec13e360 0x7f59ec071a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 -- 172.21.15.161:0/1709898092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59dc0094d0 con 0x7f59ec13df80 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.862+0000 7f59ea59c640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec152840 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009870 tx=0x7f59dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.863+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0307f0 con 0x7f59ec13df80 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.863+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59dc039d90 con 0x7f59ec13df80 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.863+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59dc043610 con 0x7f59ec13df80 2023-11-24T08:04:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.863+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec071260 con 0x7f59ec13df80 2023-11-24T08:04:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.863+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec152d80 con 0x7f59ec13df80 2023-11-24T08:04:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.864+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec0b09e0 con 0x7f59ec13df80 2023-11-24T08:04:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.865+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f59dc042390 con 0x7f59ec13df80 2023-11-24T08:04:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.866+0000 7f59e2ffd640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f59cc06aff0 0x7f59cc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.866+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f59dc0abeb0 con 0x7f59ec13df80 2023-11-24T08:04:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.866+0000 7f59e3fff640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f59cc06aff0 0x7f59cc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.867+0000 7f59e3fff640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f59cc06aff0 0x7f59cc06d4b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0ae150 tx=0x7f59d4006c90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:37.870+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59dc076b80 con 0x7f59ec13df80 2023-11-24T08:04:38.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.092+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59ec0675d0 con 0x7f59ec13df80 2023-11-24T08:04:38.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.093+0000 7f59e2ffd640 1 -- 172.21.15.161:0/1709898092 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f59dc034090 con 0x7f59ec13df80 2023-11-24T08:04:38.095 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:38.095 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:38.095 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f59cc06aff0 msgr2=0x7f59cc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f59cc06aff0 0x7f59cc06d4b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0ae150 tx=0x7f59d4006c90 comp rx=0 tx=0).stop 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 msgr2=0x7f59ec152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec152840 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f59dc009870 tx=0x7f59dc004730 comp rx=0 tx=0).stop 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 shutdown_connections 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f59cc06aff0 0x7f59cc06d4b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59ec15f9c0 0x7f59ec13ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59ec13e360 0x7f59ec071a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 --2- 172.21.15.161:0/1709898092 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f59ec13df80 0x7f59ec152840 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 >> 172.21.15.161:0/1709898092 conn(0x7f59ec06a800 msgr2=0x7f59ec15dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 shutdown_connections 2023-11-24T08:04:38.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.096+0000 7f59f0da5640 1 -- 172.21.15.161:0/1709898092 wait complete. 2023-11-24T08:04:38.115 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:38.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.326+0000 7fd9c4f61640 1 Processor -- start 2023-11-24T08:04:38.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.326+0000 7fd9c4f61640 1 -- start start 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.327+0000 7fd9c4f61640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd9c013df80 0x7fd9c015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9c4f61640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9c00cf9a0 0x7fd9c00cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9c4f61640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c006c470 con 0x7fd9c013e360 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9c4f61640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c006c750 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9c4f61640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c006ca30 con 0x7fd9c013df80 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9c00cf9a0 0x7fd9c00cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd9c00cf9a0 0x7fd9c00cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52964/0 (socket says 172.21.15.161:52964) 2023-11-24T08:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 -- 172.21.15.161:0/762686945 learned_addr learned my addr 172.21.15.161:0/762686945 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 -- 172.21.15.161:0/762686945 >> v2:172.21.15.175:3300/0 conn(0x7fd9c013df80 msgr2=0x7fd9c015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 --2- 172.21.15.161:0/762686945 >> v2:172.21.15.175:3300/0 conn(0x7fd9c013df80 0x7fd9c015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 -- 172.21.15.161:0/762686945 >> v1:172.21.15.175:6789/0 conn(0x7fd9c013e360 legacy=0x7fd9c00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.328+0000 7fd9bed9d640 1 -- 172.21.15.161:0/762686945 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c006cd10 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.330+0000 7fd9bed9d640 1 --2- 172.21.15.161:0/762686945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c00cd840 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0072770 tx=0x7fd9b802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683a6df6872a9fe9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.330+0000 7fd9bd59a640 1 -- 172.21.15.161:0/762686945 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b802ca80 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.330+0000 7fd9bd59a640 1 -- 172.21.15.161:0/762686945 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b802cbe0 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.330+0000 7fd9bd59a640 1 -- 172.21.15.161:0/762686945 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80343f0 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.330+0000 7fd9c4f61640 1 -- 172.21.15.161:0/762686945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 msgr2=0x7fd9c00cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.330+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/762686945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c00cd840 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0072770 tx=0x7fd9b802bee0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.331+0000 7fd9c4f61640 1 -- 172.21.15.161:0/762686945 shutdown_connections 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.331+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/762686945 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c00cd840 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.331+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/762686945 >> v2:172.21.15.175:3300/0 conn(0x7fd9c013df80 0x7fd9c015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.331+0000 7fd9c4f61640 1 -- 172.21.15.161:0/762686945 >> 172.21.15.161:0/762686945 conn(0x7fd9c006a800 msgr2=0x7fd9c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.331+0000 7fd9c4f61640 1 -- 172.21.15.161:0/762686945 shutdown_connections 2023-11-24T08:04:38.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.331+0000 7fd9c4f61640 1 -- 172.21.15.161:0/762686945 wait complete. 2023-11-24T08:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.332+0000 7fd9c4f61640 1 Processor -- start 2023-11-24T08:04:38.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.333+0000 7fd9c4f61640 1 -- start start 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.333+0000 7fd9c4f61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c0153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.333+0000 7fd9c4f61640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9c013df80 0x7fd9c00ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.333+0000 7fd9c4f61640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9c013e360 0x7fd9c015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9c4f61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00ae280 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9c4f61640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0070650 con 0x7fd9c013df80 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9c4f61640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c015abe0 con 0x7fd9c013e360 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c0153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c0153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52968/0 (socket says 172.21.15.161:52968) 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 -- 172.21.15.161:0/2646120929 learned_addr learned my addr 172.21.15.161:0/2646120929 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 -- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9c013e360 msgr2=0x7fd9c015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9c013e360 0x7fd9c015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 -- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9c013df80 msgr2=0x7fd9c00ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9c013df80 0x7fd9c00ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.336 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 -- 172.21.15.161:0/2646120929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009b30 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.334+0000 7fd9be59c640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c0153590 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b4a0 tx=0x7fd9b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.335+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0010610 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.335+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0010770 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.335+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0010b20 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.335+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c00ad9e0 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.335+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c00adfa0 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.336+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00cc100 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.337+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd9b0010c80 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.338+0000 7fd9aeffd640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd9a006aff0 0x7fd9a006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.338+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd9b00896b0 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.339 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.338+0000 7fd9bdd9b640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd9a006aff0 0x7fd9a006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.340 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.339+0000 7fd9bdd9b640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd9a006aff0 0x7fd9a006d4b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00b3170 tx=0x7fd9b40079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.342+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9b0054400 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.517+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9c00675d0 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.519+0000 7fd9aeffd640 1 -- 172.21.15.161:0/2646120929 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16688 (secure 0 0 0) 0x7fd9b0057a20 con 0x7fd9c00cf9a0 2023-11-24T08:04:38.521 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:38.521 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":49,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:03:06.535213+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:38.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd9a006aff0 msgr2=0x7fd9a006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd9a006aff0 0x7fd9a006d4b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00b3170 tx=0x7fd9b40079b0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 msgr2=0x7fd9c0153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c0153590 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000b4a0 tx=0x7fd9b000b960 comp rx=0 tx=0).stop 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 shutdown_connections 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd9a006aff0 0x7fd9a006d4b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9c013e360 0x7fd9c015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9c013df80 0x7fd9c00ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 --2- 172.21.15.161:0/2646120929 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd9c00cf9a0 0x7fd9c0153590 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 >> 172.21.15.161:0/2646120929 conn(0x7fd9c006a800 msgr2=0x7fd9c006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 shutdown_connections 2023-11-24T08:04:38.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.522+0000 7fd9c4f61640 1 -- 172.21.15.161:0/2646120929 wait complete. 2023-11-24T08:04:38.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:02:25.158735+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:02:26.286978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:38.541 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:38.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.755+0000 7f7b80f9e640 1 Processor -- start 2023-11-24T08:04:38.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.755+0000 7f7b80f9e640 1 -- start start 2023-11-24T08:04:38.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.757+0000 7f7b80f9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c0ccb50 0x7f7b7c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.757+0000 7f7b80f9e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7b7c15bf10 0x7f7b7c143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.757+0000 7f7b80f9e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c15f4e0 con 0x7f7b7c0adf20 2023-11-24T08:04:38.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.757+0000 7f7b80f9e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c15f970 con 0x7f7b7c15bf10 2023-11-24T08:04:38.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.757+0000 7f7b80f9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c15c3c0 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.758+0000 7f7b7b7fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7b7c0adf20 0x7f7b7c0cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.161:39810/0 (socket says 172.21.15.161:39810) 2023-11-24T08:04:38.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.758+0000 7f7b7b7fe640 1 -- 172.21.15.161:0/983369000 learned_addr learned my addr 172.21.15.161:0/983369000 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:38.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.758+0000 7f7b73fff640 1 --2- 172.21.15.161:0/983369000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c0ccb50 0x7f7b7c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.758+0000 7f7b7bfff640 1 --2- 172.21.15.161:0/983369000 >> v2:172.21.15.175:3300/0 conn(0x7f7b7c15bf10 0x7f7b7c143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b7affd640 1 -- 172.21.15.161:0/983369000 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225951888 0 0) 0x7f7b7c15f4e0 con 0x7f7b7c0adf20 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b7affd640 1 -- 172.21.15.161:0/983369000 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b68003520 con 0x7f7b7c0adf20 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b73fff640 1 -- 172.21.15.161:0/983369000 >> v2:172.21.15.175:3300/0 conn(0x7f7b7c15bf10 msgr2=0x7f7b7c143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b73fff640 1 --2- 172.21.15.161:0/983369000 >> v2:172.21.15.175:3300/0 conn(0x7f7b7c15bf10 0x7f7b7c143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b73fff640 1 -- 172.21.15.161:0/983369000 >> v1:172.21.15.175:6789/0 conn(0x7f7b7c0adf20 legacy=0x7f7b7c0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b73fff640 1 -- 172.21.15.161:0/983369000 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c071130 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.759+0000 7f7b7bfff640 1 --2- 172.21.15.161:0/983369000 >> v2:172.21.15.175:3300/0 conn(0x7f7b7c15bf10 0x7f7b7c143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:38.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.760+0000 7f7b73fff640 1 --2- 172.21.15.161:0/983369000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c0ccb50 0x7f7b7c070a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b640097a0 tx=0x7f7b6402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=512606f5ea8f3f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.761+0000 7f7b7affd640 1 -- 172.21.15.161:0/983369000 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64031780 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.761+0000 7f7b7affd640 1 -- 172.21.15.161:0/983369000 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b640318e0 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.761+0000 7f7b7affd640 1 -- 172.21.15.161:0/983369000 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64031c70 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 -- 172.21.15.161:0/983369000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c0ccb50 msgr2=0x7f7b7c070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/983369000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c0ccb50 0x7f7b7c070a30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7b640097a0 tx=0x7f7b6402b820 comp rx=0 tx=0).stop 2023-11-24T08:04:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 -- 172.21.15.161:0/983369000 shutdown_connections 2023-11-24T08:04:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/983369000 >> v2:172.21.15.175:3300/0 conn(0x7f7b7c15bf10 0x7f7b7c143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/983369000 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c0ccb50 0x7f7b7c070a30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 -- 172.21.15.161:0/983369000 >> 172.21.15.161:0/983369000 conn(0x7f7b7c06a7d0 msgr2=0x7f7b7c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 -- 172.21.15.161:0/983369000 shutdown_connections 2023-11-24T08:04:38.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.762+0000 7f7b80f9e640 1 -- 172.21.15.161:0/983369000 wait complete. 2023-11-24T08:04:38.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.764+0000 7f7b80f9e640 1 Processor -- start 2023-11-24T08:04:38.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.764+0000 7f7b80f9e640 1 -- start start 2023-11-24T08:04:38.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b80f9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c0adf20 0x7f7b7c15aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b80f9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 0x7f7b7c143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b80f9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c15bf10 0x7f7b7c143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b80f9e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0ac600 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b80f9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0ab9f0 con 0x7f7b7c0adf20 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b80f9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0abcd0 con 0x7f7b7c15bf10 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b73fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 0x7f7b7c143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b73fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 0x7f7b7c143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52974/0 (socket says 172.21.15.161:52974) 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b73fff640 1 -- 172.21.15.161:0/555636573 learned_addr learned my addr 172.21.15.161:0/555636573 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b7bfff640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c15bf10 0x7f7b7c143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.765+0000 7f7b7b7fe640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c0adf20 0x7f7b7c15aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b73fff640 1 -- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c15bf10 msgr2=0x7f7b7c143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b73fff640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c15bf10 0x7f7b7c143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b73fff640 1 -- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c0adf20 msgr2=0x7f7b7c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b73fff640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c0adf20 0x7f7b7c15aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b73fff640 1 -- 172.21.15.161:0/555636573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74009a70 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b73fff640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 0x7f7b7c143400 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7b64000c00 tx=0x7f7b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64032820 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b640329c0 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b64009400 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64032d70 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.766+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c0ac290 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.768+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c067450 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.768+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7b6404d3f0 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.769+0000 7f7b78ff9640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7b5c06aff0 0x7f7b5c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:38.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.769+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7b640ab730 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.770+0000 7f7b7b7fe640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7b5c06aff0 0x7f7b5c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:38.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.771+0000 7f7b7b7fe640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7b5c06aff0 0x7f7b5c06d4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0011e0 tx=0x7f7b6c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:38.775 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.774+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b64076410 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.963+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b7c06dad0 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.964+0000 7f7b78ff9640 1 -- 172.21.15.161:0/555636573 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b64079a30 con 0x7f7b7c0ccb50 2023-11-24T08:04:38.965 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:04:38.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7b5c06aff0 msgr2=0x7f7b5c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7b5c06aff0 0x7f7b5c06d4b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0011e0 tx=0x7f7b6c009040 comp rx=0 tx=0).stop 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 msgr2=0x7f7b7c143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 0x7f7b7c143400 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7b64000c00 tx=0x7f7b640046c0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 shutdown_connections 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7b5c06aff0 0x7f7b5c06d4b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7b7c15bf10 0x7f7b7c143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b7c0ccb50 0x7f7b7c143400 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 --2- 172.21.15.161:0/555636573 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7b7c0adf20 0x7f7b7c15aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 >> 172.21.15.161:0/555636573 conn(0x7f7b7c06a7d0 msgr2=0x7f7b7c0713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 shutdown_connections 2023-11-24T08:04:38.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:38.966+0000 7f7b80f9e640 1 -- 172.21.15.161:0/555636573 wait complete. 2023-11-24T08:04:38.987 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:04:39.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.201+0000 7fc6da6bb640 1 Processor -- start 2023-11-24T08:04:39.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.201+0000 7fc6da6bb640 1 -- start start 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.203+0000 7fc6da6bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 0x7fc6d40b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.203+0000 7fc6da6bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d406cea0 con 0x7fc6d406c6b0 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.203+0000 7fc6da6bb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d406cbc0 con 0x7fc6d40cd240 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.203+0000 7fc6da6bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d406f350 con 0x7fc6d409a170 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.203+0000 7fc6d8c58640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc6d406c6b0 0x7fc6d40cf640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:59688/0 (socket says 172.21.15.161:59688) 2023-11-24T08:04:39.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.203+0000 7fc6d8c58640 1 -- 172.21.15.161:0/1339514553 learned_addr learned my addr 172.21.15.161:0/1339514553 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:39.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6cbfff640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 0x7fc6d40b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012903830 0 0) 0x7fc6d406cea0 con 0x7fc6d406c6b0 2023-11-24T08:04:39.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c0003520 con 0x7fc6d406c6b0 2023-11-24T08:04:39.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047401141 0 0) 0x7fc6c0003520 con 0x7fc6d406c6b0 2023-11-24T08:04:39.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 msgr2=0x7fc6d40b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 0x7fc6d40b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 >> v1:172.21.15.175:6789/0 conn(0x7fc6d40cd240 legacy=0x7fc6d4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d406f630 con 0x7fc6d406c6b0 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc6cc0019f0 con 0x7fc6d406c6b0 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 >> v1:172.21.15.161:6789/0 conn(0x7fc6d406c6b0 legacy=0x7fc6d40cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6c00039a0 0x7fc6c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 0x7fc6c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c0004d00 0x7fc6c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d406f350 con 0x7fc6c00039a0 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c000bb10 con 0x7fc6c0004d00 2023-11-24T08:04:39.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c000bca0 con 0x7fc6d409a170 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.204+0000 7fc6d3fff640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6c00039a0 0x7fc6c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.205+0000 7fc6d3fff640 1 -- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 msgr2=0x7fc6c00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.205+0000 7fc6d3fff640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d409a170 0x7fc6c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.205+0000 7fc6d3fff640 1 -- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c0004d00 msgr2=0x7fc6c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.205+0000 7fc6d3fff640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c0004d00 0x7fc6c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.205+0000 7fc6d3fff640 1 -- 172.21.15.161:0/1339514553 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c0003520 con 0x7fc6c00039a0 2023-11-24T08:04:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.206+0000 7fc6d3fff640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6c00039a0 0x7fc6c0003dc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4001780 tx=0x7fc6c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33c0cf64a014beb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.206+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40052d0 con 0x7fc6c00039a0 2023-11-24T08:04:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.206+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c402e050 con 0x7fc6c00039a0 2023-11-24T08:04:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.206+0000 7fc6d37fe640 1 -- 172.21.15.161:0/1339514553 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40035f0 con 0x7fc6c00039a0 2023-11-24T08:04:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6da6bb640 1 -- 172.21.15.161:0/1339514553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6c00039a0 msgr2=0x7fc6c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/1339514553 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6c00039a0 0x7fc6c0003dc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4001780 tx=0x7fc6c00057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6d8c58640 1 -- 172.21.15.161:0/1339514553 reap_dead start 2023-11-24T08:04:39.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6da6bb640 1 -- 172.21.15.161:0/1339514553 shutdown_connections 2023-11-24T08:04:39.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6da6bb640 1 -- 172.21.15.161:0/1339514553 >> 172.21.15.161:0/1339514553 conn(0x7fc6d40b2d00 msgr2=0x7fc6d40b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6da6bb640 1 -- 172.21.15.161:0/1339514553 shutdown_connections 2023-11-24T08:04:39.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.207+0000 7fc6da6bb640 1 -- 172.21.15.161:0/1339514553 wait complete. 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.209+0000 7fc6da6bb640 1 Processor -- start 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.209+0000 7fc6da6bb640 1 -- start start 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6da6bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c00039a0 0x7fc6d40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6da6bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 0x7fc6d4154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6da6bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d40cf700 0x7fc6d40cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6da6bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40d00f0 con 0x7fc6d40b4060 2023-11-24T08:04:39.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6da6bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40b6710 con 0x7fc6c00039a0 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6da6bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40b5100 con 0x7fc6d40cf700 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 0x7fc6d4154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 0x7fc6d4154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52988/0 (socket says 172.21.15.161:52988) 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 -- 172.21.15.161:0/199377476 learned_addr learned my addr 172.21.15.161:0/199377476 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 -- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d40cf700 msgr2=0x7fc6d40cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d40cf700 0x7fc6d40cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 -- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c00039a0 msgr2=0x7fc6d40b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c00039a0 0x7fc6d40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.210+0000 7fc6cbfff640 1 -- 172.21.15.161:0/199377476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d40b44f0 con 0x7fc6d40b4060 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.211+0000 7fc6cbfff640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 0x7fc6d4154870 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00d5f0 tx=0x7fc6bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.211+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0125f0 con 0x7fc6d40b4060 2023-11-24T08:04:39.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.211+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc012750 con 0x7fc6d40b4060 2023-11-24T08:04:39.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.211+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc012b00 con 0x7fc6d40b4060 2023-11-24T08:04:39.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.211+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d40b47d0 con 0x7fc6d40b4060 2023-11-24T08:04:39.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.211+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d40b4d90 con 0x7fc6d40b4060 2023-11-24T08:04:39.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.212+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d40675d0 con 0x7fc6d40b4060 2023-11-24T08:04:39.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.213+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc6bc012c60 con 0x7fc6d40b4060 2023-11-24T08:04:39.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.214+0000 7fc6d17fa640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc6b406b020 0x7fc6b406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.214+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc6bc089d00 con 0x7fc6d40b4060 2023-11-24T08:04:39.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.214+0000 7fc6d3fff640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc6b406b020 0x7fc6b406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.215+0000 7fc6d3fff640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc6b406b020 0x7fc6b406d4e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4033000 tx=0x7fc6c402f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.219 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.218+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc6bc054ae0 con 0x7fc6d40b4060 2023-11-24T08:04:39.412 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.411+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6d40b4f50 con 0x7fc6d40b4060 2023-11-24T08:04:39.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.412+0000 7fc6d17fa640 1 -- 172.21.15.161:0/199377476 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc6bc058100 con 0x7fc6d40b4060 2023-11-24T08:04:39.413 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc6b406b020 msgr2=0x7fc6b406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc6b406b020 0x7fc6b406d4e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4033000 tx=0x7fc6c402f000 comp rx=0 tx=0).stop 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 msgr2=0x7fc6d4154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 0x7fc6d4154870 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00d5f0 tx=0x7fc6bc00dab0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 shutdown_connections 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc6b406b020 0x7fc6b406d4e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc6d40cf700 0x7fc6d40cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6d40b4060 0x7fc6d4154870 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 --2- 172.21.15.161:0/199377476 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc6c00039a0 0x7fc6d40b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 >> 172.21.15.161:0/199377476 conn(0x7fc6d40b2d00 msgr2=0x7fc6d4099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.414+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 shutdown_connections 2023-11-24T08:04:39.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.415+0000 7fc6da6bb640 1 -- 172.21.15.161:0/199377476 wait complete. 2023-11-24T08:04:39.435 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:04:39.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.652+0000 7f0acead4640 1 Processor -- start 2023-11-24T08:04:39.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.652+0000 7f0acead4640 1 -- start start 2023-11-24T08:04:39.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acead4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac8143ae0 0x7f0ac80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acead4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0ac815e3b0 0x7f0ac80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acead4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac80cfc30 con 0x7f0ac80cf7d0 2023-11-24T08:04:39.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acead4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac80b1ee0 con 0x7f0ac815e3b0 2023-11-24T08:04:39.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acead4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac80b2780 con 0x7f0ac8143ae0 2023-11-24T08:04:39.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acd071640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0ac815e3b0 0x7f0ac80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acd071640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0ac815e3b0 0x7f0ac80702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:52996/0 (socket says 172.21.15.161:52996) 2023-11-24T08:04:39.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.654+0000 7f0acd071640 1 -- 172.21.15.161:0/1661110620 learned_addr learned my addr 172.21.15.161:0/1661110620 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:39.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.655+0000 7f0acc870640 1 --2- 172.21.15.161:0/1661110620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac8143ae0 0x7f0ac80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.655+0000 7f0acd071640 1 -- 172.21.15.161:0/1661110620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac8143ae0 msgr2=0x7f0ac80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.655+0000 7f0acd071640 1 --2- 172.21.15.161:0/1661110620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac8143ae0 0x7f0ac80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.655+0000 7f0acd071640 1 -- 172.21.15.161:0/1661110620 >> v1:172.21.15.175:6789/0 conn(0x7f0ac80cf7d0 legacy=0x7f0ac815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:39.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.655+0000 7f0acd071640 1 -- 172.21.15.161:0/1661110620 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac815e990 con 0x7f0ac815e3b0 2023-11-24T08:04:39.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.656+0000 7f0acd071640 1 --2- 172.21.15.161:0/1661110620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac80702c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009870 tx=0x7f0ac002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ab18e4c734211d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.656+0000 7f0ac77fe640 1 -- 172.21.15.161:0/1661110620 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0031640 con 0x7f0ac815e3b0 2023-11-24T08:04:39.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0ac77fe640 1 -- 172.21.15.161:0/1661110620 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac00317a0 con 0x7f0ac815e3b0 2023-11-24T08:04:39.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0ac77fe640 1 -- 172.21.15.161:0/1661110620 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0031b30 con 0x7f0ac815e3b0 2023-11-24T08:04:39.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 -- 172.21.15.161:0/1661110620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 msgr2=0x7f0ac80702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 --2- 172.21.15.161:0/1661110620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac80702c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0009870 tx=0x7f0ac002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 -- 172.21.15.161:0/1661110620 shutdown_connections 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 --2- 172.21.15.161:0/1661110620 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac80702c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 --2- 172.21.15.161:0/1661110620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac8143ae0 0x7f0ac80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 -- 172.21.15.161:0/1661110620 >> 172.21.15.161:0/1661110620 conn(0x7f0ac806a800 msgr2=0x7f0ac806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 -- 172.21.15.161:0/1661110620 shutdown_connections 2023-11-24T08:04:39.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.657+0000 7f0acead4640 1 -- 172.21.15.161:0/1661110620 wait complete. 2023-11-24T08:04:39.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.659+0000 7f0acead4640 1 Processor -- start 2023-11-24T08:04:39.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.659+0000 7f0acead4640 1 -- start start 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acead4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80cf7d0 0x7f0ac8141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acead4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac8143ae0 0x7f0ac8140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acead4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac8155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acead4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac81408a0 con 0x7f0ac815e3b0 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acead4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8140ad0 con 0x7f0ac8143ae0 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acead4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac8140db0 con 0x7f0ac80cf7d0 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acd071640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac8155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acd071640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac8155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53008/0 (socket says 172.21.15.161:53008) 2023-11-24T08:04:39.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.660+0000 7f0acd071640 1 -- 172.21.15.161:0/1839990171 learned_addr learned my addr 172.21.15.161:0/1839990171 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:39.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acd071640 1 -- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80cf7d0 msgr2=0x7f0ac8141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acd071640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80cf7d0 0x7f0ac8141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acd071640 1 -- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac8143ae0 msgr2=0x7f0ac8140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acd071640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac8143ae0 0x7f0ac8140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acd071640 1 -- 172.21.15.161:0/1839990171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00094d0 con 0x7f0ac815e3b0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acd071640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac8155c50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0ac002b930 tx=0x7f0ac00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac003ac60 con 0x7f0ac815e3b0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac003ade0 con 0x7f0ac815e3b0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac0044630 con 0x7f0ac815e3b0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.661+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac8141090 con 0x7f0ac815e3b0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.662+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac813ad10 con 0x7f0ac815e3b0 2023-11-24T08:04:39.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.663+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac80675d0 con 0x7f0ac815e3b0 2023-11-24T08:04:39.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.664+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0ac002f050 con 0x7f0ac815e3b0 2023-11-24T08:04:39.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.664+0000 7f0ac57fa640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0aac06b020 0x7f0aac06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:39.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.665+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0ac00abb20 con 0x7f0ac815e3b0 2023-11-24T08:04:39.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.665+0000 7f0acc870640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0aac06b020 0x7f0aac06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:39.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.666+0000 7f0acc870640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0aac06b020 0x7f0aac06d4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8006fd0 tx=0x7f0ab8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:39.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.669+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ac0076760 con 0x7f0ac815e3b0 2023-11-24T08:04:39.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.859+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ac806af20 con 0x7f0ac815e3b0 2023-11-24T08:04:39.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.860+0000 7f0ac57fa640 1 -- 172.21.15.161:0/1839990171 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ac004d450 con 0x7f0ac815e3b0 2023-11-24T08:04:39.861 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:04:39.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0aac06b020 msgr2=0x7f0aac06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0aac06b020 0x7f0aac06d4e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8006fd0 tx=0x7f0ab8008040 comp rx=0 tx=0).stop 2023-11-24T08:04:39.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 msgr2=0x7f0ac8155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:39.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac8155c50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0ac002b930 tx=0x7f0ac00046c0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 shutdown_connections 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0aac06b020 0x7f0aac06d4e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0ac815e3b0 0x7f0ac8155c50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0ac8143ae0 0x7f0ac8140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 --2- 172.21.15.161:0/1839990171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0ac80cf7d0 0x7f0ac8141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 >> 172.21.15.161:0/1839990171 conn(0x7f0ac806a800 msgr2=0x7f0ac80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 shutdown_connections 2023-11-24T08:04:39.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:39.863+0000 7f0acead4640 1 -- 172.21.15.161:0/1839990171 wait complete. 2023-11-24T08:04:39.884 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:39.972 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:39.979 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:04:40.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.092+0000 7fa4328c2640 1 Processor -- start 2023-11-24T08:04:40.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.092+0000 7fa4328c2640 1 -- start start 2023-11-24T08:04:40.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.093+0000 7fa4328c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 0x7fa42c161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.093+0000 7fa4328c2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa42c0ce8f0 0x7fa42c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.093+0000 7fa4328c2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c1618a0 con 0x7fa42c0cfbe0 2023-11-24T08:04:40.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.093+0000 7fa4328c2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0d0de0 con 0x7fa42c0ce8f0 2023-11-24T08:04:40.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.093+0000 7fa4328c2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0d10c0 con 0x7fa42c160f80 2023-11-24T08:04:40.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.094+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 0x7fa42c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.094+0000 7fa42b7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa42c0ce8f0 0x7fa42c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.094+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 0x7fa42c161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:60812/0 (socket says 172.21.15.161:60812) 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.094+0000 7fa42bfff640 1 -- 172.21.15.161:0/3155387611 learned_addr learned my addr 172.21.15.161:0/3155387611 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.095+0000 7fa42bfff640 1 -- 172.21.15.161:0/3155387611 >> v2:172.21.15.175:3300/0 conn(0x7fa42c0ce8f0 msgr2=0x7fa42c0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.095+0000 7fa42bfff640 1 --2- 172.21.15.161:0/3155387611 >> v2:172.21.15.175:3300/0 conn(0x7fa42c0ce8f0 0x7fa42c0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.095+0000 7fa42bfff640 1 -- 172.21.15.161:0/3155387611 >> v1:172.21.15.175:6789/0 conn(0x7fa42c0cfbe0 legacy=0x7fa42c0d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.095+0000 7fa42bfff640 1 -- 172.21.15.161:0/3155387611 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0d13a0 con 0x7fa42c160f80 2023-11-24T08:04:40.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.095+0000 7fa42b7fe640 1 --2- 172.21.15.161:0/3155387611 >> v2:172.21.15.175:3300/0 conn(0x7fa42c0ce8f0 0x7fa42c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.096+0000 7fa42bfff640 1 --2- 172.21.15.161:0/3155387611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 0x7fa42c161360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009870 tx=0x7fa41c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b73ef87831b335 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.096+0000 7fa42affd640 1 -- 172.21.15.161:0/3155387611 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c030840 con 0x7fa42c160f80 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.096+0000 7fa42affd640 1 -- 172.21.15.161:0/3155387611 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c0309a0 con 0x7fa42c160f80 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.096+0000 7fa42affd640 1 -- 172.21.15.161:0/3155387611 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c030d30 con 0x7fa42c160f80 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 -- 172.21.15.161:0/3155387611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 msgr2=0x7fa42c161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 --2- 172.21.15.161:0/3155387611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 0x7fa42c161360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa41c009870 tx=0x7fa41c02b980 comp rx=0 tx=0).stop 2023-11-24T08:04:40.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 -- 172.21.15.161:0/3155387611 shutdown_connections 2023-11-24T08:04:40.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 --2- 172.21.15.161:0/3155387611 >> v2:172.21.15.175:3300/0 conn(0x7fa42c0ce8f0 0x7fa42c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 --2- 172.21.15.161:0/3155387611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c160f80 0x7fa42c161360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 -- 172.21.15.161:0/3155387611 >> 172.21.15.161:0/3155387611 conn(0x7fa42c09c550 msgr2=0x7fa42c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 -- 172.21.15.161:0/3155387611 shutdown_connections 2023-11-24T08:04:40.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.097+0000 7fa4328c2640 1 -- 172.21.15.161:0/3155387611 wait complete. 2023-11-24T08:04:40.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.099+0000 7fa4328c2640 1 Processor -- start 2023-11-24T08:04:40.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.099+0000 7fa4328c2640 1 -- start start 2023-11-24T08:04:40.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa4328c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c0ce8f0 0x7fa42c0cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa4328c2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c0cfbe0 0x7fa42c0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa4328c2640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 0x7fa42c0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa4328c2640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0cd1c0 con 0x7fa42c160f80 2023-11-24T08:04:40.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa4328c2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0ccfa0 con 0x7fa42c0cfbe0 2023-11-24T08:04:40.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa4328c2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0cb540 con 0x7fa42c0ce8f0 2023-11-24T08:04:40.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa430e5f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 0x7fa42c0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa430e5f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 0x7fa42c0cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53018/0 (socket says 172.21.15.161:53018) 2023-11-24T08:04:40.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa430e5f640 1 -- 172.21.15.161:0/1892784916 learned_addr learned my addr 172.21.15.161:0/1892784916 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:40.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa42bfff640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c0ce8f0 0x7fa42c0cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.100+0000 7fa42b7fe640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c0cfbe0 0x7fa42c0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa430e5f640 1 -- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c0ce8f0 msgr2=0x7fa42c0cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa430e5f640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c0ce8f0 0x7fa42c0cc2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa430e5f640 1 -- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c0cfbe0 msgr2=0x7fa42c0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa430e5f640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c0cfbe0 0x7fa42c0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa430e5f640 1 -- 172.21.15.161:0/1892784916 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420009400 con 0x7fa42c160f80 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa430e5f640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 0x7fa42c0cca60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa42400c7d0 tx=0x7fa42400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424003b70 con 0x7fa42c160f80 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424003cf0 con 0x7fa42c160f80 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400aa90 con 0x7fa42c160f80 2023-11-24T08:04:40.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c0094d0 con 0x7fa42c160f80 2023-11-24T08:04:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.101+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c0cbb00 con 0x7fa42c160f80 2023-11-24T08:04:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.102+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c0675d0 con 0x7fa42c160f80 2023-11-24T08:04:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.103+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa42400abf0 con 0x7fa42c160f80 2023-11-24T08:04:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.104+0000 7fa428ff9640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa41806aff0 0x7fa41806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.104+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa4240896c0 con 0x7fa42c160f80 2023-11-24T08:04:40.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.105+0000 7fa42bfff640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa41806aff0 0x7fa41806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.106+0000 7fa42bfff640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa41806aff0 0x7fa41806d4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa41c036000 tx=0x7fa41c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.109+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4240544d0 con 0x7fa42c160f80 2023-11-24T08:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.337+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa42c0d3920 con 0x7fa42c160f80 2023-11-24T08:04:40.338 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.338+0000 7fa428ff9640 1 -- 172.21.15.161:0/1892784916 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fa424057af0 con 0x7fa42c160f80 2023-11-24T08:04:40.339 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:40.339 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:40.339 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:40.341 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa41806aff0 msgr2=0x7fa41806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa41806aff0 0x7fa41806d4b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa41c036000 tx=0x7fa41c008030 comp rx=0 tx=0).stop 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 msgr2=0x7fa42c0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 0x7fa42c0cca60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa42400c7d0 tx=0x7fa42400cc90 comp rx=0 tx=0).stop 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 shutdown_connections 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa41806aff0 0x7fa41806d4b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa42c160f80 0x7fa42c0cca60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42c0cfbe0 0x7fa42c0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 --2- 172.21.15.161:0/1892784916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42c0ce8f0 0x7fa42c0cc2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.340+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 >> 172.21.15.161:0/1892784916 conn(0x7fa42c09c550 msgr2=0x7fa42c06b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.342 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.341+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 shutdown_connections 2023-11-24T08:04:40.343 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.341+0000 7fa4328c2640 1 -- 172.21.15.161:0/1892784916 wait complete. 2023-11-24T08:04:40.361 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.620+0000 7f0132b6c640 1 Processor -- start 2023-11-24T08:04:40.621 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.620+0000 7f0132b6c640 1 -- start start 2023-11-24T08:04:40.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.621+0000 7f0132b6c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f012c0d0100 0x7f012c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.621+0000 7f0132b6c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c0d0f40 0x7f012c0d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.621+0000 7f0132b6c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0d0a10 con 0x7f012c160920 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.621+0000 7f0132b6c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c0cf080 con 0x7f012c0d0100 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.621+0000 7f0132b6c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0c6be0 con 0x7f012c0d0f40 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f012c0d0100 0x7f012c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f012c0d0100 0x7f012c0b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53026/0 (socket says 172.21.15.161:53026) 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 -- 172.21.15.161:0/1623434134 learned_addr learned my addr 172.21.15.161:0/1623434134 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 -- 172.21.15.161:0/1623434134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c0d0f40 msgr2=0x7f012c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 --2- 172.21.15.161:0/1623434134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c0d0f40 0x7f012c0d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 -- 172.21.15.161:0/1623434134 >> v1:172.21.15.175:6789/0 conn(0x7f012c160920 legacy=0x7f012c0cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:40.625 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.622+0000 7f0131369640 1 -- 172.21.15.161:0/1623434134 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0ce7e0 con 0x7f012c0d0100 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.623+0000 7f0131369640 1 --2- 172.21.15.161:0/1623434134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c0b3f30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f011c009870 tx=0x7f011c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29596e90b7a94e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0130b68640 1 -- 172.21.15.161:0/1623434134 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c031640 con 0x7f012c0d0100 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0130b68640 1 -- 172.21.15.161:0/1623434134 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c0317a0 con 0x7f012c0d0100 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0130b68640 1 -- 172.21.15.161:0/1623434134 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c031b30 con 0x7f012c0d0100 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 -- 172.21.15.161:0/1623434134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 msgr2=0x7f012c0b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 --2- 172.21.15.161:0/1623434134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c0b3f30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f011c009870 tx=0x7f011c02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 -- 172.21.15.161:0/1623434134 shutdown_connections 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 --2- 172.21.15.161:0/1623434134 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c0d0f40 0x7f012c0d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 --2- 172.21.15.161:0/1623434134 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c0b3f30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 -- 172.21.15.161:0/1623434134 >> 172.21.15.161:0/1623434134 conn(0x7f012c0d3090 msgr2=0x7f012c0d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.624+0000 7f0132b6c640 1 -- 172.21.15.161:0/1623434134 shutdown_connections 2023-11-24T08:04:40.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.625+0000 7f0132b6c640 1 -- 172.21.15.161:0/1623434134 wait complete. 2023-11-24T08:04:40.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.626+0000 7f0132b6c640 1 Processor -- start 2023-11-24T08:04:40.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.626+0000 7f0132b6c640 1 -- start start 2023-11-24T08:04:40.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.627+0000 7f0132b6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.627+0000 7f0132b6c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012c0d0f40 0x7f012c14add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.627+0000 7f0132b6c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c160920 0x7f012c0b66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.627+0000 7f0132b6c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c14c2e0 con 0x7f012c0d0100 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.627+0000 7f0132b6c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c14b6d0 con 0x7f012c0d0f40 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.627+0000 7f0132b6c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c14b9b0 con 0x7f012c160920 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c14a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53028/0 (socket says 172.21.15.161:53028) 2023-11-24T08:04:40.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 -- 172.21.15.161:0/2066795563 learned_addr learned my addr 172.21.15.161:0/2066795563 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:40.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 -- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c160920 msgr2=0x7f012c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f013236b640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c160920 0x7f012c0b66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131369640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012c0d0f40 0x7f012c14add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c160920 0x7f012c0b66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 -- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012c0d0f40 msgr2=0x7f012c14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012c0d0f40 0x7f012c14add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 -- 172.21.15.161:0/2066795563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011c0094d0 con 0x7f012c0d0100 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f013236b640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c160920 0x7f012c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.628+0000 7f0131b6a640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c14a370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f012800b3f0 tx=0x7f012800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.629+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128011830 con 0x7f012c0d0100 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.629+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128011990 con 0x7f012c0d0100 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.629+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0128011d40 con 0x7f012c0d0100 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.629+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c14bc90 con 0x7f012c0d0100 2023-11-24T08:04:40.631 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.629+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c14a8b0 con 0x7f012c0d0100 2023-11-24T08:04:40.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.630+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c067450 con 0x7f012c0d0100 2023-11-24T08:04:40.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.631+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f012801a400 con 0x7f012c0d0100 2023-11-24T08:04:40.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.632+0000 7f01227fc640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f011006aff0 0x7f011006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:40.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.632+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0128089bd0 con 0x7f012c0d0100 2023-11-24T08:04:40.633 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.632+0000 7f0131369640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f011006aff0 0x7f011006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:40.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.633+0000 7f0131369640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f011006aff0 0x7f011006d4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f011c036000 tx=0x7f011c03c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:40.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.636+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0128054920 con 0x7f012c0d0100 2023-11-24T08:04:40.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.829+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f012c1600d0 con 0x7f012c0d0100 2023-11-24T08:04:40.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.832+0000 7f01227fc640 1 -- 172.21.15.161:0/2066795563 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16688 (secure 0 0 0) 0x7f0128015090 con 0x7f012c0d0100 2023-11-24T08:04:40.833 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:40.833 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":49,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:03:06.535213+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:40.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.834+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f011006aff0 msgr2=0x7f011006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.834+0000 7f0132b6c640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f011006aff0 0x7f011006d4b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f011c036000 tx=0x7f011c03c040 comp rx=0 tx=0).stop 2023-11-24T08:04:40.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 msgr2=0x7f012c14a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:40.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c14a370 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f012800b3f0 tx=0x7f012800b8b0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 shutdown_connections 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f011006aff0 0x7f011006d4b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f012c160920 0x7f012c0b66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f012c0d0f40 0x7f012c14add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 --2- 172.21.15.161:0/2066795563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f012c0d0100 0x7f012c14a370 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 >> 172.21.15.161:0/2066795563 conn(0x7f012c0d3090 msgr2=0x7f012c0c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 shutdown_connections 2023-11-24T08:04:40.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:40.835+0000 7f0132b6c640 1 -- 172.21.15.161:0/2066795563 wait complete. 2023-11-24T08:04:40.856 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:04:40.856 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:41.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.065+0000 7fd8f081c640 1 Processor -- start 2023-11-24T08:04:41.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.065+0000 7fd8f081c640 1 -- start start 2023-11-24T08:04:41.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.067+0000 7fd8f081c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 0x7fd8ec0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.067+0000 7fd8f081c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec0cfbf0 con 0x7fd8ec071070 2023-11-24T08:04:41.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.067+0000 7fd8f081c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec071690 con 0x7fd8ec0cf7d0 2023-11-24T08:04:41.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.067+0000 7fd8f081c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec14b6a0 con 0x7fd8ec14b2c0 2023-11-24T08:04:41.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.067+0000 7fd8ead9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd8ec071070 0x7fd8ec0cc160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49482/0 (socket says 172.21.15.161:49482) 2023-11-24T08:04:41.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.067+0000 7fd8ead9d640 1 -- 172.21.15.161:0/2200463991 learned_addr learned my addr 172.21.15.161:0/2200463991 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:41.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8ea59c640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 0x7fd8ec0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788550805 0 0) 0x7fd8ec0cfbf0 con 0x7fd8ec071070 2023-11-24T08:04:41.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d8003520 con 0x7fd8ec071070 2023-11-24T08:04:41.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3121763918 0 0) 0x7fd8d8003520 con 0x7fd8ec071070 2023-11-24T08:04:41.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 msgr2=0x7fd8ec0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 0x7fd8ec0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 >> v1:172.21.15.175:6789/0 conn(0x7fd8ec0cf7d0 legacy=0x7fd8ec070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec071970 con 0x7fd8ec071070 2023-11-24T08:04:41.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fd8e40019f0 con 0x7fd8ec071070 2023-11-24T08:04:41.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.068+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 >> v1:172.21.15.161:6789/0 conn(0x7fd8ec071070 legacy=0x7fd8ec0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e9d9b640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d80039a0 0x7fd8d8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e9d9b640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 0x7fd8d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e9d9b640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec14b6a0 con 0x7fd8d8004d00 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d800ba30 con 0x7fd8d80039a0 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d800bbf0 con 0x7fd8ec14b2c0 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8e1d9b640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 0x7fd8d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ead9d640 1 -- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 msgr2=0x7fd8d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8ec14b2c0 0x7fd8d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ead9d640 1 -- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d80039a0 msgr2=0x7fd8d8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ea59c640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d80039a0 0x7fd8d8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8d80039a0 0x7fd8d8003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.069+0000 7fd8ead9d640 1 -- 172.21.15.161:0/2200463991 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8003520 con 0x7fd8d8004d00 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.070+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400a800 tx=0x7fd8d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03e350cc75998f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40072d0 con 0x7fd8d8004d00 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e402f070 con 0x7fd8d8004d00 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8e9d9b640 1 -- 172.21.15.161:0/2200463991 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e40076b0 con 0x7fd8d8004d00 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8f081c640 1 -- 172.21.15.161:0/2200463991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8d8004d00 msgr2=0x7fd8d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8f081c640 1 --2- 172.21.15.161:0/2200463991 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8d8004d00 0x7fd8d8005180 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400a800 tx=0x7fd8d80057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8ead9d640 1 -- 172.21.15.161:0/2200463991 reap_dead start 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8f081c640 1 -- 172.21.15.161:0/2200463991 shutdown_connections 2023-11-24T08:04:41.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.071+0000 7fd8f081c640 1 -- 172.21.15.161:0/2200463991 >> 172.21.15.161:0/2200463991 conn(0x7fd8ec06a800 msgr2=0x7fd8ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.072+0000 7fd8f081c640 1 -- 172.21.15.161:0/2200463991 shutdown_connections 2023-11-24T08:04:41.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.072+0000 7fd8f081c640 1 -- 172.21.15.161:0/2200463991 wait complete. 2023-11-24T08:04:41.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.073+0000 7fd8f081c640 1 Processor -- start 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.073+0000 7fd8f081c640 1 -- start start 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.074+0000 7fd8f081c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d8004d00 0x7fd8ec1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.074+0000 7fd8f081c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8ec160c30 0x7fd8ec1433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.074+0000 7fd8f081c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 0x7fd8ec148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.074+0000 7fd8f081c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec160a00 con 0x7fd8ec144d10 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.074+0000 7fd8f081c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec164a10 con 0x7fd8ec160c30 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.074+0000 7fd8f081c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec164450 con 0x7fd8d8004d00 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 0x7fd8ec148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 0x7fd8ec148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36354/0 (socket says 172.21.15.161:36354) 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 -- 172.21.15.161:0/1307573683 learned_addr learned my addr 172.21.15.161:0/1307573683 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:41.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 -- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d8004d00 msgr2=0x7fd8ec1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d8004d00 0x7fd8ec1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8e1d9b640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8ec160c30 0x7fd8ec1433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 -- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8ec160c30 msgr2=0x7fd8ec1433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8ec160c30 0x7fd8ec1433a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 -- 172.21.15.161:0/1307573683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec164730 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.075+0000 7fd8ead9d640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 0x7fd8ec148b20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4001cb0 tx=0x7fd8e4001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.076+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4042070 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.076+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e402ce90 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.076+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4004d60 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.076+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ec142ba0 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.076+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec1438e0 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.077+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec1430c0 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.078+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd8e4031030 con 0x7fd8ec144d10 2023-11-24T08:04:41.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.079+0000 7fd8e37fe640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8cc06b020 0x7fd8cc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.079+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd8e40aae20 con 0x7fd8ec144d10 2023-11-24T08:04:41.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.079+0000 7fd8ea59c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8cc06b020 0x7fd8cc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.080+0000 7fd8ea59c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8cc06b020 0x7fd8cc06d4e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec161910 tx=0x7fd8dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.083+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8ec1430c0 con 0x7fd8ec144d10 2023-11-24T08:04:41.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.313+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8ec06b140 con 0x7fd8ec144d10 2023-11-24T08:04:41.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.314+0000 7fd8e37fe640 1 -- 172.21.15.161:0/1307573683 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fd8e4075af0 con 0x7fd8ec144d10 2023-11-24T08:04:41.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:41.315 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:41.316 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8cc06b020 msgr2=0x7fd8cc06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8cc06b020 0x7fd8cc06d4e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec161910 tx=0x7fd8dc008040 comp rx=0 tx=0).stop 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 msgr2=0x7fd8ec148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 0x7fd8ec148b20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4001cb0 tx=0x7fd8e4001d80 comp rx=0 tx=0).stop 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 shutdown_connections 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd8cc06b020 0x7fd8cc06d4e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd8ec144d10 0x7fd8ec148b20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8ec160c30 0x7fd8ec1433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 --2- 172.21.15.161:0/1307573683 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8d8004d00 0x7fd8ec1604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 >> 172.21.15.161:0/1307573683 conn(0x7fd8ec06a800 msgr2=0x7fd8ec148010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 shutdown_connections 2023-11-24T08:04:41.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.317+0000 7fd8f081c640 1 -- 172.21.15.161:0/1307573683 wait complete. 2023-11-24T08:04:41.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:41.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.538+0000 7f35562c9640 1 Processor -- start 2023-11-24T08:04:41.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.538+0000 7f35562c9640 1 -- start start 2023-11-24T08:04:41.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.539+0000 7f35562c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 0x7f3550164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.539+0000 7f35562c9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35500b1ee0 con 0x7f35500cf9a0 2023-11-24T08:04:41.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.539+0000 7f35562c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35500b2780 con 0x7f3550143ae0 2023-11-24T08:04:41.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.539+0000 7f35562c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355015e990 con 0x7f355015e3b0 2023-11-24T08:04:41.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.540+0000 7f3547fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f35500cf9a0 0x7f355015dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49494/0 (socket says 172.21.15.161:49494) 2023-11-24T08:04:41.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.540+0000 7f3547fff640 1 -- 172.21.15.161:0/50276970 learned_addr learned my addr 172.21.15.161:0/50276970 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:41.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.540+0000 7f3554866640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 0x7f3550164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.540+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003605205 0 0) 0x7f35500b1ee0 con 0x7f35500cf9a0 2023-11-24T08:04:41.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.540+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353c003520 con 0x7f35500cf9a0 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 873036728 0 0) 0x7f353c003520 con 0x7f35500cf9a0 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 msgr2=0x7f3550164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 0x7f3550164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 >> v1:172.21.15.175:6789/0 conn(0x7f3550143ae0 legacy=0x7f35500cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500b2130 con 0x7f35500cf9a0 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f3538001670 con 0x7f35500cf9a0 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 >> v1:172.21.15.161:6789/0 conn(0x7f35500cf9a0 legacy=0x7f355015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f353c0039a0 0x7f353c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 0x7f353c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f353c004d00 0x7f353c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355015e990 con 0x7f353c004d00 2023-11-24T08:04:41.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00bb90 con 0x7f353c0039a0 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00bd50 con 0x7f355015e3b0 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f3554866640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f353c004d00 0x7f353c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.541+0000 7f354ffff640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f353c0039a0 0x7f353c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.542+0000 7f3554866640 1 -- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 msgr2=0x7f353c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.542+0000 7f3554866640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f355015e3b0 0x7f353c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.542+0000 7f3554866640 1 -- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f353c0039a0 msgr2=0x7f353c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.542+0000 7f3554866640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f353c0039a0 0x7f353c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.542+0000 7f3554866640 1 -- 172.21.15.161:0/50276970 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c003520 con 0x7f353c004d00 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.542+0000 7f354ffff640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f353c0039a0 0x7f353c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:41.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f3554866640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f353c004d00 0x7f353c005180 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3548007360 tx=0x7f353c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf612fc2ad8bbaee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354802ccf0 con 0x7f353c004d00 2023-11-24T08:04:41.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354802ce50 con 0x7f353c004d00 2023-11-24T08:04:41.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f354f7fe640 1 -- 172.21.15.161:0/50276970 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548034660 con 0x7f353c004d00 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f35562c9640 1 -- 172.21.15.161:0/50276970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f353c004d00 msgr2=0x7f353c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f35562c9640 1 --2- 172.21.15.161:0/50276970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f353c004d00 0x7f353c005180 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3548007360 tx=0x7f353c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f3554866640 1 -- 172.21.15.161:0/50276970 reap_dead start 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f35562c9640 1 -- 172.21.15.161:0/50276970 shutdown_connections 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.543+0000 7f35562c9640 1 -- 172.21.15.161:0/50276970 >> 172.21.15.161:0/50276970 conn(0x7f355006a800 msgr2=0x7f355006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.544+0000 7f35562c9640 1 -- 172.21.15.161:0/50276970 shutdown_connections 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.544+0000 7f35562c9640 1 -- 172.21.15.161:0/50276970 wait complete. 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.545+0000 7f35562c9640 1 Processor -- start 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.545+0000 7f35562c9640 1 -- start start 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.546+0000 7f35562c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3550159060 0x7f35501597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.546+0000 7f35562c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 0x7f3550136410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.546+0000 7f35562c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3550136950 0x7f35500afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.546+0000 7f35562c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550143330 con 0x7f3550134810 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.546+0000 7f35562c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35500b0bb0 con 0x7f3550136950 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.546+0000 7f35562c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35500b0e90 con 0x7f3550159060 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 0x7f3550136410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 0x7f3550136410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36376/0 (socket says 172.21.15.161:36376) 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 -- 172.21.15.161:0/3349616656 learned_addr learned my addr 172.21.15.161:0/3349616656 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f354ffff640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3550159060 0x7f35501597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3554866640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3550136950 0x7f35500afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 -- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3550159060 msgr2=0x7f35501597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3550159060 0x7f35501597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 -- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3550136950 msgr2=0x7f35500afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3550136950 0x7f35500afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 -- 172.21.15.161:0/3349616656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35500b1170 con 0x7f3550134810 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3554866640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3550136950 0x7f35500afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.547+0000 7f3547fff640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 0x7f3550136410 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f353800ca70 tx=0x7f353800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.548+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538004cb0 con 0x7f3550134810 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.548+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538004e30 con 0x7f3550134810 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.548+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538007310 con 0x7f3550134810 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.548+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35500b1450 con 0x7f3550134810 2023-11-24T08:04:41.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.548+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3550159ef0 con 0x7f3550134810 2023-11-24T08:04:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.549+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35500b1640 con 0x7f3550134810 2023-11-24T08:04:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.550+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3538007470 con 0x7f3550134810 2023-11-24T08:04:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.551+0000 7f354d7fa640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f353006aff0 0x7f353006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.551+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3538088d50 con 0x7f3550134810 2023-11-24T08:04:41.552 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.552+0000 7f354ffff640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f353006aff0 0x7f353006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:41.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.553+0000 7f354ffff640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f353006aff0 0x7f353006d4b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3540001750 tx=0x7f3540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:41.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.556+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3538053b30 con 0x7f3550134810 2023-11-24T08:04:41.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.788+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f355006c3f0 con 0x7f3550134810 2023-11-24T08:04:41.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.789+0000 7f354d7fa640 1 -- 172.21.15.161:0/3349616656 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f3538018020 con 0x7f3550134810 2023-11-24T08:04:41.791 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:41.791 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:02:27.275368+0000","modified":"2023-11-24T08:02:30.365578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5688},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5688":{"gid":5688,"name":"b","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6837/2376580130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":2376580130},{"type":"v1","addr":"172.21.15.175:6837","nonce":2376580130}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-11-24T08:04:41.791 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 27 2023-11-24T08:04:41.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f353006aff0 msgr2=0x7f353006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f353006aff0 0x7f353006d4b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3540001750 tx=0x7f3540009040 comp rx=0 tx=0).stop 2023-11-24T08:04:41.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 msgr2=0x7f3550136410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:41.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 0x7f3550136410 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f353800ca70 tx=0x7f353800cf30 comp rx=0 tx=0).stop 2023-11-24T08:04:41.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 shutdown_connections 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f353006aff0 0x7f353006d4b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3550136950 0x7f35500afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3550134810 0x7f3550136410 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 --2- 172.21.15.161:0/3349616656 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3550159060 0x7f35501597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 >> 172.21.15.161:0/3349616656 conn(0x7f355006a800 msgr2=0x7f35500cafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 shutdown_connections 2023-11-24T08:04:41.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:41.792+0000 7f35562c9640 1 -- 172.21.15.161:0/3349616656 wait complete. 2023-11-24T08:04:41.812 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:42.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.023+0000 7fe94566d640 1 Processor -- start 2023-11-24T08:04:42.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.023+0000 7fe94566d640 1 -- start start 2023-11-24T08:04:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe94566d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe94013cfa0 0x7fe94015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe94566d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe94013fcb0 0x7fe9400b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe94566d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400cdec0 con 0x7fe9400cd530 2023-11-24T08:04:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe94566d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400ce1a0 con 0x7fe94013cfa0 2023-11-24T08:04:42.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe94566d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400ce480 con 0x7fe94013fcb0 2023-11-24T08:04:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe93ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe94013cfa0 0x7fe94015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe93ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe94013cfa0 0x7fe94015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36378/0 (socket says 172.21.15.161:36378) 2023-11-24T08:04:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.025+0000 7fe93ffff640 1 -- 172.21.15.161:0/4274121695 learned_addr learned my addr 172.21.15.161:0/4274121695 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:42.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.026+0000 7fe93ffff640 1 -- 172.21.15.161:0/4274121695 >> v2:172.21.15.175:3300/0 conn(0x7fe94013fcb0 msgr2=0x7fe9400b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.026+0000 7fe93ffff640 1 --2- 172.21.15.161:0/4274121695 >> v2:172.21.15.175:3300/0 conn(0x7fe94013fcb0 0x7fe9400b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.026+0000 7fe93ffff640 1 -- 172.21.15.161:0/4274121695 >> v1:172.21.15.161:6789/0 conn(0x7fe9400cd530 legacy=0x7fe94013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.026+0000 7fe93ffff640 1 -- 172.21.15.161:0/4274121695 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400ce760 con 0x7fe94013cfa0 2023-11-24T08:04:42.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.027+0000 7fe93ffff640 1 --2- 172.21.15.161:0/4274121695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe94015afb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe9400b3fd0 tx=0x7fe93002e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f65ae66fba57d68 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.027+0000 7fe93f7fe640 1 -- 172.21.15.161:0/4274121695 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93002eea0 con 0x7fe94013cfa0 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.027+0000 7fe93f7fe640 1 -- 172.21.15.161:0/4274121695 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930036440 con 0x7fe94013cfa0 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.027+0000 7fe93f7fe640 1 -- 172.21.15.161:0/4274121695 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300367d0 con 0x7fe94013cfa0 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 -- 172.21.15.161:0/4274121695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 msgr2=0x7fe94015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 --2- 172.21.15.161:0/4274121695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe94015afb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fe9400b3fd0 tx=0x7fe93002e0f0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 -- 172.21.15.161:0/4274121695 shutdown_connections 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 --2- 172.21.15.161:0/4274121695 >> v2:172.21.15.175:3300/0 conn(0x7fe94013fcb0 0x7fe9400b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 --2- 172.21.15.161:0/4274121695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe94015afb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 -- 172.21.15.161:0/4274121695 >> 172.21.15.161:0/4274121695 conn(0x7fe94006a800 msgr2=0x7fe94006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 -- 172.21.15.161:0/4274121695 shutdown_connections 2023-11-24T08:04:42.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.028+0000 7fe94566d640 1 -- 172.21.15.161:0/4274121695 wait complete. 2023-11-24T08:04:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.030+0000 7fe94566d640 1 Processor -- start 2023-11-24T08:04:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.030+0000 7fe94566d640 1 -- start start 2023-11-24T08:04:42.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe94566d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9400cd530 0x7fe940157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe94566d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe9400a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe94566d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe94013fcb0 0x7fe940153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe94566d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940156360 con 0x7fe94013cfa0 2023-11-24T08:04:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe94566d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940156640 con 0x7fe9400cd530 2023-11-24T08:04:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe94566d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe940156920 con 0x7fe94013fcb0 2023-11-24T08:04:42.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe937fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe9400a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe937fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe9400a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36386/0 (socket says 172.21.15.161:36386) 2023-11-24T08:04:42.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe937fff640 1 -- 172.21.15.161:0/824617996 learned_addr learned my addr 172.21.15.161:0/824617996 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:42.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe93ffff640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9400cd530 0x7fe940157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe937fff640 1 -- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe94013fcb0 msgr2=0x7fe940153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.031+0000 7fe944e6c640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe94013fcb0 0x7fe940153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe937fff640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe94013fcb0 0x7fe940153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe937fff640 1 -- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9400cd530 msgr2=0x7fe940157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe937fff640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9400cd530 0x7fe940157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe937fff640 1 -- 172.21.15.161:0/824617996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93000b770 con 0x7fe94013cfa0 2023-11-24T08:04:42.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe937fff640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe9400a84c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c450 tx=0x7fe92800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280052d0 con 0x7fe94013cfa0 2023-11-24T08:04:42.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928005430 con 0x7fe94013cfa0 2023-11-24T08:04:42.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928012870 con 0x7fe94013cfa0 2023-11-24T08:04:42.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe940156c00 con 0x7fe94013cfa0 2023-11-24T08:04:42.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.032+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe940157940 con 0x7fe94013cfa0 2023-11-24T08:04:42.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.034+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe940157120 con 0x7fe94013cfa0 2023-11-24T08:04:42.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.034+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe9280129d0 con 0x7fe94013cfa0 2023-11-24T08:04:42.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.035+0000 7fe93d7fa640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe92006aff0 0x7fe92006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.035+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe928089550 con 0x7fe94013cfa0 2023-11-24T08:04:42.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.036+0000 7fe93ffff640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe92006aff0 0x7fe92006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.037+0000 7fe93ffff640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe92006aff0 0x7fe92006d4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe930038000 tx=0x7fe930032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.040+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe940157120 con 0x7fe94013cfa0 2023-11-24T08:04:42.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.231+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe940157120 con 0x7fe94013cfa0 2023-11-24T08:04:42.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.234+0000 7fe93d7fa640 1 -- 172.21.15.161:0/824617996 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16688 (secure 0 0 0) 0x7fe940157120 con 0x7fe94013cfa0 2023-11-24T08:04:42.237 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:42.237 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":49,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:03:06.535213+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:02:25.158735+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-11-24T08:02:26.286978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.6","mappings":[{"from":0,"to":5}]},{"pgid":"7.2d","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:42.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe92006aff0 msgr2=0x7fe92006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe92006aff0 0x7fe92006d4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe930038000 tx=0x7fe930032000 comp rx=0 tx=0).stop 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 msgr2=0x7fe9400a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe9400a84c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe92800c450 tx=0x7fe92800c910 comp rx=0 tx=0).stop 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 shutdown_connections 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe92006aff0 0x7fe92006d4b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe94013fcb0 0x7fe940153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe94013cfa0 0x7fe9400a84c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 --2- 172.21.15.161:0/824617996 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe9400cd530 0x7fe940157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.237+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 >> 172.21.15.161:0/824617996 conn(0x7fe94006a800 msgr2=0x7fe94006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.238+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 shutdown_connections 2023-11-24T08:04:42.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.238+0000 7fe94566d640 1 -- 172.21.15.161:0/824617996 wait complete. 2023-11-24T08:04:42.256 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:04:42.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.468+0000 7f19bf1a9640 1 Processor -- start 2023-11-24T08:04:42.469 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.468+0000 7f19bf1a9640 1 -- start start 2023-11-24T08:04:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19bf1a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19b8143ae0 0x7f19b80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19bf1a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 0x7f19b80702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19bf1a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b80cfc30 con 0x7f19b80cf7d0 2023-11-24T08:04:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19bf1a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b80b1ee0 con 0x7f19b8143ae0 2023-11-24T08:04:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19bf1a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b2780 con 0x7f19b815e3b0 2023-11-24T08:04:42.472 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19b7fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f19b80cf7d0 0x7f19b815dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49520/0 (socket says 172.21.15.161:49520) 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.470+0000 7f19b7fff640 1 -- 172.21.15.161:0/957599849 learned_addr learned my addr 172.21.15.161:0/957599849 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19bcf45640 1 --2- 172.21.15.161:0/957599849 >> v2:172.21.15.175:3300/0 conn(0x7f19b8143ae0 0x7f19b80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19bd746640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 0x7f19b80702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728653074 0 0) 0x7f19b80cfc30 con 0x7f19b80cf7d0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a8003520 con 0x7f19b80cf7d0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910995806 0 0) 0x7f19a8003520 con 0x7f19b80cf7d0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 msgr2=0x7f19b80702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 0x7f19b80702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 >> v2:172.21.15.175:3300/0 conn(0x7f19b8143ae0 msgr2=0x7f19b80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 --2- 172.21.15.161:0/957599849 >> v2:172.21.15.175:3300/0 conn(0x7f19b8143ae0 0x7f19b80cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b815e990 con 0x7f19b80cf7d0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f19a4001670 con 0x7f19b80cf7d0 2023-11-24T08:04:42.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19bcf45640 1 --2- 172.21.15.161:0/957599849 >> v2:172.21.15.175:3300/0 conn(0x7f19b8143ae0 0x7f19b80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 >> v1:172.21.15.161:6789/0 conn(0x7f19b80cf7d0 legacy=0x7f19b815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 0x7f19a8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19a8004d00 0x7f19a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b1ee0 con 0x7f19a8003f40 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b2780 con 0x7f19a8004d00 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.471+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a800b980 con 0x7f19b815e3b0 2023-11-24T08:04:42.474 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19b7fff640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19bd746640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19a8004d00 0x7f19a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19b7fff640 1 -- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 msgr2=0x7f19a8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19b7fff640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b815e3b0 0x7f19a8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19b7fff640 1 -- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19a8004d00 msgr2=0x7f19a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19b7fff640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19a8004d00 0x7f19a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19b7fff640 1 -- 172.21.15.161:0/957599849 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a8003520 con 0x7f19a8003f40 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.472+0000 7f19bd746640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19a8004d00 0x7f19a8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.473+0000 7f19b7fff640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19a80047c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c1c0 tx=0x7f19a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8598caf14e06513e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.473+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4005ad0 con 0x7f19a8003f40 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a4005c50 con 0x7f19a8003f40 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19b77fe640 1 -- 172.21.15.161:0/957599849 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a402c810 con 0x7f19a8003f40 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bf1a9640 1 -- 172.21.15.161:0/957599849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 msgr2=0x7f19a80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/957599849 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19a80047c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f19a400c1c0 tx=0x7f19a80057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bd746640 1 -- 172.21.15.161:0/957599849 reap_dead start 2023-11-24T08:04:42.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bf1a9640 1 -- 172.21.15.161:0/957599849 shutdown_connections 2023-11-24T08:04:42.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bf1a9640 1 -- 172.21.15.161:0/957599849 >> 172.21.15.161:0/957599849 conn(0x7f19b806a800 msgr2=0x7f19b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bf1a9640 1 -- 172.21.15.161:0/957599849 shutdown_connections 2023-11-24T08:04:42.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.474+0000 7f19bf1a9640 1 -- 172.21.15.161:0/957599849 wait complete. 2023-11-24T08:04:42.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.476+0000 7f19bf1a9640 1 Processor -- start 2023-11-24T08:04:42.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.476+0000 7f19bf1a9640 1 -- start start 2023-11-24T08:04:42.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bf1a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19b8141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bf1a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b80adb70 0x7f19b81f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bf1a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b80b0bc0 0x7f19b80b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bf1a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80c4160 con 0x7f19a8003f40 2023-11-24T08:04:42.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bf1a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80c3e50 con 0x7f19b80b0bc0 2023-11-24T08:04:42.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bf1a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b1580 con 0x7f19b80adb70 2023-11-24T08:04:42.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bcf45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19b8141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bcf45640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19b8141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36406/0 (socket says 172.21.15.161:36406) 2023-11-24T08:04:42.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.477+0000 7f19bcf45640 1 -- 172.21.15.161:0/3467522482 learned_addr learned my addr 172.21.15.161:0/3467522482 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bd746640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b80b0bc0 0x7f19b80b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bcf45640 1 -- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b80adb70 msgr2=0x7f19b81f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bcf45640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b80adb70 0x7f19b81f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bcf45640 1 -- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b80b0bc0 msgr2=0x7f19b80b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bcf45640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b80b0bc0 0x7f19b80b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bcf45640 1 -- 172.21.15.161:0/3467522482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b81f2f90 con 0x7f19a8003f40 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bcf45640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19b8141d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e960 tx=0x7f19ac00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac009750 con 0x7f19a8003f40 2023-11-24T08:04:42.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac00c9a0 con 0x7f19a8003f40 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00cd30 con 0x7f19a8003f40 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.478+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b81f3270 con 0x7f19a8003f40 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.479+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b81f2c00 con 0x7f19a8003f40 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.480+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b80c43d0 con 0x7f19a8003f40 2023-11-24T08:04:42.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.481+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f19ac013470 con 0x7f19a8003f40 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.482+0000 7f19b57fa640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f199c06aff0 0x7f199c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.482+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f19ac089890 con 0x7f19a8003f40 2023-11-24T08:04:42.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.482+0000 7f19b7fff640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f199c06aff0 0x7f199c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.483+0000 7f19b7fff640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f199c06aff0 0x7f199c06d4b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f19a4034000 tx=0x7f19a402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.486+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19ac054670 con 0x7f19a8003f40 2023-11-24T08:04:42.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.716+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f19b80675d0 con 0x7f19a8003f40 2023-11-24T08:04:42.718 INFO:tasks.ceph.mon.a.smithi161.stderr:2023-11-24T08:04:42.717+0000 7f2aa1f75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:04:42.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.721+0000 7f19b57fa640 1 -- 172.21.15.161:0/3467522482 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f19ac057c90 con 0x7f19a8003f40 2023-11-24T08:04:42.722 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:04:42.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f199c06aff0 msgr2=0x7f199c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f199c06aff0 0x7f199c06d4b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f19a4034000 tx=0x7f19a402e000 comp rx=0 tx=0).stop 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 msgr2=0x7f19b8141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19b8141d80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e960 tx=0x7f19ac00ee20 comp rx=0 tx=0).stop 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 shutdown_connections 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f199c06aff0 0x7f199c06d4b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19b80b0bc0 0x7f19b80b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19b80adb70 0x7f19b81f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 --2- 172.21.15.161:0/3467522482 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f19a8003f40 0x7f19b8141d80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.724+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 >> 172.21.15.161:0/3467522482 conn(0x7f19b806a800 msgr2=0x7f19b806cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.725+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 shutdown_connections 2023-11-24T08:04:42.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.725+0000 7f19bf1a9640 1 -- 172.21.15.161:0/3467522482 wait complete. 2023-11-24T08:04:42.746 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:04:42.759 INFO:tasks.ceph.mds.b.smithi175.stderr: -9957> 2023-11-24T08:02:32.248+0000 7fb31733a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:04:42.858 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-24T08:04:42.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.953+0000 7fcb052ee640 1 Processor -- start 2023-11-24T08:04:42.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.954+0000 7fcb052ee640 1 -- start start 2023-11-24T08:04:42.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.955+0000 7fcb052ee640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb0013df80 0x7fcb0015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.955+0000 7fcb052ee640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb0013e360 0x7fcb000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.955+0000 7fcb052ee640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0006c470 con 0x7fcb0015f9c0 2023-11-24T08:04:42.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.955+0000 7fcb052ee640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0006c750 con 0x7fcb0013df80 2023-11-24T08:04:42.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.955+0000 7fcb052ee640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0006ca30 con 0x7fcb0013e360 2023-11-24T08:04:42.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.955+0000 7fcafeffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb0013df80 0x7fcb0015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafeffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcb0013df80 0x7fcb0015bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36408/0 (socket says 172.21.15.161:36408) 2023-11-24T08:04:42.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafeffd640 1 -- 172.21.15.161:0/202567054 learned_addr learned my addr 172.21.15.161:0/202567054 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:42.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafe7fc640 1 --2- 172.21.15.161:0/202567054 >> v2:172.21.15.175:3300/0 conn(0x7fcb0013e360 0x7fcb000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafeffd640 1 -- 172.21.15.161:0/202567054 >> v2:172.21.15.175:3300/0 conn(0x7fcb0013e360 msgr2=0x7fcb000cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafeffd640 1 --2- 172.21.15.161:0/202567054 >> v2:172.21.15.175:3300/0 conn(0x7fcb0013e360 0x7fcb000cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafeffd640 1 -- 172.21.15.161:0/202567054 >> v1:172.21.15.175:6789/0 conn(0x7fcb0015f9c0 legacy=0x7fcb001408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:42.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafeffd640 1 -- 172.21.15.161:0/202567054 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0006cd10 con 0x7fcb0013df80 2023-11-24T08:04:42.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.956+0000 7fcafe7fc640 1 --2- 172.21.15.161:0/202567054 >> v2:172.21.15.175:3300/0 conn(0x7fcb0013e360 0x7fcb000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:42.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.957+0000 7fcafeffd640 1 --2- 172.21.15.161:0/202567054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0013df80 0x7fcb0015bee0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcb0006ded0 tx=0x7fcaf002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3eb57d86ffdf3d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcafdffb640 1 -- 172.21.15.161:0/202567054 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0031870 con 0x7fcb0013df80 2023-11-24T08:04:42.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcafdffb640 1 -- 172.21.15.161:0/202567054 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf00319d0 con 0x7fcb0013df80 2023-11-24T08:04:42.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcafdffb640 1 -- 172.21.15.161:0/202567054 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0031d60 con 0x7fcb0013df80 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcb052ee640 1 -- 172.21.15.161:0/202567054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0013df80 msgr2=0x7fcb0015bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcb052ee640 1 --2- 172.21.15.161:0/202567054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0013df80 0x7fcb0015bee0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcb0006ded0 tx=0x7fcaf002b910 comp rx=0 tx=0).stop 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcb052ee640 1 -- 172.21.15.161:0/202567054 shutdown_connections 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcb052ee640 1 --2- 172.21.15.161:0/202567054 >> v2:172.21.15.175:3300/0 conn(0x7fcb0013e360 0x7fcb000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcb052ee640 1 --2- 172.21.15.161:0/202567054 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0013df80 0x7fcb0015bee0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.958+0000 7fcb052ee640 1 -- 172.21.15.161:0/202567054 >> 172.21.15.161:0/202567054 conn(0x7fcb0006a800 msgr2=0x7fcb0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.959+0000 7fcb052ee640 1 -- 172.21.15.161:0/202567054 shutdown_connections 2023-11-24T08:04:42.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.959+0000 7fcb052ee640 1 -- 172.21.15.161:0/202567054 wait complete. 2023-11-24T08:04:42.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.960+0000 7fcb052ee640 1 Processor -- start 2023-11-24T08:04:42.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.960+0000 7fcb052ee640 1 -- start start 2023-11-24T08:04:42.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.961+0000 7fcb052ee640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0013df80 0x7fcb0013d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.961+0000 7fcb052ee640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb0013e360 0x7fcb0014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.961+0000 7fcb052ee640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 0x7fcb0014bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.961+0000 7fcb052ee640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0014b940 con 0x7fcb0015f9c0 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.961+0000 7fcb052ee640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0013d710 con 0x7fcb0013df80 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.961+0000 7fcb052ee640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0014d870 con 0x7fcb0013e360 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 0x7fcb0014bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 0x7fcb0014bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36422/0 (socket says 172.21.15.161:36422) 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 -- 172.21.15.161:0/1770230078 learned_addr learned my addr 172.21.15.161:0/1770230078 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcafeffd640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0013df80 0x7fcb0013d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcafe7fc640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb0013e360 0x7fcb0014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 -- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb0013e360 msgr2=0x7fcb0014dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb0013e360 0x7fcb0014dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 -- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0013df80 msgr2=0x7fcb0013d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:42.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0013df80 0x7fcb0013d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:42.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 -- 172.21.15.161:0/1770230078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00094d0 con 0x7fcb0015f9c0 2023-11-24T08:04:42.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.962+0000 7fcaff7fe640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 0x7fcb0014bdd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c700 tx=0x7fcaf800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.963+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800aa50 con 0x7fcb0015f9c0 2023-11-24T08:04:42.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.963+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800abb0 con 0x7fcb0015f9c0 2023-11-24T08:04:42.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.963+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800ce10 con 0x7fcb0015f9c0 2023-11-24T08:04:42.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.963+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0014db50 con 0x7fcb0015f9c0 2023-11-24T08:04:42.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.963+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0014e4e0 con 0x7fcb0015f9c0 2023-11-24T08:04:42.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.964+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0014dd90 con 0x7fcb0015f9c0 2023-11-24T08:04:42.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.965+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fcaf8012420 con 0x7fcb0015f9c0 2023-11-24T08:04:42.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.966+0000 7fcae77fe640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcaec06aff0 0x7fcaec06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:42.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.966+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fcaf8089de0 con 0x7fcb0015f9c0 2023-11-24T08:04:42.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.966+0000 7fcafeffd640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcaec06aff0 0x7fcaec06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:42.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.967+0000 7fcafeffd640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcaec06aff0 0x7fcaec06d4b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0036000 tx=0x7fcaf003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:42.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:42.970+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb0014dd90 con 0x7fcb0015f9c0 2023-11-24T08:04:43.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.196+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcb0014b430 con 0x7fcb0015f9c0 2023-11-24T08:04:43.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.724+0000 7fcae77fe640 1 -- 172.21.15.161:0/1770230078 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcb0014b430 con 0x7fcb0015f9c0 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcaec06aff0 msgr2=0x7fcaec06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcaec06aff0 0x7fcaec06d4b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0036000 tx=0x7fcaf003c040 comp rx=0 tx=0).stop 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 msgr2=0x7fcb0014bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 0x7fcb0014bdd0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c700 tx=0x7fcaf800cbc0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 shutdown_connections 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcaec06aff0 0x7fcaec06d4b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcb0015f9c0 0x7fcb0014bdd0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb0013e360 0x7fcb0014dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 --2- 172.21.15.161:0/1770230078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb0013df80 0x7fcb0013d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.728+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 >> 172.21.15.161:0/1770230078 conn(0x7fcb0006a800 msgr2=0x7fcb000af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.729+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 shutdown_connections 2023-11-24T08:04:43.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.729+0000 7fcb052ee640 1 -- 172.21.15.161:0/1770230078 wait complete. 2023-11-24T08:04:43.750 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.969+0000 7f000997c640 1 Processor -- start 2023-11-24T08:04:43.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.969+0000 7f000997c640 1 -- start start 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f000997c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7f00040cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f000997c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040cfc30 con 0x7f000415e3b0 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f000997c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00040b1ee0 con 0x7f00040cf7d0 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f000997c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b2780 con 0x7f0004143ae0 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f00037fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f000415e3b0 0x7f00040702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49534/0 (socket says 172.21.15.161:49534) 2023-11-24T08:04:43.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f00037fe640 1 -- 172.21.15.161:0/3806054724 learned_addr learned my addr 172.21.15.161:0/3806054724 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.971+0000 7f0002ffd640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7f00040cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305845272 0 0) 0x7f00040cfc30 con 0x7f000415e3b0 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff0003520 con 0x7f000415e3b0 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2639898946 0 0) 0x7efff0003520 con 0x7f000415e3b0 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 msgr2=0x7f00040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7f00040cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 >> v1:172.21.15.175:6789/0 conn(0x7f00040cf7d0 legacy=0x7f000415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000415e990 con 0x7f000415e3b0 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7efffc0019f0 con 0x7f000415e3b0 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 >> v1:172.21.15.161:6789/0 conn(0x7f000415e3b0 legacy=0x7f00040702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7efff00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7efff00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0004d00 0x7efff0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040b2780 con 0x7efff0003f20 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff000ba60 con 0x7efff0004d00 2023-11-24T08:04:43.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff000de30 con 0x7f0004143ae0 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.972+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7efff00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7f0002ffd640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7efff00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7f00037fe640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0004d00 0x7efff0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7efffa7fc640 1 -- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 msgr2=0x7efff00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7efff00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7efffa7fc640 1 -- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0004d00 msgr2=0x7efff0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0004d00 0x7efff0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7efffa7fc640 1 -- 172.21.15.161:0/3806054724 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff0003520 con 0x7efff0003f20 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7f0002ffd640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0004143ae0 0x7efff00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.973+0000 7f00037fe640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff0004d00 0x7efff0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.974+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7efff00047c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7effec001750 tx=0x7efff00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed45e9305c8cff0a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.974+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec0052d0 con 0x7efff0003f20 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.974+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effec02e050 con 0x7efff0003f20 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.974+0000 7f00027fc640 1 -- 172.21.15.161:0/3806054724 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effec003830 con 0x7efff0003f20 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f000997c640 1 -- 172.21.15.161:0/3806054724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 msgr2=0x7efff00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f000997c640 1 --2- 172.21.15.161:0/3806054724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7efff00047c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7effec001750 tx=0x7efff00057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f00037fe640 1 -- 172.21.15.161:0/3806054724 reap_dead start 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f000997c640 1 -- 172.21.15.161:0/3806054724 shutdown_connections 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f000997c640 1 -- 172.21.15.161:0/3806054724 >> 172.21.15.161:0/3806054724 conn(0x7f000406a800 msgr2=0x7f000406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f000997c640 1 -- 172.21.15.161:0/3806054724 shutdown_connections 2023-11-24T08:04:43.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.975+0000 7f000997c640 1 -- 172.21.15.161:0/3806054724 wait complete. 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.977+0000 7f000997c640 1 Processor -- start 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.977+0000 7f000997c640 1 -- start start 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f000997c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7f000413a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f000997c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000413c5d0 0x7f000413ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f000997c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000413cf90 0x7f000415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f000997c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00041372f0 con 0x7efff0003f20 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f000997c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000413a170 con 0x7f000413cf90 2023-11-24T08:04:43.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f000997c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000415b020 con 0x7f000413c5d0 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f0002ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7f000413a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f0002ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7f000413a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36428/0 (socket says 172.21.15.161:36428) 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f0002ffd640 1 -- 172.21.15.161:0/3620374889 learned_addr learned my addr 172.21.15.161:0/3620374889 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000413c5d0 0x7f000413ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.978+0000 7f00037fe640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000413cf90 0x7f000415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0002ffd640 1 -- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000413c5d0 msgr2=0x7f000413ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0002ffd640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000413c5d0 0x7f000413ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0002ffd640 1 -- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000413cf90 msgr2=0x7f000415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0002ffd640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000413cf90 0x7f000415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:43.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0002ffd640 1 -- 172.21.15.161:0/3620374889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000413a3c0 con 0x7efff0003f20 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000413c5d0 0x7f000413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f00037fe640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000413cf90 0x7f000415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0002ffd640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7f000413a9e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efff4010910 tx=0x7efff4010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400ec20 con 0x7efff0003f20 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400ed80 con 0x7efff0003f20 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff401c600 con 0x7efff0003f20 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000415b290 con 0x7efff0003f20 2023-11-24T08:04:43.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.979+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000413a6a0 con 0x7efff0003f20 2023-11-24T08:04:43.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.980+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040675d0 con 0x7efff0003f20 2023-11-24T08:04:43.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.981+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efff401c760 con 0x7efff0003f20 2023-11-24T08:04:43.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.982+0000 7f0000ff9640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effe406aff0 0x7effe406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.982+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7efff4089fd0 con 0x7efff0003f20 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.983+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effe406aff0 0x7effe406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:43.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.984+0000 7efffa7fc640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effe406aff0 0x7effe406d4b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7effec033000 tx=0x7effec009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:43.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:43.986+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efff4054e10 con 0x7efff0003f20 2023-11-24T08:04:44.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.176+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0004070640 con 0x7efff0003f20 2023-11-24T08:04:44.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.728+0000 7f0000ff9640 1 -- 172.21.15.161:0/3620374889 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7efff4058430 con 0x7efff0003f20 2023-11-24T08:04:44.730 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:04:44.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.732+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effe406aff0 msgr2=0x7effe406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.732+0000 7f000997c640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effe406aff0 0x7effe406d4b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7effec033000 tx=0x7effec009030 comp rx=0 tx=0).stop 2023-11-24T08:04:44.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.732+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 msgr2=0x7f000413a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.732+0000 7f000997c640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7f000413a9e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7efff4010910 tx=0x7efff4010dd0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.733+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 shutdown_connections 2023-11-24T08:04:44.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.733+0000 7f000997c640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7effe406aff0 0x7effe406d4b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.733+0000 7f000997c640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f000413cf90 0x7f000415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.733+0000 7f000997c640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f000413c5d0 0x7f000413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.733+0000 7f000997c640 1 --2- 172.21.15.161:0/3620374889 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efff0003f20 0x7f000413a9e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.733+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 >> 172.21.15.161:0/3620374889 conn(0x7f000406a800 msgr2=0x7f0004140d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.734+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 shutdown_connections 2023-11-24T08:04:44.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.734+0000 7f000997c640 1 -- 172.21.15.161:0/3620374889 wait complete. 2023-11-24T08:04:44.759 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:04:44.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.968+0000 7fbbdbfff640 1 Processor -- start 2023-11-24T08:04:44.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.968+0000 7fbbdbfff640 1 -- start start 2023-11-24T08:04:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdbfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbbdc0cc990 0x7fbbdc06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdbfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc070e50 con 0x7fbbdc143c40 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdbfff640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc144020 con 0x7fbbdc0cc500 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdbfff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc0723c0 con 0x7fbbdc0cc990 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdaffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbbdc143c40 0x7fbbdc071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49546/0 (socket says 172.21.15.161:49546) 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdaffd640 1 -- 172.21.15.161:0/508128815 learned_addr learned my addr 172.21.15.161:0/508128815 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/508128815 >> v2:172.21.15.175:3300/0 conn(0x7fbbdc0cc990 0x7fbbdc06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3459746975 0 0) 0x7fbbdc070e50 con 0x7fbbdc143c40 2023-11-24T08:04:44.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.970+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc4003520 con 0x7fbbdc143c40 2023-11-24T08:04:44.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 338621820 0 0) 0x7fbbc4003520 con 0x7fbbdc143c40 2023-11-24T08:04:44.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 >> v2:172.21.15.175:3300/0 conn(0x7fbbdc0cc990 msgr2=0x7fbbdc06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:44.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 --2- 172.21.15.161:0/508128815 >> v2:172.21.15.175:3300/0 conn(0x7fbbdc0cc990 0x7fbbdc06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 >> v1:172.21.15.175:6789/0 conn(0x7fbbdc0cc500 legacy=0x7fbbdc06d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc071e00 con 0x7fbbdc143c40 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fbbcc001670 con 0x7fbbdc143c40 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 >> v1:172.21.15.161:6789/0 conn(0x7fbbdc143c40 legacy=0x7fbbdc071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40047c0 0x7fbbc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc40052a0 0x7fbbc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0723c0 con 0x7fbbc40052a0 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400c150 con 0x7fbbc4003970 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc400c310 con 0x7fbbc40047c0 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.971+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc40052a0 0x7fbbc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdaffd640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbda7fc640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40047c0 0x7fbbc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdb7fe640 1 -- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40047c0 msgr2=0x7fbbc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40047c0 0x7fbbc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdb7fe640 1 -- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc4003970 msgr2=0x7fbbc4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdb7fe640 1 -- 172.21.15.161:0/508128815 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4003520 con 0x7fbbc40052a0 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbda7fc640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40047c0 0x7fbbc4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.972+0000 7fbbdaffd640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbc4003970 0x7fbbc4003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.973+0000 7fbbdb7fe640 1 -- 172.21.15.161:0/508128815 reap_dead start 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.973+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc40052a0 0x7fbbc400b980 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4007330 tx=0x7fbbc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b38159eb15d18c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.973+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd402ccd0 con 0x7fbbc40052a0 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.973+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd402ce30 con 0x7fbbc40052a0 2023-11-24T08:04:44.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.973+0000 7fbbd9ffb640 1 -- 172.21.15.161:0/508128815 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4003bd0 con 0x7fbbc40052a0 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 -- 172.21.15.161:0/508128815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc40052a0 msgr2=0x7fbbc400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc40052a0 0x7fbbc400b980 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4007330 tx=0x7fbbc40057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 -- 172.21.15.161:0/508128815 shutdown_connections 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/508128815 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbc40052a0 0x7fbbc400b980 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 -- 172.21.15.161:0/508128815 >> 172.21.15.161:0/508128815 conn(0x7fbbdc06a800 msgr2=0x7fbbdc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 -- 172.21.15.161:0/508128815 shutdown_connections 2023-11-24T08:04:44.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.974+0000 7fbbdbfff640 1 -- 172.21.15.161:0/508128815 wait complete. 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.976+0000 7fbbdbfff640 1 Processor -- start 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.976+0000 7fbbdbfff640 1 -- start start 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40052a0 0x7fbbdc1f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 0x7fbbdc1f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdbfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbdc0a8730 0x7fbbdc0a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdbfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc13c780 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdbfff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1f61c0 con 0x7fbbdc0a8730 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdbfff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc141060 con 0x7fbbc40052a0 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 0x7fbbdc1f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 0x7fbbdc1f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36444/0 (socket says 172.21.15.161:36444) 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 -- 172.21.15.161:0/758562156 learned_addr learned my addr 172.21.15.161:0/758562156 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdaffd640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40052a0 0x7fbbdc1f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbdc0a8730 0x7fbbdc0a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 -- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40052a0 msgr2=0x7fbbdc1f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40052a0 0x7fbbdc1f5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 -- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbdc0a8730 msgr2=0x7fbbdc0a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbdc0a8730 0x7fbbdc0a8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbda7fc640 1 -- 172.21.15.161:0/758562156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc13b8b0 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.977+0000 7fbbdb7fe640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbdc0a8730 0x7fbbdc0a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:44.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.978+0000 7fbbda7fc640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 0x7fbbdc1f5c80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000d5c0 tx=0x7fbbd000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.978+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0007220 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.978+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00073a0 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.978+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc13bb00 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.978+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00067d0 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.978+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc13c0c0 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.979+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc067450 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.980+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbbd0006930 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.981+0000 7fbbc3fff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbbc806aff0 0x7fbbc806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:44.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.981+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fbbd0089580 con 0x7fbbdc13ecc0 2023-11-24T08:04:44.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.982+0000 7fbbdaffd640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbbc806aff0 0x7fbbc806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:44.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.983+0000 7fbbdaffd640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbbc806aff0 0x7fbbc806d4b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0017a0 tx=0x7fbbcc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:44.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:44.986+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbd0054450 con 0x7fbbdc13ecc0 2023-11-24T08:04:45.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.176+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbdc0ceb30 con 0x7fbbdc13ecc0 2023-11-24T08:04:45.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.732+0000 7fbbc3fff640 1 -- 172.21.15.161:0/758562156 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbbd0057a70 con 0x7fbbdc13ecc0 2023-11-24T08:04:45.733 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2023-11-24T08:04:45.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbbc806aff0 msgr2=0x7fbbc806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbbc806aff0 0x7fbbc806d4b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0017a0 tx=0x7fbbcc009040 comp rx=0 tx=0).stop 2023-11-24T08:04:45.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 msgr2=0x7fbbdc1f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 0x7fbbdc1f5c80 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000d5c0 tx=0x7fbbd000da80 comp rx=0 tx=0).stop 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 shutdown_connections 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbbc806aff0 0x7fbbc806d4b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbbdc0a8730 0x7fbbdc0a8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbdc13ecc0 0x7fbbdc1f5c80 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 --2- 172.21.15.161:0/758562156 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbbc40052a0 0x7fbbdc1f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.735+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 >> 172.21.15.161:0/758562156 conn(0x7fbbdc06a800 msgr2=0x7fbbdc0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.736+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 shutdown_connections 2023-11-24T08:04:45.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.736+0000 7fbbdbfff640 1 -- 172.21.15.161:0/758562156 wait complete. 2023-11-24T08:04:45.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:04:45.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.967+0000 7f1c45935640 1 Processor -- start 2023-11-24T08:04:45.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.968+0000 7f1c45935640 1 -- start start 2023-11-24T08:04:45.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c45935640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1c400ccb50 0x7f1c40070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c45935640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1c4015bf10 0x7f1c40143d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c45935640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4015f4e0 con 0x7f1c400adf20 2023-11-24T08:04:45.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c45935640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4015f970 con 0x7f1c400ccb50 2023-11-24T08:04:45.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c45935640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c40071130 con 0x7f1c4015bf10 2023-11-24T08:04:45.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c44933640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1c400adf20 0x7f1c400cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49548/0 (socket says 172.21.15.161:49548) 2023-11-24T08:04:45.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.969+0000 7f1c44933640 1 -- 172.21.15.161:0/1087680763 learned_addr learned my addr 172.21.15.161:0/1087680763 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:45.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3ffff640 1 --2- 172.21.15.161:0/1087680763 >> v2:172.21.15.161:3300/0 conn(0x7f1c400ccb50 0x7f1c40070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3f7fe640 1 -- 172.21.15.161:0/1087680763 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523885848 0 0) 0x7f1c4015f4e0 con 0x7f1c400adf20 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3f7fe640 1 -- 172.21.15.161:0/1087680763 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c30003520 con 0x7f1c400adf20 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c45134640 1 --2- 172.21.15.161:0/1087680763 >> v2:172.21.15.175:3300/0 conn(0x7f1c4015bf10 0x7f1c40143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3ffff640 1 -- 172.21.15.161:0/1087680763 >> v2:172.21.15.175:3300/0 conn(0x7f1c4015bf10 msgr2=0x7f1c40143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3ffff640 1 --2- 172.21.15.161:0/1087680763 >> v2:172.21.15.175:3300/0 conn(0x7f1c4015bf10 0x7f1c40143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3ffff640 1 -- 172.21.15.161:0/1087680763 >> v1:172.21.15.161:6789/0 conn(0x7f1c400adf20 legacy=0x7f1c400cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c3ffff640 1 -- 172.21.15.161:0/1087680763 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4015ebb0 con 0x7f1c400ccb50 2023-11-24T08:04:45.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.970+0000 7f1c45134640 1 --2- 172.21.15.161:0/1087680763 >> v2:172.21.15.175:3300/0 conn(0x7f1c4015bf10 0x7f1c40143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:45.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.971+0000 7f1c3ffff640 1 --2- 172.21.15.161:0/1087680763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400ccb50 0x7f1c40070a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1c4006ff20 tx=0x7f1c2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09e7ff6a951f6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c3f7fe640 1 -- 172.21.15.161:0/1087680763 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c02e070 con 0x7f1c400ccb50 2023-11-24T08:04:45.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c3f7fe640 1 -- 172.21.15.161:0/1087680763 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c0315a0 con 0x7f1c400ccb50 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c3f7fe640 1 -- 172.21.15.161:0/1087680763 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c031930 con 0x7f1c400ccb50 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 -- 172.21.15.161:0/1087680763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400ccb50 msgr2=0x7f1c40070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 --2- 172.21.15.161:0/1087680763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400ccb50 0x7f1c40070a30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1c4006ff20 tx=0x7f1c2c02b840 comp rx=0 tx=0).stop 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 -- 172.21.15.161:0/1087680763 shutdown_connections 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 --2- 172.21.15.161:0/1087680763 >> v2:172.21.15.175:3300/0 conn(0x7f1c4015bf10 0x7f1c40143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 --2- 172.21.15.161:0/1087680763 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400ccb50 0x7f1c40070a30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 -- 172.21.15.161:0/1087680763 >> 172.21.15.161:0/1087680763 conn(0x7f1c4006a7d0 msgr2=0x7f1c4006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.972+0000 7f1c45935640 1 -- 172.21.15.161:0/1087680763 shutdown_connections 2023-11-24T08:04:45.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.973+0000 7f1c45935640 1 -- 172.21.15.161:0/1087680763 wait complete. 2023-11-24T08:04:45.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.974+0000 7f1c45935640 1 Processor -- start 2023-11-24T08:04:45.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.974+0000 7f1c45935640 1 -- start start 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.975+0000 7f1c45935640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 0x7f1c401f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.975+0000 7f1c45935640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c400ccb50 0x7f1c4015a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.975+0000 7f1c45935640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4015bf10 0x7f1c400ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.975+0000 7f1c45935640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c4820 con 0x7f1c400adf20 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.975+0000 7f1c45935640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4015ae00 con 0x7f1c4015bf10 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.975+0000 7f1c45935640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c3e80 con 0x7f1c400ccb50 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 0x7f1c401f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 0x7f1c401f2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36472/0 (socket says 172.21.15.161:36472) 2023-11-24T08:04:45.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 -- 172.21.15.161:0/640727096 learned_addr learned my addr 172.21.15.161:0/640727096 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:45.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 -- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c400ccb50 msgr2=0x7f1c4015a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c400ccb50 0x7f1c4015a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 -- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4015bf10 msgr2=0x7f1c400ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4015bf10 0x7f1c400ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 -- 172.21.15.161:0/640727096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c009400 con 0x7f1c400adf20 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.976+0000 7f1c44933640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 0x7f1c401f2a60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400c500 tx=0x7f1c3400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.977+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34005ce0 con 0x7f1c400adf20 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.977+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c34005e40 con 0x7f1c400adf20 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.977+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34007330 con 0x7f1c400adf20 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.977+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c400c4160 con 0x7f1c400adf20 2023-11-24T08:04:45.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.977+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c400ace10 con 0x7f1c400adf20 2023-11-24T08:04:45.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.978+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c400c4960 con 0x7f1c400adf20 2023-11-24T08:04:45.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.979+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1c34007550 con 0x7f1c400adf20 2023-11-24T08:04:45.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.980+0000 7f1c3d7fa640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1c2406aff0 0x7f1c2406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:45.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.980+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c34088c40 con 0x7f1c400adf20 2023-11-24T08:04:45.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.981+0000 7f1c3ffff640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1c2406aff0 0x7f1c2406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:45.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.982+0000 7f1c3ffff640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1c2406aff0 0x7f1c2406d4b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c036000 tx=0x7f1c2c030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:45.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:45.984+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c400c4960 con 0x7f1c400adf20 2023-11-24T08:04:46.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.176+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1c400c4960 con 0x7f1c400adf20 2023-11-24T08:04:46.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.181+0000 7f1c3d7fa640 1 -- 172.21.15.161:0/640727096 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1c400c4960 con 0x7f1c400adf20 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.184+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1c2406aff0 msgr2=0x7f1c2406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.184+0000 7f1c45935640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1c2406aff0 0x7f1c2406d4b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c036000 tx=0x7f1c2c030000 comp rx=0 tx=0).stop 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.184+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 msgr2=0x7f1c401f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.184+0000 7f1c45935640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 0x7f1c401f2a60 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400c500 tx=0x7f1c3400c9c0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 shutdown_connections 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1c2406aff0 0x7f1c2406d4b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1c4015bf10 0x7f1c400ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1c400ccb50 0x7f1c4015a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 --2- 172.21.15.161:0/640727096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1c400adf20 0x7f1c401f2a60 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 >> 172.21.15.161:0/640727096 conn(0x7f1c4006a7d0 msgr2=0x7f1c4015b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 shutdown_connections 2023-11-24T08:04:46.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.185+0000 7f1c45935640 1 -- 172.21.15.161:0/640727096 wait complete. 2023-11-24T08:04:46.205 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2023-11-24T08:04:46.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.416+0000 7f839759e640 1 Processor -- start 2023-11-24T08:04:46.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.416+0000 7f839759e640 1 -- start start 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.417+0000 7f839759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8398071f00 0x7f8398146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f839759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83980b2e10 con 0x7f8398071410 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f839759e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839806cc10 con 0x7f839806c7c0 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f839759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806cec0 con 0x7f8398071f00 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f838ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8398071f00 0x7f8398146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f839659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8398071410 0x7f83980717f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49550/0 (socket says 172.21.15.161:49550) 2023-11-24T08:04:46.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f839659c640 1 -- 172.21.15.161:0/4236987201 learned_addr learned my addr 172.21.15.161:0/4236987201 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f838ffff640 1 -- 172.21.15.161:0/4236987201 >> v1:172.21.15.175:6789/0 conn(0x7f839806c7c0 legacy=0x7f8398166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f838ffff640 1 -- 172.21.15.161:0/4236987201 >> v1:172.21.15.161:6789/0 conn(0x7f8398071410 legacy=0x7f83980717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.418+0000 7f838ffff640 1 -- 172.21.15.161:0/4236987201 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839806d1a0 con 0x7f8398071f00 2023-11-24T08:04:46.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.420+0000 7f838ffff640 1 --2- 172.21.15.161:0/4236987201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8398071f00 0x7f8398146770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f83800097a0 tx=0x7f838002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b78cb81412234c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.420+0000 7f8395d9b640 1 -- 172.21.15.161:0/4236987201 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838002e070 con 0x7f8398071f00 2023-11-24T08:04:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.420+0000 7f8395d9b640 1 -- 172.21.15.161:0/4236987201 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800315a0 con 0x7f8398071f00 2023-11-24T08:04:46.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.420+0000 7f8395d9b640 1 -- 172.21.15.161:0/4236987201 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380031930 con 0x7f8398071f00 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.420+0000 7f839759e640 1 -- 172.21.15.161:0/4236987201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8398071f00 msgr2=0x7f8398146770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.420+0000 7f839759e640 1 --2- 172.21.15.161:0/4236987201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8398071f00 0x7f8398146770 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f83800097a0 tx=0x7f838002b840 comp rx=0 tx=0).stop 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.421+0000 7f839759e640 1 -- 172.21.15.161:0/4236987201 shutdown_connections 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.421+0000 7f839759e640 1 --2- 172.21.15.161:0/4236987201 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8398071f00 0x7f8398146770 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.421+0000 7f839759e640 1 -- 172.21.15.161:0/4236987201 >> 172.21.15.161:0/4236987201 conn(0x7f839806a800 msgr2=0x7f839806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.421+0000 7f839759e640 1 -- 172.21.15.161:0/4236987201 shutdown_connections 2023-11-24T08:04:46.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.421+0000 7f839759e640 1 -- 172.21.15.161:0/4236987201 wait complete. 2023-11-24T08:04:46.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.423+0000 7f839759e640 1 Processor -- start 2023-11-24T08:04:46.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.423+0000 7f839759e640 1 -- start start 2023-11-24T08:04:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 0x7f839813f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8398071410 0x7f83981f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8398071f00 0x7f83980c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839813fc10 con 0x7f839806c7c0 2023-11-24T08:04:46.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83981f3fa0 con 0x7f8398071410 2023-11-24T08:04:46.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980ce690 con 0x7f8398071f00 2023-11-24T08:04:46.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 0x7f839813f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 0x7f839813f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36486/0 (socket says 172.21.15.161:36486) 2023-11-24T08:04:46.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.424+0000 7f839659c640 1 -- 172.21.15.161:0/1643579730 learned_addr learned my addr 172.21.15.161:0/1643579730 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:46.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f838ffff640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8398071410 0x7f83981f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839659c640 1 -- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8398071f00 msgr2=0x7f83980c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f8396d9d640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8398071f00 0x7f83980c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839659c640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8398071f00 0x7f83980c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839659c640 1 -- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8398071410 msgr2=0x7f83981f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839659c640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8398071410 0x7f83981f3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839659c640 1 -- 172.21.15.161:0/1643579730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8380009400 con 0x7f839806c7c0 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f838ffff640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8398071410 0x7f83981f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f8396d9d640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8398071f00 0x7f83980c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839659c640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 0x7f839813f6d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f838800c4d0 tx=0x7f838800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388005ce0 con 0x7f839806c7c0 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388005e40 con 0x7f839806c7c0 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83981f41b0 con 0x7f839806c7c0 2023-11-24T08:04:46.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.425+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388007270 con 0x7f839806c7c0 2023-11-24T08:04:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.426+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83981f4770 con 0x7f839806c7c0 2023-11-24T08:04:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.427+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398067450 con 0x7f839806c7c0 2023-11-24T08:04:46.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.428+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f83880073d0 con 0x7f839806c7c0 2023-11-24T08:04:46.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.429+0000 7f838effd640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f837806aff0 0x7f837806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.429+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8388088b10 con 0x7f839806c7c0 2023-11-24T08:04:46.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.430+0000 7f838ffff640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f837806aff0 0x7f837806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.431+0000 7f838ffff640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f837806aff0 0x7f837806d4b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8380036000 tx=0x7f838003d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.433+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8388053c50 con 0x7f839806c7c0 2023-11-24T08:04:46.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.694+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) v1 -- 0x7f839806b3f0 con 0x7f839806c7c0 2023-11-24T08:04:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.750+0000 7f838effd640 1 -- 172.21.15.161:0/1643579730 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v232) v1 ==== 140+0+0 (secure 0 0 0) 0x7f8388017020 con 0x7f839806c7c0 2023-11-24T08:04:46.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f837806aff0 msgr2=0x7f837806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f837806aff0 0x7f837806d4b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8380036000 tx=0x7f838003d040 comp rx=0 tx=0).stop 2023-11-24T08:04:46.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 msgr2=0x7f839813f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 0x7f839813f6d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f838800c4d0 tx=0x7f838800c990 comp rx=0 tx=0).stop 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 shutdown_connections 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f837806aff0 0x7f837806d4b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8398071f00 0x7f83980c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8398071410 0x7f83981f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 --2- 172.21.15.161:0/1643579730 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f839806c7c0 0x7f839813f6d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 >> 172.21.15.161:0/1643579730 conn(0x7f839806a800 msgr2=0x7f83980b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 shutdown_connections 2023-11-24T08:04:46.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.753+0000 7f839759e640 1 -- 172.21.15.161:0/1643579730 wait complete. 2023-11-24T08:04:46.774 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2023-11-24T08:04:46.774 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:04:46.774 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:04:46.775 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:46.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.974+0000 7fe3fa31d640 1 Processor -- start 2023-11-24T08:04:46.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.974+0000 7fe3fa31d640 1 -- start start 2023-11-24T08:04:46.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.975+0000 7fe3fa31d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe3f415e3b0 0x7fe3f4164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.975+0000 7fe3fa31d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f40b1ee0 con 0x7fe3f40cf9a0 2023-11-24T08:04:46.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.975+0000 7fe3fa31d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f40b2780 con 0x7fe3f4143ae0 2023-11-24T08:04:46.976 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.975+0000 7fe3fa31d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f415e990 con 0x7fe3f415e3b0 2023-11-24T08:04:46.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3ebfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fe3f40cf9a0 0x7fe3f415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49566/0 (socket says 172.21.15.161:49566) 2023-11-24T08:04:46.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3ebfff640 1 -- 172.21.15.161:0/4088669687 learned_addr learned my addr 172.21.15.161:0/4088669687 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f88ba640 1 --2- 172.21.15.161:0/4088669687 >> v2:172.21.15.175:3300/0 conn(0x7fe3f415e3b0 0x7fe3f4164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904809623 0 0) 0x7fe3f40b1ee0 con 0x7fe3f40cf9a0 2023-11-24T08:04:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e0003520 con 0x7fe3f40cf9a0 2023-11-24T08:04:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2877121339 0 0) 0x7fe3e0003520 con 0x7fe3f40cf9a0 2023-11-24T08:04:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 >> v2:172.21.15.175:3300/0 conn(0x7fe3f415e3b0 msgr2=0x7fe3f4164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 --2- 172.21.15.161:0/4088669687 >> v2:172.21.15.175:3300/0 conn(0x7fe3f415e3b0 0x7fe3f4164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 >> v1:172.21.15.175:6789/0 conn(0x7fe3f4143ae0 legacy=0x7fe3f40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40b2130 con 0x7fe3f40cf9a0 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fe3dc001670 con 0x7fe3f40cf9a0 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 >> v1:172.21.15.161:6789/0 conn(0x7fe3f40cf9a0 legacy=0x7fe3f415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.976+0000 7fe3f37fe640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3e0003970 0x7fe3e0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f37fe640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e00047c0 0x7fe3e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f37fe640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e0005180 0x7fe3e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f415e990 con 0x7fe3e0005180 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000c000 con 0x7fe3e00047c0 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000c1c0 con 0x7fe3e0003970 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f88ba640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e0005180 0x7fe3e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f3fff640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3e0003970 0x7fe3e0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f88ba640 1 -- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3e0003970 msgr2=0x7fe3e0003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f88ba640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3e0003970 0x7fe3e0003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f88ba640 1 -- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e00047c0 msgr2=0x7fe3e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3ebfff640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e00047c0 0x7fe3e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f88ba640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e00047c0 0x7fe3e0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f88ba640 1 -- 172.21.15.161:0/4088669687 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0003520 con 0x7fe3e0005180 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.977+0000 7fe3f3fff640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3e0003970 0x7fe3e0003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.978+0000 7fe3f88ba640 1 -- 172.21.15.161:0/4088669687 reap_dead start 2023-11-24T08:04:46.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.978+0000 7fe3f88ba640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e0005180 0x7fe3e000b980 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009fc0 tx=0x7fe3e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa92a2dc57c184c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.978+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec02cc30 con 0x7fe3e0005180 2023-11-24T08:04:46.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec00f040 con 0x7fe3e0005180 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3f37fe640 1 -- 172.21.15.161:0/4088669687 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec003990 con 0x7fe3e0005180 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4088669687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e0005180 msgr2=0x7fe3e000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e0005180 0x7fe3e000b980 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009fc0 tx=0x7fe3e00057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4088669687 shutdown_connections 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4088669687 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3e0005180 0x7fe3e000b980 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4088669687 >> 172.21.15.161:0/4088669687 conn(0x7fe3f406a800 msgr2=0x7fe3f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4088669687 shutdown_connections 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.979+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4088669687 wait complete. 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.981+0000 7fe3fa31d640 1 Processor -- start 2023-11-24T08:04:46.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.981+0000 7fe3fa31d640 1 -- start start 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3fa31d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e0005180 0x7fe3f40adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3fa31d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 0x7fe3f40c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3fa31d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3f41f6530 0x7fe3f41f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3fa31d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40c52a0 con 0x7fe3f40c48e0 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3fa31d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40aca70 con 0x7fe3e0005180 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3fa31d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40acd50 con 0x7fe3f41f6530 2023-11-24T08:04:46.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3ebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 0x7fe3f40c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3ebfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 0x7fe3f40c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36500/0 (socket says 172.21.15.161:36500) 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.982+0000 7fe3ebfff640 1 -- 172.21.15.161:0/4091951505 learned_addr learned my addr 172.21.15.161:0/4091951505 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3f3fff640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e0005180 0x7fe3f40adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3f88ba640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3f41f6530 0x7fe3f41f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3ebfff640 1 -- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3f41f6530 msgr2=0x7fe3f41f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3ebfff640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3f41f6530 0x7fe3f41f69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3ebfff640 1 -- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e0005180 msgr2=0x7fe3f40adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3ebfff640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e0005180 0x7fe3f40adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3ebfff640 1 -- 172.21.15.161:0/4091951505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f40ad030 con 0x7fe3f40c48e0 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3ebfff640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 0x7fe3f40c4d60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00d770 tx=0x7fe3dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0074e0 con 0x7fe3f40c48e0 2023-11-24T08:04:46.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc007640 con 0x7fe3f40c48e0 2023-11-24T08:04:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f40ad310 con 0x7fe3f40c48e0 2023-11-24T08:04:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc0049e0 con 0x7fe3f40c48e0 2023-11-24T08:04:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.983+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f4159670 con 0x7fe3f40c48e0 2023-11-24T08:04:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.984+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f40ad830 con 0x7fe3f40c48e0 2023-11-24T08:04:46.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.985+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe3dc004b40 con 0x7fe3f40c48e0 2023-11-24T08:04:46.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.986+0000 7fe3f17fa640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3d406aff0 0x7fe3d406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:46.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.986+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe3dc0893c0 con 0x7fe3f40c48e0 2023-11-24T08:04:46.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.987+0000 7fe3f3fff640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3d406aff0 0x7fe3d406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:46.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.988+0000 7fe3f3fff640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3d406aff0 0x7fe3d406d4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4007fd0 tx=0x7fe3e4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:46.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:46.991+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3f40ad830 con 0x7fe3f40c48e0 2023-11-24T08:04:47.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.182+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3f40ad830 con 0x7fe3f40c48e0 2023-11-24T08:04:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.184+0000 7fe3f17fa640 1 -- 172.21.15.161:0/4091951505 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13012 (secure 0 0 0) 0x7fe3f40ad830 con 0x7fe3f40c48e0 2023-11-24T08:04:47.185 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:47.185 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":52,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:45.728120+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.175:6837/2376580130":"2023-11-25T08:04:42.717157+0000","172.21.15.175:6836/2376580130":"2023-11-25T08:04:42.717157+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3d406aff0 msgr2=0x7fe3d406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3d406aff0 0x7fe3d406d4b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4007fd0 tx=0x7fe3e4009040 comp rx=0 tx=0).stop 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 msgr2=0x7fe3f40c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 0x7fe3f40c4d60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00d770 tx=0x7fe3dc00dc30 comp rx=0 tx=0).stop 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 shutdown_connections 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3d406aff0 0x7fe3d406d4b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe3f41f6530 0x7fe3f41f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe3f40c48e0 0x7fe3f40c4d60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.187+0000 7fe3fa31d640 1 --2- 172.21.15.161:0/4091951505 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe3e0005180 0x7fe3f40adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.188+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 >> 172.21.15.161:0/4091951505 conn(0x7fe3f406a800 msgr2=0x7fe3f40702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.188+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 shutdown_connections 2023-11-24T08:04:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.188+0000 7fe3fa31d640 1 -- 172.21.15.161:0/4091951505 wait complete. 2023-11-24T08:04:47.206 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:47.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:47.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.415+0000 7fbfa1f61640 1 Processor -- start 2023-11-24T08:04:47.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.415+0000 7fbfa1f61640 1 -- start start 2023-11-24T08:04:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.416+0000 7fbfa1f61640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 0x7fbf9c0cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.416+0000 7fbfa1f61640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0b6750 con 0x7fbf9c0ce8c0 2023-11-24T08:04:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbfa1f61640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9c0cf1f0 con 0x7fbf9c0d00b0 2023-11-24T08:04:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbfa1f61640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0ced20 con 0x7fbf9c15d590 2023-11-24T08:04:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbf9bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbf9c0ce8c0 0x7fbf9c0b6be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49582/0 (socket says 172.21.15.161:49582) 2023-11-24T08:04:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbf9bfff640 1 -- 172.21.15.161:0/366226211 learned_addr learned my addr 172.21.15.161:0/366226211 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481760936 0 0) 0x7fbf9c0b6750 con 0x7fbf9c0ce8c0 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf88003520 con 0x7fbf9c0ce8c0 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.417+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 0x7fbf9c0cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034668201 0 0) 0x7fbf88003520 con 0x7fbf9c0ce8c0 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 msgr2=0x7fbf9c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 0x7fbf9c0cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 >> v1:172.21.15.175:6789/0 conn(0x7fbf9c0d00b0 legacy=0x7fbf9c0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c0cef10 con 0x7fbf9c0ce8c0 2023-11-24T08:04:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fbf94001670 con 0x7fbf9c0ce8c0 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 >> v1:172.21.15.161:6789/0 conn(0x7fbf9c0ce8c0 legacy=0x7fbf9c0b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf880039a0 0x7fbf88003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 0x7fbf880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf88004d00 0x7fbf88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8800bb60 con 0x7fbf880039a0 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8800bca0 con 0x7fbf88004d00 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8800be60 con 0x7fbf9c15d590 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf880039a0 0x7fbf88003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9b7fe640 1 -- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 msgr2=0x7fbf880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.418+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c15d590 0x7fbf880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.419+0000 7fbf9b7fe640 1 -- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf88004d00 msgr2=0x7fbf88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.419+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf88004d00 0x7fbf88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.419+0000 7fbf9b7fe640 1 -- 172.21.15.161:0/366226211 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf88003520 con 0x7fbf880039a0 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.420+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf880039a0 0x7fbf88003dc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c007360 tx=0x7fbf880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef54a1297d2a818 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.420+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c02ccf0 con 0x7fbf880039a0 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.420+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c02ce50 con 0x7fbf880039a0 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.420+0000 7fbf9a7fc640 1 -- 172.21.15.161:0/366226211 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c034660 con 0x7fbf880039a0 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbfa1f61640 1 -- 172.21.15.161:0/366226211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf880039a0 msgr2=0x7fbf88003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/366226211 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf880039a0 0x7fbf88003dc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c007360 tx=0x7fbf880057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbf9bfff640 1 -- 172.21.15.161:0/366226211 reap_dead start 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbfa1f61640 1 -- 172.21.15.161:0/366226211 shutdown_connections 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbfa1f61640 1 -- 172.21.15.161:0/366226211 >> 172.21.15.161:0/366226211 conn(0x7fbf9c09c540 msgr2=0x7fbf9c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbfa1f61640 1 -- 172.21.15.161:0/366226211 shutdown_connections 2023-11-24T08:04:47.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.421+0000 7fbfa1f61640 1 -- 172.21.15.161:0/366226211 wait complete. 2023-11-24T08:04:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.423+0000 7fbfa1f61640 1 Processor -- start 2023-11-24T08:04:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.423+0000 7fbfa1f61640 1 -- start start 2023-11-24T08:04:47.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbfa1f61640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf880039a0 0x7fbf9c150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbfa1f61640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 0x7fbf9c0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbfa1f61640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c0b4d00 0x7fbf9c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbfa1f61640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0b56c0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbfa1f61640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c15fcc0 con 0x7fbf880039a0 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbfa1f61640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9c0b0d80 con 0x7fbf9c0b4d00 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 0x7fbf9c0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbf9affd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 0x7fbf9c0b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36516/0 (socket says 172.21.15.161:36516) 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbf9affd640 1 -- 172.21.15.161:0/1342798528 learned_addr learned my addr 172.21.15.161:0/1342798528 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.424+0000 7fbf9affd640 1 -- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c0b4d00 msgr2=0x7fbf9c0b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf9affd640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c0b4d00 0x7fbf9c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf9affd640 1 -- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf880039a0 msgr2=0x7fbf9c150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf9affd640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf880039a0 0x7fbf9c150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf9affd640 1 -- 172.21.15.161:0/1342798528 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c151180 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf9affd640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 0x7fbf9c0b35e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c530 tx=0x7fbf8400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840052d0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84005430 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9c0b0a30 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84012870 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.425+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c1601f0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.426+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf9c160410 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.427+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbf840129d0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.428+0000 7fbf93fff640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbf7c06b020 0x7fbf7c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.428+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf84089210 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.429+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbf7c06b020 0x7fbf7c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.430+0000 7fbf9b7fe640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbf7c06b020 0x7fbf7c06d4e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c036000 tx=0x7fbf8c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.432+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf840542a0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.606+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf9c0675d0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.607+0000 7fbf93fff640 1 -- 172.21.15.161:0/1342798528 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf840578c0 con 0x7fbf9c1f2ca0 2023-11-24T08:04:47.608 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbf7c06b020 msgr2=0x7fbf7c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbf7c06b020 0x7fbf7c06d4e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c036000 tx=0x7fbf8c02e000 comp rx=0 tx=0).stop 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 msgr2=0x7fbf9c0b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 0x7fbf9c0b35e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400c530 tx=0x7fbf8400c9f0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 shutdown_connections 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbf7c06b020 0x7fbf7c06d4e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf9c0b4d00 0x7fbf9c0b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbf9c1f2ca0 0x7fbf9c0b35e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.609+0000 7fbfa1f61640 1 --2- 172.21.15.161:0/1342798528 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf880039a0 0x7fbf9c150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.610+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 >> 172.21.15.161:0/1342798528 conn(0x7fbf9c09c540 msgr2=0x7fbf9c0b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.610+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 shutdown_connections 2023-11-24T08:04:47.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.610+0000 7fbfa1f61640 1 -- 172.21.15.161:0/1342798528 wait complete. 2023-11-24T08:04:47.628 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:04:47.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.829+0000 7f99df5a9640 1 Processor -- start 2023-11-24T08:04:47.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.829+0000 7f99df5a9640 1 -- start start 2023-11-24T08:04:47.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.831+0000 7f99df5a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813e360 0x7f99d80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.831+0000 7f99df5a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99d815f9c0 0x7f99d80cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.831+0000 7f99df5a9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d815c5f0 con 0x7f99d813df80 2023-11-24T08:04:47.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.831+0000 7f99df5a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d806c470 con 0x7f99d815f9c0 2023-11-24T08:04:47.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.831+0000 7f99df5a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d806c750 con 0x7f99d813e360 2023-11-24T08:04:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99d815f9c0 0x7f99d80cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99d815f9c0 0x7f99d80cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:36672/0 (socket says 172.21.15.161:36672) 2023-11-24T08:04:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 -- 172.21.15.161:0/1157361267 learned_addr learned my addr 172.21.15.161:0/1157361267 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99dcb44640 1 --2- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813e360 0x7f99d80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 -- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813e360 msgr2=0x7f99d80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:47.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 --2- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813e360 0x7f99d80cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 -- 172.21.15.161:0/1157361267 >> v1:172.21.15.175:6789/0 conn(0x7f99d813df80 legacy=0x7f99d815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.832+0000 7f99ddb46640 1 -- 172.21.15.161:0/1157361267 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d806ca30 con 0x7f99d815f9c0 2023-11-24T08:04:47.834 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.834+0000 7f99ddb46640 1 --2- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d80cf7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009e50 tx=0x7f99d002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ca2748f68abe89 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.834+0000 7f99cffff640 1 -- 172.21.15.161:0/1157361267 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d002cb00 con 0x7f99d815f9c0 2023-11-24T08:04:47.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.834+0000 7f99cffff640 1 -- 172.21.15.161:0/1157361267 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d002cc60 con 0x7f99d815f9c0 2023-11-24T08:04:47.835 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.834+0000 7f99cffff640 1 -- 172.21.15.161:0/1157361267 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d00343f0 con 0x7f99d815f9c0 2023-11-24T08:04:47.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 -- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 msgr2=0x7f99d80cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d80cf7d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009e50 tx=0x7f99d002bf60 comp rx=0 tx=0).stop 2023-11-24T08:04:47.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 -- 172.21.15.161:0/1157361267 shutdown_connections 2023-11-24T08:04:47.836 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d80cf7d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1157361267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813e360 0x7f99d80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 -- 172.21.15.161:0/1157361267 >> 172.21.15.161:0/1157361267 conn(0x7f99d806a800 msgr2=0x7f99d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 -- 172.21.15.161:0/1157361267 shutdown_connections 2023-11-24T08:04:47.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.835+0000 7f99df5a9640 1 -- 172.21.15.161:0/1157361267 wait complete. 2023-11-24T08:04:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.837+0000 7f99df5a9640 1 Processor -- start 2023-11-24T08:04:47.838 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.837+0000 7f99df5a9640 1 -- start start 2023-11-24T08:04:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.838+0000 7f99df5a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813df80 0x7f99d814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.838+0000 7f99df5a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 0x7f99d8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.838+0000 7f99df5a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d81583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99df5a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8159a30 con 0x7f99d813e360 2023-11-24T08:04:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99df5a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8158db0 con 0x7f99d815f9c0 2023-11-24T08:04:47.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99df5a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d8159090 con 0x7f99d813df80 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 0x7f99d8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 0x7f99d8156b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36524/0 (socket says 172.21.15.161:36524) 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 -- 172.21.15.161:0/1007411141 learned_addr learned my addr 172.21.15.161:0/1007411141 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dd345640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813df80 0x7f99d814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99ddb46640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d81583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 -- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813df80 msgr2=0x7f99d814f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813df80 0x7f99d814f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 -- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 msgr2=0x7f99d81583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d81583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.839+0000 7f99dcb44640 1 -- 172.21.15.161:0/1007411141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d0009b30 con 0x7f99d813e360 2023-11-24T08:04:47.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.840+0000 7f99dcb44640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 0x7f99d8156b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f99c800e9b0 tx=0x7f99c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.840+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8009670 con 0x7f99d813e360 2023-11-24T08:04:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.840+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c800c9a0 con 0x7f99d813e360 2023-11-24T08:04:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.840+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800cd50 con 0x7f99d813e360 2023-11-24T08:04:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.840+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d8159370 con 0x7f99d813e360 2023-11-24T08:04:47.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.840+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d81588f0 con 0x7f99d813e360 2023-11-24T08:04:47.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.841+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d8158b10 con 0x7f99d813e360 2023-11-24T08:04:47.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.842+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f99c8013470 con 0x7f99d813e360 2023-11-24T08:04:47.844 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.843+0000 7f99cdffb640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99bc06b020 0x7f99bc06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:47.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.843+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f99c8089800 con 0x7f99d813e360 2023-11-24T08:04:47.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.844+0000 7f99dd345640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99bc06b020 0x7f99bc06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:47.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.845+0000 7f99dd345640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99bc06b020 0x7f99bc06d4e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f99d4001500 tx=0x7f99d4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:47.848 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:47.847+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f99c8054920 con 0x7f99d813e360 2023-11-24T08:04:48.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.105+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7f99d80675d0 con 0x7f99d813e360 2023-11-24T08:04:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.762+0000 7f99cdffb640 1 -- 172.21.15.161:0/1007411141 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v234) v1 ==== 164+0+0 (secure 0 0 0) 0x7f99c8057f40 con 0x7f99d813e360 2023-11-24T08:04:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99bc06b020 msgr2=0x7f99bc06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99bc06b020 0x7f99bc06d4e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f99d4001500 tx=0x7f99d4009040 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 msgr2=0x7f99d8156b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 0x7f99d8156b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f99c800e9b0 tx=0x7f99c800ee70 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 shutdown_connections 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f99bc06b020 0x7f99bc06d4e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99d815f9c0 0x7f99d81583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f99d813e360 0x7f99d8156b70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 --2- 172.21.15.161:0/1007411141 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99d813df80 0x7f99d814f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 >> 172.21.15.161:0/1007411141 conn(0x7f99d806a800 msgr2=0x7f99d815d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 shutdown_connections 2023-11-24T08:04:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:48.766+0000 7f99df5a9640 1 -- 172.21.15.161:0/1007411141 wait complete. 2023-11-24T08:04:48.788 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.000+0000 7f6c057a9640 1 Processor -- start 2023-11-24T08:04:49.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.000+0000 7f6c057a9640 1 -- start start 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6c057a9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6c000ae5a0 0x7f6c0015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6c057a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 0x7f6c000cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6c057a9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c00070c40 con 0x7f6c000b3ae0 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6c057a9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c00071450 con 0x7f6c000ae5a0 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6c057a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000cfc60 con 0x7f6c000cf290 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6bfe7fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6c000b3ae0 0x7f6c0006cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49598/0 (socket says 172.21.15.161:49598) 2023-11-24T08:04:49.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6bfe7fc640 1 -- 172.21.15.161:0/1431071772 learned_addr learned my addr 172.21.15.161:0/1431071772 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:49.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6bfeffd640 1 --2- 172.21.15.161:0/1431071772 >> v2:172.21.15.175:3300/0 conn(0x7f6c000ae5a0 0x7f6c0015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.002+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 0x7f6c000cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271232937 0 0) 0x7f6c00070c40 con 0x7f6c000b3ae0 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6be8003520 con 0x7f6c000b3ae0 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163020090 0 0) 0x7f6be8003520 con 0x7f6c000b3ae0 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 msgr2=0x7f6c000cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 0x7f6c000cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 >> v2:172.21.15.175:3300/0 conn(0x7f6c000ae5a0 msgr2=0x7f6c0015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 --2- 172.21.15.161:0/1431071772 >> v2:172.21.15.175:3300/0 conn(0x7f6c000ae5a0 0x7f6c0015e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0006c470 con 0x7f6c000b3ae0 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6bf4001670 con 0x7f6c000b3ae0 2023-11-24T08:04:49.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 >> v1:172.21.15.161:6789/0 conn(0x7f6c000b3ae0 legacy=0x7f6c0006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6be8003970 0x7f6be8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 0x7f6be80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6be8004d00 0x7f6be8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00071450 con 0x7f6be8004d00 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000cfc60 con 0x7f6be8003970 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.003+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be800b980 con 0x7f6c000cf290 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6be8004d00 0x7f6be8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bff7fe640 1 -- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 msgr2=0x7f6be80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6c000cf290 0x7f6be80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bff7fe640 1 -- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6be8003970 msgr2=0x7f6be8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bfeffd640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6be8003970 0x7f6be8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6be8003970 0x7f6be8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bff7fe640 1 -- 172.21.15.161:0/1431071772 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8003520 con 0x7f6be8004d00 2023-11-24T08:04:49.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.004+0000 7f6bfeffd640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6be8003970 0x7f6be8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.005+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6be8004d00 0x7f6be8005180 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009fc0 tx=0x7f6be80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ebb33d0addd0eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf802cc60 con 0x7f6be8004d00 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf800f040 con 0x7f6be8004d00 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6bfdffb640 1 -- 172.21.15.161:0/1431071772 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8034440 con 0x7f6be8004d00 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6c057a9640 1 -- 172.21.15.161:0/1431071772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6be8004d00 msgr2=0x7f6be8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6c057a9640 1 --2- 172.21.15.161:0/1431071772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6be8004d00 0x7f6be8005180 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009fc0 tx=0x7f6be80057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6bff7fe640 1 -- 172.21.15.161:0/1431071772 reap_dead start 2023-11-24T08:04:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6c057a9640 1 -- 172.21.15.161:0/1431071772 shutdown_connections 2023-11-24T08:04:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6c057a9640 1 -- 172.21.15.161:0/1431071772 >> 172.21.15.161:0/1431071772 conn(0x7f6c0006a800 msgr2=0x7f6c0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6c057a9640 1 -- 172.21.15.161:0/1431071772 shutdown_connections 2023-11-24T08:04:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.006+0000 7f6c057a9640 1 -- 172.21.15.161:0/1431071772 wait complete. 2023-11-24T08:04:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.008+0000 7f6c057a9640 1 Processor -- start 2023-11-24T08:04:49.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.008+0000 7f6c057a9640 1 -- start start 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.009+0000 7f6c057a9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6be8004d00 0x7f6c00153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.009+0000 7f6c057a9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c0015cbb0 0x7f6c000cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.009+0000 7f6c057a9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 0x7f6c000cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.009+0000 7f6c057a9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0015d320 con 0x7f6c0015f020 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.009+0000 7f6c057a9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0015d040 con 0x7f6c0015cbb0 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.009+0000 7f6c057a9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000cc350 con 0x7f6be8004d00 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 0x7f6c000cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 0x7f6c000cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36542/0 (socket says 172.21.15.161:36542) 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 -- 172.21.15.161:0/3935575594 learned_addr learned my addr 172.21.15.161:0/3935575594 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bfe7fc640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c0015cbb0 0x7f6c000cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bfeffd640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6be8004d00 0x7f6c00153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 -- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6be8004d00 msgr2=0x7f6c00153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6be8004d00 0x7f6c00153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 -- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c0015cbb0 msgr2=0x7f6c000cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c0015cbb0 0x7f6c000cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 -- 172.21.15.161:0/3935575594 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000cc630 con 0x7f6c0015f020 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.010+0000 7f6bff7fe640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 0x7f6c000cd370 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8002230 tx=0x7f6bf8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.011+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8034ad0 con 0x7f6c0015f020 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.011+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf8034c30 con 0x7f6c0015f020 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.011+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8003990 con 0x7f6c0015f020 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.011+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c000cc910 con 0x7f6c0015f020 2023-11-24T08:04:49.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.011+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0015c9b0 con 0x7f6c0015f020 2023-11-24T08:04:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.012+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c000cb6b0 con 0x7f6c0015f020 2023-11-24T08:04:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.013+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6bf803e440 con 0x7f6c0015f020 2023-11-24T08:04:49.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.014+0000 7f6be77fe640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6bec06aff0 0x7f6bec06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.014+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6bf80ab8f0 con 0x7f6c0015f020 2023-11-24T08:04:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.014+0000 7f6bfeffd640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6bec06aff0 0x7f6bec06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.015+0000 7f6bfeffd640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6bec06aff0 0x7f6bec06d4b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009a40 tx=0x7f6bf0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.018+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6bf8076b30 con 0x7f6c0015f020 2023-11-24T08:04:49.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.207+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6c000675d0 con 0x7f6c0015f020 2023-11-24T08:04:49.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.213+0000 7f6be77fe640 1 -- 172.21.15.161:0/3935575594 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6bf807a150 con 0x7f6c0015f020 2023-11-24T08:04:49.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6bec06aff0 msgr2=0x7f6bec06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6bec06aff0 0x7f6bec06d4b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6bf0009a40 tx=0x7f6bf0008040 comp rx=0 tx=0).stop 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 msgr2=0x7f6c000cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 0x7f6c000cd370 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8002230 tx=0x7f6bf8009750 comp rx=0 tx=0).stop 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 shutdown_connections 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6bec06aff0 0x7f6bec06d4b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c0015f020 0x7f6c000cd370 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6c0015cbb0 0x7f6c000cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 --2- 172.21.15.161:0/3935575594 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6be8004d00 0x7f6c00153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 >> 172.21.15.161:0/3935575594 conn(0x7f6c0006a800 msgr2=0x7f6c001618d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.216+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 shutdown_connections 2023-11-24T08:04:49.218 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.217+0000 7f6c057a9640 1 -- 172.21.15.161:0/3935575594 wait complete. 2023-11-24T08:04:49.237 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:04:49.237 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:49.347 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:04:49.478 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:04:49.478 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:04:49.479 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:04:49.539 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:04:49.539 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.598 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:04:49.599 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:04:49.599 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:04:49.660 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:04:49.660 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:04:49.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:04:49.719 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T08:04:49.720 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.938+0000 7ff4c4ad3640 1 Processor -- start 2023-11-24T08:04:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.938+0000 7ff4c4ad3640 1 -- start start 2023-11-24T08:04:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.939+0000 7ff4c4ad3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 0x7ff4c00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.939+0000 7ff4c4ad3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c015c5f0 con 0x7ff4c015f9c0 2023-11-24T08:04:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.939+0000 7ff4c4ad3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c006c470 con 0x7ff4c013df80 2023-11-24T08:04:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.939+0000 7ff4c4ad3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c006c750 con 0x7ff4c013e360 2023-11-24T08:04:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bed9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff4c015f9c0 0x7ff4c00cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49610/0 (socket says 172.21.15.161:49610) 2023-11-24T08:04:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bed9d640 1 -- 172.21.15.161:0/3882234125 learned_addr learned my addr 172.21.15.161:0/3882234125 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3426848202 0 0) 0x7ff4c015c5f0 con 0x7ff4c015f9c0 2023-11-24T08:04:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ac003520 con 0x7ff4c015f9c0 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4b7fff640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 0x7ff4c00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925552138 0 0) 0x7ff4ac003520 con 0x7ff4c015f9c0 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 msgr2=0x7ff4c00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.940+0000 7ff4bdd9b640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 0x7ff4c00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 >> v1:172.21.15.175:6789/0 conn(0x7ff4c013df80 legacy=0x7ff4c015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c006ca30 con 0x7ff4c015f9c0 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7ff4b80019f0 con 0x7ff4c015f9c0 2023-11-24T08:04:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 >> v1:172.21.15.161:6789/0 conn(0x7ff4c015f9c0 legacy=0x7ff4c00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0039a0 0x7ff4ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ac0047c0 0x7ff4ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 0x7ff4ac0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c006c750 con 0x7ff4ac0039a0 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac00bac0 con 0x7ff4ac0047c0 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ac00bc80 con 0x7ff4c013e360 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4be59c640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0039a0 0x7ff4ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4b7fff640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ac0047c0 0x7ff4ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4be59c640 1 -- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 msgr2=0x7ff4ac0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4be59c640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4c013e360 0x7ff4ac0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4be59c640 1 -- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ac0047c0 msgr2=0x7ff4ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4be59c640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4ac0047c0 0x7ff4ac004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.941+0000 7ff4be59c640 1 -- 172.21.15.161:0/3882234125 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac003520 con 0x7ff4ac0039a0 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.942+0000 7ff4be59c640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0039a0 0x7ff4ac003da0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0003db0 tx=0x7ff4ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789bef672896ee61 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0032600 con 0x7ff4ac0039a0 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b002e050 con 0x7ff4ac0039a0 2023-11-24T08:04:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4bdd9b640 1 -- 172.21.15.161:0/3882234125 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00329a0 con 0x7ff4ac0039a0 2023-11-24T08:04:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3882234125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0039a0 msgr2=0x7ff4ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3882234125 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4ac0039a0 0x7ff4ac003da0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0003db0 tx=0x7ff4ac0057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4bed9d640 1 -- 172.21.15.161:0/3882234125 reap_dead start 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3882234125 shutdown_connections 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3882234125 >> 172.21.15.161:0/3882234125 conn(0x7ff4c006a800 msgr2=0x7ff4c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3882234125 shutdown_connections 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.943+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3882234125 wait complete. 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.945+0000 7ff4c4ad3640 1 Processor -- start 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.945+0000 7ff4c4ad3640 1 -- start start 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4c4ad3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ac0039a0 0x7ff4c013d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4c4ad3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 0x7ff4c01f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4c4ad3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4c00b2cf0 0x7ff4c00b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4c4ad3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c00b36e0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4c4ad3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c013de10 con 0x7ff4c00b2cf0 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4c4ad3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c01f73a0 con 0x7ff4ac0039a0 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.946+0000 7ff4b7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 0x7ff4c01f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 0x7ff4c01f6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36562/0 (socket says 172.21.15.161:36562) 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 -- 172.21.15.161:0/3367126898 learned_addr learned my addr 172.21.15.161:0/3367126898 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 -- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ac0039a0 msgr2=0x7ff4c013d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ac0039a0 0x7ff4c013d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 -- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4c00b2cf0 msgr2=0x7ff4c00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4c00b2cf0 0x7ff4c00b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 -- 172.21.15.161:0/3367126898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00a8fe0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b7fff640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 0x7ff4c01f6e60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800e7e0 tx=0x7ff4a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800c6d0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a800c830 con 0x7ff4c01f2e60 2023-11-24T08:04:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c0151fe0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.947+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800cba0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.948+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c01525a0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.949+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c00675d0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.950+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff4a800cd00 con 0x7ff4c01f2e60 2023-11-24T08:04:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.950+0000 7ff4b6ffd640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff4a006b020 0x7ff4a006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.951+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff4a80894c0 con 0x7ff4c01f2e60 2023-11-24T08:04:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.951+0000 7ff4be59c640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff4a006b020 0x7ff4a006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.952+0000 7ff4be59c640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff4a006b020 0x7ff4a006d4e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0034000 tx=0x7ff4b002f000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:49.955+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4a8054440 con 0x7ff4c01f2e60 2023-11-24T08:04:50.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.182+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4c00ae300 con 0x7ff4c01f2e60 2023-11-24T08:04:50.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.183+0000 7ff4b6ffd640 1 -- 172.21.15.161:0/3367126898 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3711 (secure 0 0 0) 0x7ff4a8021e90 con 0x7ff4c01f2e60 2023-11-24T08:04:50.186 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:50.186 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1170252856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1170252856},{"type":"v1","addr":"172.21.15.175:6835","nonce":1170252856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5068,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/2232141048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6833","nonce":2232141048},{"type":"v1","addr":"172.21.15.161:6835","nonce":2232141048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5299,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/3912627638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":3912627638},{"type":"v1","addr":"172.21.15.175:6837","nonce":3912627638}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6834/3599671815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":3599671815},{"type":"v1","addr":"172.21.15.161:6834","nonce":3599671815}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2023-11-24T08:04:50.187 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 29 2023-11-24T08:04:50.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff4a006b020 msgr2=0x7ff4a006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff4a006b020 0x7ff4a006d4e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0034000 tx=0x7ff4b002f000 comp rx=0 tx=0).stop 2023-11-24T08:04:50.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 msgr2=0x7ff4c01f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 0x7ff4c01f6e60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800e7e0 tx=0x7ff4a800eca0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 shutdown_connections 2023-11-24T08:04:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff4a006b020 0x7ff4a006d4e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4c00b2cf0 0x7ff4c00b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff4c01f2e60 0x7ff4c01f6e60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 --2- 172.21.15.161:0/3367126898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4ac0039a0 0x7ff4c013d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 >> 172.21.15.161:0/3367126898 conn(0x7ff4c006a800 msgr2=0x7ff4c015a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 shutdown_connections 2023-11-24T08:04:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.186+0000 7ff4c4ad3640 1 -- 172.21.15.161:0/3367126898 wait complete. 2023-11-24T08:04:50.208 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T08:04:50.209 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T08:04:50.209 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:04:50.209 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:50.210 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T08:04:50.210 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T08:04:50.210 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:04:50.210 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:50.211 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T08:04:50.211 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T08:04:50.211 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:04:50.211 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:50.212 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T08:04:50.212 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T08:04:50.212 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:04:50.212 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:04:50.232 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:04:50.233 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T08:04:50.233 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:04:50.234 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T08:04:50.237 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:04:50.237 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T08:04:50.238 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:04:50.239 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T08:04:50.281 INFO:tasks.ceph.mds.b:Started 2023-11-24T08:04:50.282 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:50.287 INFO:tasks.ceph.mds.a:Started 2023-11-24T08:04:50.287 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:50.288 INFO:tasks.ceph.mds.d:Started 2023-11-24T08:04:50.288 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:50.294 INFO:tasks.ceph.mds.c:Started 2023-11-24T08:04:50.295 DEBUG:teuthology.parallel:result is None 2023-11-24T08:04:50.295 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T08:04:50.442 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2023-11-24T08:04:50.445 INFO:tasks.ceph.mds.a.smithi161.stdout:starting mds.a at 2023-11-24T08:04:50.446 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2023-11-24T08:04:50.447 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-11-24T08:04:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.485+0000 7fba61a51640 1 Processor -- start 2023-11-24T08:04:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.485+0000 7fba61a51640 1 -- start start 2023-11-24T08:04:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.486+0000 7fba61a51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c15e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.486+0000 7fba61a51640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba5c0cf290 0x7fba5c0cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.486+0000 7fba61a51640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c070c40 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.486+0000 7fba61a51640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c071450 con 0x7fba5c0cf290 2023-11-24T08:04:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.486+0000 7fba61a51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0cfc60 con 0x7fba5c0ae5a0 2023-11-24T08:04:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5b7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fba5c0cf290 0x7fba5c0cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba527fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fba5c0b3ae0 0x7fba5c06cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:49644/0 (socket says 172.21.15.161:49644) 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba527fc640 1 -- 172.21.15.161:0/3107227725 learned_addr learned my addr 172.21.15.161:0/3107227725 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5affd640 1 --2- 172.21.15.161:0/3107227725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c15e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5b7fe640 1 -- 172.21.15.161:0/3107227725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 msgr2=0x7fba5c15e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5b7fe640 1 --2- 172.21.15.161:0/3107227725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c15e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5b7fe640 1 -- 172.21.15.161:0/3107227725 >> v1:172.21.15.161:6789/0 conn(0x7fba5c0b3ae0 legacy=0x7fba5c06cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5b7fe640 1 -- 172.21.15.161:0/3107227725 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c06c470 con 0x7fba5c0cf290 2023-11-24T08:04:50.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.487+0000 7fba5a7fc640 1 -- 172.21.15.161:0/3107227725 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377515836 0 0) 0x7fba5c070c40 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.488+0000 7fba5b7fe640 1 --2- 172.21.15.161:0/3107227725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0cf290 0x7fba5c0cf720 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fba540097a0 tx=0x7fba5402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cfb424ed3bb7f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba5a7fc640 1 -- 172.21.15.161:0/3107227725 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54030610 con 0x7fba5c0cf290 2023-11-24T08:04:50.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba5a7fc640 1 -- 172.21.15.161:0/3107227725 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba54030770 con 0x7fba5c0cf290 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba5a7fc640 1 -- 172.21.15.161:0/3107227725 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54030b00 con 0x7fba5c0cf290 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 -- 172.21.15.161:0/3107227725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0cf290 msgr2=0x7fba5c0cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 --2- 172.21.15.161:0/3107227725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0cf290 0x7fba5c0cf720 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fba540097a0 tx=0x7fba5402b960 comp rx=0 tx=0).stop 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 -- 172.21.15.161:0/3107227725 shutdown_connections 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 --2- 172.21.15.161:0/3107227725 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0cf290 0x7fba5c0cf720 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 --2- 172.21.15.161:0/3107227725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c15e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 -- 172.21.15.161:0/3107227725 >> 172.21.15.161:0/3107227725 conn(0x7fba5c06a800 msgr2=0x7fba5c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.489+0000 7fba61a51640 1 -- 172.21.15.161:0/3107227725 shutdown_connections 2023-11-24T08:04:50.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.490+0000 7fba61a51640 1 -- 172.21.15.161:0/3107227725 wait complete. 2023-11-24T08:04:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.491+0000 7fba61a51640 1 Processor -- start 2023-11-24T08:04:50.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.491+0000 7fba61a51640 1 -- start start 2023-11-24T08:04:50.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.492+0000 7fba61a51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.492+0000 7fba61a51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 0x7fba5c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.492+0000 7fba61a51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba5c0cf290 0x7fba5c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.492+0000 7fba61a51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15f700 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.492+0000 7fba61a51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15f9e0 con 0x7fba5c0cf290 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.492+0000 7fba61a51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c15fcc0 con 0x7fba5c0ae5a0 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 0x7fba5c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 0x7fba5c157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:36602/0 (socket says 172.21.15.161:36602) 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 -- 172.21.15.161:0/2783450330 learned_addr learned my addr 172.21.15.161:0/2783450330 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba5affd640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba5b7fe640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba5c0cf290 0x7fba5c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 -- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 msgr2=0x7fba5c144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 -- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba5c0cf290 msgr2=0x7fba5c157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba5c0cf290 0x7fba5c157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 -- 172.21.15.161:0/2783450330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009400 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.493+0000 7fba527fc640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 0x7fba5c157400 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fba4400c4d0 tx=0x7fba4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.494+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440074e0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.494+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44007660 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.494+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c15ffa0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.494+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba44004a20 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.494+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c157940 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.495+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c1604c0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.496+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fba44004b80 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.497+0000 7fba58ff9640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fba3c06aff0 0x7fba3c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:50.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.497+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba44088aa0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.497+0000 7fba5affd640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fba3c06aff0 0x7fba3c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:50.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.498+0000 7fba5affd640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fba3c06aff0 0x7fba3c06d4b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0113e0 tx=0x7fba4c00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:50.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.501+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba5c1604c0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.699+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fba5c1604c0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.789+0000 7fba58ff9640 1 -- 172.21.15.161:0/2783450330 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v54) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba5c1604c0 con 0x7fba5c0b3ae0 2023-11-24T08:04:50.791 INFO:teuthology.orchestra.run.smithi161.stderr: removed all blocklist entries 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.791+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fba3c06aff0 msgr2=0x7fba3c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.791+0000 7fba61a51640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fba3c06aff0 0x7fba3c06d4b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0113e0 tx=0x7fba4c00b040 comp rx=0 tx=0).stop 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.791+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 msgr2=0x7fba5c157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.791+0000 7fba61a51640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 0x7fba5c157400 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fba4400c4d0 tx=0x7fba4400c990 comp rx=0 tx=0).stop 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 shutdown_connections 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fba3c06aff0 0x7fba3c06d4b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba5c0cf290 0x7fba5c157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fba5c0b3ae0 0x7fba5c157400 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 --2- 172.21.15.161:0/2783450330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba5c0ae5a0 0x7fba5c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 >> 172.21.15.161:0/2783450330 conn(0x7fba5c06a800 msgr2=0x7fba5c15d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 shutdown_connections 2023-11-24T08:04:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:50.792+0000 7fba61a51640 1 -- 172.21.15.161:0/2783450330 wait complete. 2023-11-24T08:04:50.815 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T08:04:51.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.014+0000 7f1224cd3640 1 Processor -- start 2023-11-24T08:04:51.017 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.015+0000 7f1224cd3640 1 -- start start 2023-11-24T08:04:51.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.016+0000 7f1224cd3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f122013df80 0x7f122015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.016+0000 7f1224cd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 0x7f12200cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.016+0000 7f1224cd3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122006c470 con 0x7f122015f9c0 2023-11-24T08:04:51.018 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.016+0000 7f1224cd3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122006c750 con 0x7f122013df80 2023-11-24T08:04:51.019 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.016+0000 7f1224cd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122006ca30 con 0x7f122013e360 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 0x7f12200cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 0x7f12200cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:58324/0 (socket says 172.21.15.161:58324) 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 -- 172.21.15.161:0/700704532 learned_addr learned my addr 172.21.15.161:0/700704532 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f121e59c640 1 --2- 172.21.15.161:0/700704532 >> v2:172.21.15.175:3300/0 conn(0x7f122013df80 0x7f122015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 -- 172.21.15.161:0/700704532 >> v2:172.21.15.175:3300/0 conn(0x7f122013df80 msgr2=0x7f122015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 --2- 172.21.15.161:0/700704532 >> v2:172.21.15.175:3300/0 conn(0x7f122013df80 0x7f122015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 -- 172.21.15.161:0/700704532 >> v1:172.21.15.175:6789/0 conn(0x7f122015f9c0 legacy=0x7f12201408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.017+0000 7f1217fff640 1 -- 172.21.15.161:0/700704532 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122006cd10 con 0x7f122013e360 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.019+0000 7f1217fff640 1 --2- 172.21.15.161:0/700704532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 0x7f12200cf290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1208009870 tx=0x7f120802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2004cfd037bc2644 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.021 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.019+0000 7f121dd9b640 1 -- 172.21.15.161:0/700704532 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208031640 con 0x7f122013e360 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.019+0000 7f121dd9b640 1 -- 172.21.15.161:0/700704532 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12080317a0 con 0x7f122013e360 2023-11-24T08:04:51.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.019+0000 7f121dd9b640 1 -- 172.21.15.161:0/700704532 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1208031b30 con 0x7f122013e360 2023-11-24T08:04:51.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 -- 172.21.15.161:0/700704532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 msgr2=0x7f12200cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.023 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 --2- 172.21.15.161:0/700704532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 0x7f12200cf290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1208009870 tx=0x7f120802b8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 -- 172.21.15.161:0/700704532 shutdown_connections 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 --2- 172.21.15.161:0/700704532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122013e360 0x7f12200cf290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 --2- 172.21.15.161:0/700704532 >> v2:172.21.15.175:3300/0 conn(0x7f122013df80 0x7f122015bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 -- 172.21.15.161:0/700704532 >> 172.21.15.161:0/700704532 conn(0x7f122006a800 msgr2=0x7f122006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 -- 172.21.15.161:0/700704532 shutdown_connections 2023-11-24T08:04:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.020+0000 7f1224cd3640 1 -- 172.21.15.161:0/700704532 wait complete. 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.022+0000 7f1224cd3640 1 Processor -- start 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.022+0000 7f1224cd3640 1 -- start start 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.023+0000 7f1224cd3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 0x7f12201f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.023+0000 7f1224cd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122013e360 0x7f12201e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.023+0000 7f1224cd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122015f9c0 0x7f122013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.023+0000 7f1224cd3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12201e58d0 con 0x7f122013df80 2023-11-24T08:04:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.023+0000 7f1224cd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12201e5310 con 0x7f122013e360 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.023+0000 7f1224cd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12201e55f0 con 0x7f122015f9c0 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 0x7f12201f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 0x7f12201f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34698/0 (socket says 172.21.15.161:34698) 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 -- 172.21.15.161:0/234777409 learned_addr learned my addr 172.21.15.161:0/234777409 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f1217fff640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122013e360 0x7f12201e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 -- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122015f9c0 msgr2=0x7f122013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122015f9c0 0x7f122013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 -- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122013e360 msgr2=0x7f12201e4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122013e360 0x7f12201e4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 -- 172.21.15.161:0/234777409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080094d0 con 0x7f122013df80 2023-11-24T08:04:51.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f121e59c640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 0x7f12201f3c60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f121000e870 tx=0x7f121000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.024+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100094f0 con 0x7f122013df80 2023-11-24T08:04:51.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.025+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121000c940 con 0x7f122013df80 2023-11-24T08:04:51.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.025+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121000ccf0 con 0x7f122013df80 2023-11-24T08:04:51.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.025+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12201f44d0 con 0x7f122013df80 2023-11-24T08:04:51.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.025+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12201e5020 con 0x7f122013df80 2023-11-24T08:04:51.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.026+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12201f4330 con 0x7f122013df80 2023-11-24T08:04:51.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.027+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1210013470 con 0x7f122013df80 2023-11-24T08:04:51.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.028+0000 7f1216ffd640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f120006aff0 0x7f120006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.028+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1210089670 con 0x7f122013df80 2023-11-24T08:04:51.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.028+0000 7f1217fff640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f120006aff0 0x7f120006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.029+0000 7f1217fff640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f120006aff0 0x7f120006d4b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1208036000 tx=0x7f120803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.032+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12201f4330 con 0x7f122013df80 2023-11-24T08:04:51.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.290+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f12201f4330 con 0x7f122013df80 2023-11-24T08:04:51.293 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.291+0000 7f1216ffd640 1 -- 172.21.15.161:0/234777409 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f12201f4330 con 0x7f122013df80 2023-11-24T08:04:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:51.293 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:04:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: "auth_dump": [ 2023-11-24T08:04:51.293 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.a", 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlHD6tGhAAHgfwFnLRAnZJYkP/R6LkDA==", 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.294 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.b", 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlhwvbARAAhTRWPeXbP0Z85pAw4aEhzw==", 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.c", 2023-11-24T08:04:51.295 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlBOzLKxAAodBeIc6gxGOmd7u2xqJcNQ==", 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mds.d", 2023-11-24T08:04:51.296 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2Blgdy3EhAATujalM2qKRTbZsSDt9Klkg==", 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.297 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.0", 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDWV2BlYGGZDRAAw5WGhgWYIelaXgs35FbP6Q==", 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.298 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.1", 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDZV2Bl7LRAJxAA/0jx7Tz254+nQpLEHq0DHw==", 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.299 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.2", 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDdV2BlGxntAxAAlq53dwY33JyEdL1bA4A4qg==", 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.300 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.3", 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDgV2BleVHNHBAA5WTP8GdbwtsQqAQGlBltKA==", 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.4", 2023-11-24T08:04:51.301 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDnV2BlnBePIRAAiBKoHmbq5RakHSkloIHXiA==", 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.5", 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDqV2BlPvd0KxAA0NN6x6VMmoheCO+k1+9Pqw==", 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.302 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.6", 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDtV2Bl93CTNBAAQciFc0K2H/YECC3VtUaz6A==", 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.303 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "osd.7", 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDxV2Bl4WVOEhAA05ppVcoEr6QDrGDWYMXoWQ==", 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow profile osd", 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile osd", 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.304 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.0", 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA==", 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow r", 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.305 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.1", 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlsuSyNxAAzKRQWIED6Y00//mN8k2A2A==", 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.306 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.2", 2023-11-24T08:04:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDRV2BlbNQdLRAAgt8XlhFRtS6ykHldSR/mTg==", 2023-11-24T08:04:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:04:51.307 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.3", 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDSV2BlFoFzBhAATWeUEX1fhVTvj03CuGTO/w==", 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow", 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow r", 2023-11-24T08:04:51.308 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow rw", 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow rwx" 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "client.admin", 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDPV2BlOyC4DhAASM/sLxsmWpuy+0JqHTr6xw==", 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "mgr": "allow *", 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow *", 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.309 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.x", 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlaY9ADhAA3F3uUt8RpzSr7R2IgBLQYA==", 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:51.310 INFO:teuthology.orchestra.run.smithi161.stdout: "entity": "mgr.y", 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "key": "AQDQV2BlNxTcABAApZPsFQs537yAkIv0IJhzOg==", 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "caps": { 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "mds": "allow *", 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "mon": "allow profile mgr", 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: "osd": "allow *" 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout: ] 2023-11-24T08:04:51.311 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:04:51.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f120006aff0 msgr2=0x7f120006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.312 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f120006aff0 0x7f120006d4b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1208036000 tx=0x7f120803c040 comp rx=0 tx=0).stop 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 msgr2=0x7f12201f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 0x7f12201f3c60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f121000e870 tx=0x7f121000ed30 comp rx=0 tx=0).stop 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 shutdown_connections 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f120006aff0 0x7f120006d4b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f122015f9c0 0x7f122013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f122013e360 0x7f12201e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 --2- 172.21.15.161:0/234777409 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f122013df80 0x7f12201f3c60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.293+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 >> 172.21.15.161:0/234777409 conn(0x7f122006a800 msgr2=0x7f12200aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.294+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 shutdown_connections 2023-11-24T08:04:51.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.294+0000 7f1224cd3640 1 -- 172.21.15.161:0/234777409 wait complete. 2023-11-24T08:04:51.315 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:51.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.517+0000 7f433f59e640 1 Processor -- start 2023-11-24T08:04:51.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.517+0000 7f433f59e640 1 -- start start 2023-11-24T08:04:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.518+0000 7f433f59e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4340159590 0x7f4340070160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433f59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f434006d050 0x7f434006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433f59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4340071790 con 0x7f43400b3c20 2023-11-24T08:04:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433f59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434006d990 con 0x7f434006d050 2023-11-24T08:04:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433f59e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4340071100 con 0x7f4340159590 2023-11-24T08:04:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f4337fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f43400b3c20 0x7f43400ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45438/0 (socket says 172.21.15.161:45438) 2023-11-24T08:04:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f4337fff640 1 -- 172.21.15.161:0/3468069484 learned_addr learned my addr 172.21.15.161:0/3468069484 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433ed9d640 1 --2- 172.21.15.161:0/3468069484 >> v2:172.21.15.161:3300/0 conn(0x7f434006d050 0x7f434006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433e59c640 1 --2- 172.21.15.161:0/3468069484 >> v2:172.21.15.175:3300/0 conn(0x7f4340159590 0x7f4340070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433dd9b640 1 -- 172.21.15.161:0/3468069484 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311488302 0 0) 0x7f4340071790 con 0x7f43400b3c20 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.519+0000 7f433dd9b640 1 -- 172.21.15.161:0/3468069484 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f432c003520 con 0x7f43400b3c20 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.520+0000 7f433ed9d640 1 -- 172.21.15.161:0/3468069484 >> v2:172.21.15.175:3300/0 conn(0x7f4340159590 msgr2=0x7f4340070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.520+0000 7f433ed9d640 1 --2- 172.21.15.161:0/3468069484 >> v2:172.21.15.175:3300/0 conn(0x7f4340159590 0x7f4340070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.520+0000 7f433ed9d640 1 -- 172.21.15.161:0/3468069484 >> v1:172.21.15.161:6789/0 conn(0x7f43400b3c20 legacy=0x7f43400ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.520+0000 7f433ed9d640 1 -- 172.21.15.161:0/3468069484 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340070860 con 0x7f434006d050 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.521+0000 7f433ed9d640 1 --2- 172.21.15.161:0/3468069484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434006d050 0x7f434006d450 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f43400b30a0 tx=0x7f433802cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c217503408cfc05 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.521+0000 7f433dd9b640 1 -- 172.21.15.161:0/3468069484 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433802dad0 con 0x7f434006d050 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.521+0000 7f433dd9b640 1 -- 172.21.15.161:0/3468069484 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433802dc30 con 0x7f434006d050 2023-11-24T08:04:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.521+0000 7f433dd9b640 1 -- 172.21.15.161:0/3468069484 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433800a2e0 con 0x7f434006d050 2023-11-24T08:04:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.521+0000 7f433f59e640 1 -- 172.21.15.161:0/3468069484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434006d050 msgr2=0x7f434006d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.521+0000 7f433f59e640 1 --2- 172.21.15.161:0/3468069484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434006d050 0x7f434006d450 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f43400b30a0 tx=0x7f433802cf30 comp rx=0 tx=0).stop 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.522+0000 7f433f59e640 1 -- 172.21.15.161:0/3468069484 shutdown_connections 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.522+0000 7f433f59e640 1 --2- 172.21.15.161:0/3468069484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f434006d050 0x7f434006d450 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.522+0000 7f433f59e640 1 --2- 172.21.15.161:0/3468069484 >> v2:172.21.15.175:3300/0 conn(0x7f4340159590 0x7f4340070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.522+0000 7f433f59e640 1 -- 172.21.15.161:0/3468069484 >> 172.21.15.161:0/3468069484 conn(0x7f434006a800 msgr2=0x7f434006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.522+0000 7f433f59e640 1 -- 172.21.15.161:0/3468069484 shutdown_connections 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.522+0000 7f433f59e640 1 -- 172.21.15.161:0/3468069484 wait complete. 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.523+0000 7f433f59e640 1 Processor -- start 2023-11-24T08:04:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.523+0000 7f433f59e640 1 -- start start 2023-11-24T08:04:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.524+0000 7f433f59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434006d050 0x7f434015b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.524+0000 7f433f59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43400b3c20 0x7f43401523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.524+0000 7f433f59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 0x7f4340152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.524+0000 7f433f59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4340152e50 con 0x7f4340159590 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.524+0000 7f433f59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434015af20 con 0x7f43400b3c20 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.524+0000 7f433f59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43401e5990 con 0x7f434006d050 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 0x7f4340152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 0x7f4340152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34716/0 (socket says 172.21.15.161:34716) 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 -- 172.21.15.161:0/588642721 learned_addr learned my addr 172.21.15.161:0/588642721 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 -- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434006d050 msgr2=0x7f434015b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f4337fff640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43400b3c20 0x7f43401523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433e59c640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434006d050 0x7f434015b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434006d050 0x7f434015b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 -- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43400b3c20 msgr2=0x7f43401523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43400b3c20 0x7f43401523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 -- 172.21.15.161:0/588642721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433800ab80 con 0x7f4340159590 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.525+0000 7f433ed9d640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 0x7f4340152910 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f433802d540 tx=0x7f4338004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.526+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338040670 con 0x7f4340159590 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.526+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43380407d0 con 0x7f4340159590 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.526+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338040b80 con 0x7f4340159590 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.526+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43401e4e10 con 0x7f4340159590 2023-11-24T08:04:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.526+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43401e53d0 con 0x7f4340159590 2023-11-24T08:04:51.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.527+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4340153690 con 0x7f4340159590 2023-11-24T08:04:51.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.528+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4338040ce0 con 0x7f4340159590 2023-11-24T08:04:51.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.529+0000 7f4336ffd640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f432006aff0 0x7f432006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:51.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.529+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f43380ac8b0 con 0x7f4340159590 2023-11-24T08:04:51.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.529+0000 7f433e59c640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f432006aff0 0x7f432006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:51.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.530+0000 7f433e59c640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f432006aff0 0x7f432006d4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4330006fd0 tx=0x7f4330008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:51.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.533+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4340153690 con 0x7f4340159590 2023-11-24T08:04:51.711 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.709+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4340153690 con 0x7f4340159590 2023-11-24T08:04:51.713 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.711+0000 7f4336ffd640 1 -- 172.21.15.161:0/588642721 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f4340153690 con 0x7f4340159590 2023-11-24T08:04:51.714 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:51.714 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":56,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:50.805255+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:51.716 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f432006aff0 msgr2=0x7f432006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f432006aff0 0x7f432006d4b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4330006fd0 tx=0x7f4330008040 comp rx=0 tx=0).stop 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 msgr2=0x7f4340152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 0x7f4340152910 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f433802d540 tx=0x7f4338004a40 comp rx=0 tx=0).stop 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 shutdown_connections 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f432006aff0 0x7f432006d4b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4340159590 0x7f4340152910 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43400b3c20 0x7f43401523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 --2- 172.21.15.161:0/588642721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f434006d050 0x7f434015b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 >> 172.21.15.161:0/588642721 conn(0x7f434006a800 msgr2=0x7f43400b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:51.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 shutdown_connections 2023-11-24T08:04:51.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.714+0000 7f433f59e640 1 -- 172.21.15.161:0/588642721 wait complete. 2023-11-24T08:04:51.733 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:04:51.733 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:04:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.944+0000 7f6579fb7640 1 Processor -- start 2023-11-24T08:04:52.022 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.944+0000 7f6579fb7640 1 -- start start 2023-11-24T08:04:52.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6579fb7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f657415c300 0x7f657415f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6579fb7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65740b34e0 0x7f657415f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6579fb7640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657415fe60 con 0x7f6574159040 2023-11-24T08:04:52.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6579fb7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65740c6060 con 0x7f65740b34e0 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6579fb7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65740cf710 con 0x7f657415c300 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6573fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65740b34e0 0x7f657415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6573fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65740b34e0 0x7f657415f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34732/0 (socket says 172.21.15.161:34732) 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.946+0000 7f6573fff640 1 -- 172.21.15.161:0/1853928930 learned_addr learned my addr 172.21.15.161:0/1853928930 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.947+0000 7f6572ffd640 1 --2- 172.21.15.161:0/1853928930 >> v2:172.21.15.175:3300/0 conn(0x7f657415c300 0x7f657415f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.947+0000 7f6573fff640 1 -- 172.21.15.161:0/1853928930 >> v2:172.21.15.175:3300/0 conn(0x7f657415c300 msgr2=0x7f657415f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.947+0000 7f6573fff640 1 --2- 172.21.15.161:0/1853928930 >> v2:172.21.15.175:3300/0 conn(0x7f657415c300 0x7f657415f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.947+0000 7f6573fff640 1 -- 172.21.15.161:0/1853928930 >> v1:172.21.15.175:6789/0 conn(0x7f6574159040 legacy=0x7f65740cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.947+0000 7f6573fff640 1 -- 172.21.15.161:0/1853928930 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740c62d0 con 0x7f65740b34e0 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.948+0000 7f6573fff640 1 --2- 172.21.15.161:0/1853928930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65740b34e0 0x7f657415f920 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f65740d1da0 tx=0x7f656c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ec44c9f183006c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.948+0000 7f65727fc640 1 -- 172.21.15.161:0/1853928930 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c031870 con 0x7f65740b34e0 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.948+0000 7f65727fc640 1 -- 172.21.15.161:0/1853928930 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c0319d0 con 0x7f65740b34e0 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.948+0000 7f65727fc640 1 -- 172.21.15.161:0/1853928930 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656c031d60 con 0x7f65740b34e0 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 -- 172.21.15.161:0/1853928930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65740b34e0 msgr2=0x7f657415f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 --2- 172.21.15.161:0/1853928930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65740b34e0 0x7f657415f920 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f65740d1da0 tx=0x7f656c02b910 comp rx=0 tx=0).stop 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 -- 172.21.15.161:0/1853928930 shutdown_connections 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 --2- 172.21.15.161:0/1853928930 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65740b34e0 0x7f657415f920 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 --2- 172.21.15.161:0/1853928930 >> v2:172.21.15.175:3300/0 conn(0x7f657415c300 0x7f657415f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 -- 172.21.15.161:0/1853928930 >> 172.21.15.161:0/1853928930 conn(0x7f6574066690 msgr2=0x7f657406a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 -- 172.21.15.161:0/1853928930 shutdown_connections 2023-11-24T08:04:52.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.949+0000 7f6579fb7640 1 -- 172.21.15.161:0/1853928930 wait complete. 2023-11-24T08:04:52.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.951+0000 7f6579fb7640 1 Processor -- start 2023-11-24T08:04:52.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.951+0000 7f6579fb7640 1 -- start start 2023-11-24T08:04:52.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6579fb7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65740b34e0 0x7f657414bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6579fb7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 0x7f657406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6579fb7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f657415c300 0x7f657406d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6579fb7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65740c9ad0 con 0x7f6574159040 2023-11-24T08:04:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6579fb7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657414c210 con 0x7f65740b34e0 2023-11-24T08:04:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6579fb7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65740c8e50 con 0x7f657415c300 2023-11-24T08:04:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6572ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 0x7f657406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6572ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 0x7f657406cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34746/0 (socket says 172.21.15.161:34746) 2023-11-24T08:04:52.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f6572ffd640 1 -- 172.21.15.161:0/4082084433 learned_addr learned my addr 172.21.15.161:0/4082084433 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.952+0000 7f65737fe640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65740b34e0 0x7f657414bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6573fff640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f657415c300 0x7f657406d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6572ffd640 1 -- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f657415c300 msgr2=0x7f657406d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6572ffd640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f657415c300 0x7f657406d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6572ffd640 1 -- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65740b34e0 msgr2=0x7f657414bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6572ffd640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65740b34e0 0x7f657414bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6572ffd640 1 -- 172.21.15.161:0/4082084433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0094d0 con 0x7f6574159040 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6573fff640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f657415c300 0x7f657406d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6572ffd640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 0x7f657406cae0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f655c00c7f0 tx=0x7f655c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c004220 con 0x7f6574159040 2023-11-24T08:04:52.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655c004380 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655c007840 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65740c9130 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.953+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65740c96f0 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.955+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6574074a50 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.955+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f655c007bb0 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.956+0000 7f656bfff640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f655406b020 0x7f655406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.956+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f655c089600 con 0x7f6574159040 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.957+0000 7f65737fe640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f655406b020 0x7f655406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.033 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.958+0000 7f65737fe640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f655406b020 0x7f655406d4e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6564001db0 tx=0x7f6564009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:51.961+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f655c054660 con 0x7f6574159040 2023-11-24T08:04:52.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.137+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65740c9c10 con 0x7f6574159040 2023-11-24T08:04:52.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.137+0000 7f656bfff640 1 -- 172.21.15.161:0/4082084433 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65740c9c10 con 0x7f6574159040 2023-11-24T08:04:52.139 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:04:52.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.139+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f655406b020 msgr2=0x7f655406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.139+0000 7f6579fb7640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f655406b020 0x7f655406d4e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6564001db0 tx=0x7f6564009040 comp rx=0 tx=0).stop 2023-11-24T08:04:52.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.139+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 msgr2=0x7f657406cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.139+0000 7f6579fb7640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 0x7f657406cae0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f655c00c7f0 tx=0x7f655c00ccb0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 shutdown_connections 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f655406b020 0x7f655406d4e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f657415c300 0x7f657406d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6574159040 0x7f657406cae0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 --2- 172.21.15.161:0/4082084433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65740b34e0 0x7f657414bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 >> 172.21.15.161:0/4082084433 conn(0x7f6574066690 msgr2=0x7f65740d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 shutdown_connections 2023-11-24T08:04:52.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.140+0000 7f6579fb7640 1 -- 172.21.15.161:0/4082084433 wait complete. 2023-11-24T08:04:52.160 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T08:04:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.368+0000 7f68dba3d640 1 Processor -- start 2023-11-24T08:04:52.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.368+0000 7f68dba3d640 1 -- start start 2023-11-24T08:04:52.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.369+0000 7f68dba3d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68d413df80 0x7f68d415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.369+0000 7f68dba3d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68d413e360 0x7f68d40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68dba3d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d406c470 con 0x7f68d415f9c0 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68dba3d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d406c750 con 0x7f68d413df80 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68dba3d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d406ca30 con 0x7f68d413e360 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d97d9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f68d413df80 0x7f68d415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d9fda640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f68d415f9c0 0x7f68d41408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45454/0 (socket says 172.21.15.161:45454) 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d9fda640 1 -- 172.21.15.161:0/72497276 learned_addr learned my addr 172.21.15.161:0/72497276 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d8fd8640 1 --2- 172.21.15.161:0/72497276 >> v2:172.21.15.175:3300/0 conn(0x7f68d413e360 0x7f68d40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d97d9640 1 -- 172.21.15.161:0/72497276 >> v2:172.21.15.175:3300/0 conn(0x7f68d413e360 msgr2=0x7f68d40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d97d9640 1 --2- 172.21.15.161:0/72497276 >> v2:172.21.15.175:3300/0 conn(0x7f68d413e360 0x7f68d40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d97d9640 1 -- 172.21.15.161:0/72497276 >> v1:172.21.15.161:6789/0 conn(0x7f68d415f9c0 legacy=0x7f68d41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.370+0000 7f68d97d9640 1 -- 172.21.15.161:0/72497276 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d406cd10 con 0x7f68d413df80 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.371+0000 7f68d97d9640 1 --2- 172.21.15.161:0/72497276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d415bee0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f68d406ded0 tx=0x7f68d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5095f90409faa39 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68cbfff640 1 -- 172.21.15.161:0/72497276 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0031830 con 0x7f68d413df80 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68cbfff640 1 -- 172.21.15.161:0/72497276 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0031990 con 0x7f68d413df80 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68cbfff640 1 -- 172.21.15.161:0/72497276 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0031d20 con 0x7f68d413df80 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68dba3d640 1 -- 172.21.15.161:0/72497276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 msgr2=0x7f68d415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68dba3d640 1 --2- 172.21.15.161:0/72497276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d415bee0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f68d406ded0 tx=0x7f68d002b8d0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68dba3d640 1 -- 172.21.15.161:0/72497276 shutdown_connections 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68dba3d640 1 --2- 172.21.15.161:0/72497276 >> v2:172.21.15.175:3300/0 conn(0x7f68d413e360 0x7f68d40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.375 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.372+0000 7f68dba3d640 1 --2- 172.21.15.161:0/72497276 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d415bee0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.373+0000 7f68dba3d640 1 -- 172.21.15.161:0/72497276 >> 172.21.15.161:0/72497276 conn(0x7f68d406a800 msgr2=0x7f68d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.373+0000 7f68dba3d640 1 -- 172.21.15.161:0/72497276 shutdown_connections 2023-11-24T08:04:52.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.373+0000 7f68dba3d640 1 -- 172.21.15.161:0/72497276 wait complete. 2023-11-24T08:04:52.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.374+0000 7f68dba3d640 1 Processor -- start 2023-11-24T08:04:52.376 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.374+0000 7f68dba3d640 1 -- start start 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.375+0000 7f68dba3d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d4148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.375+0000 7f68dba3d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d413e360 0x7f68d40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.375+0000 7f68dba3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d415f9c0 0x7f68d40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.375+0000 7f68dba3d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4146490 con 0x7f68d413df80 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.375+0000 7f68dba3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d4146700 con 0x7f68d415f9c0 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.375+0000 7f68dba3d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d41469e0 con 0x7f68d413e360 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d4148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d4148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34766/0 (socket says 172.21.15.161:34766) 2023-11-24T08:04:52.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 -- 172.21.15.161:0/2317202734 learned_addr learned my addr 172.21.15.161:0/2317202734 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:52.379 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 -- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d413e360 msgr2=0x7f68d40b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d8fd8640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d413e360 0x7f68d40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d413e360 0x7f68d40b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 -- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d415f9c0 msgr2=0x7f68d40b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d415f9c0 0x7f68d40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 -- 172.21.15.161:0/2317202734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009400 con 0x7f68d413df80 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.376+0000 7f68d97d9640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d4148e10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f68d0000c00 tx=0x7f68d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.377+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d003aa60 con 0x7f68d413df80 2023-11-24T08:04:52.380 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.377+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d003abe0 con 0x7f68d413df80 2023-11-24T08:04:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.377+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00443f0 con 0x7f68d413df80 2023-11-24T08:04:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.377+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d4146cc0 con 0x7f68d413df80 2023-11-24T08:04:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.377+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d4149350 con 0x7f68d413df80 2023-11-24T08:04:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.378+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d40675d0 con 0x7f68d413df80 2023-11-24T08:04:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.379+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f68d004d450 con 0x7f68d413df80 2023-11-24T08:04:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.380+0000 7f68c9ffb640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68b806b020 0x7f68b806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.380+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68d00ab930 con 0x7f68d413df80 2023-11-24T08:04:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.380+0000 7f68d8fd8640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68b806b020 0x7f68b806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.381+0000 7f68d8fd8640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68b806b020 0x7f68b806d4e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68d41f45d0 tx=0x7f68c4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.384+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68d0076990 con 0x7f68d413df80 2023-11-24T08:04:52.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.579+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68d415afe0 con 0x7f68d413df80 2023-11-24T08:04:52.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.579+0000 7f68c9ffb640 1 -- 172.21.15.161:0/2317202734 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7f68d0035030 con 0x7f68d413df80 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout: "poolnum": 1, 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout: "poolname": ".mgr" 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:04:52.582 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68b806b020 msgr2=0x7f68b806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68b806b020 0x7f68b806d4e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68d41f45d0 tx=0x7f68c4008040 comp rx=0 tx=0).stop 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 msgr2=0x7f68d4148e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d4148e10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f68d0000c00 tx=0x7f68d00046c0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 shutdown_connections 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f68b806b020 0x7f68b806d4e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68d415f9c0 0x7f68d40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68d413e360 0x7f68d40b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.582+0000 7f68dba3d640 1 --2- 172.21.15.161:0/2317202734 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f68d413df80 0x7f68d4148e10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.583+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 >> 172.21.15.161:0/2317202734 conn(0x7f68d406a800 msgr2=0x7f68d4155620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.583+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 shutdown_connections 2023-11-24T08:04:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.583+0000 7f68dba3d640 1 -- 172.21.15.161:0/2317202734 wait complete. 2023-11-24T08:04:52.604 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T08:04:52.605 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T08:04:52.805 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.803+0000 7f948ce6d640 1 Processor -- start 2023-11-24T08:04:52.806 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.803+0000 7f948ce6d640 1 -- start start 2023-11-24T08:04:52.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.806+0000 7f948ce6d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9488071f00 0x7f9488146770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.806+0000 7f948ce6d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880b2e10 con 0x7f948806c7c0 2023-11-24T08:04:52.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.806+0000 7f948ce6d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948806cc10 con 0x7f9488071410 2023-11-24T08:04:52.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.806+0000 7f948ce6d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948806cec0 con 0x7f9488071f00 2023-11-24T08:04:52.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.806+0000 7f9487fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f948806c7c0 0x7f9488166cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45460/0 (socket says 172.21.15.161:45460) 2023-11-24T08:04:52.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.806+0000 7f9487fff640 1 -- 172.21.15.161:0/2151479026 learned_addr learned my addr 172.21.15.161:0/2151479026 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:52.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f9486ffd640 1 --2- 172.21.15.161:0/2151479026 >> v2:172.21.15.175:3300/0 conn(0x7f9488071f00 0x7f9488146770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136932173 0 0) 0x7f94880b2e10 con 0x7f948806c7c0 2023-11-24T08:04:52.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9470003520 con 0x7f948806c7c0 2023-11-24T08:04:52.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4015314366 0 0) 0x7f9470003520 con 0x7f948806c7c0 2023-11-24T08:04:52.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 >> v2:172.21.15.175:3300/0 conn(0x7f9488071f00 msgr2=0x7f9488146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 --2- 172.21.15.161:0/2151479026 >> v2:172.21.15.175:3300/0 conn(0x7f9488071f00 0x7f9488146770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 >> v1:172.21.15.175:6789/0 conn(0x7f9488071410 legacy=0x7f94880717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948806d1a0 con 0x7f948806c7c0 2023-11-24T08:04:52.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f94800019f0 con 0x7f948806c7c0 2023-11-24T08:04:52.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 >> v1:172.21.15.161:6789/0 conn(0x7f948806c7c0 legacy=0x7f9488166cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94700039c0 0x7f9470003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94700047c0 0x7f9470004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700051d0 0x7f947000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948806cec0 con 0x7f94700039c0 2023-11-24T08:04:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947000c100 con 0x7f94700047c0 2023-11-24T08:04:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947000c2c0 con 0x7f94700051d0 2023-11-24T08:04:52.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.807+0000 7f94877fe640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94700039c0 0x7f9470003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.808+0000 7f94877fe640 1 -- 172.21.15.161:0/2151479026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700051d0 msgr2=0x7f947000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.808+0000 7f94877fe640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700051d0 0x7f947000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.808+0000 7f94877fe640 1 -- 172.21.15.161:0/2151479026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94700047c0 msgr2=0x7f9470004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:52.815 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.808+0000 7f94877fe640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94700047c0 0x7f9470004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.808+0000 7f94877fe640 1 -- 172.21.15.161:0/2151479026 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9470003520 con 0x7f94700039c0 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.808+0000 7f9487fff640 1 -- 172.21.15.161:0/2151479026 reap_dead start 2023-11-24T08:04:52.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.809+0000 7f94877fe640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94700039c0 0x7f9470003dc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9478003db0 tx=0x7f94700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e372e40189ed134 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.809+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9478032600 con 0x7f94700039c0 2023-11-24T08:04:52.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.809+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947802e050 con 0x7f94700039c0 2023-11-24T08:04:52.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.809+0000 7f94867fc640 1 -- 172.21.15.161:0/2151479026 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94780329e0 con 0x7f94700039c0 2023-11-24T08:04:52.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 -- 172.21.15.161:0/2151479026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94700039c0 msgr2=0x7f9470003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.819 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94700039c0 0x7f9470003dc0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9478003db0 tx=0x7f94700057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 -- 172.21.15.161:0/2151479026 shutdown_connections 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 --2- 172.21.15.161:0/2151479026 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f94700039c0 0x7f9470003dc0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 -- 172.21.15.161:0/2151479026 >> 172.21.15.161:0/2151479026 conn(0x7f948806a800 msgr2=0x7f948806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 -- 172.21.15.161:0/2151479026 shutdown_connections 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.810+0000 7f948ce6d640 1 -- 172.21.15.161:0/2151479026 wait complete. 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.812+0000 7f948ce6d640 1 Processor -- start 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.812+0000 7f948ce6d640 1 -- start start 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f948ce6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039c0 0x7f94881f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f948ce6d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 0x7f948815ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f948ce6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815fba0 0x7f948815deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f948ce6d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948815da90 con 0x7f948815f720 2023-11-24T08:04:52.820 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f948ce6d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948815d740 con 0x7f948815fba0 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f948ce6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94881f6e00 con 0x7f94700039c0 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f9486ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 0x7f948815ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f9486ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 0x7f948815ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34782/0 (socket says 172.21.15.161:34782) 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.813+0000 7f9486ffd640 1 -- 172.21.15.161:0/1695263795 learned_addr learned my addr 172.21.15.161:0/1695263795 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f94877fe640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039c0 0x7f94881f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9486ffd640 1 -- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039c0 msgr2=0x7f94881f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9486ffd640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039c0 0x7f94881f68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9487fff640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815fba0 0x7f948815deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9486ffd640 1 -- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815fba0 msgr2=0x7f948815deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9486ffd640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815fba0 0x7f948815deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9486ffd640 1 -- 172.21.15.161:0/1695263795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880b2fe0 con 0x7f948815f720 2023-11-24T08:04:52.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f9486ffd640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 0x7f948815ea80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f947c00e7a0 tx=0x7f947c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00ee50 con 0x7f948815f720 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00c940 con 0x7f948815f720 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00ccf0 con 0x7f948815f720 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.814+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94880b32c0 con 0x7f948815f720 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.815+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94880b2c40 con 0x7f948815f720 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.816+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9488067450 con 0x7f948815f720 2023-11-24T08:04:52.822 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.816+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f947c013470 con 0x7f948815f720 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.818+0000 7f946ffff640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f947406aff0 0x7f947406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.818+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f947c0894c0 con 0x7f948815f720 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.818+0000 7f94877fe640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f947406aff0 0x7f947406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:52.823 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.820+0000 7f94877fe640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f947406aff0 0x7f947406d4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9478034000 tx=0x7f9478009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:52.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:52.822+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f947c0546b0 con 0x7f948815f720 2023-11-24T08:04:53.015 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.013+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9488145080 con 0x7f948815f720 2023-11-24T08:04:53.821 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.818+0000 7f946ffff640 1 -- 172.21.15.161:0/1695263795 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7f947c057cd0 con 0x7f948815f720 2023-11-24T08:04:53.821 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' created 2023-11-24T08:04:53.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f947406aff0 msgr2=0x7f947406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f947406aff0 0x7f947406d4b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9478034000 tx=0x7f9478009030 comp rx=0 tx=0).stop 2023-11-24T08:04:53.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 msgr2=0x7f948815ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:53.824 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 0x7f948815ea80 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f947c00e7a0 tx=0x7f947c00ec60 comp rx=0 tx=0).stop 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 shutdown_connections 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f947406aff0 0x7f947406d4b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815fba0 0x7f948815deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f948815f720 0x7f948815ea80 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 --2- 172.21.15.161:0/1695263795 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039c0 0x7f94881f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 >> 172.21.15.161:0/1695263795 conn(0x7f948806a800 msgr2=0x7f94880b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 shutdown_connections 2023-11-24T08:04:53.825 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:53.822+0000 7f948ce6d640 1 -- 172.21.15.161:0/1695263795 wait complete. 2023-11-24T08:04:53.851 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T08:04:54.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.057+0000 7f4e7b378640 1 Processor -- start 2023-11-24T08:04:54.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.058+0000 7f4e7b378640 1 -- start start 2023-11-24T08:04:54.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.059+0000 7f4e7b378640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415dd40 0x7f4e7415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.059+0000 7f4e7b378640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e7415bed0 0x7f4e7415c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.059+0000 7f4e7b378640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7415e6e0 con 0x7f4e74157dc0 2023-11-24T08:04:54.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.059+0000 7f4e7b378640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e741581a0 con 0x7f4e7415bed0 2023-11-24T08:04:54.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.059+0000 7f4e7b378640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7415ba40 con 0x7f4e7415dd40 2023-11-24T08:04:54.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.060+0000 7f4e79114640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4e74157dc0 0x7f4e74070cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45466/0 (socket says 172.21.15.161:45466) 2023-11-24T08:04:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.060+0000 7f4e79114640 1 -- 172.21.15.161:0/3430577670 learned_addr learned my addr 172.21.15.161:0/3430577670 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.060+0000 7f4e79915640 1 --2- 172.21.15.161:0/3430577670 >> v2:172.21.15.175:3300/0 conn(0x7f4e7415bed0 0x7f4e7415c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.060+0000 7f4e78913640 1 --2- 172.21.15.161:0/3430577670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415dd40 0x7f4e7415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.060+0000 7f4e73fff640 1 -- 172.21.15.161:0/3430577670 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955611997 0 0) 0x7f4e7415e6e0 con 0x7f4e74157dc0 2023-11-24T08:04:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.060+0000 7f4e73fff640 1 -- 172.21.15.161:0/3430577670 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e5c003520 con 0x7f4e74157dc0 2023-11-24T08:04:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.061+0000 7f4e78913640 1 -- 172.21.15.161:0/3430577670 >> v2:172.21.15.175:3300/0 conn(0x7f4e7415bed0 msgr2=0x7f4e7415c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.061+0000 7f4e78913640 1 --2- 172.21.15.161:0/3430577670 >> v2:172.21.15.175:3300/0 conn(0x7f4e7415bed0 0x7f4e7415c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.061+0000 7f4e78913640 1 -- 172.21.15.161:0/3430577670 >> v1:172.21.15.161:6789/0 conn(0x7f4e74157dc0 legacy=0x7f4e74070cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.061+0000 7f4e73fff640 1 -- 172.21.15.161:0/3430577670 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664944074 0 0) 0x7f4e5c003520 con 0x7f4e74157dc0 2023-11-24T08:04:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.061+0000 7f4e78913640 1 -- 172.21.15.161:0/3430577670 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7415eb10 con 0x7f4e7415dd40 2023-11-24T08:04:54.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.062+0000 7f4e78913640 1 --2- 172.21.15.161:0/3430577670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415dd40 0x7f4e7415e1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097d0 tx=0x7f4e6802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1743797640dad92 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.062+0000 7f4e73fff640 1 -- 172.21.15.161:0/3430577670 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e640019f0 con 0x7f4e7415dd40 2023-11-24T08:04:54.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e73fff640 1 -- 172.21.15.161:0/3430577670 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6802e050 con 0x7f4e7415dd40 2023-11-24T08:04:54.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e73fff640 1 -- 172.21.15.161:0/3430577670 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68030710 con 0x7f4e7415dd40 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 -- 172.21.15.161:0/3430577670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415dd40 msgr2=0x7f4e7415e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 --2- 172.21.15.161:0/3430577670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415dd40 0x7f4e7415e1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4e680097d0 tx=0x7f4e6802b770 comp rx=0 tx=0).stop 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 -- 172.21.15.161:0/3430577670 shutdown_connections 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 --2- 172.21.15.161:0/3430577670 >> v2:172.21.15.175:3300/0 conn(0x7f4e7415bed0 0x7f4e7415c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 --2- 172.21.15.161:0/3430577670 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415dd40 0x7f4e7415e1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 -- 172.21.15.161:0/3430577670 >> 172.21.15.161:0/3430577670 conn(0x7f4e740b0be0 msgr2=0x7f4e740b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 -- 172.21.15.161:0/3430577670 shutdown_connections 2023-11-24T08:04:54.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.063+0000 7f4e7b378640 1 -- 172.21.15.161:0/3430577670 wait complete. 2023-11-24T08:04:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.065+0000 7f4e7b378640 1 Processor -- start 2023-11-24T08:04:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.065+0000 7f4e7b378640 1 -- start start 2023-11-24T08:04:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.066+0000 7f4e7b378640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e74157dc0 0x7f4e74144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.066+0000 7f4e7b378640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415bed0 0x7f4e740ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.066+0000 7f4e7b378640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 0x7f4e740aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.066+0000 7f4e7b378640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74144ea0 con 0x7f4e7415dd40 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.066+0000 7f4e7b378640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74154550 con 0x7f4e74157dc0 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.066+0000 7f4e7b378640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740cdae0 con 0x7f4e7415bed0 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 0x7f4e740aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 0x7f4e740aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34792/0 (socket says 172.21.15.161:34792) 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 -- 172.21.15.161:0/2312758004 learned_addr learned my addr 172.21.15.161:0/2312758004 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e78913640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415bed0 0x7f4e740ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79114640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e74157dc0 0x7f4e74144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 -- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415bed0 msgr2=0x7f4e740ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415bed0 0x7f4e740ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 -- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e74157dc0 msgr2=0x7f4e74144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e74157dc0 0x7f4e74144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 -- 172.21.15.161:0/2312758004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68009400 con 0x7f4e7415dd40 2023-11-24T08:04:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.067+0000 7f4e79915640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 0x7f4e740aefd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00e930 tx=0x7f4e6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.068+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c009690 con 0x7f4e7415dd40 2023-11-24T08:04:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.068+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c00c980 con 0x7f4e7415dd40 2023-11-24T08:04:54.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.068+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c00cd30 con 0x7f4e7415dd40 2023-11-24T08:04:54.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.068+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e740cddc0 con 0x7f4e7415dd40 2023-11-24T08:04:54.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.068+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e740cd790 con 0x7f4e7415dd40 2023-11-24T08:04:54.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.069+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e740ce2e0 con 0x7f4e7415dd40 2023-11-24T08:04:54.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.070+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4e6c013470 con 0x7f4e7415dd40 2023-11-24T08:04:54.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.071+0000 7f4e71ffb640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e6006aff0 0x7f4e6006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:54.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.071+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f4e6c089e90 con 0x7f4e7415dd40 2023-11-24T08:04:54.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.072+0000 7f4e79114640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e6006aff0 0x7f4e6006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:54.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.073+0000 7f4e79114640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e6006aff0 0x7f4e6006d4b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4e64001560 tx=0x7f4e64009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:54.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.075+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e6c0550d0 con 0x7f4e7415dd40 2023-11-24T08:04:54.269 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.267+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4e740ce2e0 con 0x7f4e7415dd40 2023-11-24T08:04:54.826 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.824+0000 7f4e71ffb640 1 -- 172.21.15.161:0/2312758004 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4e740ce2e0 con 0x7f4e7415dd40 2023-11-24T08:04:54.826 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' created 2023-11-24T08:04:54.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.827+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e6006aff0 msgr2=0x7f4e6006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.829 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.827+0000 7f4e7b378640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e6006aff0 0x7f4e6006d4b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4e64001560 tx=0x7f4e64009040 comp rx=0 tx=0).stop 2023-11-24T08:04:54.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.827+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 msgr2=0x7f4e740aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:54.830 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.827+0000 7f4e7b378640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 0x7f4e740aefd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00e930 tx=0x7f4e6c00edf0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 shutdown_connections 2023-11-24T08:04:54.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4e6006aff0 0x7f4e6006d4b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4e7415dd40 0x7f4e740aefd0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e7415bed0 0x7f4e740ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 --2- 172.21.15.161:0/2312758004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e74157dc0 0x7f4e74144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:54.832 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 >> 172.21.15.161:0/2312758004 conn(0x7f4e740b0be0 msgr2=0x7f4e74158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:54.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 shutdown_connections 2023-11-24T08:04:54.833 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:54.829+0000 7f4e7b378640 1 -- 172.21.15.161:0/2312758004 wait complete. 2023-11-24T08:04:54.864 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T08:04:55.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.048+0000 7fb3dad67640 1 Processor -- start 2023-11-24T08:04:55.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.048+0000 7fb3dad67640 1 -- start start 2023-11-24T08:04:55.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.050+0000 7fb3dad67640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3d4070a30 0x7fb3d415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.050+0000 7fb3dad67640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d415f4e0 con 0x7fb3d40adf20 2023-11-24T08:04:55.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.050+0000 7fb3dad67640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d4070ea0 con 0x7fb3d40ccb50 2023-11-24T08:04:55.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.050+0000 7fb3dad67640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d415c450 con 0x7fb3d4070a30 2023-11-24T08:04:55.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.050+0000 7fb3d9d65640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb3d40adf20 0x7fb3d40cc440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45480/0 (socket says 172.21.15.161:45480) 2023-11-24T08:04:55.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.050+0000 7fb3d9d65640 1 -- 172.21.15.161:0/3585425072 learned_addr learned my addr 172.21.15.161:0/3585425072 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3da566640 1 --2- 172.21.15.161:0/3585425072 >> v2:172.21.15.175:3300/0 conn(0x7fb3d4070a30 0x7fb3d415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409809368 0 0) 0x7fb3d415f4e0 con 0x7fb3d40adf20 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3c0003520 con 0x7fb3d40adf20 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3493255869 0 0) 0x7fb3c0003520 con 0x7fb3d40adf20 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 >> v2:172.21.15.175:3300/0 conn(0x7fb3d4070a30 msgr2=0x7fb3d415bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 --2- 172.21.15.161:0/3585425072 >> v2:172.21.15.175:3300/0 conn(0x7fb3d4070a30 0x7fb3d415bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 >> v1:172.21.15.175:6789/0 conn(0x7fb3d40ccb50 legacy=0x7fb3d4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4071130 con 0x7fb3d40adf20 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fb3d0001670 con 0x7fb3d40adf20 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 >> v1:172.21.15.161:6789/0 conn(0x7fb3d40adf20 legacy=0x7fb3d40cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.051+0000 7fb3d8d63640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3c00039c0 0x7fb3c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d8d63640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3c00047c0 0x7fb3c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d8d63640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00051d0 0x7fb3c000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415c450 con 0x7fb3c00047c0 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c000c120 con 0x7fb3c00051d0 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c000c2e0 con 0x7fb3c00039c0 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9564640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3c00047c0 0x7fb3c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9d65640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3c00039c0 0x7fb3c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3da566640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00051d0 0x7fb3c000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9564640 1 -- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3c00039c0 msgr2=0x7fb3c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9564640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3c00039c0 0x7fb3c0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9564640 1 -- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00051d0 msgr2=0x7fb3c000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:55.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9564640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00051d0 0x7fb3c000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9564640 1 -- 172.21.15.161:0/3585425072 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0003520 con 0x7fb3c00047c0 2023-11-24T08:04:55.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3d9d65640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3c00039c0 0x7fb3c0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:55.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3da566640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00051d0 0x7fb3c000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:55.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.052+0000 7fb3da566640 1 -- 172.21.15.161:0/3585425072 reap_dead start 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.054+0000 7fb3d9564640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3c00047c0 0x7fb3c0004c40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40ccf90 tx=0x7fb3c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f2d8fa3f3c4398 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.054+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40052d0 con 0x7fb3c00047c0 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.054+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c402e050 con 0x7fb3c00047c0 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.054+0000 7fb3d8d63640 1 -- 172.21.15.161:0/3585425072 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4003830 con 0x7fb3c00047c0 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 -- 172.21.15.161:0/3585425072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3c00047c0 msgr2=0x7fb3c0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3c00047c0 0x7fb3c0004c40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40ccf90 tx=0x7fb3c00057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 -- 172.21.15.161:0/3585425072 shutdown_connections 2023-11-24T08:04:55.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 --2- 172.21.15.161:0/3585425072 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3c00047c0 0x7fb3c0004c40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 -- 172.21.15.161:0/3585425072 >> 172.21.15.161:0/3585425072 conn(0x7fb3d406a7d0 msgr2=0x7fb3d406abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 -- 172.21.15.161:0/3585425072 shutdown_connections 2023-11-24T08:04:55.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.055+0000 7fb3dad67640 1 -- 172.21.15.161:0/3585425072 wait complete. 2023-11-24T08:04:55.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.057+0000 7fb3dad67640 1 Processor -- start 2023-11-24T08:04:55.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.057+0000 7fb3dad67640 1 -- start start 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3dad67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00047c0 0x7fb3d413bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3dad67640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 0x7fb3d413c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3dad67640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4137e00 0x7fb3d40b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3dad67640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d413e730 con 0x7fb3d415a5c0 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3dad67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d413f500 con 0x7fb3c00047c0 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3dad67640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d415a2e0 con 0x7fb3d4137e00 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3d9564640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 0x7fb3d413c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3d9564640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 0x7fb3d413c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34802/0 (socket says 172.21.15.161:34802) 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3d9564640 1 -- 172.21.15.161:0/1385180760 learned_addr learned my addr 172.21.15.161:0/1385180760 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:55.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.058+0000 7fb3d9d65640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00047c0 0x7fb3d413bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3da566640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4137e00 0x7fb3d40b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9564640 1 -- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4137e00 msgr2=0x7fb3d40b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9564640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4137e00 0x7fb3d40b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9564640 1 -- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00047c0 msgr2=0x7fb3d413bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9564640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00047c0 0x7fb3d413bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9564640 1 -- 172.21.15.161:0/1385180760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d413ded0 con 0x7fb3d415a5c0 2023-11-24T08:04:55.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9d65640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00047c0 0x7fb3d413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3d9564640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 0x7fb3d413c400 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb3c402bb10 tx=0x7fb3c4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40076c0 con 0x7fb3d415a5c0 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c4007a30 con 0x7fb3d415a5c0 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.059+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4006be0 con 0x7fb3d415a5c0 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.060+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d413f220 con 0x7fb3d415a5c0 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.060+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d413e450 con 0x7fb3d415a5c0 2023-11-24T08:04:55.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.061+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4067450 con 0x7fb3d415a5c0 2023-11-24T08:04:55.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.062+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb3c4006d40 con 0x7fb3d415a5c0 2023-11-24T08:04:55.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.063+0000 7fb3ca7fc640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb3b806aff0 0x7fb3b806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:55.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.063+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb3c40ab320 con 0x7fb3d415a5c0 2023-11-24T08:04:55.065 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.063+0000 7fb3d9d65640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb3b806aff0 0x7fb3b806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:55.066 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.064+0000 7fb3d9d65640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb3b806aff0 0x7fb3b806d4b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3d413ed00 tx=0x7fb3d0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:55.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.069+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3c4076130 con 0x7fb3d415a5c0 2023-11-24T08:04:55.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.286+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb3d40b2880 con 0x7fb3d415a5c0 2023-11-24T08:04:55.856 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.854+0000 7fb3ca7fc640 1 -- 172.21.15.161:0/1385180760 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v32) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb3c4079750 con 0x7fb3d415a5c0 2023-11-24T08:04:55.857 INFO:teuthology.orchestra.run.smithi161.stderr:new fs with metadata pool 8 and data pool 9 2023-11-24T08:04:55.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb3b806aff0 msgr2=0x7fb3b806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb3b806aff0 0x7fb3b806d4b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb3d413ed00 tx=0x7fb3d0009040 comp rx=0 tx=0).stop 2023-11-24T08:04:55.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 msgr2=0x7fb3d413c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:55.860 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 0x7fb3d413c400 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb3c402bb10 tx=0x7fb3c4001120 comp rx=0 tx=0).stop 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 shutdown_connections 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb3b806aff0 0x7fb3b806d4b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4137e00 0x7fb3d40b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3d415a5c0 0x7fb3d413c400 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 --2- 172.21.15.161:0/1385180760 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3c00047c0 0x7fb3d413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 >> 172.21.15.161:0/1385180760 conn(0x7fb3d406a7d0 msgr2=0x7fb3d40cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.858+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 shutdown_connections 2023-11-24T08:04:55.861 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:55.859+0000 7fb3dad67640 1 -- 172.21.15.161:0/1385180760 wait complete. 2023-11-24T08:04:55.886 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:56.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.067+0000 7f4fad116640 1 Processor -- start 2023-11-24T08:04:56.069 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.067+0000 7f4fad116640 1 -- start start 2023-11-24T08:04:56.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4fad116640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4fad116640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4fa813e360 0x7f4fa80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.071 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4fad116640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa806c470 con 0x7f4fa815f9c0 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4fad116640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa806c750 con 0x7f4fa813e360 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4fad116640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa806ca30 con 0x7f4fa813df80 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4f9ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4fa813e360 0x7f4fa80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4f9ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4fa813e360 0x7f4fa80cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34804/0 (socket says 172.21.15.161:34804) 2023-11-24T08:04:56.072 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.069+0000 7f4f9ffff640 1 -- 172.21.15.161:0/208857249 learned_addr learned my addr 172.21.15.161:0/208857249 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.070+0000 7f4fa6d9d640 1 --2- 172.21.15.161:0/208857249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.070+0000 7f4f9ffff640 1 -- 172.21.15.161:0/208857249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 msgr2=0x7f4fa815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.070+0000 7f4f9ffff640 1 --2- 172.21.15.161:0/208857249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.070+0000 7f4f9ffff640 1 -- 172.21.15.161:0/208857249 >> v1:172.21.15.175:6789/0 conn(0x7f4fa815f9c0 legacy=0x7f4fa81408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.073 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.070+0000 7f4f9ffff640 1 -- 172.21.15.161:0/208857249 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa806cd10 con 0x7f4fa813e360 2023-11-24T08:04:56.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.071+0000 7f4f9ffff640 1 --2- 172.21.15.161:0/208857249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa813e360 0x7f4fa80cf290 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7dab76c114e708 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fa659c640 1 -- 172.21.15.161:0/208857249 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90031640 con 0x7f4fa813e360 2023-11-24T08:04:56.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fa659c640 1 -- 172.21.15.161:0/208857249 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900317a0 con 0x7f4fa813e360 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fa659c640 1 -- 172.21.15.161:0/208857249 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90031b30 con 0x7f4fa813e360 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 -- 172.21.15.161:0/208857249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa813e360 msgr2=0x7f4fa80cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 --2- 172.21.15.161:0/208857249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa813e360 0x7f4fa80cf290 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4f90009870 tx=0x7f4f9002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 -- 172.21.15.161:0/208857249 shutdown_connections 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 --2- 172.21.15.161:0/208857249 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa813e360 0x7f4fa80cf290 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 --2- 172.21.15.161:0/208857249 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 -- 172.21.15.161:0/208857249 >> 172.21.15.161:0/208857249 conn(0x7f4fa806a800 msgr2=0x7f4fa806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.072+0000 7f4fad116640 1 -- 172.21.15.161:0/208857249 shutdown_connections 2023-11-24T08:04:56.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.073+0000 7f4fad116640 1 -- 172.21.15.161:0/208857249 wait complete. 2023-11-24T08:04:56.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.074+0000 7f4fad116640 1 Processor -- start 2023-11-24T08:04:56.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.074+0000 7f4fad116640 1 -- start start 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.075+0000 7f4fad116640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa813d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.075+0000 7f4fad116640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa813e360 0x7f4fa81f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.075+0000 7f4fad116640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 0x7f4fa813cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.075+0000 7f4fad116640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa813d470 con 0x7f4fa815f9c0 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.075+0000 7f4fad116640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81f5510 con 0x7f4fa813e360 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.075+0000 7f4fad116640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa81f4c70 con 0x7f4fa813df80 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 0x7f4fa813cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 0x7f4fa813cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34818/0 (socket says 172.21.15.161:34818) 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 -- 172.21.15.161:0/65430196 learned_addr learned my addr 172.21.15.161:0/65430196 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:56.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4f9ffff640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa813e360 0x7f4fa81f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa6d9d640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa813d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 -- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 msgr2=0x7f4fa813d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa813d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 -- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa813e360 msgr2=0x7f4fa81f45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa813e360 0x7f4fa81f45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 -- 172.21.15.161:0/65430196 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900094d0 con 0x7f4fa815f9c0 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4f9ffff640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa813e360 0x7f4fa81f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.076+0000 7f4fa759e640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 0x7f4fa813cf30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c780 tx=0x7f4fa000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.077+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa0004b60 con 0x7f4fa815f9c0 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.077+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa000ce90 con 0x7f4fa815f9c0 2023-11-24T08:04:56.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.077+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa000a850 con 0x7f4fa815f9c0 2023-11-24T08:04:56.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.077+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa81f4f50 con 0x7f4fa815f9c0 2023-11-24T08:04:56.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.077+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa814e1b0 con 0x7f4fa815f9c0 2023-11-24T08:04:56.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.078+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa814e3a0 con 0x7f4fa815f9c0 2023-11-24T08:04:56.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.079+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4fa000a9b0 con 0x7f4fa815f9c0 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.080+0000 7f4f9f7fe640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4f8806aff0 0x7f4f8806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.080+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4fa0089a60 con 0x7f4fa815f9c0 2023-11-24T08:04:56.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.081+0000 7f4fa6d9d640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4f8806aff0 0x7f4f8806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.082+0000 7f4fa6d9d640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4f8806aff0 0x7f4f8806d4b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006fd0 tx=0x7f4f98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.085+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4fa0054920 con 0x7f4fa815f9c0 2023-11-24T08:04:56.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.275+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fa80675d0 con 0x7f4fa815f9c0 2023-11-24T08:04:56.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.278+0000 7f4f9f7fe640 1 -- 172.21.15.161:0/65430196 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16602 (secure 0 0 0) 0x7f4fa0057f40 con 0x7f4fa815f9c0 2023-11-24T08:04:56.281 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:56.281 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":59,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:55.288834+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:56.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4f8806aff0 msgr2=0x7f4f8806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4f8806aff0 0x7f4f8806d4b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f98006fd0 tx=0x7f4f98008040 comp rx=0 tx=0).stop 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 msgr2=0x7f4fa813cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 0x7f4fa813cf30 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c780 tx=0x7f4fa000cc40 comp rx=0 tx=0).stop 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 shutdown_connections 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4f8806aff0 0x7f4f8806d4b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4fa815f9c0 0x7f4fa813cf30 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4fa813e360 0x7f4fa81f45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 --2- 172.21.15.161:0/65430196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4fa813df80 0x7f4fa813d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 >> 172.21.15.161:0/65430196 conn(0x7f4fa806a800 msgr2=0x7f4fa80cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.281+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 shutdown_connections 2023-11-24T08:04:56.284 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.282+0000 7f4fad116640 1 -- 172.21.15.161:0/65430196 wait complete. 2023-11-24T08:04:56.302 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:56.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.502+0000 7fc3e3a94640 1 Processor -- start 2023-11-24T08:04:56.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.502+0000 7fc3e3a94640 1 -- start start 2023-11-24T08:04:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e3a94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 0x7fc3dc166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e3a94640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc15c5f0 con 0x7fc3dc13e360 2023-11-24T08:04:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e3a94640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3dc06c470 con 0x7fc3dc13df80 2023-11-24T08:04:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e3a94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc06c750 con 0x7fc3dc0cf9a0 2023-11-24T08:04:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e102f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc3dc13e360 0x7fc3dc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45484/0 (socket says 172.21.15.161:45484) 2023-11-24T08:04:56.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e102f640 1 -- 172.21.15.161:0/2782729823 learned_addr learned my addr 172.21.15.161:0/2782729823 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:56.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e2031640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 0x7fc3dc166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.504+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 177962555 0 0) 0x7fc3dc15c5f0 con 0x7fc3dc13e360 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3c8003520 con 0x7fc3dc13e360 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129317433 0 0) 0x7fc3c8003520 con 0x7fc3dc13e360 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 msgr2=0x7fc3dc166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 0x7fc3dc166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 >> v1:172.21.15.175:6789/0 conn(0x7fc3dc13df80 legacy=0x7fc3dc15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc06ca30 con 0x7fc3dc13e360 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc3cc001670 con 0x7fc3dc13e360 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 >> v1:172.21.15.161:6789/0 conn(0x7fc3dc13e360 legacy=0x7fc3dc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 0x7fc3c80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3c8004d00 0x7fc3c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.509 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc06c750 con 0x7fc3c8003f20 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c800ba60 con 0x7fc3c8004d00 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c800bc20 con 0x7fc3dc0cf9a0 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.505+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e1830640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 0x7fc3c80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e2031640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3c8004d00 0x7fc3c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e102f640 1 -- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 msgr2=0x7fc3c80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc0cf9a0 0x7fc3c80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e102f640 1 -- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3c8004d00 msgr2=0x7fc3c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3c8004d00 0x7fc3c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e102f640 1 -- 172.21.15.161:0/2782729823 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c8003520 con 0x7fc3c8003f20 2023-11-24T08:04:56.510 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.506+0000 7fc3e2031640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3c8004d00 0x7fc3c8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:56.511 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.507+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3c80047c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c210 tx=0x7fc3c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29370b8994d15fd2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.507+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc005ad0 con 0x7fc3c8003f20 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.507+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc005c30 con 0x7fc3c8003f20 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.507+0000 7fc3e082e640 1 -- 172.21.15.161:0/2782729823 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc02cad0 con 0x7fc3c8003f20 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2782729823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 msgr2=0x7fc3c80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2782729823 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3c80047c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc00c210 tx=0x7fc3c80057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e2031640 1 -- 172.21.15.161:0/2782729823 reap_dead start 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2782729823 shutdown_connections 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2782729823 >> 172.21.15.161:0/2782729823 conn(0x7fc3dc06a800 msgr2=0x7fc3dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2782729823 shutdown_connections 2023-11-24T08:04:56.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.508+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2782729823 wait complete. 2023-11-24T08:04:56.513 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.510+0000 7fc3e3a94640 1 Processor -- start 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.510+0000 7fc3e3a94640 1 -- start start 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.511+0000 7fc3e3a94640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3dc13b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.511+0000 7fc3e3a94640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc151d80 0x7fc3dc15dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.511+0000 7fc3e3a94640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15e4e0 0x7fc3dc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.511+0000 7fc3e3a94640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc0b0840 con 0x7fc3c8003f20 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.511+0000 7fc3e3a94640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc15e960 con 0x7fc3dc151d80 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.511+0000 7fc3e3a94640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3dc1ee510 con 0x7fc3dc15e4e0 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3dc13b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3dc13b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34836/0 (socket says 172.21.15.161:34836) 2023-11-24T08:04:56.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 -- 172.21.15.161:0/2626000596 learned_addr learned my addr 172.21.15.161:0/2626000596 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:56.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e2031640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15e4e0 0x7fc3dc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc151d80 0x7fc3dc15dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 -- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15e4e0 msgr2=0x7fc3dc155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15e4e0 0x7fc3dc155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 -- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc151d80 msgr2=0x7fc3dc15dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc151d80 0x7fc3dc15dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 -- 172.21.15.161:0/2626000596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3dc1ee740 con 0x7fc3c8003f20 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.512+0000 7fc3e1830640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3dc13b580 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800e580 tx=0x7fc3d800ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.513+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d80052e0 con 0x7fc3c8003f20 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.513+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8005440 con 0x7fc3c8003f20 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.513+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8003810 con 0x7fc3c8003f20 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.513+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3dc1eea20 con 0x7fc3c8003f20 2023-11-24T08:04:56.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.513+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3dc1eefe0 con 0x7fc3c8003f20 2023-11-24T08:04:56.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.514+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3dc0675d0 con 0x7fc3c8003f20 2023-11-24T08:04:56.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.515+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc3d8003970 con 0x7fc3c8003f20 2023-11-24T08:04:56.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.516+0000 7fc3d27fc640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc3c006aff0 0x7fc3c006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.516+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3d80896a0 con 0x7fc3c8003f20 2023-11-24T08:04:56.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.517+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc3c006aff0 0x7fc3c006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.518+0000 7fc3e102f640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc3c006aff0 0x7fc3c006d4b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc034000 tx=0x7fc3cc009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.520+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc3d80544e0 con 0x7fc3c8003f20 2023-11-24T08:04:56.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.716+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3dc06df00 con 0x7fc3c8003f20 2023-11-24T08:04:56.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.718+0000 7fc3d27fc640 1 -- 172.21.15.161:0/2626000596 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fc3d8057b00 con 0x7fc3c8003f20 2023-11-24T08:04:56.720 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:56.720 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:56.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc3c006aff0 msgr2=0x7fc3c006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc3c006aff0 0x7fc3c006d4b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc034000 tx=0x7fc3cc009030 comp rx=0 tx=0).stop 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 msgr2=0x7fc3dc13b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3dc13b580 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800e580 tx=0x7fc3d800ea40 comp rx=0 tx=0).stop 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 shutdown_connections 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc3c006aff0 0x7fc3c006d4b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc3dc15e4e0 0x7fc3dc155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc3dc151d80 0x7fc3dc15dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 --2- 172.21.15.161:0/2626000596 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3c8003f20 0x7fc3dc13b580 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 >> 172.21.15.161:0/2626000596 conn(0x7fc3dc06a800 msgr2=0x7fc3dc0b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.720+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 shutdown_connections 2023-11-24T08:04:56.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.721+0000 7fc3e3a94640 1 -- 172.21.15.161:0/2626000596 wait complete. 2023-11-24T08:04:56.741 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T08:04:56.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.959+0000 7fa27d231640 1 Processor -- start 2023-11-24T08:04:56.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.959+0000 7fa27d231640 1 -- start start 2023-11-24T08:04:56.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27d231640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2780b3ae0 0x7fa27815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27d231640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa278070c40 con 0x7fa2780cf290 2023-11-24T08:04:56.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27d231640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27806c470 con 0x7fa2780ae5a0 2023-11-24T08:04:56.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27d231640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa278071450 con 0x7fa2780b3ae0 2023-11-24T08:04:56.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27759e640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa2780cf290 0x7fa2780b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45488/0 (socket says 172.21.15.161:45488) 2023-11-24T08:04:56.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27759e640 1 -- 172.21.15.161:0/3183760176 learned_addr learned my addr 172.21.15.161:0/3183760176 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa27659c640 1 --2- 172.21.15.161:0/3183760176 >> v2:172.21.15.175:3300/0 conn(0x7fa2780b3ae0 0x7fa27815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 16022300 0 0) 0x7fa278070c40 con 0x7fa2780cf290 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.961+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa260003520 con 0x7fa2780cf290 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837227371 0 0) 0x7fa260003520 con 0x7fa2780cf290 2023-11-24T08:04:56.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 >> v2:172.21.15.175:3300/0 conn(0x7fa2780b3ae0 msgr2=0x7fa27815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 --2- 172.21.15.161:0/3183760176 >> v2:172.21.15.175:3300/0 conn(0x7fa2780b3ae0 0x7fa27815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 >> v1:172.21.15.175:6789/0 conn(0x7fa2780ae5a0 legacy=0x7fa27806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27806c750 con 0x7fa2780cf290 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fa2700019f0 con 0x7fa2780cf290 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 >> v1:172.21.15.161:6789/0 conn(0x7fa2780cf290 legacy=0x7fa2780b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260003970 0x7fa260003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2600047c0 0x7fa260004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa260005180 0x7fa26000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa278071450 con 0x7fa260005180 2023-11-24T08:04:56.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26000c030 con 0x7fa260003970 2023-11-24T08:04:56.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26000c1f0 con 0x7fa2600047c0 2023-11-24T08:04:56.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.962+0000 7fa27759e640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa260005180 0x7fa26000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa276d9d640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260003970 0x7fa260003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa27659c640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2600047c0 0x7fa260004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa27759e640 1 -- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2600047c0 msgr2=0x7fa260004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa27759e640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2600047c0 0x7fa260004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa27759e640 1 -- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260003970 msgr2=0x7fa260003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa27759e640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260003970 0x7fa260003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.963+0000 7fa27759e640 1 -- 172.21.15.161:0/3183760176 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa260003520 con 0x7fa260005180 2023-11-24T08:04:56.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.964+0000 7fa27759e640 1 -- 172.21.15.161:0/3183760176 reap_dead start 2023-11-24T08:04:56.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.964+0000 7fa27759e640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa260005180 0x7fa26000b980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa27000a800 tx=0x7fa2600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4b043fdadf6dfb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.964+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270034630 con 0x7fa260005180 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.964+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27002f070 con 0x7fa260005180 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.964+0000 7fa275d9b640 1 -- 172.21.15.161:0/3183760176 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270034a10 con 0x7fa260005180 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 -- 172.21.15.161:0/3183760176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa260005180 msgr2=0x7fa26000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa260005180 0x7fa26000b980 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa27000a800 tx=0x7fa2600057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 -- 172.21.15.161:0/3183760176 shutdown_connections 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 --2- 172.21.15.161:0/3183760176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa260005180 0x7fa26000b980 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 -- 172.21.15.161:0/3183760176 >> 172.21.15.161:0/3183760176 conn(0x7fa27806a800 msgr2=0x7fa27806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 -- 172.21.15.161:0/3183760176 shutdown_connections 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.965+0000 7fa27d231640 1 -- 172.21.15.161:0/3183760176 wait complete. 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.967+0000 7fa27d231640 1 Processor -- start 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.967+0000 7fa27d231640 1 -- start start 2023-11-24T08:04:56.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27d231640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260005180 0x7fa2780cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27d231640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780cb8a0 0x7fa278157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27d231640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 0x7fa27806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27d231640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806d480 con 0x7fa27806cae0 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27d231640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781f6fa0 con 0x7fa260005180 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27d231640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781f66b0 con 0x7fa2780cb8a0 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 0x7fa27806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 0x7fa27806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34856/0 (socket says 172.21.15.161:34856) 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27759e640 1 -- 172.21.15.161:0/174792336 learned_addr learned my addr 172.21.15.161:0/174792336 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa276d9d640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260005180 0x7fa2780cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.968+0000 7fa27659c640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780cb8a0 0x7fa278157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.974 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27759e640 1 -- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780cb8a0 msgr2=0x7fa278157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27759e640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780cb8a0 0x7fa278157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27759e640 1 -- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260005180 msgr2=0x7fa2780cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27759e640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260005180 0x7fa2780cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27759e640 1 -- 172.21.15.161:0/174792336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2781f6950 con 0x7fa27806cae0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa276d9d640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260005180 0x7fa2780cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27759e640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 0x7fa27806cf40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa270002230 tx=0x7fa27806c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270042070 con 0x7fa27806cae0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27002ce90 con 0x7fa27806cae0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270004b60 con 0x7fa27806cae0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2781f6c30 con 0x7fa27806cae0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.969+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780cc770 con 0x7fa27806cae0 2023-11-24T08:04:56.975 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.970+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780cb0d0 con 0x7fa27806cae0 2023-11-24T08:04:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.971+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa270031030 con 0x7fa27806cae0 2023-11-24T08:04:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.972+0000 7fa25f7fe640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa26406aff0 0x7fa26406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.972+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2700aaef0 con 0x7fa27806cae0 2023-11-24T08:04:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.973+0000 7fa276d9d640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa26406aff0 0x7fa26406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:56.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.974+0000 7fa276d9d640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa26406aff0 0x7fa26406d4b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa27815aa30 tx=0x7fa268009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:56.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:56.977+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa270075c00 con 0x7fa27806cae0 2023-11-24T08:04:57.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.205+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa2780cb0d0 con 0x7fa27806cae0 2023-11-24T08:04:57.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.879+0000 7fa25f7fe640 1 -- 172.21.15.161:0/174792336 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa270001a10 con 0x7fa27806cae0 2023-11-24T08:04:57.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.882+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa26406aff0 msgr2=0x7fa26406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.882+0000 7fa27d231640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa26406aff0 0x7fa26406d4b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa27815aa30 tx=0x7fa268009040 comp rx=0 tx=0).stop 2023-11-24T08:04:57.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.882+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 msgr2=0x7fa27806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.882+0000 7fa27d231640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 0x7fa27806cf40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa270002230 tx=0x7fa27806c6c0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 shutdown_connections 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa26406aff0 0x7fa26406d4b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa27806cae0 0x7fa27806cf40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2780cb8a0 0x7fa278157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 --2- 172.21.15.161:0/174792336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa260005180 0x7fa2780cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:57.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 >> 172.21.15.161:0/174792336 conn(0x7fa27806a800 msgr2=0x7fa2780706d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:57.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 shutdown_connections 2023-11-24T08:04:57.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:57.883+0000 7fa27d231640 1 -- 172.21.15.161:0/174792336 wait complete. 2023-11-24T08:04:57.906 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T08:04:57.906 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T08:04:58.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.119+0000 7fd653490640 1 Processor -- start 2023-11-24T08:04:58.122 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.120+0000 7fd653490640 1 -- start start 2023-11-24T08:04:58.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.121+0000 7fd653490640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd64c160f80 0x7fd64c161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.121+0000 7fd653490640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd64c0ce8f0 0x7fd64c0ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.121+0000 7fd653490640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64c1618a0 con 0x7fd64c0cfbe0 2023-11-24T08:04:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.121+0000 7fd653490640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0d0de0 con 0x7fd64c160f80 2023-11-24T08:04:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.121+0000 7fd653490640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0d10c0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd64c160f80 0x7fd64c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd64c160f80 0x7fd64c161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34860/0 (socket says 172.21.15.161:34860) 2023-11-24T08:04:58.124 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 -- 172.21.15.161:0/612510641 learned_addr learned my addr 172.21.15.161:0/612510641 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:58.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd650a2b640 1 --2- 172.21.15.161:0/612510641 >> v2:172.21.15.175:3300/0 conn(0x7fd64c0ce8f0 0x7fd64c0ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 -- 172.21.15.161:0/612510641 >> v2:172.21.15.175:3300/0 conn(0x7fd64c0ce8f0 msgr2=0x7fd64c0ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 --2- 172.21.15.161:0/612510641 >> v2:172.21.15.175:3300/0 conn(0x7fd64c0ce8f0 0x7fd64c0ced50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 -- 172.21.15.161:0/612510641 >> v1:172.21.15.175:6789/0 conn(0x7fd64c0cfbe0 legacy=0x7fd64c0d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:58.125 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.122+0000 7fd65122c640 1 -- 172.21.15.161:0/612510641 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0d13a0 con 0x7fd64c160f80 2023-11-24T08:04:58.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.123+0000 7fd65122c640 1 --2- 172.21.15.161:0/612510641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c160f80 0x7fd64c161360 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0b5d10 tx=0x7fd64802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598bf3007fcee218 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd63ffff640 1 -- 172.21.15.161:0/612510641 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648031870 con 0x7fd64c160f80 2023-11-24T08:04:58.126 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd63ffff640 1 -- 172.21.15.161:0/612510641 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6480319d0 con 0x7fd64c160f80 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd63ffff640 1 -- 172.21.15.161:0/612510641 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648031d60 con 0x7fd64c160f80 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 -- 172.21.15.161:0/612510641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c160f80 msgr2=0x7fd64c161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 --2- 172.21.15.161:0/612510641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c160f80 0x7fd64c161360 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd64c0b5d10 tx=0x7fd64802b910 comp rx=0 tx=0).stop 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 -- 172.21.15.161:0/612510641 shutdown_connections 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 --2- 172.21.15.161:0/612510641 >> v2:172.21.15.175:3300/0 conn(0x7fd64c0ce8f0 0x7fd64c0ced50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 --2- 172.21.15.161:0/612510641 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c160f80 0x7fd64c161360 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 -- 172.21.15.161:0/612510641 >> 172.21.15.161:0/612510641 conn(0x7fd64c09c550 msgr2=0x7fd64c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 -- 172.21.15.161:0/612510641 shutdown_connections 2023-11-24T08:04:58.127 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.124+0000 7fd653490640 1 -- 172.21.15.161:0/612510641 wait complete. 2023-11-24T08:04:58.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.126+0000 7fd653490640 1 Processor -- start 2023-11-24T08:04:58.128 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.126+0000 7fd653490640 1 -- start start 2023-11-24T08:04:58.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd653490640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 0x7fd64c0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd653490640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd64c0cfbe0 0x7fd64c0b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd653490640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd64c160f80 0x7fd64c0b8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd653490640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0c91d0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd653490640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0c85c0 con 0x7fd64c160f80 2023-11-24T08:04:58.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd653490640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c0c88a0 con 0x7fd64c0cfbe0 2023-11-24T08:04:58.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd65122c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 0x7fd64c0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd65122c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 0x7fd64c0c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34874/0 (socket says 172.21.15.161:34874) 2023-11-24T08:04:58.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.127+0000 7fd65122c640 1 -- 172.21.15.161:0/1358037798 learned_addr learned my addr 172.21.15.161:0/1358037798 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:58.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd651a2d640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd64c160f80 0x7fd64c0b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd65122c640 1 -- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd64c0cfbe0 msgr2=0x7fd64c0b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd65122c640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd64c0cfbe0 0x7fd64c0b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd65122c640 1 -- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd64c160f80 msgr2=0x7fd64c0b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd65122c640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd64c160f80 0x7fd64c0b8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd65122c640 1 -- 172.21.15.161:0/1358037798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480094d0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd65122c640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 0x7fd64c0c7d90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd648000c00 tx=0x7fd6480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.128+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64803ad30 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.129+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64803ae90 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.129+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648044630 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.129+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c0c8b80 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.129+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c0c82d0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.130+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c0675d0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.131+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd64804d450 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.131+0000 7fd63dffb640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd63006aff0 0x7fd63006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:58.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.132+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd64802d040 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.132+0000 7fd650a2b640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd63006aff0 0x7fd63006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:58.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.133+0000 7fd650a2b640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd63006aff0 0x7fd63006d4b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd640006fd0 tx=0x7fd640008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:58.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.136+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd648076dd0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.363+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd64c161680 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.892+0000 7fd63dffb640 1 -- 172.21.15.161:0/1358037798 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd64807a3f0 con 0x7fd64c0ce8f0 2023-11-24T08:04:58.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.895+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd63006aff0 msgr2=0x7fd63006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.895+0000 7fd653490640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd63006aff0 0x7fd63006d4b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd640006fd0 tx=0x7fd640008040 comp rx=0 tx=0).stop 2023-11-24T08:04:58.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.895+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 msgr2=0x7fd64c0c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:58.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.895+0000 7fd653490640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 0x7fd64c0c7d90 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fd648000c00 tx=0x7fd6480046c0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 shutdown_connections 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd63006aff0 0x7fd63006d4b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd64c160f80 0x7fd64c0b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd64c0cfbe0 0x7fd64c0b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 --2- 172.21.15.161:0/1358037798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd64c0ce8f0 0x7fd64c0c7d90 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 >> 172.21.15.161:0/1358037798 conn(0x7fd64c09c550 msgr2=0x7fd64c15b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 shutdown_connections 2023-11-24T08:04:58.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:58.896+0000 7fd653490640 1 -- 172.21.15.161:0/1358037798 wait complete. 2023-11-24T08:04:58.917 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T08:04:58.917 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:04:59.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.127+0000 7f932e3c9640 1 Processor -- start 2023-11-24T08:04:59.129 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.127+0000 7f932e3c9640 1 -- start start 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.128+0000 7f932e3c9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f932813df80 0x7f932815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f932e3c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93280cf9a0 0x7f93280cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f932e3c9640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932806c470 con 0x7f932813e360 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f932e3c9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932806c750 con 0x7f932813df80 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f932e3c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932806ca30 con 0x7f93280cf9a0 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f932813df80 0x7f932815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f932813df80 0x7f932815bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34888/0 (socket says 172.21.15.161:34888) 2023-11-24T08:04:59.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 -- 172.21.15.161:0/449200113 learned_addr learned my addr 172.21.15.161:0/449200113 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:59.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 -- 172.21.15.161:0/449200113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93280cf9a0 msgr2=0x7f93280cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:59.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 --2- 172.21.15.161:0/449200113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93280cf9a0 0x7f93280cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 -- 172.21.15.161:0/449200113 >> v1:172.21.15.175:6789/0 conn(0x7f932813e360 legacy=0x7f93280cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:59.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.129+0000 7f9327fff640 1 -- 172.21.15.161:0/449200113 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932806cd10 con 0x7f932813df80 2023-11-24T08:04:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.130+0000 7f9327fff640 1 --2- 172.21.15.161:0/449200113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813df80 0x7f932815bee0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9310009870 tx=0x7f931002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d833db34882ca8ef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.131+0000 7f9326ffd640 1 -- 172.21.15.161:0/449200113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310031640 con 0x7f932813df80 2023-11-24T08:04:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.131+0000 7f9326ffd640 1 -- 172.21.15.161:0/449200113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93100317a0 con 0x7f932813df80 2023-11-24T08:04:59.133 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.131+0000 7f9326ffd640 1 -- 172.21.15.161:0/449200113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9310031b30 con 0x7f932813df80 2023-11-24T08:04:59.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.131+0000 7f932e3c9640 1 -- 172.21.15.161:0/449200113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813df80 msgr2=0x7f932815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.131+0000 7f932e3c9640 1 --2- 172.21.15.161:0/449200113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813df80 0x7f932815bee0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9310009870 tx=0x7f931002b8f0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.132+0000 7f932e3c9640 1 -- 172.21.15.161:0/449200113 shutdown_connections 2023-11-24T08:04:59.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.132+0000 7f932e3c9640 1 --2- 172.21.15.161:0/449200113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93280cf9a0 0x7f93280cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.132+0000 7f932e3c9640 1 --2- 172.21.15.161:0/449200113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813df80 0x7f932815bee0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.132+0000 7f932e3c9640 1 -- 172.21.15.161:0/449200113 >> 172.21.15.161:0/449200113 conn(0x7f932806a800 msgr2=0x7f932806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:59.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.132+0000 7f932e3c9640 1 -- 172.21.15.161:0/449200113 shutdown_connections 2023-11-24T08:04:59.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.132+0000 7f932e3c9640 1 -- 172.21.15.161:0/449200113 wait complete. 2023-11-24T08:04:59.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.134+0000 7f932e3c9640 1 Processor -- start 2023-11-24T08:04:59.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.134+0000 7f932e3c9640 1 -- start start 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.135+0000 7f932e3c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93280cf9a0 0x7f9328071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.135+0000 7f932e3c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f932813df80 0x7f9328070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932e3c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 0x7f9328153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932e3c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932815ab80 con 0x7f932813e360 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932e3c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93280722f0 con 0x7f93280cf9a0 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932e3c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9328071a50 con 0x7f932813df80 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 0x7f9328153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 0x7f9328153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34898/0 (socket says 172.21.15.161:34898) 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 -- 172.21.15.161:0/768380418 learned_addr learned my addr 172.21.15.161:0/768380418 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f93277fe640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f932813df80 0x7f9328070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f9327fff640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93280cf9a0 0x7f9328071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 -- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f932813df80 msgr2=0x7f9328070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f932813df80 0x7f9328070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 -- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93280cf9a0 msgr2=0x7f9328071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93280cf9a0 0x7f9328071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f932c966640 1 -- 172.21.15.161:0/768380418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93100094d0 con 0x7f932813e360 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f93277fe640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f932813df80 0x7f9328070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.136+0000 7f9327fff640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93280cf9a0 0x7f9328071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:59.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.137+0000 7f932c966640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 0x7f9328153300 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f932000b440 tx=0x7f932000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.137+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320011830 con 0x7f932813e360 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.137+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320011990 con 0x7f932813e360 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.137+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320011d40 con 0x7f932813e360 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.137+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9328071d30 con 0x7f932813e360 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.137+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93280aca00 con 0x7f932813e360 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.138+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93280675d0 con 0x7f932813e360 2023-11-24T08:04:59.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.139+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f932001a400 con 0x7f932813e360 2023-11-24T08:04:59.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.140+0000 7f9324ff9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f930806aff0 0x7f930806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.140+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9320089a50 con 0x7f932813e360 2023-11-24T08:04:59.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.141+0000 7f9327fff640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f930806aff0 0x7f930806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.142+0000 7f9327fff640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f930806aff0 0x7f930806d4b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9310036000 tx=0x7f931003c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:59.146 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.144+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9320054870 con 0x7f932813e360 2023-11-24T08:04:59.372 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.370+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f932806df00 con 0x7f932813e360 2023-11-24T08:04:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.371+0000 7f9324ff9640 1 -- 172.21.15.161:0/768380418 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f9320015020 con 0x7f932813e360 2023-11-24T08:04:59.374 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:59.374 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:55.289954+0000","modified":"2023-11-24T08:04:58.365831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4018716146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4018716146},{"type":"v1","addr":"172.21.15.161:6835","nonce":4018716146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:04:59.374 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 36 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f930806aff0 msgr2=0x7f930806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f930806aff0 0x7f930806d4b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9310036000 tx=0x7f931003c040 comp rx=0 tx=0).stop 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 msgr2=0x7f9328153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 0x7f9328153300 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f932000b440 tx=0x7f932000b840 comp rx=0 tx=0).stop 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 shutdown_connections 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f930806aff0 0x7f930806d4b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f932813e360 0x7f9328153300 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f932813df80 0x7f9328070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 --2- 172.21.15.161:0/768380418 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93280cf9a0 0x7f9328071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.377 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.374+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 >> 172.21.15.161:0/768380418 conn(0x7f932806a800 msgr2=0x7f9328153bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.375+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 shutdown_connections 2023-11-24T08:04:59.378 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.375+0000 7f932e3c9640 1 -- 172.21.15.161:0/768380418 wait complete. 2023-11-24T08:04:59.395 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:04:59.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.595+0000 7f184de1c640 1 Processor -- start 2023-11-24T08:04:59.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.595+0000 7f184de1c640 1 -- start start 2023-11-24T08:04:59.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.597+0000 7f184de1c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 0x7f184815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.597+0000 7f184de1c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1848070c40 con 0x7f18480ae5a0 2023-11-24T08:04:59.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.597+0000 7f184de1c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184806c470 con 0x7f18480cf290 2023-11-24T08:04:59.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.597+0000 7f184de1c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1848071450 con 0x7f18480b3ae0 2023-11-24T08:04:59.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.597+0000 7f18477fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f18480ae5a0 0x7f184806cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:45492/0 (socket says 172.21.15.161:45492) 2023-11-24T08:04:59.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.597+0000 7f18477fe640 1 -- 172.21.15.161:0/285684818 learned_addr learned my addr 172.21.15.161:0/285684818 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:04:59.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f183ffff640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 0x7f184815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897290766 0 0) 0x7f1848070c40 con 0x7f18480ae5a0 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1834003520 con 0x7f18480ae5a0 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519699849 0 0) 0x7f1834003520 con 0x7f18480ae5a0 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 msgr2=0x7f184815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 0x7f184815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 >> v1:172.21.15.175:6789/0 conn(0x7f18480cf290 legacy=0x7f18480b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184806c750 con 0x7f18480ae5a0 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.598+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f1838001670 con 0x7f18480ae5a0 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 >> v1:172.21.15.161:6789/0 conn(0x7f18480ae5a0 legacy=0x7f184806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 0x7f18340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834003f20 0x7f18340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834004d00 0x7f1834005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848071450 con 0x7f1834004d00 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183400baf0 con 0x7f1834003f20 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183400bcb0 con 0x7f18480b3ae0 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1847fff640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834004d00 0x7f1834005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f183ffff640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834003f20 0x7f18340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f18477fe640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 0x7f18340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1847fff640 1 -- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 msgr2=0x7f18340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1847fff640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18480b3ae0 0x7f18340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1847fff640 1 -- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834003f20 msgr2=0x7f18340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1847fff640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834003f20 0x7f18340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.599+0000 7f1847fff640 1 -- 172.21.15.161:0/285684818 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1834003520 con 0x7f1834004d00 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.601+0000 7f1847fff640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834004d00 0x7f1834005180 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1840001e50 tx=0x7f18340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecbf046e2e87cd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.601+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840003b70 con 0x7f1834004d00 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.601+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840003cd0 con 0x7f1834004d00 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.601+0000 7f1846ffd640 1 -- 172.21.15.161:0/285684818 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840005310 con 0x7f1834004d00 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f184de1c640 1 -- 172.21.15.161:0/285684818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834004d00 msgr2=0x7f1834005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f184de1c640 1 --2- 172.21.15.161:0/285684818 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1834004d00 0x7f1834005180 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1840001e50 tx=0x7f18340057f0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f1847fff640 1 -- 172.21.15.161:0/285684818 reap_dead start 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f184de1c640 1 -- 172.21.15.161:0/285684818 shutdown_connections 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f184de1c640 1 -- 172.21.15.161:0/285684818 >> 172.21.15.161:0/285684818 conn(0x7f184806a800 msgr2=0x7f184806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:59.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f184de1c640 1 -- 172.21.15.161:0/285684818 shutdown_connections 2023-11-24T08:04:59.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.602+0000 7f184de1c640 1 -- 172.21.15.161:0/285684818 wait complete. 2023-11-24T08:04:59.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.604+0000 7f184de1c640 1 Processor -- start 2023-11-24T08:04:59.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.604+0000 7f184de1c640 1 -- start start 2023-11-24T08:04:59.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f184de1c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834004d00 0x7f18480ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f184de1c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 0x7f18481611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f184de1c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18481578e0 0x7f18481556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f184de1c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481585a0 con 0x7f18480cb8a0 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f184de1c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480ce740 con 0x7f1834004d00 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f184de1c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480cbe20 con 0x7f18481578e0 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f183ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 0x7f18481611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f183ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 0x7f18481611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34916/0 (socket says 172.21.15.161:34916) 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.605+0000 7f183ffff640 1 -- 172.21.15.161:0/2567347004 learned_addr learned my addr 172.21.15.161:0/2567347004 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f18477fe640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834004d00 0x7f18480ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f1847fff640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18481578e0 0x7f18481556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f183ffff640 1 -- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18481578e0 msgr2=0x7f18481556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f183ffff640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18481578e0 0x7f18481556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f183ffff640 1 -- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834004d00 msgr2=0x7f18480ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f183ffff640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834004d00 0x7f18480ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f183ffff640 1 -- 172.21.15.161:0/2567347004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848156b20 con 0x7f18480cb8a0 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f1847fff640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18481578e0 0x7f18481556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f183ffff640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 0x7f18481611a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1830011600 tx=0x7f1830011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000f920 con 0x7f18480cb8a0 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000fa80 con 0x7f18480cb8a0 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1848156e00 con 0x7f18480cb8a0 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000fdf0 con 0x7f18480cb8a0 2023-11-24T08:04:59.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.606+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18481573c0 con 0x7f18480cb8a0 2023-11-24T08:04:59.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.608+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18480675d0 con 0x7f18480cb8a0 2023-11-24T08:04:59.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.608+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1830015460 con 0x7f18480cb8a0 2023-11-24T08:04:59.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.609+0000 7f1844ff9640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f182806aff0 0x7f182806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:04:59.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.609+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1830089eb0 con 0x7f18480cb8a0 2023-11-24T08:04:59.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.610+0000 7f18477fe640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f182806aff0 0x7f182806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:04:59.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.611+0000 7f18477fe640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f182806aff0 0x7f182806d4b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1838001eb0 tx=0x7f1838001190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:04:59.616 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.614+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1830054c40 con 0x7f18480cb8a0 2023-11-24T08:04:59.808 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.806+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f184806ae20 con 0x7f18480cb8a0 2023-11-24T08:04:59.811 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.809+0000 7f1844ff9640 1 -- 172.21.15.161:0/2567347004 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f1830022090 con 0x7f18480cb8a0 2023-11-24T08:04:59.812 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:04:59.812 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f182806aff0 msgr2=0x7f182806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f182806aff0 0x7f182806d4b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f1838001eb0 tx=0x7f1838001190 comp rx=0 tx=0).stop 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 msgr2=0x7f18481611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 0x7f18481611a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1830011600 tx=0x7f1830011ac0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 shutdown_connections 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f182806aff0 0x7f182806d4b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18481578e0 0x7f18481556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f18480cb8a0 0x7f18481611a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 --2- 172.21.15.161:0/2567347004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1834004d00 0x7f18480ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:04:59.816 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 >> 172.21.15.161:0/2567347004 conn(0x7f184806a800 msgr2=0x7f18480b1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:04:59.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 shutdown_connections 2023-11-24T08:04:59.817 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:04:59.812+0000 7f184de1c640 1 -- 172.21.15.161:0/2567347004 wait complete. 2023-11-24T08:04:59.832 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T08:04:59.832 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:00.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.044+0000 7f2c1e13e640 1 Processor -- start 2023-11-24T08:05:00.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.045+0000 7f2c1e13e640 1 -- start start 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.046+0000 7f2c1e13e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2c1813e360 0x7f2c180cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.046+0000 7f2c1e13e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c180cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.046+0000 7f2c1e13e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1815c5f0 con 0x7f2c1813df80 2023-11-24T08:05:00.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.046+0000 7f2c1e13e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1806c470 con 0x7f2c1813e360 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.046+0000 7f2c1e13e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1806c750 con 0x7f2c1815f9c0 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.047+0000 7f2c17fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c180cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.047+0000 7f2c17fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c180cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:58554/0 (socket says 172.21.15.161:58554) 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.047+0000 7f2c17fff640 1 -- 172.21.15.161:0/1304111515 learned_addr learned my addr 172.21.15.161:0/1304111515 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:00.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.047+0000 7f2c0ffff640 1 --2- 172.21.15.161:0/1304111515 >> v2:172.21.15.175:3300/0 conn(0x7f2c1813e360 0x7f2c180cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.048+0000 7f2c17fff640 1 -- 172.21.15.161:0/1304111515 >> v2:172.21.15.175:3300/0 conn(0x7f2c1813e360 msgr2=0x7f2c180cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.048+0000 7f2c17fff640 1 --2- 172.21.15.161:0/1304111515 >> v2:172.21.15.175:3300/0 conn(0x7f2c1813e360 0x7f2c180cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.048+0000 7f2c17fff640 1 -- 172.21.15.161:0/1304111515 >> v1:172.21.15.175:6789/0 conn(0x7f2c1813df80 legacy=0x7f2c1815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.048+0000 7f2c17fff640 1 -- 172.21.15.161:0/1304111515 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1806ca30 con 0x7f2c1815f9c0 2023-11-24T08:05:00.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.049+0000 7f2c17fff640 1 --2- 172.21.15.161:0/1304111515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c180cf7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c1806ded0 tx=0x7f2c1002be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0e22860bc34c76 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c16ffd640 1 -- 172.21.15.161:0/1304111515 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1002ca30 con 0x7f2c1815f9c0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c16ffd640 1 -- 172.21.15.161:0/1304111515 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1002cb90 con 0x7f2c1815f9c0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c16ffd640 1 -- 172.21.15.161:0/1304111515 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100343f0 con 0x7f2c1815f9c0 2023-11-24T08:05:00.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c1e13e640 1 -- 172.21.15.161:0/1304111515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 msgr2=0x7f2c180cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/1304111515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c180cf7d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2c1806ded0 tx=0x7f2c1002be90 comp rx=0 tx=0).stop 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c1e13e640 1 -- 172.21.15.161:0/1304111515 shutdown_connections 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/1304111515 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c180cf7d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/1304111515 >> v2:172.21.15.175:3300/0 conn(0x7f2c1813e360 0x7f2c180cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.050+0000 7f2c1e13e640 1 -- 172.21.15.161:0/1304111515 >> 172.21.15.161:0/1304111515 conn(0x7f2c1806a800 msgr2=0x7f2c1806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.051+0000 7f2c1e13e640 1 -- 172.21.15.161:0/1304111515 shutdown_connections 2023-11-24T08:05:00.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.051+0000 7f2c1e13e640 1 -- 172.21.15.161:0/1304111515 wait complete. 2023-11-24T08:05:00.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.053+0000 7f2c1e13e640 1 Processor -- start 2023-11-24T08:05:00.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.053+0000 7f2c1e13e640 1 -- start start 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c1e13e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 0x7f2c1813acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c1e13e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c1813e360 0x7f2c181568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c1e13e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c1813ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c1e13e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18143120 con 0x7f2c1813df80 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c1e13e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c18143400 con 0x7f2c1813e360 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c1e13e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c181436e0 con 0x7f2c1815f9c0 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c177fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 0x7f2c1813acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c177fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 0x7f2c1813acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34932/0 (socket says 172.21.15.161:34932) 2023-11-24T08:05:00.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.054+0000 7f2c177fe640 1 -- 172.21.15.161:0/4061650506 learned_addr learned my addr 172.21.15.161:0/4061650506 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:00.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c17fff640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c1813ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.061 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c0ffff640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c1813e360 0x7f2c181568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c177fe640 1 -- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 msgr2=0x7f2c1813ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c177fe640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c1813ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c177fe640 1 -- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c1813e360 msgr2=0x7f2c181568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c177fe640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c1813e360 0x7f2c181568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c177fe640 1 -- 172.21.15.161:0/4061650506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c10009b30 con 0x7f2c1813df80 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.055+0000 7f2c177fe640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 0x7f2c1813acf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800b3f0 tx=0x7f2c0800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.056+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08011830 con 0x7f2c1813df80 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.056+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08011990 con 0x7f2c1813df80 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.056+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c181439c0 con 0x7f2c1813df80 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.056+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08011d40 con 0x7f2c1813df80 2023-11-24T08:05:00.062 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.056+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c18143f80 con 0x7f2c1813df80 2023-11-24T08:05:00.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.057+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c181441a0 con 0x7f2c1813df80 2023-11-24T08:05:00.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.058+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2c0801a400 con 0x7f2c1813df80 2023-11-24T08:05:00.063 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.059+0000 7f2c14ff9640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2bf806aff0 0x7f2bf806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.060+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c08089820 con 0x7f2c1813df80 2023-11-24T08:05:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.060+0000 7f2c0ffff640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2bf806aff0 0x7f2bf806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.064 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.061+0000 7f2c0ffff640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2bf806aff0 0x7f2bf806d4b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c18153860 tx=0x7f2c00008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.067 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.066+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c080545c0 con 0x7f2c1813df80 2023-11-24T08:05:00.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.249+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c1806cff0 con 0x7f2bf806aff0 2023-11-24T08:05:00.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.276+0000 7f2c14ff9640 1 -- 172.21.15.161:0/4061650506 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277493 (secure 0 0 0) 0x7f2c00011970 con 0x7f2bf806aff0 2023-11-24T08:05:00.282 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:00.284 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2bf806aff0 msgr2=0x7f2bf806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2bf806aff0 0x7f2bf806d4b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c18153860 tx=0x7f2c00008040 comp rx=0 tx=0).stop 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 msgr2=0x7f2c1813acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 0x7f2c1813acf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800b3f0 tx=0x7f2c0800b8b0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 shutdown_connections 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2bf806aff0 0x7f2bf806d4b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c1815f9c0 0x7f2c1813ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c1813e360 0x7f2c181568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 --2- 172.21.15.161:0/4061650506 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2c1813df80 0x7f2c1813acf0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.281+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 >> 172.21.15.161:0/4061650506 conn(0x7f2c1806a800 msgr2=0x7f2c1815e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.282+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 shutdown_connections 2023-11-24T08:05:00.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.282+0000 7f2c1e13e640 1 -- 172.21.15.161:0/4061650506 wait complete. 2023-11-24T08:05:00.304 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2023-11-24T08:04:58.627759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592562,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":239344,"kb_used_data":6520,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735376,"statfs":{"total":773094113280,"available":772849025024,"internally_reserved":0,"allocated":6676480,"data_stored":3432525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":238276147},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.803327"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583469+0000","last_change":"2023-11-24T08:04:55.610886+0000","last_active":"2023-11-24T08:04:56.583469+0000","last_peered":"2023-11-24T08:04:56.583469+0000","last_clean":"2023-11-24T08:04:56.583469+0000","last_became_active":"2023-11-24T08:04:55.610639+0000","last_became_peered":"2023-11-24T08:04:55.610639+0000","last_unstale":"2023-11-24T08:04:56.583469+0000","last_undegraded":"2023-11-24T08:04:56.583469+0000","last_fullsized":"2023-11-24T08:04:56.583469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:05.704769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584797+0000","last_change":"2023-11-24T08:04:55.612475+0000","last_active":"2023-11-24T08:04:56.584797+0000","last_peered":"2023-11-24T08:04:56.584797+0000","last_clean":"2023-11-24T08:04:56.584797+0000","last_became_active":"2023-11-24T08:04:55.610381+0000","last_became_peered":"2023-11-24T08:04:55.610381+0000","last_unstale":"2023-11-24T08:04:56.584797+0000","last_undegraded":"2023-11-24T08:04:56.584797+0000","last_fullsized":"2023-11-24T08:04:56.584797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:36.186963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586471+0000","last_change":"2023-11-24T08:04:55.605399+0000","last_active":"2023-11-24T08:04:56.586471+0000","last_peered":"2023-11-24T08:04:56.586471+0000","last_clean":"2023-11-24T08:04:56.586471+0000","last_became_active":"2023-11-24T08:04:55.604883+0000","last_became_peered":"2023-11-24T08:04:55.604883+0000","last_unstale":"2023-11-24T08:04:56.586471+0000","last_undegraded":"2023-11-24T08:04:56.586471+0000","last_fullsized":"2023-11-24T08:04:56.586471+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:45.620989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883924+0000","last_change":"2023-11-24T08:04:55.607025+0000","last_active":"2023-11-24T08:04:56.883924+0000","last_peered":"2023-11-24T08:04:56.883924+0000","last_clean":"2023-11-24T08:04:56.883924+0000","last_became_active":"2023-11-24T08:04:55.606771+0000","last_became_peered":"2023-11-24T08:04:55.606771+0000","last_unstale":"2023-11-24T08:04:56.883924+0000","last_undegraded":"2023-11-24T08:04:56.883924+0000","last_fullsized":"2023-11-24T08:04:56.883924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:00:42.164832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883771+0000","last_change":"2023-11-24T08:04:55.605695+0000","last_active":"2023-11-24T08:04:56.883771+0000","last_peered":"2023-11-24T08:04:56.883771+0000","last_clean":"2023-11-24T08:04:56.883771+0000","last_became_active":"2023-11-24T08:04:55.605430+0000","last_became_peered":"2023-11-24T08:04:55.605430+0000","last_unstale":"2023-11-24T08:04:56.883771+0000","last_undegraded":"2023-11-24T08:04:56.883771+0000","last_fullsized":"2023-11-24T08:04:56.883771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:14.223235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585958+0000","last_change":"2023-11-24T08:04:55.604992+0000","last_active":"2023-11-24T08:04:56.585958+0000","last_peered":"2023-11-24T08:04:56.585958+0000","last_clean":"2023-11-24T08:04:56.585958+0000","last_became_active":"2023-11-24T08:04:55.604630+0000","last_became_peered":"2023-11-24T08:04:55.604630+0000","last_unstale":"2023-11-24T08:04:56.585958+0000","last_undegraded":"2023-11-24T08:04:56.585958+0000","last_fullsized":"2023-11-24T08:04:56.585958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:40.234525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585152+0000","last_change":"2023-11-24T08:04:55.607663+0000","last_active":"2023-11-24T08:04:56.585152+0000","last_peered":"2023-11-24T08:04:56.585152+0000","last_clean":"2023-11-24T08:04:56.585152+0000","last_became_active":"2023-11-24T08:04:55.607311+0000","last_became_peered":"2023-11-24T08:04:55.607311+0000","last_unstale":"2023-11-24T08:04:56.585152+0000","last_undegraded":"2023-11-24T08:04:56.585152+0000","last_fullsized":"2023-11-24T08:04:56.585152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:58.159037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.582956+0000","last_change":"2023-11-24T08:04:55.612858+0000","last_active":"2023-11-24T08:04:56.582956+0000","last_peered":"2023-11-24T08:04:56.582956+0000","last_clean":"2023-11-24T08:04:56.582956+0000","last_became_active":"2023-11-24T08:04:55.612556+0000","last_became_peered":"2023-11-24T08:04:55.612556+0000","last_unstale":"2023-11-24T08:04:56.582956+0000","last_undegraded":"2023-11-24T08:04:56.582956+0000","last_fullsized":"2023-11-24T08:04:56.582956+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:14:15.091268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584554+0000","last_change":"2023-11-24T08:04:55.613452+0000","last_active":"2023-11-24T08:04:56.584554+0000","last_peered":"2023-11-24T08:04:56.584554+0000","last_clean":"2023-11-24T08:04:56.584554+0000","last_became_active":"2023-11-24T08:04:55.612038+0000","last_became_peered":"2023-11-24T08:04:55.612038+0000","last_unstale":"2023-11-24T08:04:56.584554+0000","last_undegraded":"2023-11-24T08:04:56.584554+0000","last_fullsized":"2023-11-24T08:04:56.584554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:23.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583106+0000","last_change":"2023-11-24T08:04:55.606026+0000","last_active":"2023-11-24T08:04:56.583106+0000","last_peered":"2023-11-24T08:04:56.583106+0000","last_clean":"2023-11-24T08:04:56.583106+0000","last_became_active":"2023-11-24T08:04:55.605556+0000","last_became_peered":"2023-11-24T08:04:55.605556+0000","last_unstale":"2023-11-24T08:04:56.583106+0000","last_undegraded":"2023-11-24T08:04:56.583106+0000","last_fullsized":"2023-11-24T08:04:56.583106+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:16.746875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584334+0000","last_change":"2023-11-24T08:04:55.608017+0000","last_active":"2023-11-24T08:04:56.584334+0000","last_peered":"2023-11-24T08:04:56.584334+0000","last_clean":"2023-11-24T08:04:56.584334+0000","last_became_active":"2023-11-24T08:04:55.606725+0000","last_became_peered":"2023-11-24T08:04:55.606725+0000","last_unstale":"2023-11-24T08:04:56.584334+0000","last_undegraded":"2023-11-24T08:04:56.584334+0000","last_fullsized":"2023-11-24T08:04:56.584334+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:43.358049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584364+0000","last_change":"2023-11-24T08:04:54.856744+0000","last_active":"2023-11-24T08:04:56.584364+0000","last_peered":"2023-11-24T08:04:56.584364+0000","last_clean":"2023-11-24T08:04:56.584364+0000","last_became_active":"2023-11-24T08:04:54.856292+0000","last_became_peered":"2023-11-24T08:04:54.856292+0000","last_unstale":"2023-11-24T08:04:56.584364+0000","last_undegraded":"2023-11-24T08:04:56.584364+0000","last_fullsized":"2023-11-24T08:04:56.584364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:32.343608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883941+0000","last_change":"2023-11-24T08:04:55.604169+0000","last_active":"2023-11-24T08:04:56.883941+0000","last_peered":"2023-11-24T08:04:56.883941+0000","last_clean":"2023-11-24T08:04:56.883941+0000","last_became_active":"2023-11-24T08:04:55.601308+0000","last_became_peered":"2023-11-24T08:04:55.601308+0000","last_unstale":"2023-11-24T08:04:56.883941+0000","last_undegraded":"2023-11-24T08:04:56.883941+0000","last_fullsized":"2023-11-24T08:04:56.883941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:43.790910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584098+0000","last_change":"2023-11-24T08:04:55.607567+0000","last_active":"2023-11-24T08:04:56.584098+0000","last_peered":"2023-11-24T08:04:56.584098+0000","last_clean":"2023-11-24T08:04:56.584098+0000","last_became_active":"2023-11-24T08:04:55.607187+0000","last_became_peered":"2023-11-24T08:04:55.607187+0000","last_unstale":"2023-11-24T08:04:56.584098+0000","last_undegraded":"2023-11-24T08:04:56.584098+0000","last_fullsized":"2023-11-24T08:04:56.584098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:19.652831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584702+0000","last_change":"2023-11-24T08:04:54.853026+0000","last_active":"2023-11-24T08:04:56.584702+0000","last_peered":"2023-11-24T08:04:56.584702+0000","last_clean":"2023-11-24T08:04:56.584702+0000","last_became_active":"2023-11-24T08:04:54.852541+0000","last_became_peered":"2023-11-24T08:04:54.852541+0000","last_unstale":"2023-11-24T08:04:56.584702+0000","last_undegraded":"2023-11-24T08:04:56.584702+0000","last_fullsized":"2023-11-24T08:04:56.584702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:14:39.584083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584276+0000","last_change":"2023-11-24T08:04:55.615561+0000","last_active":"2023-11-24T08:04:56.584276+0000","last_peered":"2023-11-24T08:04:56.584276+0000","last_clean":"2023-11-24T08:04:56.584276+0000","last_became_active":"2023-11-24T08:04:55.615213+0000","last_became_peered":"2023-11-24T08:04:55.615213+0000","last_unstale":"2023-11-24T08:04:56.584276+0000","last_undegraded":"2023-11-24T08:04:56.584276+0000","last_fullsized":"2023-11-24T08:04:56.584276+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:07.985266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586521+0000","last_change":"2023-11-24T08:04:54.859295+0000","last_active":"2023-11-24T08:04:56.586521+0000","last_peered":"2023-11-24T08:04:56.586521+0000","last_clean":"2023-11-24T08:04:56.586521+0000","last_became_active":"2023-11-24T08:04:54.858003+0000","last_became_peered":"2023-11-24T08:04:54.858003+0000","last_unstale":"2023-11-24T08:04:56.586521+0000","last_undegraded":"2023-11-24T08:04:56.586521+0000","last_fullsized":"2023-11-24T08:04:56.586521+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:13.207476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583716+0000","last_change":"2023-11-24T08:04:54.854968+0000","last_active":"2023-11-24T08:04:56.583716+0000","last_peered":"2023-11-24T08:04:56.583716+0000","last_clean":"2023-11-24T08:04:56.583716+0000","last_became_active":"2023-11-24T08:04:54.854702+0000","last_became_peered":"2023-11-24T08:04:54.854702+0000","last_unstale":"2023-11-24T08:04:56.583716+0000","last_undegraded":"2023-11-24T08:04:56.583716+0000","last_fullsized":"2023-11-24T08:04:56.583716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:13:11.415048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584456+0000","last_change":"2023-11-24T08:04:54.849649+0000","last_active":"2023-11-24T08:04:56.584456+0000","last_peered":"2023-11-24T08:04:56.584456+0000","last_clean":"2023-11-24T08:04:56.584456+0000","last_became_active":"2023-11-24T08:04:54.849385+0000","last_became_peered":"2023-11-24T08:04:54.849385+0000","last_unstale":"2023-11-24T08:04:56.584456+0000","last_undegraded":"2023-11-24T08:04:56.584456+0000","last_fullsized":"2023-11-24T08:04:56.584456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:07.751883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586736+0000","last_change":"2023-11-24T08:04:55.607316+0000","last_active":"2023-11-24T08:04:56.586736+0000","last_peered":"2023-11-24T08:04:56.586736+0000","last_clean":"2023-11-24T08:04:56.586736+0000","last_became_active":"2023-11-24T08:04:55.606668+0000","last_became_peered":"2023-11-24T08:04:55.606668+0000","last_unstale":"2023-11-24T08:04:56.586736+0000","last_undegraded":"2023-11-24T08:04:56.586736+0000","last_fullsized":"2023-11-24T08:04:56.586736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:28.650507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883621+0000","last_change":"2023-11-24T08:04:55.605575+0000","last_active":"2023-11-24T08:04:56.883621+0000","last_peered":"2023-11-24T08:04:56.883621+0000","last_clean":"2023-11-24T08:04:56.883621+0000","last_became_active":"2023-11-24T08:04:55.605310+0000","last_became_peered":"2023-11-24T08:04:55.605310+0000","last_unstale":"2023-11-24T08:04:56.883621+0000","last_undegraded":"2023-11-24T08:04:56.883621+0000","last_fullsized":"2023-11-24T08:04:56.883621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:58.072786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586442+0000","last_change":"2023-11-24T08:04:54.859552+0000","last_active":"2023-11-24T08:04:56.586442+0000","last_peered":"2023-11-24T08:04:56.586442+0000","last_clean":"2023-11-24T08:04:56.586442+0000","last_became_active":"2023-11-24T08:04:54.857574+0000","last_became_peered":"2023-11-24T08:04:54.857574+0000","last_unstale":"2023-11-24T08:04:56.586442+0000","last_undegraded":"2023-11-24T08:04:56.586442+0000","last_fullsized":"2023-11-24T08:04:56.586442+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:00:41.149073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584090+0000","last_change":"2023-11-24T08:04:55.601170+0000","last_active":"2023-11-24T08:04:56.584090+0000","last_peered":"2023-11-24T08:04:56.584090+0000","last_clean":"2023-11-24T08:04:56.584090+0000","last_became_active":"2023-11-24T08:04:55.600899+0000","last_became_peered":"2023-11-24T08:04:55.600899+0000","last_unstale":"2023-11-24T08:04:56.584090+0000","last_undegraded":"2023-11-24T08:04:56.584090+0000","last_fullsized":"2023-11-24T08:04:56.584090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:43.790910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584234+0000","last_change":"2023-11-24T08:04:54.859465+0000","last_active":"2023-11-24T08:04:56.584234+0000","last_peered":"2023-11-24T08:04:56.584234+0000","last_clean":"2023-11-24T08:04:56.584234+0000","last_became_active":"2023-11-24T08:04:54.858849+0000","last_became_peered":"2023-11-24T08:04:54.858849+0000","last_unstale":"2023-11-24T08:04:56.584234+0000","last_undegraded":"2023-11-24T08:04:56.584234+0000","last_fullsized":"2023-11-24T08:04:56.584234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:12.786072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583955+0000","last_change":"2023-11-24T08:04:54.861376+0000","last_active":"2023-11-24T08:04:56.583955+0000","last_peered":"2023-11-24T08:04:56.583955+0000","last_clean":"2023-11-24T08:04:56.583955+0000","last_became_active":"2023-11-24T08:04:54.860420+0000","last_became_peered":"2023-11-24T08:04:54.860420+0000","last_unstale":"2023-11-24T08:04:56.583955+0000","last_undegraded":"2023-11-24T08:04:56.583955+0000","last_fullsized":"2023-11-24T08:04:56.583955+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:30.531126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583508+0000","last_change":"2023-11-24T08:04:55.612930+0000","last_active":"2023-11-24T08:04:56.583508+0000","last_peered":"2023-11-24T08:04:56.583508+0000","last_clean":"2023-11-24T08:04:56.583508+0000","last_became_active":"2023-11-24T08:04:55.612664+0000","last_became_peered":"2023-11-24T08:04:55.612664+0000","last_unstale":"2023-11-24T08:04:56.583508+0000","last_undegraded":"2023-11-24T08:04:56.583508+0000","last_fullsized":"2023-11-24T08:04:56.583508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:04.732080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883560+0000","last_change":"2023-11-24T08:04:54.851596+0000","last_active":"2023-11-24T08:04:56.883560+0000","last_peered":"2023-11-24T08:04:56.883560+0000","last_clean":"2023-11-24T08:04:56.883560+0000","last_became_active":"2023-11-24T08:04:54.851315+0000","last_became_peered":"2023-11-24T08:04:54.851315+0000","last_unstale":"2023-11-24T08:04:56.883560+0000","last_undegraded":"2023-11-24T08:04:56.883560+0000","last_fullsized":"2023-11-24T08:04:56.883560+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:47.864227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583420+0000","last_change":"2023-11-24T08:04:55.608339+0000","last_active":"2023-11-24T08:04:56.583420+0000","last_peered":"2023-11-24T08:04:56.583420+0000","last_clean":"2023-11-24T08:04:56.583420+0000","last_became_active":"2023-11-24T08:04:55.608024+0000","last_became_peered":"2023-11-24T08:04:55.608024+0000","last_unstale":"2023-11-24T08:04:56.583420+0000","last_undegraded":"2023-11-24T08:04:56.583420+0000","last_fullsized":"2023-11-24T08:04:56.583420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:27.419732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884097+0000","last_change":"2023-11-24T08:04:54.845716+0000","last_active":"2023-11-24T08:04:56.884097+0000","last_peered":"2023-11-24T08:04:56.884097+0000","last_clean":"2023-11-24T08:04:56.884097+0000","last_became_active":"2023-11-24T08:04:54.845439+0000","last_became_peered":"2023-11-24T08:04:54.845439+0000","last_unstale":"2023-11-24T08:04:56.884097+0000","last_undegraded":"2023-11-24T08:04:56.884097+0000","last_fullsized":"2023-11-24T08:04:56.884097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:44.417362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584462+0000","last_change":"2023-11-24T08:04:54.854110+0000","last_active":"2023-11-24T08:04:56.584462+0000","last_peered":"2023-11-24T08:04:56.584462+0000","last_clean":"2023-11-24T08:04:56.584462+0000","last_became_active":"2023-11-24T08:04:54.853837+0000","last_became_peered":"2023-11-24T08:04:54.853837+0000","last_unstale":"2023-11-24T08:04:56.584462+0000","last_undegraded":"2023-11-24T08:04:56.584462+0000","last_fullsized":"2023-11-24T08:04:56.584462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:08.767405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883529+0000","last_change":"2023-11-24T08:04:55.605052+0000","last_active":"2023-11-24T08:04:56.883529+0000","last_peered":"2023-11-24T08:04:56.883529+0000","last_clean":"2023-11-24T08:04:56.883529+0000","last_became_active":"2023-11-24T08:04:55.604774+0000","last_became_peered":"2023-11-24T08:04:55.604774+0000","last_unstale":"2023-11-24T08:04:56.883529+0000","last_undegraded":"2023-11-24T08:04:56.883529+0000","last_fullsized":"2023-11-24T08:04:56.883529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:08.767642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584589+0000","last_change":"2023-11-24T08:04:55.615156+0000","last_active":"2023-11-24T08:04:56.584589+0000","last_peered":"2023-11-24T08:04:56.584589+0000","last_clean":"2023-11-24T08:04:56.584589+0000","last_became_active":"2023-11-24T08:04:55.613741+0000","last_became_peered":"2023-11-24T08:04:55.613741+0000","last_unstale":"2023-11-24T08:04:56.584589+0000","last_undegraded":"2023-11-24T08:04:56.584589+0000","last_fullsized":"2023-11-24T08:04:56.584589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:03:06.998042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883373+0000","last_change":"2023-11-24T08:04:54.859429+0000","last_active":"2023-11-24T08:04:56.883373+0000","last_peered":"2023-11-24T08:04:56.883373+0000","last_clean":"2023-11-24T08:04:56.883373+0000","last_became_active":"2023-11-24T08:04:54.857860+0000","last_became_peered":"2023-11-24T08:04:54.857860+0000","last_unstale":"2023-11-24T08:04:56.883373+0000","last_undegraded":"2023-11-24T08:04:56.883373+0000","last_fullsized":"2023-11-24T08:04:56.883373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:39.003851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585963+0000","last_change":"2023-11-24T08:04:54.860130+0000","last_active":"2023-11-24T08:04:56.585963+0000","last_peered":"2023-11-24T08:04:56.585963+0000","last_clean":"2023-11-24T08:04:56.585963+0000","last_became_active":"2023-11-24T08:04:54.859857+0000","last_became_peered":"2023-11-24T08:04:54.859857+0000","last_unstale":"2023-11-24T08:04:56.585963+0000","last_undegraded":"2023-11-24T08:04:56.585963+0000","last_fullsized":"2023-11-24T08:04:56.585963+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:57.057027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883351+0000","last_change":"2023-11-24T08:04:55.607548+0000","last_active":"2023-11-24T08:04:56.883351+0000","last_peered":"2023-11-24T08:04:56.883351+0000","last_clean":"2023-11-24T08:04:56.883351+0000","last_became_active":"2023-11-24T08:04:55.607258+0000","last_became_peered":"2023-11-24T08:04:55.607258+0000","last_unstale":"2023-11-24T08:04:56.883351+0000","last_undegraded":"2023-11-24T08:04:56.883351+0000","last_fullsized":"2023-11-24T08:04:56.883351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:51.354283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883206+0000","last_change":"2023-11-24T08:04:54.851447+0000","last_active":"2023-11-24T08:04:56.883206+0000","last_peered":"2023-11-24T08:04:56.883206+0000","last_clean":"2023-11-24T08:04:56.883206+0000","last_became_active":"2023-11-24T08:04:54.850700+0000","last_became_peered":"2023-11-24T08:04:54.850700+0000","last_unstale":"2023-11-24T08:04:56.883206+0000","last_undegraded":"2023-11-24T08:04:56.883206+0000","last_fullsized":"2023-11-24T08:04:56.883206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:44:59.111965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:54.819600+0000","last_change":"2023-11-24T08:04:54.819600+0000","last_active":"2023-11-24T08:04:54.819600+0000","last_peered":"2023-11-24T08:04:54.819600+0000","last_clean":"2023-11-24T08:04:54.819600+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:54.819600+0000","last_undegraded":"2023-11-24T08:04:54.819600+0000","last_fullsized":"2023-11-24T08:04:54.819600+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-24T08:04:53.803841+0000","last_change":"2023-11-24T08:04:53.803841+0000","last_active":"2023-11-24T08:04:53.803841+0000","last_peered":"2023-11-24T08:04:53.803841+0000","last_clean":"2023-11-24T08:04:53.803841+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-24T08:04:53.803841+0000","last_undegraded":"2023-11-24T08:04:53.803841+0000","last_fullsized":"2023-11-24T08:04:53.803841+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-11-24T08:04:45.927862+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:04:45.927862+0000","last_peered":"2023-11-24T08:04:45.927862+0000","last_clean":"2023-11-24T08:04:45.927862+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:04:45.927862+0000","last_undegraded":"2023-11-24T08:04:45.927862+0000","last_fullsized":"2023-11-24T08:04:45.927862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":3},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2194,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":28,"acting":28,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1257472,"data_stored":861920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.135},"min":{"1min":0.73199999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.474,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.087,"15min":1.0549999999999999},"min":{"1min":0.84799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4950000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1699999999999999,"15min":1.1639999999999999},"min":{"1min":0.86599999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6719999999999999,"5min":1.929,"15min":1.929},"last":1.03},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.181,"15min":1.194},"min":{"1min":0.94199999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5700000000000001,"5min":2.02,"15min":2.02},"last":1.165}]},{"osd":2,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.169,"15min":1.125},"min":{"1min":0.92200000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.429,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.1539999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7450000000000001,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.351}]},{"osd":3,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.244,"15min":1.1779999999999999},"min":{"1min":1.087,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.706,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.091},{"interface":"front","average":{"1min":1.423,"5min":1.419,"15min":1.415},"min":{"1min":1.0629999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.768,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.2290000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":1.05,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6120000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.319},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.0880000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.861,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.4079999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4970000000000001,"15min":1.542},"min":{"1min":1.1060000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6890000000000001,"5min":2.504,"15min":2.504},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5049999999999999,"15min":1.528},"min":{"1min":1.2370000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.7390000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.4490000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5960000000000001,"15min":1.6020000000000001},"min":{"1min":1.2729999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3479999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.381},{"interface":"front","average":{"1min":1.51,"5min":1.5329999999999999,"15min":1.526},"min":{"1min":1.3440000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.984,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.28}]}]},{"osd":6,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27680,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":663552,"data_stored":271552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.012,"15min":0.95399999999999996},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4810000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.212,"5min":1.087,"15min":1.0629999999999999},"min":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.528,"5min":1.593,"15min":1.593},"last":0.71599999999999997}]},{"osd":1,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2250000000000001,"15min":1.204},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.622},"max":{"1min":1.6850000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7350000000000001,"5min":2.597,"15min":2.597},"last":1.486}]},{"osd":2,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1859999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4930000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.242},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2869999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":2.831,"15min":2.831},"last":1.264}]},{"osd":3,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.92400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.478,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8069999999999999,"5min":1.974,"15min":1.974},"last":1.431}]},{"osd":4,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5740000000000001,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.121},{"interface":"front","average":{"1min":1.242,"5min":1.337,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.573,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.208}]},{"osd":5,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.518,"15min":1.571},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6439999999999999,"5min":2.105,"15min":2.105},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5009999999999999,"15min":1.5249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4590000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.528,"15min":1.5920000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7050000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.091},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5329999999999999,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.8640000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.391}]}]},{"osd":5,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27668,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":663552,"data_stored":271552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.1140000000000001,"15min":1.0840000000000001},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.589,"5min":2.431,"15min":2.431},"last":0.751},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.093,"15min":1.0369999999999999},"min":{"1min":0.871,"5min":0.63,"15min":0.63},"max":{"1min":1.4670000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.875}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.464,"5min":1.653,"15min":1.653},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.80000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.524}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.88100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.363},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.77900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5860000000000001,"5min":1.768,"15min":1.768},"last":1.2569999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3029999999999999,"15min":1.3400000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7889999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.3340000000000001},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.4610000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2889999999999999,"15min":1.3560000000000001},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8260000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.601},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.401,"15min":1.4990000000000001},"min":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9019999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.7689999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3979999999999999,"15min":1.4279999999999999},"min":{"1min":0.94399999999999995,"5min":0.629,"15min":0.629},"max":{"1min":2.0209999999999999,"5min":2.569,"15min":2.569},"last":1.837},{"interface":"front","average":{"1min":1.363,"5min":1.464,"15min":1.522},"min":{"1min":1.0049999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7270000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.8620000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.5529999999999999,"15min":1.675},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.948,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.903},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5580000000000001,"15min":1.5760000000000001},"min":{"1min":0.86599999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":2.0150000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31828,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340012,"statfs":{"total":96636764160,"available":96604172288,"internally_reserved":0,"allocated":663552,"data_stored":271552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.628,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.82699999999999996},"min":{"1min":0.73199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.202,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.02,"15min":0.97499999999999998},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.45,"5min":1.871,"15min":1.871},"last":0.746}]},{"osd":2,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.056,"15min":1.034},"min":{"1min":0.60399999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0960000000000001,"15min":1.0289999999999999},"min":{"1min":0.69999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.91300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6419999999999999,"5min":1.875,"15min":1.875},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.262,"15min":1.204},"min":{"1min":1.127,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7430000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.6240000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3380000000000001,"15min":1.296},"min":{"1min":1.1519999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.8180000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.27},"min":{"1min":1.161,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7270000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.88800000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.298,"15min":1.26},"min":{"1min":1.208,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.776,"5min":1.861,"15min":1.861},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.421,"15min":1.3819999999999999},"min":{"1min":1.254,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.742,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.405}]},{"osd":7,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.393,"15min":1.325},"min":{"1min":1.234,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7330000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.3480000000000001,"15min":1.288},"min":{"1min":1.2390000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.788,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.0209999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31832,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":663552,"data_stored":271552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90200000000000002,"15min":0.99199999999999999},"min":{"1min":0.64100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.175,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.127,"5min":0.96499999999999997,"15min":0.89000000000000001},"min":{"1min":0.77200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5369999999999999,"5min":3.343,"15min":3.343},"last":0.871}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.069,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.72399999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4550000000000001,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":1.5109999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0589999999999999,"15min":1.002},"min":{"1min":0.87,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4490000000000001,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":1.306}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4930000000000001,"15min":1.518},"min":{"1min":1.218,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.9199999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":1.417},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5109999999999999,"15min":1.569},"min":{"1min":1.0149999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7889999999999999,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":0.999}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4199999999999999,"15min":1.504},"min":{"1min":1.167,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9159999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.448,"15min":1.3580000000000001},"min":{"1min":1.109,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9810000000000001,"5min":12.798,"15min":12.798},"last":1.242}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4630000000000001,"15min":1.415},"min":{"1min":1.1319999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.9159999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.347},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4850000000000001,"15min":1.585},"min":{"1min":1.1930000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0190000000000001,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.597}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.4810000000000001,"15min":1.423},"min":{"1min":1.1180000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0369999999999999,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5049999999999999,"15min":1.5840000000000001},"min":{"1min":0.98499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0569999999999999,"5min":6.399,"15min":6.399},"last":1.5800000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542204,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":298323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.0820000000000001,"15min":1.0960000000000001},"min":{"1min":0.79000000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0640000000000001,"15min":1.1080000000000001},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.234,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1599999999999999,"15min":1.1579999999999999},"min":{"1min":0.78500000000000003,"5min":0.621,"15min":0.621},"max":{"1min":1.615,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1819999999999999,"15min":1.226},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5089999999999999,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"min":{"1min":0.88800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.383,"5min":1.3839999999999999,"15min":1.4319999999999999},"min":{"1min":0.91000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9419999999999999,"5min":1.966,"15min":1.966},"last":1.1799999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.82799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3480000000000001,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7270000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.347}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4179999999999999,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6000000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.242},{"interface":"front","average":{"1min":1.472,"5min":1.508,"15min":1.512},"min":{"1min":1.1180000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.857,"5min":2.073,"15min":2.073},"last":1.298}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.448,"15min":1.528},"min":{"1min":1.131,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6379999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.502},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.51,"15min":1.5940000000000001},"min":{"1min":1.05,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.468}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.5469999999999999,"15min":1.5920000000000001},"min":{"1min":0.91000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0259999999999998,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6779999999999999},"min":{"1min":1.274,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.8280000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.5820000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":296801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.60799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.556,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.996},{"interface":"front","average":{"1min":1.032,"5min":0.93999999999999995,"15min":0.999},"min":{"1min":0.70099999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.369,"5min":3.266,"15min":3.266},"last":1.284}]},{"osd":2,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.72399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3109999999999999,"5min":1.706,"15min":1.706},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.82899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4259999999999999,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.131}]},{"osd":3,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.169,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.825,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.498},{"interface":"front","average":{"1min":1.173,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.91100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.649,"5min":1.976,"15min":1.976},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3300000000000001,"15min":1.472},"min":{"1min":0.98099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.552,"5min":4.367,"15min":4.367},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.375,"15min":1.4339999999999999},"min":{"1min":1.0840000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0790000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.3320000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3999999999999999,"15min":1.54},"min":{"1min":1.1180000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6599999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.405},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.46,"15min":1.4950000000000001},"min":{"1min":1.274,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1459999999999999,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.5629999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.395},"min":{"1min":1.103,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.917,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5409999999999999,"15min":1.643},"min":{"1min":1.3069999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.875,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.5229999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3979999999999999,"15min":1.4319999999999999},"min":{"1min":1.131,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7849999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.591},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5329999999999999,"15min":1.663},"min":{"1min":1.1559999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7929999999999999,"5min":4.452,"15min":4.452},"last":1.6240000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1323008,"data_stored":889273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.64700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1930000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.878,"15min":0.89200000000000002},"min":{"1min":0.65500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3360000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.038},"min":{"1min":0.85199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0669999999999999},"min":{"1min":0.99399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5329999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1699999999999999,"15min":1.1299999999999999},"min":{"1min":1.0940000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.244,"15min":1.234},"min":{"1min":0.99199999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.698,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.397},{"interface":"front","average":{"1min":1.377,"5min":1.3120000000000001,"15min":1.3280000000000001},"min":{"1min":1.04,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.8899999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4390000000000001,"15min":1.4970000000000001},"min":{"1min":1.1890000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0680000000000001,"5min":2.839,"15min":2.839},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3620000000000001,"15min":1.387},"min":{"1min":1.2569999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6539999999999999,"5min":2.823,"15min":2.823},"last":1.0760000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.333,"15min":1.351},"min":{"1min":1.0609999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.552,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.137},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":1.089,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9730000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.5580000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4630000000000001,"15min":1.51},"min":{"1min":1.1739999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.891,"5min":2.875,"15min":2.875},"last":1.28},{"interface":"front","average":{"1min":1.335,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.7669999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.726}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:00.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:00.564 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.562+0000 7fe40ed16640 1 Processor -- start 2023-11-24T08:05:00.565 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.562+0000 7fe40ed16640 1 -- start start 2023-11-24T08:05:00.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40ed16640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4080b34e0 0x7fe4080b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40ed16640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe4080b4140 0x7fe4080d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40ed16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d1b90 0x7fe4080cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40ed16640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080d2020 con 0x7fe4080b34e0 2023-11-24T08:05:00.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40ed16640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4080d0420 con 0x7fe4080b4140 2023-11-24T08:05:00.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40ed16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080d0e70 con 0x7fe4080d1b90 2023-11-24T08:05:00.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40dd14640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4080b34e0 0x7fe4080b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40dd14640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe4080b34e0 0x7fe4080b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34940/0 (socket says 172.21.15.161:34940) 2023-11-24T08:05:00.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.564+0000 7fe40dd14640 1 -- 172.21.15.161:0/2349661159 learned_addr learned my addr 172.21.15.161:0/2349661159 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.565+0000 7fe40dd14640 1 -- 172.21.15.161:0/2349661159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d1b90 msgr2=0x7fe4080cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.565+0000 7fe40dd14640 1 --2- 172.21.15.161:0/2349661159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d1b90 0x7fe4080cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.565+0000 7fe40dd14640 1 -- 172.21.15.161:0/2349661159 >> v2:172.21.15.175:3300/0 conn(0x7fe4080b4140 msgr2=0x7fe4080d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.565+0000 7fe40d513640 1 --2- 172.21.15.161:0/2349661159 >> v2:172.21.15.175:3300/0 conn(0x7fe4080b4140 0x7fe4080d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.565+0000 7fe40dd14640 1 --2- 172.21.15.161:0/2349661159 >> v2:172.21.15.175:3300/0 conn(0x7fe4080b4140 0x7fe4080d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.565+0000 7fe40dd14640 1 -- 172.21.15.161:0/2349661159 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080d3d50 con 0x7fe4080b34e0 2023-11-24T08:05:00.568 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.566+0000 7fe40dd14640 1 --2- 172.21.15.161:0/2349661159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b34e0 0x7fe4080b3c00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe4080a0fa0 tx=0x7fe40402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c51950fcedd9b82 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.566+0000 7fe40cd12640 1 -- 172.21.15.161:0/2349661159 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404031870 con 0x7fe4080b34e0 2023-11-24T08:05:00.569 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.566+0000 7fe40cd12640 1 -- 172.21.15.161:0/2349661159 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4040319d0 con 0x7fe4080b34e0 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.566+0000 7fe40cd12640 1 -- 172.21.15.161:0/2349661159 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404031d60 con 0x7fe4080b34e0 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 -- 172.21.15.161:0/2349661159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b34e0 msgr2=0x7fe4080b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 --2- 172.21.15.161:0/2349661159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b34e0 0x7fe4080b3c00 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe4080a0fa0 tx=0x7fe40402b910 comp rx=0 tx=0).stop 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 -- 172.21.15.161:0/2349661159 shutdown_connections 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 --2- 172.21.15.161:0/2349661159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080d1b90 0x7fe4080cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 --2- 172.21.15.161:0/2349661159 >> v2:172.21.15.175:3300/0 conn(0x7fe4080b4140 0x7fe4080d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 --2- 172.21.15.161:0/2349661159 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b34e0 0x7fe4080b3c00 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.570 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 -- 172.21.15.161:0/2349661159 >> 172.21.15.161:0/2349661159 conn(0x7fe4080d3090 msgr2=0x7fe4080d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 -- 172.21.15.161:0/2349661159 shutdown_connections 2023-11-24T08:05:00.572 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.567+0000 7fe40ed16640 1 -- 172.21.15.161:0/2349661159 wait complete. 2023-11-24T08:05:00.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.569+0000 7fe40ed16640 1 Processor -- start 2023-11-24T08:05:00.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.569+0000 7fe40ed16640 1 -- start start 2023-11-24T08:05:00.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40ed16640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080b34e0 0x7fe4081565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.574 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40ed16640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 0x7fe4080ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40ed16640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080d1b90 0x7fe4080ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40ed16640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4081e5f00 con 0x7fe4080b4140 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40ed16640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4081e6d60 con 0x7fe4080d1b90 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40ed16640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408156b10 con 0x7fe4080b34e0 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40d513640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 0x7fe4080ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40d513640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 0x7fe4080ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:34956/0 (socket says 172.21.15.161:34956) 2023-11-24T08:05:00.575 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.570+0000 7fe40d513640 1 -- 172.21.15.161:0/3353764444 learned_addr learned my addr 172.21.15.161:0/3353764444 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40dd14640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080b34e0 0x7fe4081565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40e515640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080d1b90 0x7fe4080ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40d513640 1 -- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080b34e0 msgr2=0x7fe4081565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40d513640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080b34e0 0x7fe4081565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40d513640 1 -- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080d1b90 msgr2=0x7fe4080ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40d513640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080d1b90 0x7fe4080ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.576 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40d513640 1 -- 172.21.15.161:0/3353764444 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4040094d0 con 0x7fe4080b4140 2023-11-24T08:05:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40d513640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 0x7fe4080ca160 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800c7f0 tx=0x7fe3f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8004220 con 0x7fe4080b4140 2023-11-24T08:05:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f80043a0 con 0x7fe4080b4140 2023-11-24T08:05:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4081e6150 con 0x7fe4080b4140 2023-11-24T08:05:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.571+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8007860 con 0x7fe4080b4140 2023-11-24T08:05:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.572+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4081e6710 con 0x7fe4080b4140 2023-11-24T08:05:00.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.573+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4080d1350 con 0x7fe4080b4140 2023-11-24T08:05:00.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.574+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe3f8007bd0 con 0x7fe4080b4140 2023-11-24T08:05:00.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.575+0000 7fe3fe7fc640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3ec06aff0 0x7fe3ec06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:00.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.575+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f80899d0 con 0x7fe4080b4140 2023-11-24T08:05:00.578 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.575+0000 7fe40dd14640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3ec06aff0 0x7fe3ec06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:00.579 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.576+0000 7fe40dd14640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3ec06aff0 0x7fe3ec06d4b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe404036000 tx=0x7fe40403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:00.581 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.579+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4080d1350 con 0x7fe4080b4140 2023-11-24T08:05:00.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.768+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe4080cf1c0 con 0x7fe3ec06aff0 2023-11-24T08:05:00.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.792+0000 7fe3fe7fc640 1 -- 172.21.15.161:0/3353764444 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286778 (secure 0 0 0) 0x7fe404044400 con 0x7fe3ec06aff0 2023-11-24T08:05:00.797 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:00.799 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3ec06aff0 msgr2=0x7fe3ec06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3ec06aff0 0x7fe3ec06d4b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe404036000 tx=0x7fe40403c040 comp rx=0 tx=0).stop 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 msgr2=0x7fe4080ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 0x7fe4080ca160 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe3f800c7f0 tx=0x7fe3f800ccb0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 shutdown_connections 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe3ec06aff0 0x7fe3ec06d4b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4080d1b90 0x7fe4080ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe4080b4140 0x7fe4080ca160 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 --2- 172.21.15.161:0/3353764444 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4080b34e0 0x7fe4081565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 >> 172.21.15.161:0/3353764444 conn(0x7fe4080d3090 msgr2=0x7fe40806c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:00.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 shutdown_connections 2023-11-24T08:05:00.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:00.798+0000 7fe40ed16640 1 -- 172.21.15.161:0/3353764444 wait complete. 2023-11-24T08:05:00.821 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2023-11-24T08:05:00.628472+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243780,"kb_used_data":6792,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730940,"statfs":{"total":773094113280,"available":772844482560,"internally_reserved":0,"allocated":6955008,"data_stored":3559244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002074"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881360+0000","last_change":"2023-11-24T08:04:55.604995+0000","last_active":"2023-11-24T08:04:56.881360+0000","last_peered":"2023-11-24T08:04:56.881360+0000","last_clean":"2023-11-24T08:04:56.881360+0000","last_became_active":"2023-11-24T08:04:55.604685+0000","last_became_peered":"2023-11-24T08:04:55.604685+0000","last_unstale":"2023-11-24T08:04:56.881360+0000","last_undegraded":"2023-11-24T08:04:56.881360+0000","last_fullsized":"2023-11-24T08:04:56.881360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:47:20.557056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882612+0000","last_change":"2023-11-24T08:04:55.615254+0000","last_active":"2023-11-24T08:04:56.882612+0000","last_peered":"2023-11-24T08:04:56.882612+0000","last_clean":"2023-11-24T08:04:56.882612+0000","last_became_active":"2023-11-24T08:04:55.614967+0000","last_became_peered":"2023-11-24T08:04:55.614967+0000","last_unstale":"2023-11-24T08:04:56.882612+0000","last_undegraded":"2023-11-24T08:04:56.882612+0000","last_fullsized":"2023-11-24T08:04:56.882612+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:02:24.619066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885279+0000","last_change":"2023-11-24T08:04:55.601607+0000","last_active":"2023-11-24T08:04:56.885279+0000","last_peered":"2023-11-24T08:04:56.885279+0000","last_clean":"2023-11-24T08:04:56.885279+0000","last_became_active":"2023-11-24T08:04:55.601308+0000","last_became_peered":"2023-11-24T08:04:55.601308+0000","last_unstale":"2023-11-24T08:04:56.885279+0000","last_undegraded":"2023-11-24T08:04:56.885279+0000","last_fullsized":"2023-11-24T08:04:56.885279+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:28:30.590535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884248+0000","last_change":"2023-11-24T08:04:55.612610+0000","last_active":"2023-11-24T08:04:56.884248+0000","last_peered":"2023-11-24T08:04:56.884248+0000","last_clean":"2023-11-24T08:04:56.884248+0000","last_became_active":"2023-11-24T08:04:55.611751+0000","last_became_peered":"2023-11-24T08:04:55.611751+0000","last_unstale":"2023-11-24T08:04:56.884248+0000","last_undegraded":"2023-11-24T08:04:56.884248+0000","last_fullsized":"2023-11-24T08:04:56.884248+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:32.131738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.880976+0000","last_change":"2023-11-24T08:04:55.612379+0000","last_active":"2023-11-24T08:04:56.880976+0000","last_peered":"2023-11-24T08:04:56.880976+0000","last_clean":"2023-11-24T08:04:56.880976+0000","last_became_active":"2023-11-24T08:04:55.612052+0000","last_became_peered":"2023-11-24T08:04:55.612052+0000","last_unstale":"2023-11-24T08:04:56.880976+0000","last_undegraded":"2023-11-24T08:04:56.880976+0000","last_fullsized":"2023-11-24T08:04:56.880976+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:17:11.707616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583469+0000","last_change":"2023-11-24T08:04:55.610886+0000","last_active":"2023-11-24T08:04:56.583469+0000","last_peered":"2023-11-24T08:04:56.583469+0000","last_clean":"2023-11-24T08:04:56.583469+0000","last_became_active":"2023-11-24T08:04:55.610639+0000","last_became_peered":"2023-11-24T08:04:55.610639+0000","last_unstale":"2023-11-24T08:04:56.583469+0000","last_undegraded":"2023-11-24T08:04:56.583469+0000","last_fullsized":"2023-11-24T08:04:56.583469+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:24:05.704769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584797+0000","last_change":"2023-11-24T08:04:55.612475+0000","last_active":"2023-11-24T08:04:56.584797+0000","last_peered":"2023-11-24T08:04:56.584797+0000","last_clean":"2023-11-24T08:04:56.584797+0000","last_became_active":"2023-11-24T08:04:55.610381+0000","last_became_peered":"2023-11-24T08:04:55.610381+0000","last_unstale":"2023-11-24T08:04:56.584797+0000","last_undegraded":"2023-11-24T08:04:56.584797+0000","last_fullsized":"2023-11-24T08:04:56.584797+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:16:36.186963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882007+0000","last_change":"2023-11-24T08:04:55.611035+0000","last_active":"2023-11-24T08:04:56.882007+0000","last_peered":"2023-11-24T08:04:56.882007+0000","last_clean":"2023-11-24T08:04:56.882007+0000","last_became_active":"2023-11-24T08:04:55.609426+0000","last_became_peered":"2023-11-24T08:04:55.609426+0000","last_unstale":"2023-11-24T08:04:56.882007+0000","last_undegraded":"2023-11-24T08:04:56.882007+0000","last_fullsized":"2023-11-24T08:04:56.882007+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:25:14.794161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586471+0000","last_change":"2023-11-24T08:04:55.605399+0000","last_active":"2023-11-24T08:04:56.586471+0000","last_peered":"2023-11-24T08:04:56.586471+0000","last_clean":"2023-11-24T08:04:56.586471+0000","last_became_active":"2023-11-24T08:04:55.604883+0000","last_became_peered":"2023-11-24T08:04:55.604883+0000","last_unstale":"2023-11-24T08:04:56.586471+0000","last_undegraded":"2023-11-24T08:04:56.586471+0000","last_fullsized":"2023-11-24T08:04:56.586471+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:18:45.620989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883924+0000","last_change":"2023-11-24T08:04:55.607025+0000","last_active":"2023-11-24T08:04:56.883924+0000","last_peered":"2023-11-24T08:04:56.883924+0000","last_clean":"2023-11-24T08:04:56.883924+0000","last_became_active":"2023-11-24T08:04:55.606771+0000","last_became_peered":"2023-11-24T08:04:55.606771+0000","last_unstale":"2023-11-24T08:04:56.883924+0000","last_undegraded":"2023-11-24T08:04:56.883924+0000","last_fullsized":"2023-11-24T08:04:56.883924+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:00:42.164832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883771+0000","last_change":"2023-11-24T08:04:55.605695+0000","last_active":"2023-11-24T08:04:56.883771+0000","last_peered":"2023-11-24T08:04:56.883771+0000","last_clean":"2023-11-24T08:04:56.883771+0000","last_became_active":"2023-11-24T08:04:55.605430+0000","last_became_peered":"2023-11-24T08:04:55.605430+0000","last_unstale":"2023-11-24T08:04:56.883771+0000","last_undegraded":"2023-11-24T08:04:56.883771+0000","last_fullsized":"2023-11-24T08:04:56.883771+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:14.223235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884584+0000","last_change":"2023-11-24T08:04:55.612223+0000","last_active":"2023-11-24T08:04:56.884584+0000","last_peered":"2023-11-24T08:04:56.884584+0000","last_clean":"2023-11-24T08:04:56.884584+0000","last_became_active":"2023-11-24T08:04:55.611920+0000","last_became_peered":"2023-11-24T08:04:55.611920+0000","last_unstale":"2023-11-24T08:04:56.884584+0000","last_undegraded":"2023-11-24T08:04:56.884584+0000","last_fullsized":"2023-11-24T08:04:56.884584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:53.546588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585716+0000","last_change":"2023-11-24T08:04:55.602983+0000","last_active":"2023-11-24T08:04:56.585716+0000","last_peered":"2023-11-24T08:04:56.585716+0000","last_clean":"2023-11-24T08:04:56.585716+0000","last_became_active":"2023-11-24T08:04:55.602705+0000","last_became_peered":"2023-11-24T08:04:55.602705+0000","last_unstale":"2023-11-24T08:04:56.585716+0000","last_undegraded":"2023-11-24T08:04:56.585716+0000","last_fullsized":"2023-11-24T08:04:56.585716+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:10:38.332897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585958+0000","last_change":"2023-11-24T08:04:55.604992+0000","last_active":"2023-11-24T08:04:56.585958+0000","last_peered":"2023-11-24T08:04:56.585958+0000","last_clean":"2023-11-24T08:04:56.585958+0000","last_became_active":"2023-11-24T08:04:55.604630+0000","last_became_peered":"2023-11-24T08:04:55.604630+0000","last_unstale":"2023-11-24T08:04:56.585958+0000","last_undegraded":"2023-11-24T08:04:56.585958+0000","last_fullsized":"2023-11-24T08:04:56.585958+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:40.234525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585152+0000","last_change":"2023-11-24T08:04:55.607663+0000","last_active":"2023-11-24T08:04:56.585152+0000","last_peered":"2023-11-24T08:04:56.585152+0000","last_clean":"2023-11-24T08:04:56.585152+0000","last_became_active":"2023-11-24T08:04:55.607311+0000","last_became_peered":"2023-11-24T08:04:55.607311+0000","last_unstale":"2023-11-24T08:04:56.585152+0000","last_undegraded":"2023-11-24T08:04:56.585152+0000","last_fullsized":"2023-11-24T08:04:56.585152+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:58.159037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.582956+0000","last_change":"2023-11-24T08:04:55.612858+0000","last_active":"2023-11-24T08:04:56.582956+0000","last_peered":"2023-11-24T08:04:56.582956+0000","last_clean":"2023-11-24T08:04:56.582956+0000","last_became_active":"2023-11-24T08:04:55.612556+0000","last_became_peered":"2023-11-24T08:04:55.612556+0000","last_unstale":"2023-11-24T08:04:56.582956+0000","last_undegraded":"2023-11-24T08:04:56.582956+0000","last_fullsized":"2023-11-24T08:04:56.582956+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:14:15.091268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882664+0000","last_change":"2023-11-24T08:04:55.614203+0000","last_active":"2023-11-24T08:04:56.882664+0000","last_peered":"2023-11-24T08:04:56.882664+0000","last_clean":"2023-11-24T08:04:56.882664+0000","last_became_active":"2023-11-24T08:04:55.613932+0000","last_became_peered":"2023-11-24T08:04:55.613932+0000","last_unstale":"2023-11-24T08:04:56.882664+0000","last_undegraded":"2023-11-24T08:04:56.882664+0000","last_fullsized":"2023-11-24T08:04:56.882664+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:41:22.947121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885818+0000","last_change":"2023-11-24T08:04:55.604338+0000","last_active":"2023-11-24T08:04:56.885818+0000","last_peered":"2023-11-24T08:04:56.885818+0000","last_clean":"2023-11-24T08:04:56.885818+0000","last_became_active":"2023-11-24T08:04:55.603401+0000","last_became_peered":"2023-11-24T08:04:55.603401+0000","last_unstale":"2023-11-24T08:04:56.885818+0000","last_undegraded":"2023-11-24T08:04:56.885818+0000","last_fullsized":"2023-11-24T08:04:56.885818+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:34:00.358232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.880993+0000","last_change":"2023-11-24T08:04:55.601157+0000","last_active":"2023-11-24T08:04:56.880993+0000","last_peered":"2023-11-24T08:04:56.880993+0000","last_clean":"2023-11-24T08:04:56.880993+0000","last_became_active":"2023-11-24T08:04:55.600597+0000","last_became_peered":"2023-11-24T08:04:55.600597+0000","last_unstale":"2023-11-24T08:04:56.880993+0000","last_undegraded":"2023-11-24T08:04:56.880993+0000","last_fullsized":"2023-11-24T08:04:56.880993+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:18:52.286652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882456+0000","last_change":"2023-11-24T08:04:55.604736+0000","last_active":"2023-11-24T08:04:56.882456+0000","last_peered":"2023-11-24T08:04:56.882456+0000","last_clean":"2023-11-24T08:04:56.882456+0000","last_became_active":"2023-11-24T08:04:55.604145+0000","last_became_peered":"2023-11-24T08:04:55.604145+0000","last_unstale":"2023-11-24T08:04:56.882456+0000","last_undegraded":"2023-11-24T08:04:56.882456+0000","last_fullsized":"2023-11-24T08:04:56.882456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:10:05.411710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884874+0000","last_change":"2023-11-24T08:04:55.612774+0000","last_active":"2023-11-24T08:04:56.884874+0000","last_peered":"2023-11-24T08:04:56.884874+0000","last_clean":"2023-11-24T08:04:56.884874+0000","last_became_active":"2023-11-24T08:04:55.611940+0000","last_became_peered":"2023-11-24T08:04:55.611940+0000","last_unstale":"2023-11-24T08:04:56.884874+0000","last_undegraded":"2023-11-24T08:04:56.884874+0000","last_fullsized":"2023-11-24T08:04:56.884874+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:54:33.387959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881960+0000","last_change":"2023-11-24T08:04:55.613410+0000","last_active":"2023-11-24T08:04:56.881960+0000","last_peered":"2023-11-24T08:04:56.881960+0000","last_clean":"2023-11-24T08:04:56.881960+0000","last_became_active":"2023-11-24T08:04:55.613083+0000","last_became_peered":"2023-11-24T08:04:55.613083+0000","last_unstale":"2023-11-24T08:04:56.881960+0000","last_undegraded":"2023-11-24T08:04:56.881960+0000","last_fullsized":"2023-11-24T08:04:56.881960+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:52.226553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884161+0000","last_change":"2023-11-24T08:04:55.606395+0000","last_active":"2023-11-24T08:04:56.884161+0000","last_peered":"2023-11-24T08:04:56.884161+0000","last_clean":"2023-11-24T08:04:56.884161+0000","last_became_active":"2023-11-24T08:04:55.605960+0000","last_became_peered":"2023-11-24T08:04:55.605960+0000","last_unstale":"2023-11-24T08:04:56.884161+0000","last_undegraded":"2023-11-24T08:04:56.884161+0000","last_fullsized":"2023-11-24T08:04:56.884161+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:34.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584554+0000","last_change":"2023-11-24T08:04:55.604569+0000","last_active":"2023-11-24T08:04:56.584554+0000","last_peered":"2023-11-24T08:04:56.584554+0000","last_clean":"2023-11-24T08:04:56.584554+0000","last_became_active":"2023-11-24T08:04:55.603452+0000","last_became_peered":"2023-11-24T08:04:55.603452+0000","last_unstale":"2023-11-24T08:04:56.584554+0000","last_undegraded":"2023-11-24T08:04:56.584554+0000","last_fullsized":"2023-11-24T08:04:56.584554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:17:08.299175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881586+0000","last_change":"2023-11-24T08:04:55.607002+0000","last_active":"2023-11-24T08:04:56.881586+0000","last_peered":"2023-11-24T08:04:56.881586+0000","last_clean":"2023-11-24T08:04:56.881586+0000","last_became_active":"2023-11-24T08:04:55.606737+0000","last_became_peered":"2023-11-24T08:04:55.606737+0000","last_unstale":"2023-11-24T08:04:56.881586+0000","last_undegraded":"2023-11-24T08:04:56.881586+0000","last_fullsized":"2023-11-24T08:04:56.881586+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:19:00.792460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883562+0000","last_change":"2023-11-24T08:04:55.611266+0000","last_active":"2023-11-24T08:04:56.883562+0000","last_peered":"2023-11-24T08:04:56.883562+0000","last_clean":"2023-11-24T08:04:56.883562+0000","last_became_active":"2023-11-24T08:04:55.610842+0000","last_became_peered":"2023-11-24T08:04:55.610842+0000","last_unstale":"2023-11-24T08:04:56.883562+0000","last_undegraded":"2023-11-24T08:04:56.883562+0000","last_fullsized":"2023-11-24T08:04:56.883562+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:36:12.355032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584554+0000","last_change":"2023-11-24T08:04:55.613452+0000","last_active":"2023-11-24T08:04:56.584554+0000","last_peered":"2023-11-24T08:04:56.584554+0000","last_clean":"2023-11-24T08:04:56.584554+0000","last_became_active":"2023-11-24T08:04:55.612038+0000","last_became_peered":"2023-11-24T08:04:55.612038+0000","last_unstale":"2023-11-24T08:04:56.584554+0000","last_undegraded":"2023-11-24T08:04:56.584554+0000","last_fullsized":"2023-11-24T08:04:56.584554+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:34:23.954435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881025+0000","last_change":"2023-11-24T08:04:55.612582+0000","last_active":"2023-11-24T08:04:56.881025+0000","last_peered":"2023-11-24T08:04:56.881025+0000","last_clean":"2023-11-24T08:04:56.881025+0000","last_became_active":"2023-11-24T08:04:55.611718+0000","last_became_peered":"2023-11-24T08:04:55.611718+0000","last_unstale":"2023-11-24T08:04:56.881025+0000","last_undegraded":"2023-11-24T08:04:56.881025+0000","last_fullsized":"2023-11-24T08:04:56.881025+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:20:51.062143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881936+0000","last_change":"2023-11-24T08:04:55.615453+0000","last_active":"2023-11-24T08:04:56.881936+0000","last_peered":"2023-11-24T08:04:56.881936+0000","last_clean":"2023-11-24T08:04:56.881936+0000","last_became_active":"2023-11-24T08:04:55.614898+0000","last_became_peered":"2023-11-24T08:04:55.614898+0000","last_unstale":"2023-11-24T08:04:56.881936+0000","last_undegraded":"2023-11-24T08:04:56.881936+0000","last_fullsized":"2023-11-24T08:04:56.881936+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:16.347209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883514+0000","last_change":"2023-11-24T08:04:55.602075+0000","last_active":"2023-11-24T08:04:56.883514+0000","last_peered":"2023-11-24T08:04:56.883514+0000","last_clean":"2023-11-24T08:04:56.883514+0000","last_became_active":"2023-11-24T08:04:55.601763+0000","last_became_peered":"2023-11-24T08:04:55.601763+0000","last_unstale":"2023-11-24T08:04:56.883514+0000","last_undegraded":"2023-11-24T08:04:56.883514+0000","last_fullsized":"2023-11-24T08:04:56.883514+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:41:32.131738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.880813+0000","last_change":"2023-11-24T08:04:55.599347+0000","last_active":"2023-11-24T08:04:56.880813+0000","last_peered":"2023-11-24T08:04:56.880813+0000","last_clean":"2023-11-24T08:04:56.880813+0000","last_became_active":"2023-11-24T08:04:55.597121+0000","last_became_peered":"2023-11-24T08:04:55.597121+0000","last_unstale":"2023-11-24T08:04:56.880813+0000","last_undegraded":"2023-11-24T08:04:56.880813+0000","last_fullsized":"2023-11-24T08:04:56.880813+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:53:04.452076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583106+0000","last_change":"2023-11-24T08:04:55.606026+0000","last_active":"2023-11-24T08:04:56.583106+0000","last_peered":"2023-11-24T08:04:56.583106+0000","last_clean":"2023-11-24T08:04:56.583106+0000","last_became_active":"2023-11-24T08:04:55.605556+0000","last_became_peered":"2023-11-24T08:04:55.605556+0000","last_unstale":"2023-11-24T08:04:56.583106+0000","last_undegraded":"2023-11-24T08:04:56.583106+0000","last_fullsized":"2023-11-24T08:04:56.583106+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:16.746875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584334+0000","last_change":"2023-11-24T08:04:55.608017+0000","last_active":"2023-11-24T08:04:56.584334+0000","last_peered":"2023-11-24T08:04:56.584334+0000","last_clean":"2023-11-24T08:04:56.584334+0000","last_became_active":"2023-11-24T08:04:55.606725+0000","last_became_peered":"2023-11-24T08:04:55.606725+0000","last_unstale":"2023-11-24T08:04:56.584334+0000","last_undegraded":"2023-11-24T08:04:56.584334+0000","last_fullsized":"2023-11-24T08:04:56.584334+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:53:43.358049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":16,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584364+0000","last_change":"2023-11-24T08:04:54.856744+0000","last_active":"2023-11-24T08:04:56.584364+0000","last_peered":"2023-11-24T08:04:56.584364+0000","last_clean":"2023-11-24T08:04:56.584364+0000","last_became_active":"2023-11-24T08:04:54.856292+0000","last_became_peered":"2023-11-24T08:04:54.856292+0000","last_unstale":"2023-11-24T08:04:56.584364+0000","last_undegraded":"2023-11-24T08:04:56.584364+0000","last_fullsized":"2023-11-24T08:04:56.584364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:47:32.343608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883941+0000","last_change":"2023-11-24T08:04:55.604169+0000","last_active":"2023-11-24T08:04:56.883941+0000","last_peered":"2023-11-24T08:04:56.883941+0000","last_clean":"2023-11-24T08:04:56.883941+0000","last_became_active":"2023-11-24T08:04:55.601308+0000","last_became_peered":"2023-11-24T08:04:55.601308+0000","last_unstale":"2023-11-24T08:04:56.883941+0000","last_undegraded":"2023-11-24T08:04:56.883941+0000","last_fullsized":"2023-11-24T08:04:56.883941+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:43.790910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882603+0000","last_change":"2023-11-24T08:04:54.859751+0000","last_active":"2023-11-24T08:04:56.882603+0000","last_peered":"2023-11-24T08:04:56.882603+0000","last_clean":"2023-11-24T08:04:56.882603+0000","last_became_active":"2023-11-24T08:04:54.859486+0000","last_became_peered":"2023-11-24T08:04:54.859486+0000","last_unstale":"2023-11-24T08:04:56.882603+0000","last_undegraded":"2023-11-24T08:04:56.882603+0000","last_fullsized":"2023-11-24T08:04:56.882603+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:32:10.633616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584098+0000","last_change":"2023-11-24T08:04:55.607567+0000","last_active":"2023-11-24T08:04:56.584098+0000","last_peered":"2023-11-24T08:04:56.584098+0000","last_clean":"2023-11-24T08:04:56.584098+0000","last_became_active":"2023-11-24T08:04:55.607187+0000","last_became_peered":"2023-11-24T08:04:55.607187+0000","last_unstale":"2023-11-24T08:04:56.584098+0000","last_undegraded":"2023-11-24T08:04:56.584098+0000","last_fullsized":"2023-11-24T08:04:56.584098+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:19.652831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584702+0000","last_change":"2023-11-24T08:04:54.853026+0000","last_active":"2023-11-24T08:04:56.584702+0000","last_peered":"2023-11-24T08:04:56.584702+0000","last_clean":"2023-11-24T08:04:56.584702+0000","last_became_active":"2023-11-24T08:04:54.852541+0000","last_became_peered":"2023-11-24T08:04:54.852541+0000","last_unstale":"2023-11-24T08:04:56.584702+0000","last_undegraded":"2023-11-24T08:04:56.584702+0000","last_fullsized":"2023-11-24T08:04:56.584702+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:14:39.584083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584276+0000","last_change":"2023-11-24T08:04:55.615561+0000","last_active":"2023-11-24T08:04:56.584276+0000","last_peered":"2023-11-24T08:04:56.584276+0000","last_clean":"2023-11-24T08:04:56.584276+0000","last_became_active":"2023-11-24T08:04:55.615213+0000","last_became_peered":"2023-11-24T08:04:55.615213+0000","last_unstale":"2023-11-24T08:04:56.584276+0000","last_undegraded":"2023-11-24T08:04:56.584276+0000","last_fullsized":"2023-11-24T08:04:56.584276+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:12:07.985266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884676+0000","last_change":"2023-11-24T08:04:54.863394+0000","last_active":"2023-11-24T08:04:56.884676+0000","last_peered":"2023-11-24T08:04:56.884676+0000","last_clean":"2023-11-24T08:04:56.884676+0000","last_became_active":"2023-11-24T08:04:54.862692+0000","last_became_peered":"2023-11-24T08:04:54.862692+0000","last_unstale":"2023-11-24T08:04:56.884676+0000","last_undegraded":"2023-11-24T08:04:56.884676+0000","last_fullsized":"2023-11-24T08:04:56.884676+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:21:47.496836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882120+0000","last_change":"2023-11-24T08:04:55.604933+0000","last_active":"2023-11-24T08:04:56.882120+0000","last_peered":"2023-11-24T08:04:56.882120+0000","last_clean":"2023-11-24T08:04:56.882120+0000","last_became_active":"2023-11-24T08:04:55.604648+0000","last_became_peered":"2023-11-24T08:04:55.604648+0000","last_unstale":"2023-11-24T08:04:56.882120+0000","last_undegraded":"2023-11-24T08:04:56.882120+0000","last_fullsized":"2023-11-24T08:04:56.882120+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:12:15.623454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586521+0000","last_change":"2023-11-24T08:04:54.859295+0000","last_active":"2023-11-24T08:04:56.586521+0000","last_peered":"2023-11-24T08:04:56.586521+0000","last_clean":"2023-11-24T08:04:56.586521+0000","last_became_active":"2023-11-24T08:04:54.858003+0000","last_became_peered":"2023-11-24T08:04:54.858003+0000","last_unstale":"2023-11-24T08:04:56.586521+0000","last_undegraded":"2023-11-24T08:04:56.586521+0000","last_fullsized":"2023-11-24T08:04:56.586521+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:24:13.207476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881674+0000","last_change":"2023-11-24T08:04:55.610159+0000","last_active":"2023-11-24T08:04:56.881674+0000","last_peered":"2023-11-24T08:04:56.881674+0000","last_clean":"2023-11-24T08:04:56.881674+0000","last_became_active":"2023-11-24T08:04:55.609877+0000","last_became_peered":"2023-11-24T08:04:55.609877+0000","last_unstale":"2023-11-24T08:04:56.881674+0000","last_undegraded":"2023-11-24T08:04:56.881674+0000","last_fullsized":"2023-11-24T08:04:56.881674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:47:54.567107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583716+0000","last_change":"2023-11-24T08:04:54.854968+0000","last_active":"2023-11-24T08:04:56.583716+0000","last_peered":"2023-11-24T08:04:56.583716+0000","last_clean":"2023-11-24T08:04:56.583716+0000","last_became_active":"2023-11-24T08:04:54.854702+0000","last_became_peered":"2023-11-24T08:04:54.854702+0000","last_unstale":"2023-11-24T08:04:56.583716+0000","last_undegraded":"2023-11-24T08:04:56.583716+0000","last_fullsized":"2023-11-24T08:04:56.583716+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:13:11.415048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584674+0000","last_change":"2023-11-24T08:04:55.598797+0000","last_active":"2023-11-24T08:04:56.584674+0000","last_peered":"2023-11-24T08:04:56.584674+0000","last_clean":"2023-11-24T08:04:56.584674+0000","last_became_active":"2023-11-24T08:04:55.597280+0000","last_became_peered":"2023-11-24T08:04:55.597280+0000","last_unstale":"2023-11-24T08:04:56.584674+0000","last_undegraded":"2023-11-24T08:04:56.584674+0000","last_fullsized":"2023-11-24T08:04:56.584674+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:56:09.344922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883301+0000","last_change":"2023-11-24T08:04:54.858919+0000","last_active":"2023-11-24T08:04:56.883301+0000","last_peered":"2023-11-24T08:04:56.883301+0000","last_clean":"2023-11-24T08:04:56.883301+0000","last_became_active":"2023-11-24T08:04:54.858649+0000","last_became_peered":"2023-11-24T08:04:54.858649+0000","last_unstale":"2023-11-24T08:04:56.883301+0000","last_undegraded":"2023-11-24T08:04:56.883301+0000","last_fullsized":"2023-11-24T08:04:56.883301+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:17.200762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881903+0000","last_change":"2023-11-24T08:04:55.613204+0000","last_active":"2023-11-24T08:04:56.881903+0000","last_peered":"2023-11-24T08:04:56.881903+0000","last_clean":"2023-11-24T08:04:56.881903+0000","last_became_active":"2023-11-24T08:04:55.612927+0000","last_became_peered":"2023-11-24T08:04:55.612927+0000","last_unstale":"2023-11-24T08:04:56.881903+0000","last_undegraded":"2023-11-24T08:04:56.881903+0000","last_fullsized":"2023-11-24T08:04:56.881903+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:18:48.794555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584456+0000","last_change":"2023-11-24T08:04:54.849649+0000","last_active":"2023-11-24T08:04:56.584456+0000","last_peered":"2023-11-24T08:04:56.584456+0000","last_clean":"2023-11-24T08:04:56.584456+0000","last_became_active":"2023-11-24T08:04:54.849385+0000","last_became_peered":"2023-11-24T08:04:54.849385+0000","last_unstale":"2023-11-24T08:04:56.584456+0000","last_undegraded":"2023-11-24T08:04:56.584456+0000","last_fullsized":"2023-11-24T08:04:56.584456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:07.751883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586736+0000","last_change":"2023-11-24T08:04:55.607316+0000","last_active":"2023-11-24T08:04:56.586736+0000","last_peered":"2023-11-24T08:04:56.586736+0000","last_clean":"2023-11-24T08:04:56.586736+0000","last_became_active":"2023-11-24T08:04:55.606668+0000","last_became_peered":"2023-11-24T08:04:55.606668+0000","last_unstale":"2023-11-24T08:04:56.586736+0000","last_undegraded":"2023-11-24T08:04:56.586736+0000","last_fullsized":"2023-11-24T08:04:56.586736+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:31:28.650507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.886189+0000","last_change":"2023-11-24T08:04:54.860674+0000","last_active":"2023-11-24T08:04:56.886189+0000","last_peered":"2023-11-24T08:04:56.886189+0000","last_clean":"2023-11-24T08:04:56.886189+0000","last_became_active":"2023-11-24T08:04:54.860398+0000","last_became_peered":"2023-11-24T08:04:54.860398+0000","last_unstale":"2023-11-24T08:04:56.886189+0000","last_undegraded":"2023-11-24T08:04:56.886189+0000","last_fullsized":"2023-11-24T08:04:56.886189+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:10.915545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.886183+0000","last_change":"2023-11-24T08:04:55.609283+0000","last_active":"2023-11-24T08:04:56.886183+0000","last_peered":"2023-11-24T08:04:56.886183+0000","last_clean":"2023-11-24T08:04:56.886183+0000","last_became_active":"2023-11-24T08:04:55.608528+0000","last_became_peered":"2023-11-24T08:04:55.608528+0000","last_unstale":"2023-11-24T08:04:56.886183+0000","last_undegraded":"2023-11-24T08:04:56.886183+0000","last_fullsized":"2023-11-24T08:04:56.886183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:50.595558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882750+0000","last_change":"2023-11-24T08:04:54.858502+0000","last_active":"2023-11-24T08:04:56.882750+0000","last_peered":"2023-11-24T08:04:56.882750+0000","last_clean":"2023-11-24T08:04:56.882750+0000","last_became_active":"2023-11-24T08:04:54.857426+0000","last_became_peered":"2023-11-24T08:04:54.857426+0000","last_unstale":"2023-11-24T08:04:56.882750+0000","last_undegraded":"2023-11-24T08:04:56.882750+0000","last_fullsized":"2023-11-24T08:04:56.882750+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:13.127019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883621+0000","last_change":"2023-11-24T08:04:55.605575+0000","last_active":"2023-11-24T08:04:56.883621+0000","last_peered":"2023-11-24T08:04:56.883621+0000","last_clean":"2023-11-24T08:04:56.883621+0000","last_became_active":"2023-11-24T08:04:55.605310+0000","last_became_peered":"2023-11-24T08:04:55.605310+0000","last_unstale":"2023-11-24T08:04:56.883621+0000","last_undegraded":"2023-11-24T08:04:56.883621+0000","last_fullsized":"2023-11-24T08:04:56.883621+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:58.072786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885542+0000","last_change":"2023-11-24T08:04:54.863600+0000","last_active":"2023-11-24T08:04:56.885542+0000","last_peered":"2023-11-24T08:04:56.885542+0000","last_clean":"2023-11-24T08:04:56.885542+0000","last_became_active":"2023-11-24T08:04:54.863298+0000","last_became_peered":"2023-11-24T08:04:54.863298+0000","last_unstale":"2023-11-24T08:04:56.885542+0000","last_undegraded":"2023-11-24T08:04:56.885542+0000","last_fullsized":"2023-11-24T08:04:56.885542+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:14.431071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885240+0000","last_change":"2023-11-24T08:04:55.607999+0000","last_active":"2023-11-24T08:04:56.885240+0000","last_peered":"2023-11-24T08:04:56.885240+0000","last_clean":"2023-11-24T08:04:56.885240+0000","last_became_active":"2023-11-24T08:04:55.607535+0000","last_became_peered":"2023-11-24T08:04:55.607535+0000","last_unstale":"2023-11-24T08:04:56.885240+0000","last_undegraded":"2023-11-24T08:04:56.885240+0000","last_fullsized":"2023-11-24T08:04:56.885240+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:28:16.844936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":18,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.586442+0000","last_change":"2023-11-24T08:04:54.859552+0000","last_active":"2023-11-24T08:04:56.586442+0000","last_peered":"2023-11-24T08:04:56.586442+0000","last_clean":"2023-11-24T08:04:56.586442+0000","last_became_active":"2023-11-24T08:04:54.857574+0000","last_became_peered":"2023-11-24T08:04:54.857574+0000","last_unstale":"2023-11-24T08:04:56.586442+0000","last_undegraded":"2023-11-24T08:04:56.586442+0000","last_fullsized":"2023-11-24T08:04:56.586442+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:00:41.149073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883325+0000","last_change":"2023-11-24T08:04:55.612881+0000","last_active":"2023-11-24T08:04:56.883325+0000","last_peered":"2023-11-24T08:04:56.883325+0000","last_clean":"2023-11-24T08:04:56.883325+0000","last_became_active":"2023-11-24T08:04:55.612453+0000","last_became_peered":"2023-11-24T08:04:55.612453+0000","last_unstale":"2023-11-24T08:04:56.883325+0000","last_undegraded":"2023-11-24T08:04:56.883325+0000","last_fullsized":"2023-11-24T08:04:56.883325+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:30:11.931305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881773+0000","last_change":"2023-11-24T08:04:54.859124+0000","last_active":"2023-11-24T08:04:56.881773+0000","last_peered":"2023-11-24T08:04:56.881773+0000","last_clean":"2023-11-24T08:04:56.881773+0000","last_became_active":"2023-11-24T08:04:54.858138+0000","last_became_peered":"2023-11-24T08:04:54.858138+0000","last_unstale":"2023-11-24T08:04:56.881773+0000","last_undegraded":"2023-11-24T08:04:56.881773+0000","last_fullsized":"2023-11-24T08:04:56.881773+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:25.848782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885133+0000","last_change":"2023-11-24T08:04:55.596442+0000","last_active":"2023-11-24T08:04:56.885133+0000","last_peered":"2023-11-24T08:04:56.885133+0000","last_clean":"2023-11-24T08:04:56.885133+0000","last_became_active":"2023-11-24T08:04:55.594602+0000","last_became_peered":"2023-11-24T08:04:55.594602+0000","last_unstale":"2023-11-24T08:04:56.885133+0000","last_undegraded":"2023-11-24T08:04:56.885133+0000","last_fullsized":"2023-11-24T08:04:56.885133+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:16:17.110960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585199+0000","last_change":"2023-11-24T08:04:54.856809+0000","last_active":"2023-11-24T08:04:56.585199+0000","last_peered":"2023-11-24T08:04:56.585199+0000","last_clean":"2023-11-24T08:04:56.585199+0000","last_became_active":"2023-11-24T08:04:54.855624+0000","last_became_peered":"2023-11-24T08:04:54.855624+0000","last_unstale":"2023-11-24T08:04:56.585199+0000","last_undegraded":"2023-11-24T08:04:56.585199+0000","last_fullsized":"2023-11-24T08:04:56.585199+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:03:31.248495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584090+0000","last_change":"2023-11-24T08:04:55.601170+0000","last_active":"2023-11-24T08:04:56.584090+0000","last_peered":"2023-11-24T08:04:56.584090+0000","last_clean":"2023-11-24T08:04:56.584090+0000","last_became_active":"2023-11-24T08:04:55.600899+0000","last_became_peered":"2023-11-24T08:04:55.600899+0000","last_unstale":"2023-11-24T08:04:56.584090+0000","last_undegraded":"2023-11-24T08:04:56.584090+0000","last_fullsized":"2023-11-24T08:04:56.584090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:56:43.790910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883286+0000","last_change":"2023-11-24T08:04:54.861553+0000","last_active":"2023-11-24T08:04:56.883286+0000","last_peered":"2023-11-24T08:04:56.883286+0000","last_clean":"2023-11-24T08:04:56.883286+0000","last_became_active":"2023-11-24T08:04:54.861210+0000","last_became_peered":"2023-11-24T08:04:54.861210+0000","last_unstale":"2023-11-24T08:04:56.883286+0000","last_undegraded":"2023-11-24T08:04:56.883286+0000","last_fullsized":"2023-11-24T08:04:56.883286+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:19:34.388911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884272+0000","last_change":"2023-11-24T08:04:55.606219+0000","last_active":"2023-11-24T08:04:56.884272+0000","last_peered":"2023-11-24T08:04:56.884272+0000","last_clean":"2023-11-24T08:04:56.884272+0000","last_became_active":"2023-11-24T08:04:55.605591+0000","last_became_peered":"2023-11-24T08:04:55.605591+0000","last_unstale":"2023-11-24T08:04:56.884272+0000","last_undegraded":"2023-11-24T08:04:56.884272+0000","last_fullsized":"2023-11-24T08:04:56.884272+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:53.546588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":20,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883861+0000","last_change":"2023-11-24T08:04:54.861222+0000","last_active":"2023-11-24T08:04:56.883861+0000","last_peered":"2023-11-24T08:04:56.883861+0000","last_clean":"2023-11-24T08:04:56.883861+0000","last_became_active":"2023-11-24T08:04:54.860908+0000","last_became_peered":"2023-11-24T08:04:54.860908+0000","last_unstale":"2023-11-24T08:04:56.883861+0000","last_undegraded":"2023-11-24T08:04:56.883861+0000","last_fullsized":"2023-11-24T08:04:56.883861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:43:34.575292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885972+0000","last_change":"2023-11-24T08:04:55.602372+0000","last_active":"2023-11-24T08:04:56.885972+0000","last_peered":"2023-11-24T08:04:56.885972+0000","last_clean":"2023-11-24T08:04:56.885972+0000","last_became_active":"2023-11-24T08:04:55.602064+0000","last_became_peered":"2023-11-24T08:04:55.602064+0000","last_unstale":"2023-11-24T08:04:56.885972+0000","last_undegraded":"2023-11-24T08:04:56.885972+0000","last_fullsized":"2023-11-24T08:04:56.885972+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:09:26.864541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882887+0000","last_change":"2023-11-24T08:04:54.858353+0000","last_active":"2023-11-24T08:04:56.882887+0000","last_peered":"2023-11-24T08:04:56.882887+0000","last_clean":"2023-11-24T08:04:56.882887+0000","last_became_active":"2023-11-24T08:04:54.858015+0000","last_became_peered":"2023-11-24T08:04:54.858015+0000","last_unstale":"2023-11-24T08:04:56.882887+0000","last_undegraded":"2023-11-24T08:04:56.882887+0000","last_fullsized":"2023-11-24T08:04:56.882887+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:09:12.779918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884035+0000","last_change":"2023-11-24T08:04:55.612010+0000","last_active":"2023-11-24T08:04:56.884035+0000","last_peered":"2023-11-24T08:04:56.884035+0000","last_clean":"2023-11-24T08:04:56.884035+0000","last_became_active":"2023-11-24T08:04:55.611234+0000","last_became_peered":"2023-11-24T08:04:55.611234+0000","last_unstale":"2023-11-24T08:04:56.884035+0000","last_undegraded":"2023-11-24T08:04:56.884035+0000","last_fullsized":"2023-11-24T08:04:56.884035+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T19:30:27.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584234+0000","last_change":"2023-11-24T08:04:54.859465+0000","last_active":"2023-11-24T08:04:56.584234+0000","last_peered":"2023-11-24T08:04:56.584234+0000","last_clean":"2023-11-24T08:04:56.584234+0000","last_became_active":"2023-11-24T08:04:54.858849+0000","last_became_peered":"2023-11-24T08:04:54.858849+0000","last_unstale":"2023-11-24T08:04:56.584234+0000","last_undegraded":"2023-11-24T08:04:56.584234+0000","last_fullsized":"2023-11-24T08:04:56.584234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:27:12.786072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882610+0000","last_change":"2023-11-24T08:04:55.610104+0000","last_active":"2023-11-24T08:04:56.882610+0000","last_peered":"2023-11-24T08:04:56.882610+0000","last_clean":"2023-11-24T08:04:56.882610+0000","last_became_active":"2023-11-24T08:04:55.609815+0000","last_became_peered":"2023-11-24T08:04:55.609815+0000","last_unstale":"2023-11-24T08:04:56.882610+0000","last_undegraded":"2023-11-24T08:04:56.882610+0000","last_fullsized":"2023-11-24T08:04:56.882610+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:25.598860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884066+0000","last_change":"2023-11-24T08:04:54.857386+0000","last_active":"2023-11-24T08:04:56.884066+0000","last_peered":"2023-11-24T08:04:56.884066+0000","last_clean":"2023-11-24T08:04:56.884066+0000","last_became_active":"2023-11-24T08:04:54.857107+0000","last_became_peered":"2023-11-24T08:04:54.857107+0000","last_unstale":"2023-11-24T08:04:56.884066+0000","last_undegraded":"2023-11-24T08:04:56.884066+0000","last_fullsized":"2023-11-24T08:04:56.884066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:33:14.431071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885456+0000","last_change":"2023-11-24T08:04:55.597693+0000","last_active":"2023-11-24T08:04:56.885456+0000","last_peered":"2023-11-24T08:04:56.885456+0000","last_clean":"2023-11-24T08:04:56.885456+0000","last_became_active":"2023-11-24T08:04:55.597375+0000","last_became_peered":"2023-11-24T08:04:55.597375+0000","last_unstale":"2023-11-24T08:04:56.885456+0000","last_undegraded":"2023-11-24T08:04:56.885456+0000","last_fullsized":"2023-11-24T08:04:56.885456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:35:42.999218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583955+0000","last_change":"2023-11-24T08:04:54.861376+0000","last_active":"2023-11-24T08:04:56.583955+0000","last_peered":"2023-11-24T08:04:56.583955+0000","last_clean":"2023-11-24T08:04:56.583955+0000","last_became_active":"2023-11-24T08:04:54.860420+0000","last_became_peered":"2023-11-24T08:04:54.860420+0000","last_unstale":"2023-11-24T08:04:56.583955+0000","last_undegraded":"2023-11-24T08:04:56.583955+0000","last_fullsized":"2023-11-24T08:04:56.583955+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:30.531126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883638+0000","last_change":"2023-11-24T08:04:55.611019+0000","last_active":"2023-11-24T08:04:56.883638+0000","last_peered":"2023-11-24T08:04:56.883638+0000","last_clean":"2023-11-24T08:04:56.883638+0000","last_became_active":"2023-11-24T08:04:55.610580+0000","last_became_peered":"2023-11-24T08:04:55.610580+0000","last_unstale":"2023-11-24T08:04:56.883638+0000","last_undegraded":"2023-11-24T08:04:56.883638+0000","last_fullsized":"2023-11-24T08:04:56.883638+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:14:57.434719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882049+0000","last_change":"2023-11-24T08:04:54.855231+0000","last_active":"2023-11-24T08:04:56.882049+0000","last_peered":"2023-11-24T08:04:56.882049+0000","last_clean":"2023-11-24T08:04:56.882049+0000","last_became_active":"2023-11-24T08:04:54.854977+0000","last_became_peered":"2023-11-24T08:04:54.854977+0000","last_unstale":"2023-11-24T08:04:56.882049+0000","last_undegraded":"2023-11-24T08:04:56.882049+0000","last_fullsized":"2023-11-24T08:04:56.882049+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:53:49.579798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583508+0000","last_change":"2023-11-24T08:04:55.612930+0000","last_active":"2023-11-24T08:04:56.583508+0000","last_peered":"2023-11-24T08:04:56.583508+0000","last_clean":"2023-11-24T08:04:56.583508+0000","last_became_active":"2023-11-24T08:04:55.612664+0000","last_became_peered":"2023-11-24T08:04:55.612664+0000","last_unstale":"2023-11-24T08:04:56.583508+0000","last_undegraded":"2023-11-24T08:04:56.583508+0000","last_fullsized":"2023-11-24T08:04:56.583508+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:45:04.732080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883560+0000","last_change":"2023-11-24T08:04:54.851596+0000","last_active":"2023-11-24T08:04:56.883560+0000","last_peered":"2023-11-24T08:04:56.883560+0000","last_clean":"2023-11-24T08:04:56.883560+0000","last_became_active":"2023-11-24T08:04:54.851315+0000","last_became_peered":"2023-11-24T08:04:54.851315+0000","last_unstale":"2023-11-24T08:04:56.883560+0000","last_undegraded":"2023-11-24T08:04:56.883560+0000","last_fullsized":"2023-11-24T08:04:56.883560+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:04:47.864227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.583420+0000","last_change":"2023-11-24T08:04:55.608339+0000","last_active":"2023-11-24T08:04:56.583420+0000","last_peered":"2023-11-24T08:04:56.583420+0000","last_clean":"2023-11-24T08:04:56.583420+0000","last_became_active":"2023-11-24T08:04:55.608024+0000","last_became_peered":"2023-11-24T08:04:55.608024+0000","last_unstale":"2023-11-24T08:04:56.583420+0000","last_undegraded":"2023-11-24T08:04:56.583420+0000","last_fullsized":"2023-11-24T08:04:56.583420+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:47:27.419732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883068+0000","last_change":"2023-11-24T08:04:54.859934+0000","last_active":"2023-11-24T08:04:56.883068+0000","last_peered":"2023-11-24T08:04:56.883068+0000","last_clean":"2023-11-24T08:04:56.883068+0000","last_became_active":"2023-11-24T08:04:54.859687+0000","last_became_peered":"2023-11-24T08:04:54.859687+0000","last_unstale":"2023-11-24T08:04:56.883068+0000","last_undegraded":"2023-11-24T08:04:56.883068+0000","last_fullsized":"2023-11-24T08:04:56.883068+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:54:52.250794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884814+0000","last_change":"2023-11-24T08:04:55.611621+0000","last_active":"2023-11-24T08:04:56.884814+0000","last_peered":"2023-11-24T08:04:56.884814+0000","last_clean":"2023-11-24T08:04:56.884814+0000","last_became_active":"2023-11-24T08:04:55.611295+0000","last_became_peered":"2023-11-24T08:04:55.611295+0000","last_unstale":"2023-11-24T08:04:56.884814+0000","last_undegraded":"2023-11-24T08:04:56.884814+0000","last_fullsized":"2023-11-24T08:04:56.884814+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:54:33.387959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884097+0000","last_change":"2023-11-24T08:04:54.845716+0000","last_active":"2023-11-24T08:04:56.884097+0000","last_peered":"2023-11-24T08:04:56.884097+0000","last_clean":"2023-11-24T08:04:56.884097+0000","last_became_active":"2023-11-24T08:04:54.845439+0000","last_became_peered":"2023-11-24T08:04:54.845439+0000","last_unstale":"2023-11-24T08:04:56.884097+0000","last_undegraded":"2023-11-24T08:04:56.884097+0000","last_fullsized":"2023-11-24T08:04:56.884097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:14:44.417362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.884347+0000","last_change":"2023-11-24T08:04:55.612971+0000","last_active":"2023-11-24T08:04:56.884347+0000","last_peered":"2023-11-24T08:04:56.884347+0000","last_clean":"2023-11-24T08:04:56.884347+0000","last_became_active":"2023-11-24T08:04:55.612333+0000","last_became_peered":"2023-11-24T08:04:55.612333+0000","last_unstale":"2023-11-24T08:04:56.884347+0000","last_undegraded":"2023-11-24T08:04:56.884347+0000","last_fullsized":"2023-11-24T08:04:56.884347+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:13:34.879373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584462+0000","last_change":"2023-11-24T08:04:54.854110+0000","last_active":"2023-11-24T08:04:56.584462+0000","last_peered":"2023-11-24T08:04:56.584462+0000","last_clean":"2023-11-24T08:04:56.584462+0000","last_became_active":"2023-11-24T08:04:54.853837+0000","last_became_peered":"2023-11-24T08:04:54.853837+0000","last_unstale":"2023-11-24T08:04:56.584462+0000","last_undegraded":"2023-11-24T08:04:56.584462+0000","last_fullsized":"2023-11-24T08:04:56.584462+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:34:08.767405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883529+0000","last_change":"2023-11-24T08:04:55.605052+0000","last_active":"2023-11-24T08:04:56.883529+0000","last_peered":"2023-11-24T08:04:56.883529+0000","last_clean":"2023-11-24T08:04:56.883529+0000","last_became_active":"2023-11-24T08:04:55.604774+0000","last_became_peered":"2023-11-24T08:04:55.604774+0000","last_unstale":"2023-11-24T08:04:56.883529+0000","last_undegraded":"2023-11-24T08:04:56.883529+0000","last_fullsized":"2023-11-24T08:04:56.883529+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:48:08.767642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585069+0000","last_change":"2023-11-24T08:04:54.855749+0000","last_active":"2023-11-24T08:04:56.585069+0000","last_peered":"2023-11-24T08:04:56.585069+0000","last_clean":"2023-11-24T08:04:56.585069+0000","last_became_active":"2023-11-24T08:04:54.855430+0000","last_became_peered":"2023-11-24T08:04:54.855430+0000","last_unstale":"2023-11-24T08:04:56.585069+0000","last_undegraded":"2023-11-24T08:04:56.585069+0000","last_fullsized":"2023-11-24T08:04:56.585069+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:07:36.035448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584589+0000","last_change":"2023-11-24T08:04:55.615156+0000","last_active":"2023-11-24T08:04:56.584589+0000","last_peered":"2023-11-24T08:04:56.584589+0000","last_clean":"2023-11-24T08:04:56.584589+0000","last_became_active":"2023-11-24T08:04:55.613741+0000","last_became_peered":"2023-11-24T08:04:55.613741+0000","last_unstale":"2023-11-24T08:04:56.584589+0000","last_undegraded":"2023-11-24T08:04:56.584589+0000","last_fullsized":"2023-11-24T08:04:56.584589+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:03:06.998042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885335+0000","last_change":"2023-11-24T08:04:54.864157+0000","last_active":"2023-11-24T08:04:56.885335+0000","last_peered":"2023-11-24T08:04:56.885335+0000","last_clean":"2023-11-24T08:04:56.885335+0000","last_became_active":"2023-11-24T08:04:54.863791+0000","last_became_peered":"2023-11-24T08:04:54.863791+0000","last_unstale":"2023-11-24T08:04:56.885335+0000","last_undegraded":"2023-11-24T08:04:56.885335+0000","last_fullsized":"2023-11-24T08:04:56.885335+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:02:43.592097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882263+0000","last_change":"2023-11-24T08:04:55.608436+0000","last_active":"2023-11-24T08:04:56.882263+0000","last_peered":"2023-11-24T08:04:56.882263+0000","last_clean":"2023-11-24T08:04:56.882263+0000","last_became_active":"2023-11-24T08:04:55.607682+0000","last_became_peered":"2023-11-24T08:04:55.607682+0000","last_unstale":"2023-11-24T08:04:56.882263+0000","last_undegraded":"2023-11-24T08:04:56.882263+0000","last_fullsized":"2023-11-24T08:04:56.882263+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:08.487156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883373+0000","last_change":"2023-11-24T08:04:54.859429+0000","last_active":"2023-11-24T08:04:56.883373+0000","last_peered":"2023-11-24T08:04:56.883373+0000","last_clean":"2023-11-24T08:04:56.883373+0000","last_became_active":"2023-11-24T08:04:54.857860+0000","last_became_peered":"2023-11-24T08:04:54.857860+0000","last_unstale":"2023-11-24T08:04:56.883373+0000","last_undegraded":"2023-11-24T08:04:56.883373+0000","last_fullsized":"2023-11-24T08:04:56.883373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:37:39.003851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.885243+0000","last_change":"2023-11-24T08:04:55.606575+0000","last_active":"2023-11-24T08:04:56.885243+0000","last_peered":"2023-11-24T08:04:56.885243+0000","last_clean":"2023-11-24T08:04:56.885243+0000","last_became_active":"2023-11-24T08:04:55.606221+0000","last_became_peered":"2023-11-24T08:04:55.606221+0000","last_unstale":"2023-11-24T08:04:56.885243+0000","last_undegraded":"2023-11-24T08:04:56.885243+0000","last_fullsized":"2023-11-24T08:04:56.885243+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:44:28.473876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.585963+0000","last_change":"2023-11-24T08:04:54.860130+0000","last_active":"2023-11-24T08:04:56.585963+0000","last_peered":"2023-11-24T08:04:56.585963+0000","last_clean":"2023-11-24T08:04:56.585963+0000","last_became_active":"2023-11-24T08:04:54.859857+0000","last_became_peered":"2023-11-24T08:04:54.859857+0000","last_unstale":"2023-11-24T08:04:56.585963+0000","last_undegraded":"2023-11-24T08:04:56.585963+0000","last_fullsized":"2023-11-24T08:04:56.585963+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:57.057027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883351+0000","last_change":"2023-11-24T08:04:55.607548+0000","last_active":"2023-11-24T08:04:56.883351+0000","last_peered":"2023-11-24T08:04:56.883351+0000","last_clean":"2023-11-24T08:04:56.883351+0000","last_became_active":"2023-11-24T08:04:55.607258+0000","last_became_peered":"2023-11-24T08:04:55.607258+0000","last_unstale":"2023-11-24T08:04:56.883351+0000","last_undegraded":"2023-11-24T08:04:56.883351+0000","last_fullsized":"2023-11-24T08:04:56.883351+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:51:51.354283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.883206+0000","last_change":"2023-11-24T08:04:54.851447+0000","last_active":"2023-11-24T08:04:56.883206+0000","last_peered":"2023-11-24T08:04:56.883206+0000","last_clean":"2023-11-24T08:04:56.883206+0000","last_became_active":"2023-11-24T08:04:54.850700+0000","last_became_peered":"2023-11-24T08:04:54.850700+0000","last_unstale":"2023-11-24T08:04:56.883206+0000","last_undegraded":"2023-11-24T08:04:56.883206+0000","last_fullsized":"2023-11-24T08:04:56.883206+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:44:59.111965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.881988+0000","last_change":"2023-11-24T08:04:55.612200+0000","last_active":"2023-11-24T08:04:56.881988+0000","last_peered":"2023-11-24T08:04:56.881988+0000","last_clean":"2023-11-24T08:04:56.881988+0000","last_became_active":"2023-11-24T08:04:55.611776+0000","last_became_peered":"2023-11-24T08:04:55.611776+0000","last_unstale":"2023-11-24T08:04:56.881988+0000","last_undegraded":"2023-11-24T08:04:56.881988+0000","last_fullsized":"2023-11-24T08:04:56.881988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:19:23.406786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882233+0000","last_change":"2023-11-24T08:04:54.858349+0000","last_active":"2023-11-24T08:04:56.882233+0000","last_peered":"2023-11-24T08:04:56.882233+0000","last_clean":"2023-11-24T08:04:56.882233+0000","last_became_active":"2023-11-24T08:04:54.857326+0000","last_became_peered":"2023-11-24T08:04:54.857326+0000","last_unstale":"2023-11-24T08:04:56.882233+0000","last_undegraded":"2023-11-24T08:04:56.882233+0000","last_fullsized":"2023-11-24T08:04:56.882233+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:15:20.555084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.882264+0000","last_change":"2023-11-24T08:04:55.603156+0000","last_active":"2023-11-24T08:04:56.882264+0000","last_peered":"2023-11-24T08:04:56.882264+0000","last_clean":"2023-11-24T08:04:56.882264+0000","last_became_active":"2023-11-24T08:04:55.602693+0000","last_became_peered":"2023-11-24T08:04:55.602693+0000","last_unstale":"2023-11-24T08:04:56.882264+0000","last_undegraded":"2023-11-24T08:04:56.882264+0000","last_fullsized":"2023-11-24T08:04:56.882264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:54.819600+0000","last_clean_scrub_stamp":"2023-11-24T08:04:54.819600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:34:03.991836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-11-24T08:04:56.584762+0000","last_change":"2023-11-24T08:04:54.860055+0000","last_active":"2023-11-24T08:04:56.584762+0000","last_peered":"2023-11-24T08:04:56.584762+0000","last_clean":"2023-11-24T08:04:56.584762+0000","last_became_active":"2023-11-24T08:04:54.859767+0000","last_became_peered":"2023-11-24T08:04:54.859767+0000","last_unstale":"2023-11-24T08:04:56.584762+0000","last_undegraded":"2023-11-24T08:04:56.584762+0000","last_fullsized":"2023-11-24T08:04:56.584762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:04:53.803841+0000","last_clean_scrub_stamp":"2023-11-24T08:04:53.803841+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:45:19.532110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":199,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-11-24T08:04:55.579909+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:04:55.579909+0000","last_peered":"2023-11-24T08:04:55.579909+0000","last_clean":"2023-11-24T08:04:55.579909+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:04:55.579909+0000","last_undegraded":"2023-11-24T08:04:55.579909+0000","last_fullsized":"2023-11-24T08:04:55.579909+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":887239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.135},"min":{"1min":0.73199999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.474,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.496},{"interface":"front","average":{"1min":1.141,"5min":1.087,"15min":1.0549999999999999},"min":{"1min":0.84799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4950000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.5189999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1699999999999999,"15min":1.1639999999999999},"min":{"1min":0.86599999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6719999999999999,"5min":1.929,"15min":1.929},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.181,"15min":1.194},"min":{"1min":0.94199999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5700000000000001,"5min":2.02,"15min":2.02},"last":1.044}]},{"osd":2,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.169,"15min":1.125},"min":{"1min":0.92200000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.429,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.1539999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7450000000000001,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.605}]},{"osd":3,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.244,"15min":1.1779999999999999},"min":{"1min":1.087,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.706,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.419,"15min":1.415},"min":{"1min":1.0629999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.768,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.8129999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":1.05,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6120000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.389},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.0880000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.861,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.446}]},{"osd":5,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4970000000000001,"15min":1.542},"min":{"1min":1.1060000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6890000000000001,"5min":2.504,"15min":2.504},"last":1.738},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5049999999999999,"15min":1.528},"min":{"1min":1.2370000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.7390000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.655}]},{"osd":6,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5960000000000001,"15min":1.6020000000000001},"min":{"1min":1.2729999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3479999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.766},{"interface":"front","average":{"1min":1.51,"5min":1.5329999999999999,"15min":1.526},"min":{"1min":1.3440000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.984,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.7070000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":696,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":712704,"data_stored":296711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.012,"15min":0.95399999999999996},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4810000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.212,"5min":1.087,"15min":1.0629999999999999},"min":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.528,"5min":1.593,"15min":1.593},"last":1.0720000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2250000000000001,"15min":1.204},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.622},"max":{"1min":1.6850000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7350000000000001,"5min":2.597,"15min":2.597},"last":1.373}]},{"osd":2,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1859999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4930000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.87},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2869999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":2.831,"15min":2.831},"last":1.502}]},{"osd":3,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.92400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.478,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8069999999999999,"5min":1.974,"15min":1.974},"last":1.204}]},{"osd":4,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5740000000000001,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.337,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.573,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2609999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.518,"15min":1.571},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6439999999999999,"5min":2.105,"15min":2.105},"last":1.625},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5009999999999999,"15min":1.5249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5940000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.528,"15min":1.5920000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7050000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5329999999999999,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.8640000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.4179999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31892,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339948,"statfs":{"total":96636764160,"available":96604106752,"internally_reserved":0,"allocated":720896,"data_stored":297363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.1140000000000001,"15min":1.0840000000000001},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.589,"5min":2.431,"15min":2.431},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.093,"15min":1.0369999999999999},"min":{"1min":0.871,"5min":0.63,"15min":0.63},"max":{"1min":1.4670000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.98199999999999998}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.464,"5min":1.653,"15min":1.653},"last":0.877},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.80000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.258}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.88100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.77900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5860000000000001,"5min":1.768,"15min":1.768},"last":1.2030000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3029999999999999,"15min":1.3400000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7889999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.3340000000000001},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.7849999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2889999999999999,"15min":1.3560000000000001},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8260000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.7290000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.401,"15min":1.4990000000000001},"min":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9019999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.881}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3979999999999999,"15min":1.4279999999999999},"min":{"1min":0.94399999999999995,"5min":0.629,"15min":0.629},"max":{"1min":2.0209999999999999,"5min":2.569,"15min":2.569},"last":1.919},{"interface":"front","average":{"1min":1.363,"5min":1.464,"15min":1.522},"min":{"1min":1.0049999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7270000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.6399999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.5529999999999999,"15min":1.675},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.948,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5580000000000001,"15min":1.5760000000000001},"min":{"1min":0.86599999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.9850000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":720896,"data_stored":296767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.628,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1020000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.82699999999999996},"min":{"1min":0.73199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.202,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.02,"15min":0.97499999999999998},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.45,"5min":1.871,"15min":1.871},"last":0.91800000000000004}]},{"osd":2,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.056,"15min":1.034},"min":{"1min":0.60399999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.377},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0960000000000001,"15min":1.0289999999999999},"min":{"1min":0.69999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.3129999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.91300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6419999999999999,"5min":1.875,"15min":1.875},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.262,"15min":1.204},"min":{"1min":1.127,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7430000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.6040000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3380000000000001,"15min":1.296},"min":{"1min":1.1519999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.8180000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.264},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.27},"min":{"1min":1.161,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7270000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.5629999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.298,"15min":1.26},"min":{"1min":1.208,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.776,"5min":1.861,"15min":1.861},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.421,"15min":1.3819999999999999},"min":{"1min":1.254,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.742,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.4850000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.393,"15min":1.325},"min":{"1min":1.234,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7330000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.3480000000000001,"15min":1.288},"min":{"1min":1.2390000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.788,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.6779999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":720896,"data_stored":296767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90200000000000002,"15min":0.99199999999999999},"min":{"1min":0.64100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.175,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.127,"5min":0.96499999999999997,"15min":0.89000000000000001},"min":{"1min":0.77200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5369999999999999,"5min":3.343,"15min":3.343},"last":0.80600000000000005}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.069,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.72399999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4550000000000001,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":0.93899999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0589999999999999,"15min":1.002},"min":{"1min":0.87,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4490000000000001,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":1.4490000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4930000000000001,"15min":1.518},"min":{"1min":1.218,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.9199999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":1.343},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5109999999999999,"15min":1.569},"min":{"1min":1.0149999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7889999999999999,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":1.958}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4199999999999999,"15min":1.504},"min":{"1min":1.167,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9159999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.897},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.448,"15min":1.3580000000000001},"min":{"1min":1.109,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9810000000000001,"5min":12.798,"15min":12.798},"last":1.859}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4630000000000001,"15min":1.415},"min":{"1min":1.1319999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.9159999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4850000000000001,"15min":1.585},"min":{"1min":1.1930000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0190000000000001,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.8080000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.4810000000000001,"15min":1.423},"min":{"1min":1.1180000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0369999999999999,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":1.766},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5049999999999999,"15min":1.5840000000000001},"min":{"1min":0.98499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0569999999999999,"5min":6.399,"15min":6.399},"last":1.5860000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542204,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31888,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339952,"statfs":{"total":96636764160,"available":96604110848,"internally_reserved":0,"allocated":724992,"data_stored":298323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.0820000000000001,"15min":1.0960000000000001},"min":{"1min":0.79000000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.0640000000000001,"15min":1.1080000000000001},"min":{"1min":0.68400000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.234,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1599999999999999,"15min":1.1579999999999999},"min":{"1min":0.78500000000000003,"5min":0.621,"15min":0.621},"max":{"1min":1.615,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.1819999999999999,"15min":1.226},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5089999999999999,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"min":{"1min":0.88800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.383,"5min":1.3839999999999999,"15min":1.4319999999999999},"min":{"1min":0.91000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9419999999999999,"5min":1.966,"15min":1.966},"last":1.1799999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.82799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3480000000000001,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7270000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.347}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4179999999999999,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6000000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.242},{"interface":"front","average":{"1min":1.472,"5min":1.508,"15min":1.512},"min":{"1min":1.1180000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.857,"5min":2.073,"15min":2.073},"last":1.298}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.448,"15min":1.528},"min":{"1min":1.131,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6379999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.502},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.51,"15min":1.5940000000000001},"min":{"1min":1.05,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.468}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.5469999999999999,"15min":1.5920000000000001},"min":{"1min":0.91000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0259999999999998,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6779999999999999},"min":{"1min":1.274,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.8280000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.5820000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542202,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":296801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.60799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.556,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.996},{"interface":"front","average":{"1min":1.032,"5min":0.93999999999999995,"15min":0.999},"min":{"1min":0.70099999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.369,"5min":3.266,"15min":3.266},"last":1.284}]},{"osd":2,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.72399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3109999999999999,"5min":1.706,"15min":1.706},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.82899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4259999999999999,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.131}]},{"osd":3,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.169,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.825,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.498},{"interface":"front","average":{"1min":1.173,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.91100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.649,"5min":1.976,"15min":1.976},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3300000000000001,"15min":1.472},"min":{"1min":0.98099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.552,"5min":4.367,"15min":4.367},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.375,"15min":1.4339999999999999},"min":{"1min":1.0840000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0790000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.3320000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3999999999999999,"15min":1.54},"min":{"1min":1.1180000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6599999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.405},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.46,"15min":1.4950000000000001},"min":{"1min":1.274,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1459999999999999,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.5629999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.395},"min":{"1min":1.103,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.917,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5409999999999999,"15min":1.643},"min":{"1min":1.3069999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.875,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.5229999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3979999999999999,"15min":1.4319999999999999},"min":{"1min":1.131,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7849999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.591},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5329999999999999,"15min":1.663},"min":{"1min":1.1559999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7929999999999999,"5min":4.452,"15min":4.452},"last":1.6240000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542203,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28316,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343524,"statfs":{"total":96636764160,"available":96607768576,"internally_reserved":0,"allocated":1323008,"data_stored":889273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.64700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1930000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.878,"15min":0.89200000000000002},"min":{"1min":0.65500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.2250000000000001,"5min":1.46,"15min":1.46},"last":0.69799999999999995}]},{"osd":2,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3360000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.038},"min":{"1min":0.85199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0669999999999999},"min":{"1min":0.99399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5329999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1699999999999999,"15min":1.1299999999999999},"min":{"1min":1.0940000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:20 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.244,"15min":1.234},"min":{"1min":0.99199999999999999,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.698,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.397},{"interface":"front","average":{"1min":1.377,"5min":1.3120000000000001,"15min":1.3280000000000001},"min":{"1min":1.04,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.8899999999999999,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.2190000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4390000000000001,"15min":1.4970000000000001},"min":{"1min":1.1890000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0680000000000001,"5min":2.839,"15min":2.839},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3620000000000001,"15min":1.387},"min":{"1min":1.2569999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6539999999999999,"5min":2.823,"15min":2.823},"last":1.0760000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.333,"15min":1.351},"min":{"1min":1.0609999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.552,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.137},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":1.089,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9730000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.5580000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4630000000000001,"15min":1.51},"min":{"1min":1.1739999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.891,"5min":2.875,"15min":2.875},"last":1.28},{"interface":"front","average":{"1min":1.335,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.7669999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.726}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:00.826 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T08:05:00.826 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.078+0000 7ff0d4333640 1 Processor -- start 2023-11-24T08:05:01.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.078+0000 7ff0d4333640 1 -- start start 2023-11-24T08:05:01.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.079+0000 7ff0d4333640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 0x7ff0cc141360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.079+0000 7ff0d4333640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff0cc15f100 0x7ff0cc0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d4333640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0cc13e440 con 0x7ff0cc0cdcc0 2023-11-24T08:05:01.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d4333640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0cc0ce1d0 con 0x7ff0cc15f100 2023-11-24T08:05:01.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d4333640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0ce4b0 con 0x7ff0cc15ed20 2023-11-24T08:05:01.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d28d0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff0cc0cdcc0 0x7ff0cc15b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40780/0 (socket says 172.21.15.161:40780) 2023-11-24T08:05:01.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d28d0640 1 -- 172.21.15.161:0/358951720 learned_addr learned my addr 172.21.15.161:0/358951720 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:01.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d18ce640 1 --2- 172.21.15.161:0/358951720 >> v2:172.21.15.175:3300/0 conn(0x7ff0cc15f100 0x7ff0cc0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 0x7ff0cc141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689587740 0 0) 0x7ff0cc13e440 con 0x7ff0cc0cdcc0 2023-11-24T08:05:01.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.080+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b8003520 con 0x7ff0cc0cdcc0 2023-11-24T08:05:01.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1735428546 0 0) 0x7ff0b8003520 con 0x7ff0cc0cdcc0 2023-11-24T08:05:01.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 msgr2=0x7ff0cc141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 0x7ff0cc141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 >> v2:172.21.15.175:3300/0 conn(0x7ff0cc15f100 msgr2=0x7ff0cc0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 --2- 172.21.15.161:0/358951720 >> v2:172.21.15.175:3300/0 conn(0x7ff0cc15f100 0x7ff0cc0cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc0ce790 con 0x7ff0cc0cdcc0 2023-11-24T08:05:01.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7ff0c40019f0 con 0x7ff0cc0cdcc0 2023-11-24T08:05:01.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 >> v1:172.21.15.161:6789/0 conn(0x7ff0cc0cdcc0 legacy=0x7ff0cc15b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8003970 0x7ff0b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 0x7ff0b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8004d00 0x7ff0b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0ce1d0 con 0x7ff0b8003970 2023-11-24T08:05:01.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc0ce4b0 con 0x7ff0b8004d00 2023-11-24T08:05:01.094 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b800b9b0 con 0x7ff0cc15ed20 2023-11-24T08:05:01.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8003970 0x7ff0b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.081+0000 7ff0d18ce640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 0x7ff0b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.082+0000 7ff0d20cf640 1 -- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 msgr2=0x7ff0b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.082+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15ed20 0x7ff0b80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.082+0000 7ff0d28d0640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8004d00 0x7ff0b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.095 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.082+0000 7ff0d20cf640 1 -- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8004d00 msgr2=0x7ff0b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.082+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8004d00 0x7ff0b8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.082+0000 7ff0d20cf640 1 -- 172.21.15.161:0/358951720 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b8003520 con 0x7ff0b8003970 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.083+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8003970 0x7ff0b8003d90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009ac0 tx=0x7ff0b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c5df1fea603a50 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.083+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c802c6b0 con 0x7ff0b8003970 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.083+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c802c810 con 0x7ff0b8003970 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.083+0000 7ff0d10cd640 1 -- 172.21.15.161:0/358951720 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c802cba0 con 0x7ff0b8003970 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.083+0000 7ff0d4333640 1 -- 172.21.15.161:0/358951720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8003970 msgr2=0x7ff0b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.083+0000 7ff0d4333640 1 --2- 172.21.15.161:0/358951720 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0b8003970 0x7ff0b8003d90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009ac0 tx=0x7ff0b80057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.084+0000 7ff0d28d0640 1 -- 172.21.15.161:0/358951720 reap_dead start 2023-11-24T08:05:01.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.084+0000 7ff0d4333640 1 -- 172.21.15.161:0/358951720 shutdown_connections 2023-11-24T08:05:01.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.084+0000 7ff0d4333640 1 -- 172.21.15.161:0/358951720 >> 172.21.15.161:0/358951720 conn(0x7ff0cc0b0be0 msgr2=0x7ff0cc0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.084+0000 7ff0d4333640 1 -- 172.21.15.161:0/358951720 shutdown_connections 2023-11-24T08:05:01.097 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.084+0000 7ff0d4333640 1 -- 172.21.15.161:0/358951720 wait complete. 2023-11-24T08:05:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.085+0000 7ff0d4333640 1 Processor -- start 2023-11-24T08:05:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.086+0000 7ff0d4333640 1 -- start start 2023-11-24T08:05:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.086+0000 7ff0d4333640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8003970 0x7ff0cc152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d4333640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15cca0 0x7ff0cc070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d4333640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 0x7ff0cc137cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d4333640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc152640 con 0x7ff0cc137870 2023-11-24T08:05:01.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d4333640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc138230 con 0x7ff0b8003970 2023-11-24T08:05:01.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d4333640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0cc071da0 con 0x7ff0cc15cca0 2023-11-24T08:05:01.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 0x7ff0cc137cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 0x7ff0cc137cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48364/0 (socket says 172.21.15.161:48364) 2023-11-24T08:05:01.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 -- 172.21.15.161:0/2668492076 learned_addr learned my addr 172.21.15.161:0/2668492076 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8003970 0x7ff0cc152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 -- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15cca0 msgr2=0x7ff0cc070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15cca0 0x7ff0cc070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 -- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8003970 msgr2=0x7ff0cc152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8003970 0x7ff0cc152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 -- 172.21.15.161:0/2668492076 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc15f6c0 con 0x7ff0cc137870 2023-11-24T08:05:01.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.087+0000 7ff0d28d0640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 0x7ff0cc137cf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc072770 tx=0x7ff0c400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.088+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4004d60 con 0x7ff0cc137870 2023-11-24T08:05:01.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.088+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c400bb80 con 0x7ff0cc137870 2023-11-24T08:05:01.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.088+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4007070 con 0x7ff0cc137870 2023-11-24T08:05:01.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.088+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc072080 con 0x7ff0cc137870 2023-11-24T08:05:01.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.088+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc0b2d80 con 0x7ff0cc137870 2023-11-24T08:05:01.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.089+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0cc1ee5e0 con 0x7ff0cc137870 2023-11-24T08:05:01.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.090+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ff0c40071d0 con 0x7ff0cc137870 2023-11-24T08:05:01.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.091+0000 7ff0c2ffd640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff0b006aff0 0x7ff0b006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.091+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0c4089ec0 con 0x7ff0cc137870 2023-11-24T08:05:01.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.092+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff0b006aff0 0x7ff0b006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.093+0000 7ff0d20cf640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff0b006aff0 0x7ff0b006d4b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8036000 tx=0x7ff0c8030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.096+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0c4054bc0 con 0x7ff0cc137870 2023-11-24T08:05:01.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.356+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff0cc067670 con 0x7ff0cc137870 2023-11-24T08:05:01.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.360+0000 7ff0c2ffd640 1 -- 172.21.15.161:0/2668492076 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff0c40581e0 con 0x7ff0cc137870 2023-11-24T08:05:01.363 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-11-24T08:05:01.363 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQDRV2BlrJ0RIRAAp9nU0BpisuWvPk/UwDIoOA== 2023-11-24T08:05:01.363 INFO:teuthology.orchestra.run.smithi161.stdout: caps mds = "allow" 2023-11-24T08:05:01.363 INFO:teuthology.orchestra.run.smithi161.stdout: caps mon = "allow r" 2023-11-24T08:05:01.363 INFO:teuthology.orchestra.run.smithi161.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T08:05:01.363 INFO:teuthology.orchestra.run.smithi161.stderr:updated caps for client.0 2023-11-24T08:05:01.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff0b006aff0 msgr2=0x7ff0b006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff0b006aff0 0x7ff0b006d4b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8036000 tx=0x7ff0c8030000 comp rx=0 tx=0).stop 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 msgr2=0x7ff0cc137cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 0x7ff0cc137cf0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc072770 tx=0x7ff0c400b4a0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 shutdown_connections 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ff0b006aff0 0x7ff0b006d4b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff0cc137870 0x7ff0cc137cf0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0cc15cca0 0x7ff0cc070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.366 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 --2- 172.21.15.161:0/2668492076 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff0b8003970 0x7ff0cc152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 >> 172.21.15.161:0/2668492076 conn(0x7ff0cc0b0be0 msgr2=0x7ff0cc13d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 shutdown_connections 2023-11-24T08:05:01.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.363+0000 7ff0d4333640 1 -- 172.21.15.161:0/2668492076 wait complete. 2023-11-24T08:05:01.384 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.593+0000 7faaaca9b640 1 Processor -- start 2023-11-24T08:05:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.593+0000 7faaaca9b640 1 -- start start 2023-11-24T08:05:01.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.594+0000 7faaaca9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7faaa813df80 0x7faaa815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.594+0000 7faaaca9b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa806c470 con 0x7faaa813e360 2023-11-24T08:05:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faaaca9b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa806c750 con 0x7faaa80cf9a0 2023-11-24T08:05:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faaaca9b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa806ca30 con 0x7faaa813df80 2023-11-24T08:05:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faa9dd9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7faaa813e360 0x7faaa80cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40788/0 (socket says 172.21.15.161:40788) 2023-11-24T08:05:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faa9dd9b640 1 -- 172.21.15.161:0/1309473367 learned_addr learned my addr 172.21.15.161:0/1309473367 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faaa659c640 1 --2- 172.21.15.161:0/1309473367 >> v2:172.21.15.161:3300/0 conn(0x7faaa813df80 0x7faaa815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faaa659c640 1 -- 172.21.15.161:0/1309473367 >> v1:172.21.15.175:6789/0 conn(0x7faaa80cf9a0 legacy=0x7faaa80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faaa659c640 1 -- 172.21.15.161:0/1309473367 >> v1:172.21.15.161:6789/0 conn(0x7faaa813e360 legacy=0x7faaa80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.595+0000 7faaa659c640 1 -- 172.21.15.161:0/1309473367 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa806cd10 con 0x7faaa813df80 2023-11-24T08:05:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.596+0000 7faaa659c640 1 --2- 172.21.15.161:0/1309473367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813df80 0x7faaa815bee0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faa980097a0 tx=0x7faa9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a81c8bbf349dc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.597+0000 7faaa5d9b640 1 -- 172.21.15.161:0/1309473367 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98031830 con 0x7faaa813df80 2023-11-24T08:05:01.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.597+0000 7faaa5d9b640 1 -- 172.21.15.161:0/1309473367 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa98031990 con 0x7faaa813df80 2023-11-24T08:05:01.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.597+0000 7faaa5d9b640 1 -- 172.21.15.161:0/1309473367 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98031d20 con 0x7faaa813df80 2023-11-24T08:05:01.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.597+0000 7faaaca9b640 1 -- 172.21.15.161:0/1309473367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813df80 msgr2=0x7faaa815bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.597+0000 7faaaca9b640 1 --2- 172.21.15.161:0/1309473367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813df80 0x7faaa815bee0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faa980097a0 tx=0x7faa9802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.598+0000 7faaaca9b640 1 -- 172.21.15.161:0/1309473367 shutdown_connections 2023-11-24T08:05:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.598+0000 7faaaca9b640 1 --2- 172.21.15.161:0/1309473367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813df80 0x7faaa815bee0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.598+0000 7faaaca9b640 1 -- 172.21.15.161:0/1309473367 >> 172.21.15.161:0/1309473367 conn(0x7faaa806a800 msgr2=0x7faaa806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.598+0000 7faaaca9b640 1 -- 172.21.15.161:0/1309473367 shutdown_connections 2023-11-24T08:05:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.598+0000 7faaaca9b640 1 -- 172.21.15.161:0/1309473367 wait complete. 2023-11-24T08:05:01.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.600+0000 7faaaca9b640 1 Processor -- start 2023-11-24T08:05:01.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.600+0000 7faaaca9b640 1 -- start start 2023-11-24T08:05:01.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaaca9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80cf9a0 0x7faaa813bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaaca9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa813df80 0x7faaa814af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaaca9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 0x7faaa81f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaaca9b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa813c1c0 con 0x7faaa813e360 2023-11-24T08:05:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaaca9b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa813b7f0 con 0x7faaa813df80 2023-11-24T08:05:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaaca9b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa80b4200 con 0x7faaa80cf9a0 2023-11-24T08:05:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaa6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 0x7faaa81f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaa6d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 0x7faaa81f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48372/0 (socket says 172.21.15.161:48372) 2023-11-24T08:05:01.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.601+0000 7faaa6d9d640 1 -- 172.21.15.161:0/3912278777 learned_addr learned my addr 172.21.15.161:0/3912278777 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:01.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faa9dd9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa813df80 0x7faaa814af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa659c640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80cf9a0 0x7faaa813bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa6d9d640 1 -- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80cf9a0 msgr2=0x7faaa813bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa6d9d640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80cf9a0 0x7faaa813bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa6d9d640 1 -- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa813df80 msgr2=0x7faaa814af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa6d9d640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa813df80 0x7faaa814af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa6d9d640 1 -- 172.21.15.161:0/3912278777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009400 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa659c640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80cf9a0 0x7faaa813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.602+0000 7faaa6d9d640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 0x7faaa81f2fc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7faaa000ba10 tx=0x7faaa000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.603+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa000cb40 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.603+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa000cca0 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.603+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0014680 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.603+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa813b1a0 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.603+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa814b490 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.604+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa80675d0 con 0x7faaa813e360 2023-11-24T08:05:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.605+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7faaa001d3b0 con 0x7faaa813e360 2023-11-24T08:05:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.606+0000 7faa9f7fe640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8806aff0 0x7faa8806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.606+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaa0089660 con 0x7faaa813e360 2023-11-24T08:05:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.606+0000 7faaa659c640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8806aff0 0x7faa8806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.607+0000 7faaa659c640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8806aff0 0x7faa8806d4b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa98036000 tx=0x7faa98008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.610+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faaa0054490 con 0x7faaa813e360 2023-11-24T08:05:01.802 INFO:tasks.ceph.mds.c.smithi161.stderr:2023-11-24T08:05:01.800+0000 7fe5b7141640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:05:01.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.839+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaa813b930 con 0x7faaa813e360 2023-11-24T08:05:01.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.840+0000 7faa9f7fe640 1 -- 172.21.15.161:0/3912278777 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4916 (secure 0 0 0) 0x7faaa0057ab0 con 0x7faaa813e360 2023-11-24T08:05:01.842 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:01.842 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:55.289954+0000","modified":"2023-11-24T08:04:58.365831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4018716146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4018716146},{"type":"v1","addr":"172.21.15.161:6835","nonce":4018716146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:05:01.843 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 36 2023-11-24T08:05:01.845 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8806aff0 msgr2=0x7faa8806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8806aff0 0x7faa8806d4b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa98036000 tx=0x7faa98008030 comp rx=0 tx=0).stop 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 msgr2=0x7faaa81f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 0x7faaa81f2fc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7faaa000ba10 tx=0x7faaa000bed0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 shutdown_connections 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7faa8806aff0 0x7faa8806d4b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faaa813e360 0x7faaa81f2fc0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa813df80 0x7faaa814af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 --2- 172.21.15.161:0/3912278777 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80cf9a0 0x7faaa813bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 >> 172.21.15.161:0/3912278777 conn(0x7faaa806a800 msgr2=0x7faaa815a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 shutdown_connections 2023-11-24T08:05:01.847 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:01.843+0000 7faaaca9b640 1 -- 172.21.15.161:0/3912278777 wait complete. 2023-11-24T08:05:02.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T08:04:55.289954+0000', 'modified': '2023-11-24T08:04:58.365831+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6324}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6324': {'gid': 6324, 'name': 'c', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.161:6835/4018716146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.161:6834', 'nonce': 4018716146}, {'type': 'v1', 'addr': '172.21.15.161:6835', 'nonce': 4018716146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T08:05:02.266 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T08:05:02.267 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-24T08:05:02.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.489+0000 7f2eb8ad8640 1 Processor -- start 2023-11-24T08:05:02.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.489+0000 7f2eb8ad8640 1 -- start start 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb8ad8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2eb4143c40 0x7f2eb4071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb8ad8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2eb40cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb8ad8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb4070e50 con 0x7f2eb40cca40 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb8ad8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb40723c0 con 0x7f2eb4143c40 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb8ad8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40cce70 con 0x7f2eb40717d0 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f2eb40cca40 0x7f2eb415eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40792/0 (socket says 172.21.15.161:40792) 2023-11-24T08:05:02.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb3fff640 1 -- 172.21.15.161:0/2478764058 learned_addr learned my addr 172.21.15.161:0/2478764058 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.491+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846453271 0 0) 0x7f2eb4070e50 con 0x7f2eb40cca40 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e9c003520 con 0x7f2eb40cca40 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2eb40cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2478764058 >> v2:172.21.15.175:3300/0 conn(0x7f2eb4143c40 0x7f2eb4071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1641352421 0 0) 0x7f2e9c003520 con 0x7f2eb40cca40 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 msgr2=0x7f2eb40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2eb40cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 >> v2:172.21.15.175:3300/0 conn(0x7f2eb4143c40 msgr2=0x7f2eb4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 --2- 172.21.15.161:0/2478764058 >> v2:172.21.15.175:3300/0 conn(0x7f2eb4143c40 0x7f2eb4071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb406e170 con 0x7f2eb40cca40 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f2eac0019f0 con 0x7f2eb40cca40 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2eb40cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 >> v1:172.21.15.161:6789/0 conn(0x7f2eb40cca40 legacy=0x7f2eb415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c003970 0x7f2e9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0047c0 0x7f2e9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2e9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40723c0 con 0x7f2e9c003970 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb40cce70 con 0x7f2e9c0047c0 2023-11-24T08:05:02.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c00bb10 con 0x7f2eb40717d0 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.492+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c003970 0x7f2e9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2e9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0047c0 0x7f2e9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 msgr2=0x7f2e9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb40717d0 0x7f2e9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0047c0 msgr2=0x7f2e9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0047c0 0x7f2e9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2478764058 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c003520 con 0x7f2e9c003970 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.493+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c0047c0 0x7f2e9c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:02.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.494+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c003970 0x7f2e9c003d90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400ba00 tx=0x7f2e9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740eec8d2f5e470c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.494+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4032630 con 0x7f2e9c003970 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.494+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4032790 con 0x7f2e9c003970 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.494+0000 7f2eb27fc640 1 -- 172.21.15.161:0/2478764058 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4032b20 con 0x7f2e9c003970 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/2478764058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c003970 msgr2=0x7f2e9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/2478764058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2e9c003970 0x7f2e9c003d90 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400ba00 tx=0x7f2e9c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb3fff640 1 -- 172.21.15.161:0/2478764058 reap_dead start 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/2478764058 shutdown_connections 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/2478764058 >> 172.21.15.161:0/2478764058 conn(0x7f2eb406a800 msgr2=0x7f2eb406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/2478764058 shutdown_connections 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.495+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/2478764058 wait complete. 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.497+0000 7f2eb8ad8640 1 Processor -- start 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.497+0000 7f2eb8ad8640 1 -- start start 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb8ad8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c003970 0x7f2eb415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb8ad8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb41f4280 0x7f2eb41f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb8ad8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 0x7f2eb40afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb8ad8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41f1c50 con 0x7f2eb4135190 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb8ad8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb413a740 con 0x7f2e9c003970 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb8ad8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb41f4700 con 0x7f2eb41f4280 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 0x7f2eb40afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 0x7f2eb40afac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48396/0 (socket says 172.21.15.161:48396) 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb3fff640 1 -- 172.21.15.161:0/765531113 learned_addr learned my addr 172.21.15.161:0/765531113 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c003970 0x7f2eb415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.498+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb41f4280 0x7f2eb41f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb3fff640 1 -- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb41f4280 msgr2=0x7f2eb41f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb41f4280 0x7f2eb41f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb3fff640 1 -- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c003970 msgr2=0x7f2eb415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c003970 0x7f2eb415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb3fff640 1 -- 172.21.15.161:0/765531113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb41f4980 con 0x7f2eb4135190 2023-11-24T08:05:02.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb41f4280 0x7f2eb41f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:02.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c003970 0x7f2eb415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:02.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 0x7f2eb40afac0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2eac002230 tx=0x7f2eac007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2e9bfff640 1 -- 172.21.15.161:0/765531113 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac00eb00 con 0x7f2eb4135190 2023-11-24T08:05:02.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2e9bfff640 1 -- 172.21.15.161:0/765531113 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac00ec60 con 0x7f2eb4135190 2023-11-24T08:05:02.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2e9bfff640 1 -- 172.21.15.161:0/765531113 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac013420 con 0x7f2eb4135190 2023-11-24T08:05:02.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb41f4c60 con 0x7f2eb4135190 2023-11-24T08:05:02.506 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.499+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb4135610 con 0x7f2eb4135190 2023-11-24T08:05:02.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.501+0000 7f2e9bfff640 1 -- 172.21.15.161:0/765531113 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2eac013580 con 0x7f2eb4135190 2023-11-24T08:05:02.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.502+0000 7f2e9bfff640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ea006b020 0x7f2ea006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.502+0000 7f2e9bfff640 1 -- 172.21.15.161:0/765531113 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2eac089dc0 con 0x7f2eb4135190 2023-11-24T08:05:02.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.503+0000 7f2ebc9a8740 1 Processor -- start 2023-11-24T08:05:02.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.503+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ea006b020 0x7f2ea006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.503+0000 7f2ebc9a8740 1 -- start start 2023-11-24T08:05:02.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba27b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba24ad70 0x5575ba250c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 0x5575ba293730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.518 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba1ae880 con 0x5575ba2511b0 2023-11-24T08:05:02.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba1bdae0 con 0x5575ba24ad70 2023-11-24T08:05:02.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ba1bb1d0 con 0x5575ba27ad50 2023-11-24T08:05:02.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ea006b020 0x7f2ea006d4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0057a0 tx=0x7f2ea403d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 0x5575ba293730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 0x5575ba293730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48404/0 (socket says 172.21.15.161:48404) 2023-11-24T08:05:02.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.504+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1767783198 learned_addr learned my addr 172.21.15.161:0/1767783198 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba27b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 msgr2=0x5575ba27b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba24ad70 0x5575ba250c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba27b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba24ad70 msgr2=0x5575ba250c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba24ad70 0x5575ba250c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1767783198 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575ba17e860 con 0x5575ba2511b0 2023-11-24T08:05:02.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba27b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:02.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 0x5575ba293730 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0880a0 tx=0x7f2eac058fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea8c3e209058599e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2e997fa640 1 -- 172.21.15.161:0/1767783198 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac070120 con 0x5575ba2511b0 2023-11-24T08:05:02.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2e997fa640 1 -- 172.21.15.161:0/1767783198 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac060b10 con 0x5575ba2511b0 2023-11-24T08:05:02.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.505+0000 7f2e997fa640 1 -- 172.21.15.161:0/1767783198 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0881b0 con 0x5575ba2511b0 2023-11-24T08:05:02.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1767783198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 msgr2=0x5575ba293730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 0x5575ba293730 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0880a0 tx=0x7f2eac058fd0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1767783198 shutdown_connections 2023-11-24T08:05:02.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba2511b0 0x5575ba293730 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba24ad70 0x5575ba250c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1767783198 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba27b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1767783198 >> 172.21.15.161:0/1767783198 conn(0x5575ba211c70 msgr2=0x5575ba295b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1767783198 shutdown_connections 2023-11-24T08:05:02.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.506+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1767783198 wait complete. 2023-11-24T08:05:02.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.507+0000 7f2ebc9a8740 1 -- start start 2023-11-24T08:05:02.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.507+0000 7f2ebc9a8740 1 Processor -- start 2023-11-24T08:05:02.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba295750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba2619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba2729e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba1b6ac0 con 0x5575ba24ad70 2023-11-24T08:05:02.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba1532f0 con 0x5575ba272560 2023-11-24T08:05:02.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ba170c70 con 0x5575ba27ad50 2023-11-24T08:05:02.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2ebc9a8740 10 client.0 _ll_register_callbacks cb 0x5575ba1753b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:02.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba295750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba295750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48412/0 (socket says 172.21.15.161:48412) 2023-11-24T08:05:02.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.508+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2876990291 learned_addr learned my addr 172.21.15.161:0/2876990291 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2876990291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 msgr2=0x5575ba2619d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba2619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2876990291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 msgr2=0x5575ba2729e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba2729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2eb37fe640 1 -- 172.21.15.161:0/2876990291 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb4135610 con 0x5575ba24ad70 2023-11-24T08:05:02.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba295750 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2ea402bf80 tx=0x7f2ea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d117fc16b6f1c8f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2e927fc640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:05:02.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2e927fc640 1 -- 172.21.15.161:0/2876990291 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea404b070 con 0x5575ba24ad70 2023-11-24T08:05:02.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2e927fc640 1 -- 172.21.15.161:0/2876990291 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea40306d0 con 0x5575ba24ad70 2023-11-24T08:05:02.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.509+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575ba1afaa0 con 0x5575ba24ad70 2023-11-24T08:05:02.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2e927fc640 1 -- 172.21.15.161:0/2876990291 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ea4030890 con 0x5575ba24ad70 2023-11-24T08:05:02.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 10 client.6450 fetch_fsmap learned FSMap version 36 2023-11-24T08:05:02.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5575ba1b5140 con 0x5575ba24ad70 2023-11-24T08:05:02.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2e927fc640 1 -- 172.21.15.161:0/2876990291 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5575ba1afaa0 con 0x5575ba24ad70 2023-11-24T08:05:02.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2e927fc640 1 -- 172.21.15.161:0/2876990291 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2ea40309f0 con 0x5575ba24ad70 2023-11-24T08:05:02.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 10 client.6450 fetch_fsmap finished waiting for FSMap version 36 2023-11-24T08:05:02.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 10 client.6450 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T08:05:02.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 20 client.6450 populate_metadata read hostname 'smithi161' 2023-11-24T08:05:02.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba264590 0x5575ba2639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 4 client.6450 mds_command: new command op to 6324 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T08:05:02.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 --> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575ba1af7c0 con 0x5575ba264590 2023-11-24T08:05:02.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.510+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba264590 0x5575ba2639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.511+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba264590 0x5575ba2639e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=917c2d2a1903ecea server_cookie=a8fbc03eac284817 in_seq=0 out_seq=0 2023-11-24T08:05:02.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.511+0000 7f2e927fc640 10 client.6450 ms_handle_connect on v2:172.21.15.161:6834/4018716146 2023-11-24T08:05:02.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2e927fc640 1 -- 172.21.15.161:0/2876990291 <== mds.0 v2:172.21.15.161:6834/4018716146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575ba1af7c0 con 0x5575ba264590 2023-11-24T08:05:02.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2e927fc640 10 client.6450 handle_command_reply: tid=0 2023-11-24T08:05:02.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 client.6450 shutdown 2023-11-24T08:05:02.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 msgr2=0x5575ba295750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba295750 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2ea402bf80 tx=0x7f2ea40046c0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 shutdown_connections 2023-11-24T08:05:02.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba264590 0x5575ba2639e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba2729e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba27ad50 0x5575ba2619d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/2876990291 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba295750 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2e927fc640 0 client.6450 ms_handle_reset on v2:172.21.15.161:6834/4018716146 2023-11-24T08:05:02.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 >> 172.21.15.161:0/2876990291 conn(0x5575ba211c70 msgr2=0x5575ba27d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 shutdown_connections 2023-11-24T08:05:02.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/2876990291 wait complete. 2023-11-24T08:05:02.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.512+0000 7f2ebc9a8740 20 client.6450 trim_cache size 0 max 16384 2023-11-24T08:05:02.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.529+0000 7f2ebc9a8740 1 Processor -- start 2023-11-24T08:05:02.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.529+0000 7f2ebc9a8740 1 -- start start 2023-11-24T08:05:02.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba2639e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba272560 0x5575ba263f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba27ad50 0x5575ba273a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575b9f19f20 con 0x5575ba24ad70 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba27e850 con 0x5575ba27ad50 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ba262220 con 0x5575ba272560 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba2639e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.530+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba2639e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48420/0 (socket says 172.21.15.161:48420) 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 -- 172.21.15.161:0/3111612690 learned_addr learned my addr 172.21.15.161:0/3111612690 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba272560 0x5575ba263f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba27ad50 0x5575ba273a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 -- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba272560 msgr2=0x5575ba263f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba272560 0x5575ba263f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 -- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba27ad50 msgr2=0x5575ba273a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba27ad50 0x5575ba273a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 -- 172.21.15.161:0/3111612690 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575ba152b80 con 0x5575ba24ad70 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba2639e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4006d40 tx=0x7f2ea404b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd9d222ab801009 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2e99ffb640 1 -- 172.21.15.161:0/3111612690 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40306d0 con 0x5575ba24ad70 2023-11-24T08:05:02.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2e99ffb640 1 -- 172.21.15.161:0/3111612690 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea4030830 con 0x5575ba24ad70 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.531+0000 7f2e99ffb640 1 -- 172.21.15.161:0/3111612690 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea405e410 con 0x5575ba24ad70 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/3111612690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 msgr2=0x5575ba2639e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba2639e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4006d40 tx=0x7f2ea404b000 comp rx=0 tx=0).stop 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/3111612690 shutdown_connections 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba27ad50 0x5575ba273a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba272560 0x5575ba263f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/3111612690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba24ad70 0x5575ba2639e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/3111612690 >> 172.21.15.161:0/3111612690 conn(0x5575ba211c70 msgr2=0x5575ba298f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/3111612690 shutdown_connections 2023-11-24T08:05:02.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.532+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/3111612690 wait complete. 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.533+0000 7f2ebc9a8740 1 -- start start 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.533+0000 7f2ebc9a8740 1 Processor -- start 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba24ad70 0x5575ba3045d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba276b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 0x5575ba2770d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba277e80 con 0x5575ba27ad50 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575ba261460 con 0x5575ba272560 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x5575ba2742f0 con 0x5575ba24ad70 2023-11-24T08:05:02.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2ebc9a8740 10 client.0 _ll_register_callbacks cb 0x7f2e9c0036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 0x5575ba2770d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2eb3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 0x5575ba2770d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48430/0 (socket says 172.21.15.161:48430) 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.534+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1947312572 learned_addr learned my addr 172.21.15.161:0/1947312572 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba24ad70 msgr2=0x5575ba3045d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba24ad70 0x5575ba3045d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb2ffd640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba276b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba24ad70 0x5575ba3045d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 msgr2=0x5575ba276b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba276b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb3fff640 1 -- 172.21.15.161:0/1947312572 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575ba1b5140 con 0x5575ba27ad50 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2eb3fff640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 0x5575ba2770d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2eac002200 tx=0x7f2eac002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abc26bd4237f16b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2e927fc640 10 client.0 ms_handle_connect on v2:172.21.15.161:3300/0 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2e927fc640 1 -- 172.21.15.161:0/1947312572 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0883b0 con 0x5575ba27ad50 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2e927fc640 1 -- 172.21.15.161:0/1947312572 <== mon.0 v2:172.21.15.161:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2eac057d00 con 0x5575ba27ad50 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.535+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2eac060b10 con 0x5575ba27ad50 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2e927fc640 1 -- 172.21.15.161:0/1947312572 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac070120 con 0x5575ba27ad50 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 10 client.6456 fetch_fsmap learned FSMap version 36 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5575ba178170 con 0x5575ba27ad50 2023-11-24T08:05:02.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2e927fc640 1 -- 172.21.15.161:0/1947312572 <== mon.0 v2:172.21.15.161:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac060b10 con 0x5575ba27ad50 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2e927fc640 1 -- 172.21.15.161:0/1947312572 <== mon.0 v2:172.21.15.161:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2eac060680 con 0x5575ba27ad50 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 10 client.6456 fetch_fsmap finished waiting for FSMap version 36 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 10 client.6456 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 20 client.6456 populate_metadata read hostname 'smithi161' 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba2605c0 0x5575ba2609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 4 client.6456 mds_command: new command op to 6324 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 --> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575b9eb76c0 con 0x5575ba2605c0 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.536+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba2605c0 0x5575ba2609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2eb37fe640 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba2605c0 0x5575ba2609a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b3e5cd3c9b6194 server_cookie=41cb72aca07eb573 in_seq=0 out_seq=0 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2e927fc640 10 client.6456 ms_handle_connect on v2:172.21.15.161:6834/4018716146 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2e927fc640 1 -- 172.21.15.161:0/1947312572 <== mds.0 v2:172.21.15.161:6834/4018716146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5575b9eb76c0 con 0x5575ba2605c0 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2e927fc640 10 client.6456 handle_command_reply: tid=0 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 client.6456 shutdown 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 msgr2=0x5575ba2770d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 0x5575ba2770d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2eac002200 tx=0x7f2eac002170 comp rx=0 tx=0).stop 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 shutdown_connections 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:6834/4018716146,v1:172.21.15.161:6835/4018716146] conn(0x5575ba2605c0 0x5575ba2609a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x5575ba27ad50 0x5575ba2770d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5575ba272560 0x5575ba276b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 --2- 172.21.15.161:0/1947312572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5575ba24ad70 0x5575ba3045d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2e927fc640 0 client.6456 ms_handle_reset on v2:172.21.15.161:6834/4018716146 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 >> 172.21.15.161:0/1947312572 conn(0x5575ba211c70 msgr2=0x5575ba273a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 shutdown_connections 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.537+0000 7f2ebc9a8740 1 -- 172.21.15.161:0/1947312572 wait complete. 2023-11-24T08:05:02.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2ebc9a8740 20 client.6456 trim_cache size 0 max 16384 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout: "cluster_fsid": "2e355083-a16f-42dd-a3ed-5276a3fda4f7", 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout: "whoami": 0, 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 6324, 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout: "want_state": "up:active", 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout: "state": "up:active", 2023-11-24T08:05:02.552 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs", 2023-11-24T08:05:02.553 INFO:teuthology.orchestra.run.smithi161.stdout: "rank_uptime": 6.6812646149999999, 2023-11-24T08:05:02.553 INFO:teuthology.orchestra.run.smithi161.stdout: "mdsmap_epoch": 36, 2023-11-24T08:05:02.553 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch": 60, 2023-11-24T08:05:02.553 INFO:teuthology.orchestra.run.smithi161.stdout: "osdmap_epoch_barrier": 60, 2023-11-24T08:05:02.553 INFO:teuthology.orchestra.run.smithi161.stdout: "uptime": 12.086098299 2023-11-24T08:05:02.553 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ea006b020 msgr2=0x7f2ea006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ea006b020 0x7f2ea006d4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0057a0 tx=0x7f2ea403d040 comp rx=0 tx=0).stop 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 msgr2=0x7f2eb40afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 0x7f2eb40afac0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2eac002230 tx=0x7f2eac007be0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 shutdown_connections 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f2ea006b020 0x7f2ea006d4e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2eb4135190 0x7f2eb40afac0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2eb41f4280 0x7f2eb41f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 --2- 172.21.15.161:0/765531113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2e9c003970 0x7f2eb415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 >> 172.21.15.161:0/765531113 conn(0x7f2eb406a800 msgr2=0x7f2eb40caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 shutdown_connections 2023-11-24T08:05:02.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.538+0000 7f2eb8ad8640 1 -- 172.21.15.161:0/765531113 wait complete. 2023-11-24T08:05:02.559 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:02.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.773+0000 7ffbbbbe5640 1 Processor -- start 2023-11-24T08:05:02.776 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.774+0000 7ffbbbbe5640 1 -- start start 2023-11-24T08:05:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.775+0000 7ffbbbbe5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffbb413df80 0x7ffbb415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.775+0000 7ffbbbbe5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ffbb413e360 0x7ffbb40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.775+0000 7ffbbbbe5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 0x7ffbb40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.775+0000 7ffbbbbe5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb406c470 con 0x7ffbb413df80 2023-11-24T08:05:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.775+0000 7ffbbbbe5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb406c750 con 0x7ffbb413e360 2023-11-24T08:05:02.778 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.775+0000 7ffbbbbe5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb406ca30 con 0x7ffbb415f9c0 2023-11-24T08:05:02.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffbb413df80 0x7ffbb415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ffbb413df80 0x7ffbb415bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48442/0 (socket says 172.21.15.161:48442) 2023-11-24T08:05:02.779 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 -- 172.21.15.161:0/1946592301 learned_addr learned my addr 172.21.15.161:0/1946592301 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 -- 172.21.15.161:0/1946592301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 msgr2=0x7ffbb40cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 --2- 172.21.15.161:0/1946592301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 0x7ffbb40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 -- 172.21.15.161:0/1946592301 >> v2:172.21.15.175:3300/0 conn(0x7ffbb413e360 msgr2=0x7ffbb40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 --2- 172.21.15.161:0/1946592301 >> v2:172.21.15.175:3300/0 conn(0x7ffbb413e360 0x7ffbb40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.776+0000 7ffbb9981640 1 -- 172.21.15.161:0/1946592301 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb406cd10 con 0x7ffbb413df80 2023-11-24T08:05:02.781 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.777+0000 7ffbb9981640 1 --2- 172.21.15.161:0/1946592301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb415bee0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffbb406ded0 tx=0x7ffba402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6bae85256f866b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.778+0000 7ffbb897f640 1 -- 172.21.15.161:0/1946592301 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba402ca70 con 0x7ffbb413df80 2023-11-24T08:05:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.778+0000 7ffbb897f640 1 -- 172.21.15.161:0/1946592301 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba402cbd0 con 0x7ffbb413df80 2023-11-24T08:05:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.778+0000 7ffbb897f640 1 -- 172.21.15.161:0/1946592301 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba40343f0 con 0x7ffbb413df80 2023-11-24T08:05:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.778+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/1946592301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 msgr2=0x7ffbb415bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.778+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/1946592301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb415bee0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7ffbb406ded0 tx=0x7ffba402bed0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/1946592301 shutdown_connections 2023-11-24T08:05:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/1946592301 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 0x7ffbb40cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/1946592301 >> v2:172.21.15.175:3300/0 conn(0x7ffbb413e360 0x7ffbb40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/1946592301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb415bee0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/1946592301 >> 172.21.15.161:0/1946592301 conn(0x7ffbb406a800 msgr2=0x7ffbb406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/1946592301 shutdown_connections 2023-11-24T08:05:02.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.779+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/1946592301 wait complete. 2023-11-24T08:05:02.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.780+0000 7ffbbbbe5640 1 Processor -- start 2023-11-24T08:05:02.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.781+0000 7ffbbbbe5640 1 -- start start 2023-11-24T08:05:02.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.781+0000 7ffbbbbe5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb413d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.781+0000 7ffbbbbe5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbb413e360 0x7ffbb40a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbbbbe5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 0x7ffbb40a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbbbbe5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb413d720 con 0x7ffbb413df80 2023-11-24T08:05:02.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbbbbe5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40aa9a0 con 0x7ffbb413e360 2023-11-24T08:05:02.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbbbbe5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40a8560 con 0x7ffbb415f9c0 2023-11-24T08:05:02.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb413d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb413d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48456/0 (socket says 172.21.15.161:48456) 2023-11-24T08:05:02.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 -- 172.21.15.161:0/3634104288 learned_addr learned my addr 172.21.15.161:0/3634104288 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:02.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9180640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbb413e360 0x7ffbb40a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 -- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 msgr2=0x7ffbb40a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 0x7ffbb40a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 -- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbb413e360 msgr2=0x7ffbb40a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:02.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbb413e360 0x7ffbb40a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9981640 1 -- 172.21.15.161:0/3634104288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba4009b30 con 0x7ffbb413df80 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.782+0000 7ffbb9180640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbb413e360 0x7ffbb40a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.783+0000 7ffbb9981640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb413d1e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ffba40093e0 tx=0x7ffba4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.783+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba403e450 con 0x7ffbb413df80 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.783+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba403e5b0 con 0x7ffbb413df80 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.783+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba403e960 con 0x7ffbb413df80 2023-11-24T08:05:02.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.783+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb40a8840 con 0x7ffbb413df80 2023-11-24T08:05:02.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.783+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb40adbd0 con 0x7ffbb413df80 2023-11-24T08:05:02.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.784+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb40a8d00 con 0x7ffbb413df80 2023-11-24T08:05:02.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.785+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7ffba403eac0 con 0x7ffbb413df80 2023-11-24T08:05:02.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.786+0000 7ffbb27fc640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffba006aff0 0x7ffba006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:02.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.786+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffba40ac9f0 con 0x7ffbb413df80 2023-11-24T08:05:02.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.787+0000 7ffbb9180640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffba006aff0 0x7ffba006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:02.791 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.788+0000 7ffbb9180640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffba006aff0 0x7ffba006d4b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffba8006fd0 tx=0x7ffba8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:02.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:02.792+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffba4077940 con 0x7ffbb413df80 2023-11-24T08:05:03.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.032+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffbb40675d0 con 0x7ffbb413df80 2023-11-24T08:05:03.034 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.033+0000 7ffbb27fc640 1 -- 172.21.15.161:0/3634104288 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffba4043060 con 0x7ffbb413df80 2023-11-24T08:05:03.035 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffba006aff0 msgr2=0x7ffba006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffba006aff0 0x7ffba006d4b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffba8006fd0 tx=0x7ffba8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 msgr2=0x7ffbb413d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb413d1e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ffba40093e0 tx=0x7ffba4004a40 comp rx=0 tx=0).stop 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 shutdown_connections 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7ffba006aff0 0x7ffba006d4b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffbb415f9c0 0x7ffbb40a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffbb413e360 0x7ffbb40a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 --2- 172.21.15.161:0/3634104288 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ffbb413df80 0x7ffbb413d1e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:03.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.035+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 >> 172.21.15.161:0/3634104288 conn(0x7ffbb406a800 msgr2=0x7ffbb40afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:03.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.036+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 shutdown_connections 2023-11-24T08:05:03.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:03.036+0000 7ffbbbbe5640 1 -- 172.21.15.161:0/3634104288 wait complete. 2023-11-24T08:05:03.057 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:05:03.057 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:03.057 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi161.front.sepia.ceph.com 2023-11-24T08:05:03.057 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T08:05:03.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:03.058 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:05:03.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:05:03.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:03.058 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:03.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.058 DEBUG:teuthology.orchestra.run.smithi161:> ip addr 2023-11-24T08:05:03.110 INFO:teuthology.orchestra.run.smithi161.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7c brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f0 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:03.111 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:d9:36:7d brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout: altname enp7s0f1 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:50 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 0c:c4:7a:88:72:51 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout: inet 172.21.15.161/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:05:03.112 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft 42099sec preferred_lft 42099sec 2023-11-24T08:05:03.113 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::ec4:7aff:fe88:7251/64 scope link 2023-11-24T08:05:03.113 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.113 INFO:teuthology.orchestra.run.smithi161.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:03.113 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:03.113 INFO:teuthology.orchestra.run.smithi161.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::8039:e9ff:fe5c:58ac/64 scope link 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether 02:f4:2a:75:db:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::f4:2aff:fe75:db23/64 scope link 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: link/ether ca:62:f1:ec:2f:57 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:03.114 INFO:teuthology.orchestra.run.smithi161.stdout: inet6 fe80::c862:f1ff:feec:2f57/64 scope link 2023-11-24T08:05:03.115 INFO:teuthology.orchestra.run.smithi161.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:03.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.116 DEBUG:teuthology.orchestra.run.smithi161:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:03.197 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-11-24T08:05:03.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.200 DEBUG:teuthology.orchestra.run.smithi161:> route 2023-11-24T08:05:03.253 INFO:teuthology.orchestra.run.smithi161.stdout:Kernel IP routing table 2023-11-24T08:05:03.253 INFO:teuthology.orchestra.run.smithi161.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:03.254 INFO:teuthology.orchestra.run.smithi161.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:03.254 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:03.254 INFO:teuthology.orchestra.run.smithi161.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:03.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.254 DEBUG:teuthology.orchestra.run.smithi161:> (cd / && exec bash -c ' 2023-11-24T08:05:03.254 DEBUG:teuthology.orchestra.run.smithi161:> set -e 2023-11-24T08:05:03.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:03.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:03.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:03.255 DEBUG:teuthology.orchestra.run.smithi161:> ') 2023-11-24T08:05:03.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.436 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:05:03.484 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:05:03.484 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:05:03.485 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:03.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link set brx.0 up 2023-11-24T08:05:03.578 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-24T08:05:03.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:03.579 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:03.633 INFO:teuthology.orchestra.run.smithi161.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T08:05:03.633 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:03.633 DEBUG:teuthology.orchestra.run.smithi161:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:03.682 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:05:03.773 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:05:03.829 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:05:03.830 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:03.831 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:03.832 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:03.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:03.833 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:05:03.883 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:05:03.883 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-24T08:05:03.889 DEBUG:teuthology.orchestra.run.smithi161:> sudo modprobe fuse 2023-11-24T08:05:03.966 DEBUG:teuthology.orchestra.run.smithi161:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:05:04.007 INFO:teuthology.orchestra.run.smithi161.stdout:/proc 2023-11-24T08:05:04.007 INFO:teuthology.orchestra.run.smithi161.stdout:/sys 2023-11-24T08:05:04.007 INFO:teuthology.orchestra.run.smithi161.stdout:/dev 2023-11-24T08:05:04.007 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/security 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/shm 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/pts 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/run 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/cgroup 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/pstore 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/ 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/selinux 2023-11-24T08:05:04.008 INFO:teuthology.orchestra.run.smithi161.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/hugepages 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/dev/mqueue 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/debug 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/tracing 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/fs/fuse/connections 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/sys/kernel/config 2023-11-24T08:05:04.009 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:05:04.010 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:05:04.010 INFO:teuthology.orchestra.run.smithi161.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:05:04.010 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:05:04.010 INFO:teuthology.orchestra.run.smithi161.stdout:/run/user/1000 2023-11-24T08:05:04.010 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph 2023-11-24T08:05:04.010 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-0 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-1 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-2 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/var/lib/ceph/osd/ceph-3 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:04.011 INFO:teuthology.orchestra.run.smithi161.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:04.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:04.013 DEBUG:teuthology.orchestra.run.smithi161:> ls /sys/fs/fuse/connections 2023-11-24T08:05:04.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:2023-11-24T08:05:04.075+0000 7fdb0c646480 -1 init, newargv = 0x5589cd7aeab0 newargc=15 2023-11-24T08:05:04.077 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[109459]: starting ceph client 2023-11-24T08:05:04.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[109459]: starting fuse 2023-11-24T08:05:04.100 INFO:teuthology.orchestra.run.smithi161.stdout:39 2023-11-24T08:05:04.100 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> import glob 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> import re 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> import os 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> import subprocess 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> def _find_admin_socket(client_name): 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> files = glob.glob(asok_path) 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-24T08:05:04.101 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> # Given a non-glob path, it better be there 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> if "*" not in asok_path: 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> assert(len(files) == 1) 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> return files[0] 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> for f in files: 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> contents = proc_f.read() 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> if mountpoint in contents: 2023-11-24T08:05:04.102 DEBUG:teuthology.orchestra.run.smithi161:> return f 2023-11-24T08:05:04.103 DEBUG:teuthology.orchestra.run.smithi161:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:05:04.103 DEBUG:teuthology.orchestra.run.smithi161:> 2023-11-24T08:05:04.103 DEBUG:teuthology.orchestra.run.smithi161:> print(_find_admin_socket("client.0")) 2023-11-24T08:05:04.103 DEBUG:teuthology.orchestra.run.smithi161:> ' 2023-11-24T08:05:04.302 INFO:teuthology.orchestra.run.smithi161.stdout:/var/run/ceph/ceph-client.0.109459.asok 2023-11-24T08:05:04.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:05:04.319 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.109459.asok 2023-11-24T08:05:04.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:04.319 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.109459.asok status 2023-11-24T08:05:04.558 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "metadata": { 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "entity_id": "0", 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "hostname": "smithi161", 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "pid": "109459", 2023-11-24T08:05:04.559 INFO:teuthology.orchestra.run.smithi161.stdout: "root": "/" 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_count": 0, 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "dentry_pinned_count": 0, 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "id": 6468, 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "inst": { 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "name": { 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "client", 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "num": 6468 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:05:04.560 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1430797277 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": { 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "type": "v1", 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "nonce": 1430797277 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: }, 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "inst_str": "client.6468 192.168.0.1:0/1430797277", 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "addr_str": "192.168.0.1:0/1430797277", 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "inode_count": 1, 2023-11-24T08:05:04.561 INFO:teuthology.orchestra.run.smithi161.stdout: "mds_epoch": 36, 2023-11-24T08:05:04.562 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch": 60, 2023-11-24T08:05:04.562 INFO:teuthology.orchestra.run.smithi161.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:05:04.562 INFO:teuthology.orchestra.run.smithi161.stdout: "blocklisted": false, 2023-11-24T08:05:04.562 INFO:teuthology.orchestra.run.smithi161.stdout: "fs_name": "cephfs" 2023-11-24T08:05:04.562 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:04.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:04.573 DEBUG:teuthology.orchestra.run.smithi161:> stat --file-system '--printf=%T 2023-11-24T08:05:04.573 DEBUG:teuthology.orchestra.run.smithi161:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:04.623 INFO:teuthology.orchestra.run.smithi161.stdout:fuseblk 2023-11-24T08:05:04.624 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:04.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:04.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:04.717 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T08:05:04.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.924+0000 7f1fa45ea640 1 Processor -- start 2023-11-24T08:05:04.926 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.924+0000 7f1fa45ea640 1 -- start start 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa45ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c143ae0 0x7f1f9c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa45ea640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f9c0cf7d0 0x7f1f9c15dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa45ea640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1f9c15e1e0 0x7f1f9c15a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa45ea640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c0cfc30 con 0x7f1f9c0cf7d0 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa45ea640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9c0b1ee0 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa45ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c0b2780 con 0x7f1f9c143ae0 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.925+0000 7f1fa1b85640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f9c0cf7d0 0x7f1f9c15dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1f9c0cf7d0 0x7f1f9c15dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48466/0 (socket says 172.21.15.161:48466) 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 -- 172.21.15.161:0/1721433382 learned_addr learned my addr 172.21.15.161:0/1721433382 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:04.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 -- 172.21.15.161:0/1721433382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c143ae0 msgr2=0x7f1f9c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 --2- 172.21.15.161:0/1721433382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c143ae0 0x7f1f9c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 -- 172.21.15.161:0/1721433382 >> v2:172.21.15.175:3300/0 conn(0x7f1f9c15e1e0 msgr2=0x7f1f9c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:04.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 --2- 172.21.15.161:0/1721433382 >> v2:172.21.15.175:3300/0 conn(0x7f1f9c15e1e0 0x7f1f9c15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.926+0000 7f1fa1b85640 1 -- 172.21.15.161:0/1721433382 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c15e990 con 0x7f1f9c0cf7d0 2023-11-24T08:05:04.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.927+0000 7f1fa1b85640 1 --2- 172.21.15.161:0/1721433382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0cf7d0 0x7f1f9c15dca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c072160 tx=0x7f1f8c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d39cc31665d3bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.927+0000 7f1fa1384640 1 -- 172.21.15.161:0/1721433382 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c031870 con 0x7f1f9c0cf7d0 2023-11-24T08:05:04.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa1384640 1 -- 172.21.15.161:0/1721433382 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c0319d0 con 0x7f1f9c0cf7d0 2023-11-24T08:05:04.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa1384640 1 -- 172.21.15.161:0/1721433382 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c031d60 con 0x7f1f9c0cf7d0 2023-11-24T08:05:04.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1721433382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0cf7d0 msgr2=0x7f1f9c15dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1721433382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0cf7d0 0x7f1f9c15dca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c072160 tx=0x7f1f8c02b910 comp rx=0 tx=0).stop 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1721433382 shutdown_connections 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1721433382 >> v2:172.21.15.175:3300/0 conn(0x7f1f9c15e1e0 0x7f1f9c15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1721433382 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c0cf7d0 0x7f1f9c15dca0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1721433382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c143ae0 0x7f1f9c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1721433382 >> 172.21.15.161:0/1721433382 conn(0x7f1f9c06a800 msgr2=0x7f1f9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1721433382 shutdown_connections 2023-11-24T08:05:04.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.928+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1721433382 wait complete. 2023-11-24T08:05:04.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.930+0000 7f1fa45ea640 1 Processor -- start 2023-11-24T08:05:04.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.930+0000 7f1fa45ea640 1 -- start start 2023-11-24T08:05:04.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa45ea640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c0cf7d0 0x7f1f9c13a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa45ea640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f9c143ae0 0x7f1f9c0b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa45ea640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 0x7f1f9c0b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa45ea640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c157180 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa45ea640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c13dfc0 con 0x7f1f9c143ae0 2023-11-24T08:05:04.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa45ea640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9c13a890 con 0x7f1f9c0cf7d0 2023-11-24T08:05:04.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa2b87640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 0x7f1f9c0b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa2b87640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 0x7f1f9c0b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48474/0 (socket says 172.21.15.161:48474) 2023-11-24T08:05:04.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.931+0000 7f1fa2b87640 1 -- 172.21.15.161:0/1572355466 learned_addr learned my addr 172.21.15.161:0/1572355466 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:04.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa1b85640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f9c143ae0 0x7f1f9c0b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2386640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c0cf7d0 0x7f1f9c13a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2b87640 1 -- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c0cf7d0 msgr2=0x7f1f9c13a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2b87640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c0cf7d0 0x7f1f9c13a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2b87640 1 -- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f9c143ae0 msgr2=0x7f1f9c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2b87640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f9c143ae0 0x7f1f9c0b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2b87640 1 -- 172.21.15.161:0/1572355466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c0094d0 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1fa2b87640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 0x7f1f9c0b0550 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400b970 tx=0x7f1f9400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9400cb40 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9400ccc0 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.932+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f94014680 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.933+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f9c13d0d0 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.933+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9c13d690 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.934+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9c0675d0 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.935+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1f9401d3b0 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.936+0000 7f1f92ffd640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f8006aff0 0x7f1f8006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:04.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.936+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f94089970 con 0x7f1f9c15e1e0 2023-11-24T08:05:04.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.937+0000 7f1fa2386640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f8006aff0 0x7f1f8006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:04.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.938+0000 7f1fa2386640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f8006aff0 0x7f1f8006d4b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a810 tx=0x7f1f98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:04.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:04.941+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f94054700 con 0x7f1f9c15e1e0 2023-11-24T08:05:05.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.171+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1f9c0b2bf0 con 0x7f1f9c15e1e0 2023-11-24T08:05:05.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.171+0000 7f1f92ffd640 1 -- 172.21.15.161:0/1572355466 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1f9c0b2bf0 con 0x7f1f9c15e1e0 2023-11-24T08:05:05.173 INFO:teuthology.orchestra.run.smithi161.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f8006aff0 msgr2=0x7f1f8006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f8006aff0 0x7f1f8006d4b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800a810 tx=0x7f1f98008040 comp rx=0 tx=0).stop 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 msgr2=0x7f1f9c0b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 0x7f1f9c0b0550 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1f9400b970 tx=0x7f1f9400be30 comp rx=0 tx=0).stop 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 shutdown_connections 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1f8006aff0 0x7f1f8006d4b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1f9c15e1e0 0x7f1f9c0b0550 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1f9c143ae0 0x7f1f9c0b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 --2- 172.21.15.161:0/1572355466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1f9c0cf7d0 0x7f1f9c13a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:05.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 >> 172.21.15.161:0/1572355466 conn(0x7f1f9c06a800 msgr2=0x7f1f9c0702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:05.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.174+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 shutdown_connections 2023-11-24T08:05:05.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:05.175+0000 7f1fa45ea640 1 -- 172.21.15.161:0/1572355466 wait complete. 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T08:05:05.196 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:05.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.197 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2023-11-24T08:05:05.258 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T08:05:05.258 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T08:05:05.258 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T08:05:05.259 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42103sec preferred_lft 42103sec 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::ec4:7aff:fe88:71f1/64 scope link 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::aca0:d6ff:fe4f:fbed/64 scope link 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:05.260 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 32:04:f3:a7:6a:6b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:05.261 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::3004:f3ff:fea7:6a6b/64 scope link 2023-11-24T08:05:05.261 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.261 INFO:teuthology.orchestra.run.smithi175.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T08:05:05.261 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 7e:b6:55:83:e4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:05.261 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::7cb6:55ff:fe83:e4c9/64 scope link 2023-11-24T08:05:05.261 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2023-11-24T08:05:05.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.262 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T08:05:05.355 INFO:teuthology.orchestra.run.smithi175.stdout:1 2023-11-24T08:05:05.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.359 DEBUG:teuthology.orchestra.run.smithi175:> route 2023-11-24T08:05:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2023-11-24T08:05:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T08:05:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T08:05:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T08:05:05.413 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T08:05:05.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.413 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec bash -c ' 2023-11-24T08:05:05.414 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2023-11-24T08:05:05.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T08:05:05.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T08:05:05.414 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T08:05:05.414 DEBUG:teuthology.orchestra.run.smithi175:> ') 2023-11-24T08:05:05.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.595 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:05:05.645 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:05:05.645 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:05:05.645 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:05.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.645 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2023-11-24T08:05:05.731 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-24T08:05:05.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:05.732 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:05.784 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T08:05:05.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T08:05:05.784 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:05.835 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:05:05.926 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:05:05.979 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:05:05.980 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:05:05.981 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:05.982 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:05.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:05.983 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:05:06.033 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-24T08:05:06.033 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-24T08:05:06.038 DEBUG:teuthology.orchestra.run.smithi175:> sudo modprobe fuse 2023-11-24T08:05:06.117 DEBUG:teuthology.orchestra.run.smithi175:> cat /proc/self/mounts | awk '{print $2}' 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/proc 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/sys 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/dev 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/security 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/shm 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/pts 2023-11-24T08:05:06.159 INFO:teuthology.orchestra.run.smithi175.stdout:/run 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/cgroup 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/pstore 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/ 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/selinux 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/proc/sys/fs/binfmt_misc 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/hugepages 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/dev/mqueue 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/debug 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/tracing 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/fs/fuse/connections 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/sys/kernel/config 2023-11-24T08:05:06.160 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-sysctl.service 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/nfs/rpc_pipefs 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/run/user/1000 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-4 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-5 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-6 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/var/lib/ceph/osd/ceph-7 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:06.161 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:06.162 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:06.162 INFO:teuthology.orchestra.run.smithi175.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:06.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:06.163 DEBUG:teuthology.orchestra.run.smithi175:> ls /sys/fs/fuse/connections 2023-11-24T08:05:06.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:2023-11-24T08:05:06.220+0000 7fd42f167480 -1 init, newargv = 0x55bc5497ac20 newargc=15 2023-11-24T08:05:06.222 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[97016]: starting ceph client 2023-11-24T08:05:06.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[97016]: starting fuse 2023-11-24T08:05:06.250 INFO:teuthology.orchestra.run.smithi175.stdout:39 2023-11-24T08:05:06.250 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-11-24T08:05:06.250 DEBUG:teuthology.orchestra.run.smithi175:> sudo stdin-killer -- python3 -c ' 2023-11-24T08:05:06.250 DEBUG:teuthology.orchestra.run.smithi175:> import glob 2023-11-24T08:05:06.250 DEBUG:teuthology.orchestra.run.smithi175:> import re 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> import os 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> import subprocess 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> def _find_admin_socket(client_name): 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> files = glob.glob(asok_path) 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> # Given a non-glob path, it better be there 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> if "*" not in asok_path: 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> assert(len(files) == 1) 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> return files[0] 2023-11-24T08:05:06.251 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> for f in files: 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> contents = proc_f.read() 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> if mountpoint in contents: 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> return f 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> print(_find_admin_socket("client.1")) 2023-11-24T08:05:06.252 DEBUG:teuthology.orchestra.run.smithi175:> ' 2023-11-24T08:05:06.450 INFO:teuthology.orchestra.run.smithi175.stdout:/var/run/ceph/ceph-client.1.97016.asok 2023-11-24T08:05:06.455 INFO:teuthology.orchestra.run.smithi175.stderr:2023-11-24T08:05:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-24T08:05:06.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.97016.asok 2023-11-24T08:05:06.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:06.468 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.97016.asok status 2023-11-24T08:05:06.711 INFO:teuthology.orchestra.run.smithi175.stdout:{ 2023-11-24T08:05:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "metadata": { 2023-11-24T08:05:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_sha1": "a13ea5ff00cb4df7a9cc941166ddeb358881144c", 2023-11-24T08:05:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "ceph_version": "ceph version 18.0.0-7484-ga13ea5ff (a13ea5ff00cb4df7a9cc941166ddeb358881144c) reef (dev)", 2023-11-24T08:05:06.711 INFO:teuthology.orchestra.run.smithi175.stdout: "entity_id": "1", 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "hostname": "smithi175", 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "pid": "97016", 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "root": "/" 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_count": 0, 2023-11-24T08:05:06.712 INFO:teuthology.orchestra.run.smithi175.stdout: "dentry_pinned_count": 0, 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "id": 5096, 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "inst": { 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "name": { 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "client", 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "num": 5096 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:05:06.713 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 940765077 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: } 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": { 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "type": "v1", 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "addr": "192.168.0.1:0", 2023-11-24T08:05:06.714 INFO:teuthology.orchestra.run.smithi175.stdout: "nonce": 940765077 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: }, 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "inst_str": "client.5096 192.168.0.1:0/940765077", 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "addr_str": "192.168.0.1:0/940765077", 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "inode_count": 1, 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "mds_epoch": 36, 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch": 60, 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "osd_epoch_barrier": 0, 2023-11-24T08:05:06.715 INFO:teuthology.orchestra.run.smithi175.stdout: "blocklisted": false, 2023-11-24T08:05:06.716 INFO:teuthology.orchestra.run.smithi175.stdout: "fs_name": "cephfs" 2023-11-24T08:05:06.716 INFO:teuthology.orchestra.run.smithi175.stdout:} 2023-11-24T08:05:06.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:06.727 DEBUG:teuthology.orchestra.run.smithi175:> stat --file-system '--printf=%T 2023-11-24T08:05:06.727 DEBUG:teuthology.orchestra.run.smithi175:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:06.781 INFO:teuthology.orchestra.run.smithi175.stdout:fuseblk 2023-11-24T08:05:06.782 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:06.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:06.782 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:06.875 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T08:05:07.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.102+0000 7f4a563ec640 1 Processor -- start 2023-11-24T08:05:07.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.102+0000 7f4a563ec640 1 -- start start 2023-11-24T08:05:07.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.104+0000 7f4a563ec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a5006b690 0x7f4a5015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.104+0000 7f4a563ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a5015e270 0x7f4a50070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.104+0000 7f4a563ec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a50154490 con 0x7f4a501540b0 2023-11-24T08:05:07.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.104+0000 7f4a563ec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5015d550 con 0x7f4a5006b690 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.104+0000 7f4a563ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5015a7b0 con 0x7f4a5015e270 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.104+0000 7f4a47fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4a5006b690 0x7f4a5015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a4ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4a501540b0 0x7f4a50159f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40800/0 (socket says 172.21.15.161:40800) 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a4ffff640 1 -- 172.21.15.161:0/305356399 learned_addr learned my addr 172.21.15.161:0/305356399 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a54989640 1 --2- 172.21.15.161:0/305356399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a5015e270 0x7f4a50070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a47fff640 1 -- 172.21.15.161:0/305356399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a5015e270 msgr2=0x7f4a50070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a47fff640 1 --2- 172.21.15.161:0/305356399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a5015e270 0x7f4a50070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a47fff640 1 -- 172.21.15.161:0/305356399 >> v1:172.21.15.161:6789/0 conn(0x7f4a501540b0 legacy=0x7f4a50159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a47fff640 1 -- 172.21.15.161:0/305356399 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5015aa90 con 0x7f4a5006b690 2023-11-24T08:05:07.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.105+0000 7f4a4f7fe640 1 -- 172.21.15.161:0/305356399 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345919277 0 0) 0x7f4a50154490 con 0x7f4a501540b0 2023-11-24T08:05:07.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.107+0000 7f4a47fff640 1 --2- 172.21.15.161:0/305356399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a5015dd30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4a380097a0 tx=0x7f4a3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d362bd072148a257 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.107+0000 7f4a4f7fe640 1 -- 172.21.15.161:0/305356399 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38031830 con 0x7f4a5006b690 2023-11-24T08:05:07.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.107+0000 7f4a4f7fe640 1 -- 172.21.15.161:0/305356399 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38031990 con 0x7f4a5006b690 2023-11-24T08:05:07.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.107+0000 7f4a4f7fe640 1 -- 172.21.15.161:0/305356399 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38031d20 con 0x7f4a5006b690 2023-11-24T08:05:07.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 -- 172.21.15.161:0/305356399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 msgr2=0x7f4a5015dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 --2- 172.21.15.161:0/305356399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a5015dd30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4a380097a0 tx=0x7f4a3802b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 -- 172.21.15.161:0/305356399 shutdown_connections 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 --2- 172.21.15.161:0/305356399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a5015e270 0x7f4a50070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 --2- 172.21.15.161:0/305356399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a5015dd30 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 -- 172.21.15.161:0/305356399 >> 172.21.15.161:0/305356399 conn(0x7f4a500cf700 msgr2=0x7f4a500cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 -- 172.21.15.161:0/305356399 shutdown_connections 2023-11-24T08:05:07.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.108+0000 7f4a563ec640 1 -- 172.21.15.161:0/305356399 wait complete. 2023-11-24T08:05:07.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.110+0000 7f4a563ec640 1 Processor -- start 2023-11-24T08:05:07.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.110+0000 7f4a563ec640 1 -- start start 2023-11-24T08:05:07.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a563ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a50146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a563ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a501540b0 0x7f4a50151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a563ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a50158fe0 0x7f4a50151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a563ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50157f60 con 0x7f4a5006b690 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a563ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50158240 con 0x7f4a501540b0 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a563ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50158520 con 0x7f4a50158fe0 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a4ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a50146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.111+0000 7f4a4ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a50146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48502/0 (socket says 172.21.15.161:48502) 2023-11-24T08:05:07.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 -- 172.21.15.161:0/1443614987 learned_addr learned my addr 172.21.15.161:0/1443614987 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:07.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a54989640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a50158fe0 0x7f4a50151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a47fff640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a501540b0 0x7f4a50151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 -- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a50158fe0 msgr2=0x7f4a50151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a50158fe0 0x7f4a50151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 -- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a501540b0 msgr2=0x7f4a50151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a501540b0 0x7f4a50151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 -- 172.21.15.161:0/1443614987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009400 con 0x7f4a5006b690 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4ffff640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a50146d50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c4d0 tx=0x7f4a4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.112+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400074e0 con 0x7f4a5006b690 2023-11-24T08:05:07.116 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.113+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40007660 con 0x7f4a5006b690 2023-11-24T08:05:07.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.113+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a50158800 con 0x7f4a5006b690 2023-11-24T08:05:07.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.113+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40004a20 con 0x7f4a5006b690 2023-11-24T08:05:07.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.113+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a50147290 con 0x7f4a5006b690 2023-11-24T08:05:07.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.114+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a500675d0 con 0x7f4a5006b690 2023-11-24T08:05:07.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.115+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f4a40004b80 con 0x7f4a5006b690 2023-11-24T08:05:07.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.116+0000 7f4a4d7fa640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4a3006aff0 0x7f4a3006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.118 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.116+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a40088e60 con 0x7f4a5006b690 2023-11-24T08:05:07.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.117+0000 7f4a47fff640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4a3006aff0 0x7f4a3006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.120 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.118+0000 7f4a47fff640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4a3006aff0 0x7f4a3006d4b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4a38036000 tx=0x7f4a38008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.123 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.121+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a40053c90 con 0x7f4a5006b690 2023-11-24T08:05:07.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.346+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a50066380 con 0x7f4a5006b690 2023-11-24T08:05:07.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.698+0000 7f4a4d7fa640 1 -- 172.21.15.161:0/1443614987 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 136+0+0 (secure 0 0 0) 0x7f4a400180c0 con 0x7f4a5006b690 2023-11-24T08:05:07.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4a3006aff0 msgr2=0x7f4a3006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4a3006aff0 0x7f4a3006d4b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4a38036000 tx=0x7f4a38008030 comp rx=0 tx=0).stop 2023-11-24T08:05:07.704 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 msgr2=0x7f4a50146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a50146d50 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c4d0 tx=0x7f4a4000c990 comp rx=0 tx=0).stop 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 shutdown_connections 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f4a3006aff0 0x7f4a3006d4b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a50158fe0 0x7f4a50151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a501540b0 0x7f4a50151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 --2- 172.21.15.161:0/1443614987 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a5006b690 0x7f4a50146d50 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 >> 172.21.15.161:0/1443614987 conn(0x7f4a500cf700 msgr2=0x7f4a50159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 shutdown_connections 2023-11-24T08:05:07.705 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.702+0000 7f4a563ec640 1 -- 172.21.15.161:0/1443614987 wait complete. 2023-11-24T08:05:07.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T08:05:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.935+0000 7f3df9733640 1 Processor -- start 2023-11-24T08:05:07.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.935+0000 7f3df9733640 1 -- start start 2023-11-24T08:05:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.936+0000 7f3df9733640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 0x7f3df415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.936+0000 7f3df9733640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df406c470 con 0x7f3df413e360 2023-11-24T08:05:07.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.936+0000 7f3df9733640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df406c750 con 0x7f3df40cf9a0 2023-11-24T08:05:07.939 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.936+0000 7f3df9733640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df406ca30 con 0x7f3df413df80 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.937+0000 7f3df27fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3df413e360 0x7f3df40cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40814/0 (socket says 172.21.15.161:40814) 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.937+0000 7f3df27fc640 1 -- 172.21.15.161:0/3824434191 learned_addr learned my addr 172.21.15.161:0/3824434191 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.937+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 0x7f3df415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.937+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596150499 0 0) 0x7f3df406c470 con 0x7f3df413e360 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.937+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ddc003520 con 0x7f3df413e360 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584640734 0 0) 0x7f3ddc003520 con 0x7f3df413e360 2023-11-24T08:05:07.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 msgr2=0x7f3df415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 0x7f3df415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 >> v1:172.21.15.175:6789/0 conn(0x7f3df40cf9a0 legacy=0x7f3df40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df406cd10 con 0x7f3df413e360 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f3de8001670 con 0x7f3df413e360 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 >> v1:172.21.15.161:6789/0 conn(0x7f3df413e360 legacy=0x7f3df40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ddc0039a0 0x7f3ddc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 0x7f3ddc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ddc004d00 0x7f3ddc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df406ca30 con 0x7f3ddc0039a0 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc00ba60 con 0x7f3ddc004d00 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc00bc20 con 0x7f3df413df80 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.938+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ddc0039a0 0x7f3ddc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.939+0000 7f3df2ffd640 1 -- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 msgr2=0x7f3ddc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.939+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3df413df80 0x7f3ddc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.939+0000 7f3df2ffd640 1 -- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ddc004d00 msgr2=0x7f3ddc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.939+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3ddc004d00 0x7f3ddc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.939+0000 7f3df2ffd640 1 -- 172.21.15.161:0/3824434191 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc003520 con 0x7f3ddc0039a0 2023-11-24T08:05:07.946 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ddc0039a0 0x7f3ddc003dc0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009a90 tx=0x7f3ddc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce57fc422b881539 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de402c6b0 con 0x7f3ddc0039a0 2023-11-24T08:05:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de402c810 con 0x7f3ddc0039a0 2023-11-24T08:05:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df1ffb640 1 -- 172.21.15.161:0/3824434191 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de402cba0 con 0x7f3ddc0039a0 2023-11-24T08:05:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df9733640 1 -- 172.21.15.161:0/3824434191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ddc0039a0 msgr2=0x7f3ddc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df9733640 1 --2- 172.21.15.161:0/3824434191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3ddc0039a0 0x7f3ddc003dc0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3de4009a90 tx=0x7f3ddc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df37fe640 1 -- 172.21.15.161:0/3824434191 reap_dead start 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df9733640 1 -- 172.21.15.161:0/3824434191 shutdown_connections 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.940+0000 7f3df9733640 1 -- 172.21.15.161:0/3824434191 >> 172.21.15.161:0/3824434191 conn(0x7f3df406a800 msgr2=0x7f3df406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.941+0000 7f3df9733640 1 -- 172.21.15.161:0/3824434191 shutdown_connections 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.941+0000 7f3df9733640 1 -- 172.21.15.161:0/3824434191 wait complete. 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.942+0000 7f3df9733640 1 Processor -- start 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.942+0000 7f3df9733640 1 -- start start 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df9733640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ddc0039a0 0x7f3df413d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df9733640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 0x7f3df4146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df9733640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df41473e0 0x7f3df40b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df9733640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df413dd90 con 0x7f3df4148990 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df9733640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df41478f0 con 0x7f3df41473e0 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df9733640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df4147bd0 con 0x7f3ddc0039a0 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.943+0000 7f3df27fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 0x7f3df4146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 0x7f3df4146ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48522/0 (socket says 172.21.15.161:48522) 2023-11-24T08:05:07.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 -- 172.21.15.161:0/1798389304 learned_addr learned my addr 172.21.15.161:0/1798389304 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 -- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ddc0039a0 msgr2=0x7f3df413d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ddc0039a0 0x7f3df413d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 -- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df41473e0 msgr2=0x7f3df40b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df41473e0 0x7f3df40b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 -- 172.21.15.161:0/1798389304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4147eb0 con 0x7f3df4148990 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3df27fc640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 0x7f3df4146ea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c770 tx=0x7f3de800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.944+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de80074e0 con 0x7f3df4148990 2023-11-24T08:05:07.950 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.945+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de8007640 con 0x7f3df4148990 2023-11-24T08:05:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.945+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8004a20 con 0x7f3df4148990 2023-11-24T08:05:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.945+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df4148190 con 0x7f3df4148990 2023-11-24T08:05:07.951 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.945+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df415a680 con 0x7f3df4148990 2023-11-24T08:05:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.946+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df40675d0 con 0x7f3df4148990 2023-11-24T08:05:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.947+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3de8004b80 con 0x7f3df4148990 2023-11-24T08:05:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.948+0000 7f3ddb7fe640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3de006b020 0x7f3de006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.948+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3de8088d90 con 0x7f3df4148990 2023-11-24T08:05:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.948+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3de006b020 0x7f3de006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:07.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.950+0000 7f3df2ffd640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3de006b020 0x7f3de006d4e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3de4036000 tx=0x7f3de402e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:07.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:07.952+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3de8053b30 con 0x7f3df4148990 2023-11-24T08:05:08.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.167+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3df415beb0 con 0x7f3de006b020 2023-11-24T08:05:08.173 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.171+0000 7f3ddb7fe640 1 -- 172.21.15.161:0/1798389304 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3df415beb0 con 0x7f3de006b020 2023-11-24T08:05:08.173 INFO:teuthology.orchestra.run.smithi161.stdout:[ 2023-11-24T08:05:08.173 INFO:teuthology.orchestra.run.smithi161.stdout: { 2023-11-24T08:05:08.173 INFO:teuthology.orchestra.run.smithi161.stdout: "name": "cephfs" 2023-11-24T08:05:08.174 INFO:teuthology.orchestra.run.smithi161.stdout: } 2023-11-24T08:05:08.174 INFO:teuthology.orchestra.run.smithi161.stdout:] 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3de006b020 msgr2=0x7f3de006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3de006b020 0x7f3de006d4e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3de4036000 tx=0x7f3de402e000 comp rx=0 tx=0).stop 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 msgr2=0x7f3df4146ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 0x7f3df4146ea0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c770 tx=0x7f3de800cc30 comp rx=0 tx=0).stop 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 shutdown_connections 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f3de006b020 0x7f3de006d4e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3df41473e0 0x7f3df40b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3df4148990 0x7f3df4146ea0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 --2- 172.21.15.161:0/1798389304 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3ddc0039a0 0x7f3df413d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.173+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 >> 172.21.15.161:0/1798389304 conn(0x7f3df406a800 msgr2=0x7f3df40ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.174+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 shutdown_connections 2023-11-24T08:05:08.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.174+0000 7f3df9733640 1 -- 172.21.15.161:0/1798389304 wait complete. 2023-11-24T08:05:08.195 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T08:05:08.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.411+0000 7f28a739e640 1 Processor -- start 2023-11-24T08:05:08.414 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.411+0000 7f28a739e640 1 -- start start 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a739e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f28a00d0b60 0x7f28a00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a739e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28a00aede0 0x7f28a006f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a739e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a0071de0 con 0x7f28a006a3e0 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a739e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00af270 con 0x7f28a00aede0 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a739e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a0072030 con 0x7f28a00d0b60 2023-11-24T08:05:08.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a593b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28a00aede0 0x7f28a006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a593b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f28a00aede0 0x7f28a006f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48526/0 (socket says 172.21.15.161:48526) 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a593b640 1 -- 172.21.15.161:0/3476987695 learned_addr learned my addr 172.21.15.161:0/3476987695 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.413+0000 7f28a4939640 1 --2- 172.21.15.161:0/3476987695 >> v2:172.21.15.175:3300/0 conn(0x7f28a00d0b60 0x7f28a00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.414+0000 7f28a593b640 1 -- 172.21.15.161:0/3476987695 >> v2:172.21.15.175:3300/0 conn(0x7f28a00d0b60 msgr2=0x7f28a00ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.414+0000 7f28a593b640 1 --2- 172.21.15.161:0/3476987695 >> v2:172.21.15.175:3300/0 conn(0x7f28a00d0b60 0x7f28a00ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.414+0000 7f28a593b640 1 -- 172.21.15.161:0/3476987695 >> v1:172.21.15.175:6789/0 conn(0x7f28a006a3e0 legacy=0x7f28a006a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:08.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.414+0000 7f28a593b640 1 -- 172.21.15.161:0/3476987695 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a0072310 con 0x7f28a00aede0 2023-11-24T08:05:08.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.415+0000 7f28a593b640 1 --2- 172.21.15.161:0/3476987695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a006f080 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f28a00b6120 tx=0x7f289802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee7eb6d3c869bb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.415+0000 7f2897fff640 1 -- 172.21.15.161:0/3476987695 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289802ca80 con 0x7f28a00aede0 2023-11-24T08:05:08.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.415+0000 7f2897fff640 1 -- 172.21.15.161:0/3476987695 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289802cbe0 con 0x7f28a00aede0 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.415+0000 7f2897fff640 1 -- 172.21.15.161:0/3476987695 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28980343f0 con 0x7f28a00aede0 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 -- 172.21.15.161:0/3476987695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 msgr2=0x7f28a006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 --2- 172.21.15.161:0/3476987695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a006f080 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f28a00b6120 tx=0x7f289802bee0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 -- 172.21.15.161:0/3476987695 shutdown_connections 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 --2- 172.21.15.161:0/3476987695 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a006f080 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 --2- 172.21.15.161:0/3476987695 >> v2:172.21.15.175:3300/0 conn(0x7f28a00d0b60 0x7f28a00ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 -- 172.21.15.161:0/3476987695 >> 172.21.15.161:0/3476987695 conn(0x7f28a00cfef0 msgr2=0x7f28a00d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 -- 172.21.15.161:0/3476987695 shutdown_connections 2023-11-24T08:05:08.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.416+0000 7f28a739e640 1 -- 172.21.15.161:0/3476987695 wait complete. 2023-11-24T08:05:08.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.418+0000 7f28a739e640 1 Processor -- start 2023-11-24T08:05:08.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.418+0000 7f28a739e640 1 -- start start 2023-11-24T08:05:08.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a739e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a006a3e0 0x7f28a00cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a739e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a0154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a739e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00d0b60 0x7f28a0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a739e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0141ed0 con 0x7f28a00aede0 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a739e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a0141240 con 0x7f28a00d0b60 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a739e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01415a0 con 0x7f28a006a3e0 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a0154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48528/0 (socket says 172.21.15.161:48528) 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 -- 172.21.15.161:0/3229382358 learned_addr learned my addr 172.21.15.161:0/3229382358 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a593b640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00d0b60 0x7f28a0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 -- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a006a3e0 msgr2=0x7f28a00cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a006a3e0 0x7f28a00cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 -- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00d0b60 msgr2=0x7f28a0154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00d0b60 0x7f28a0154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.419+0000 7f28a4939640 1 -- 172.21.15.161:0/3229382358 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009b30 con 0x7f28a00aede0 2023-11-24T08:05:08.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.420+0000 7f28a4939640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a0154600 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f289000d5c0 tx=0x7f289000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.420+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28900125f0 con 0x7f28a00aede0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.420+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2890012750 con 0x7f28a00aede0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.420+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2890012b00 con 0x7f28a00aede0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.420+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a0141880 con 0x7f28a00aede0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.420+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a0144430 con 0x7f28a00aede0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.421+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a00675d0 con 0x7f28a00aede0 2023-11-24T08:05:08.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.422+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f2890012c60 con 0x7f28a00aede0 2023-11-24T08:05:08.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.423+0000 7f2895ffb640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288406aff0 0x7f288406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:08.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.423+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2890089e30 con 0x7f28a00aede0 2023-11-24T08:05:08.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.424+0000 7f28a513a640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288406aff0 0x7f288406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:08.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.425+0000 7f28a513a640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288406aff0 0x7f288406d4b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28a01f60a0 tx=0x7f289c0079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:08.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.428+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2890054bc0 con 0x7f28a00aede0 2023-11-24T08:05:08.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.621+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f28a0142010 con 0x7f28a00aede0 2023-11-24T08:05:08.624 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.622+0000 7f2895ffb640 1 -- 172.21.15.161:0/3229382358 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f28a0142010 con 0x7f28a00aede0 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.624+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288406aff0 msgr2=0x7f288406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.624+0000 7f28a739e640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288406aff0 0x7f288406d4b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28a01f60a0 tx=0x7f289c0079b0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.624+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 msgr2=0x7f28a0154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.624+0000 7f28a739e640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a0154600 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f289000d5c0 tx=0x7f289000da80 comp rx=0 tx=0).stop 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 shutdown_connections 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f288406aff0 0x7f288406d4b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f28a00d0b60 0x7f28a0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f28a00aede0 0x7f28a0154600 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 --2- 172.21.15.161:0/3229382358 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f28a006a3e0 0x7f28a00cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:08.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 >> 172.21.15.161:0/3229382358 conn(0x7f28a00cfef0 msgr2=0x7f28a00adc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:08.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 shutdown_connections 2023-11-24T08:05:08.628 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:08.625+0000 7f28a739e640 1 -- 172.21.15.161:0/3229382358 wait complete. 2023-11-24T08:05:08.645 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T08:05:08.645 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:08.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T08:05:08.887 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T08:05:08.887 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:05:08.887 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:08.946 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:09.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.154+0000 7f049db35640 1 Processor -- start 2023-11-24T08:05:09.156 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.154+0000 7f049db35640 1 -- start start 2023-11-24T08:05:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049db35640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f04980b3f30 0x7f04980d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049db35640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980d0a10 con 0x7f0498160920 2023-11-24T08:05:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049db35640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980cf080 con 0x7f04980d0100 2023-11-24T08:05:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049db35640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04980c6be0 con 0x7f04980b3f30 2023-11-24T08:05:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049cb33640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0498160920 0x7f04980cf9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40822/0 (socket says 172.21.15.161:40822) 2023-11-24T08:05:09.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049cb33640 1 -- 172.21.15.161:0/550128237 learned_addr learned my addr 172.21.15.161:0/550128237 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:09.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f049d334640 1 --2- 172.21.15.161:0/550128237 >> v2:172.21.15.175:3300/0 conn(0x7f04980b3f30 0x7f04980d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.160 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.156+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937475375 0 0) 0x7f04980d0a10 con 0x7f0498160920 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0488003520 con 0x7f0498160920 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 974995264 0 0) 0x7f0488003520 con 0x7f0498160920 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 >> v2:172.21.15.175:3300/0 conn(0x7f04980b3f30 msgr2=0x7f04980d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 --2- 172.21.15.161:0/550128237 >> v2:172.21.15.175:3300/0 conn(0x7f04980b3f30 0x7f04980d1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 >> v1:172.21.15.175:6789/0 conn(0x7f04980d0100 legacy=0x7f04980d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980ce7e0 con 0x7f0498160920 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f048c001670 con 0x7f0498160920 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 >> v1:172.21.15.161:6789/0 conn(0x7f0498160920 legacy=0x7f04980cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0488003970 0x7f0488003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04880047c0 0x7f0488004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0488005180 0x7f048800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980c6be0 con 0x7f0488003970 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f048800c0d0 con 0x7f0488005180 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048800c290 con 0x7f04880047c0 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f049d334640 1 --2- 172.21.15.161:0/550128237 >> v2:172.21.15.175:3300/0 conn(0x7f04980b3f30 0x7f04980d1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.157+0000 7f049cb33640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0488003970 0x7f0488003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f0497fff640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04880047c0 0x7f0488004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049d334640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0488005180 0x7f048800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049cb33640 1 -- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04880047c0 msgr2=0x7f0488004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049cb33640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04880047c0 0x7f0488004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049cb33640 1 -- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0488005180 msgr2=0x7f048800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:09.162 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049cb33640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0488005180 0x7f048800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049d334640 1 -- 172.21.15.161:0/550128237 reap_dead start 2023-11-24T08:05:09.163 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.158+0000 7f049cb33640 1 -- 172.21.15.161:0/550128237 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0488003520 con 0x7f0488003970 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.159+0000 7f049cb33640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0488003970 0x7f0488003d90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c190 tx=0x7f04880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4fcad281dd195d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.159+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c005ad0 con 0x7f0488003970 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.159+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c005c30 con 0x7f0488003970 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.159+0000 7f04977fe640 1 -- 172.21.15.161:0/550128237 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c02cae0 con 0x7f0488003970 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 -- 172.21.15.161:0/550128237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0488003970 msgr2=0x7f0488003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0488003970 0x7f0488003d90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f048c00c190 tx=0x7f04880057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 -- 172.21.15.161:0/550128237 shutdown_connections 2023-11-24T08:05:09.164 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 --2- 172.21.15.161:0/550128237 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0488003970 0x7f0488003d90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 -- 172.21.15.161:0/550128237 >> 172.21.15.161:0/550128237 conn(0x7f04980d3090 msgr2=0x7f04980d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 -- 172.21.15.161:0/550128237 shutdown_connections 2023-11-24T08:05:09.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.160+0000 7f049db35640 1 -- 172.21.15.161:0/550128237 wait complete. 2023-11-24T08:05:09.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.162+0000 7f049db35640 1 Processor -- start 2023-11-24T08:05:09.165 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.162+0000 7f049db35640 1 -- start start 2023-11-24T08:05:09.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.163+0000 7f049db35640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0488003970 0x7f049815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.163+0000 7f049db35640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 0x7f04980cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.163+0000 7f049db35640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04980ca160 0x7f04980ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.163+0000 7f049db35640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b69d0 con 0x7f04980cbb20 2023-11-24T08:05:09.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.163+0000 7f049db35640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b6cb0 con 0x7f04980ca160 2023-11-24T08:05:09.166 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.163+0000 7f049db35640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980b6f90 con 0x7f0488003970 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 0x7f04980cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 0x7f04980cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48538/0 (socket says 172.21.15.161:48538) 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 -- 172.21.15.161:0/2171890404 learned_addr learned my addr 172.21.15.161:0/2171890404 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 -- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0488003970 msgr2=0x7f049815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0488003970 0x7f049815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 -- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04980ca160 msgr2=0x7f04980ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04980ca160 0x7f04980ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 -- 172.21.15.161:0/2171890404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980b7270 con 0x7f04980cbb20 2023-11-24T08:05:09.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f0497fff640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 0x7f04980cbfa0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f048400e410 tx=0x7f048400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.164+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840052e0 con 0x7f04980cbb20 2023-11-24T08:05:09.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.165+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484005440 con 0x7f04980cbb20 2023-11-24T08:05:09.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.165+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04980b7550 con 0x7f04980cbb20 2023-11-24T08:05:09.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.165+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484003810 con 0x7f04980cbb20 2023-11-24T08:05:09.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.165+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049815aa50 con 0x7f04980cbb20 2023-11-24T08:05:09.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.166+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049815ac70 con 0x7f04980cbb20 2023-11-24T08:05:09.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.167+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0484003970 con 0x7f04980cbb20 2023-11-24T08:05:09.169 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.168+0000 7f04957fa640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f047c06aff0 0x7f047c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.168+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04840890d0 con 0x7f04980cbb20 2023-11-24T08:05:09.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.168+0000 7f049cb33640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f047c06aff0 0x7f047c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.170+0000 7f049cb33640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f047c06aff0 0x7f047c06d4b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f048c034000 tx=0x7f048c039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.172+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0484053fb0 con 0x7f04980cbb20 2023-11-24T08:05:09.365 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.362+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0498067450 con 0x7f04980cbb20 2023-11-24T08:05:09.367 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.365+0000 7f04957fa640 1 -- 172.21.15.161:0/2171890404 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f04840575d0 con 0x7f04980cbb20 2023-11-24T08:05:09.367 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:09.367 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f047c06aff0 msgr2=0x7f047c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f047c06aff0 0x7f047c06d4b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f048c034000 tx=0x7f048c039040 comp rx=0 tx=0).stop 2023-11-24T08:05:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 msgr2=0x7f04980cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.369 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 0x7f04980cbfa0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f048400e410 tx=0x7f048400e8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 shutdown_connections 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f047c06aff0 0x7f047c06d4b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04980ca160 0x7f04980ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04980cbb20 0x7f04980cbfa0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 --2- 172.21.15.161:0/2171890404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0488003970 0x7f049815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 >> 172.21.15.161:0/2171890404 conn(0x7f04980d3090 msgr2=0x7f049806c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 shutdown_connections 2023-11-24T08:05:09.370 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.367+0000 7f049db35640 1 -- 172.21.15.161:0/2171890404 wait complete. 2023-11-24T08:05:09.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:53.068861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:54.318999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:09.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:09.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.596+0000 7fb330890640 1 Processor -- start 2023-11-24T08:05:09.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.596+0000 7fb330890640 1 -- start start 2023-11-24T08:05:09.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.598+0000 7fb330890640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb32c06a3e0 0x7fb32c0ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.598+0000 7fb330890640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32c071de0 con 0x7fb32c0aede0 2023-11-24T08:05:09.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.598+0000 7fb330890640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb32c0af270 con 0x7fb32c0d0b60 2023-11-24T08:05:09.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.598+0000 7fb330890640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb32c072030 con 0x7fb32c06a3e0 2023-11-24T08:05:09.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.598+0000 7fb32ad9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb32c0aede0 0x7fb32c06f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40826/0 (socket says 172.21.15.161:40826) 2023-11-24T08:05:09.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.598+0000 7fb32ad9d640 1 -- 172.21.15.161:0/3986996143 learned_addr learned my addr 172.21.15.161:0/3986996143 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:09.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32a59c640 1 --2- 172.21.15.161:0/3986996143 >> v2:172.21.15.175:3300/0 conn(0x7fb32c06a3e0 0x7fb32c0ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32959a640 1 -- 172.21.15.161:0/3986996143 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611224161 0 0) 0x7fb32c071de0 con 0x7fb32c0aede0 2023-11-24T08:05:09.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32959a640 1 -- 172.21.15.161:0/3986996143 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb318003520 con 0x7fb32c0aede0 2023-11-24T08:05:09.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32a59c640 1 -- 172.21.15.161:0/3986996143 >> v1:172.21.15.175:6789/0 conn(0x7fb32c0d0b60 legacy=0x7fb32c06a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32a59c640 1 -- 172.21.15.161:0/3986996143 >> v1:172.21.15.161:6789/0 conn(0x7fb32c0aede0 legacy=0x7fb32c06f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32959a640 1 -- 172.21.15.161:0/3986996143 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319034670 0 0) 0x7fb318003520 con 0x7fb32c0aede0 2023-11-24T08:05:09.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.599+0000 7fb32a59c640 1 -- 172.21.15.161:0/3986996143 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c072310 con 0x7fb32c06a3e0 2023-11-24T08:05:09.603 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.601+0000 7fb32a59c640 1 --2- 172.21.15.161:0/3986996143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c06a3e0 0x7fb32c0ac8d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755f2f0f229a07f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.601+0000 7fb32959a640 1 -- 172.21.15.161:0/3986996143 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb324001670 con 0x7fb32c06a3e0 2023-11-24T08:05:09.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb32959a640 1 -- 172.21.15.161:0/3986996143 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c02c940 con 0x7fb32c06a3e0 2023-11-24T08:05:09.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb32959a640 1 -- 172.21.15.161:0/3986996143 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c02ccd0 con 0x7fb32c06a3e0 2023-11-24T08:05:09.604 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 -- 172.21.15.161:0/3986996143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c06a3e0 msgr2=0x7fb32c0ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 --2- 172.21.15.161:0/3986996143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c06a3e0 0x7fb32c0ac8d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c02be10 comp rx=0 tx=0).stop 2023-11-24T08:05:09.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 -- 172.21.15.161:0/3986996143 shutdown_connections 2023-11-24T08:05:09.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 --2- 172.21.15.161:0/3986996143 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c06a3e0 0x7fb32c0ac8d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 -- 172.21.15.161:0/3986996143 >> 172.21.15.161:0/3986996143 conn(0x7fb32c0cfef0 msgr2=0x7fb32c0d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 -- 172.21.15.161:0/3986996143 shutdown_connections 2023-11-24T08:05:09.605 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.602+0000 7fb330890640 1 -- 172.21.15.161:0/3986996143 wait complete. 2023-11-24T08:05:09.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.604+0000 7fb330890640 1 Processor -- start 2023-11-24T08:05:09.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.604+0000 7fb330890640 1 -- start start 2023-11-24T08:05:09.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.605+0000 7fb330890640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb32c06a3e0 0x7fb32c13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.607 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.605+0000 7fb330890640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 0x7fb32c13e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.605+0000 7fb330890640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c0d0b60 0x7fb32c144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.605+0000 7fb330890640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c156f60 con 0x7fb32c0aede0 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.605+0000 7fb330890640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c1573f0 con 0x7fb32c0d0b60 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.605+0000 7fb330890640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32c154800 con 0x7fb32c06a3e0 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 0x7fb32c13e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 0x7fb32c13e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48552/0 (socket says 172.21.15.161:48552) 2023-11-24T08:05:09.608 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 -- 172.21.15.161:0/1906514379 learned_addr learned my addr 172.21.15.161:0/1906514379 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:09.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 -- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb32c06a3e0 msgr2=0x7fb32c13dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb32c06a3e0 0x7fb32c13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb32ad9d640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c0d0b60 0x7fb32c144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.609 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 -- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c0d0b60 msgr2=0x7fb32c144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c0d0b60 0x7fb32c144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 -- 172.21.15.161:0/1906514379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c009a70 con 0x7fb32c0aede0 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb329d9b640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 0x7fb32c13e530 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c400 tx=0x7fb31400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.606+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3140052d0 con 0x7fb32c0aede0 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.607+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb314005430 con 0x7fb32c0aede0 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.607+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb314003830 con 0x7fb32c0aede0 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.607+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c154520 con 0x7fb32c0aede0 2023-11-24T08:05:09.610 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.607+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c156bf0 con 0x7fb32c0aede0 2023-11-24T08:05:09.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.608+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb32c0675d0 con 0x7fb32c0aede0 2023-11-24T08:05:09.611 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.609+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb314003990 con 0x7fb32c0aede0 2023-11-24T08:05:09.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.610+0000 7fb322ffd640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb30c06aff0 0x7fb30c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:09.612 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.610+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb314088fa0 con 0x7fb32c0aede0 2023-11-24T08:05:09.613 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.611+0000 7fb32a59c640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb30c06aff0 0x7fb30c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:09.614 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.612+0000 7fb32a59c640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb30c06aff0 0x7fb30c06d4b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb31c036000 tx=0x7fb31c02e000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:09.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.615+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb314053d30 con 0x7fb32c0aede0 2023-11-24T08:05:09.809 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.807+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb32c0ad120 con 0x7fb32c0aede0 2023-11-24T08:05:09.810 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.808+0000 7fb322ffd640 1 -- 172.21.15.161:0/1906514379 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3140170a0 con 0x7fb32c0aede0 2023-11-24T08:05:09.810 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb30c06aff0 msgr2=0x7fb30c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb30c06aff0 0x7fb30c06d4b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb31c036000 tx=0x7fb31c02e000 comp rx=0 tx=0).stop 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 msgr2=0x7fb32c13e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 0x7fb32c13e530 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c400 tx=0x7fb31400c8c0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 shutdown_connections 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb30c06aff0 0x7fb30c06d4b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.810+0000 7fb330890640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb32c0d0b60 0x7fb32c144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.811+0000 7fb330890640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb32c0aede0 0x7fb32c13e530 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.811+0000 7fb330890640 1 --2- 172.21.15.161:0/1906514379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb32c06a3e0 0x7fb32c13dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:09.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.811+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 >> 172.21.15.161:0/1906514379 conn(0x7fb32c0cfef0 msgr2=0x7fb32c0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:09.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.811+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 shutdown_connections 2023-11-24T08:05:09.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:09.811+0000 7fb330890640 1 -- 172.21.15.161:0/1906514379 wait complete. 2023-11-24T08:05:09.830 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:10.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.039+0000 7f1582f9e640 1 Processor -- start 2023-11-24T08:05:10.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.039+0000 7f1582f9e640 1 -- start start 2023-11-24T08:05:10.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.041+0000 7f1582f9e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f157c150760 0x7f157c15d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.041+0000 7f1582f9e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f157c15d840 0x7f157c0b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.041+0000 7f1582f9e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f157c15dc70 con 0x7f157c072230 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.041+0000 7f1582f9e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c072610 con 0x7f157c150760 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.041+0000 7f1582f9e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157c0cf9a0 con 0x7f157c15d840 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f157c150760 0x7f157c15d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f157c150760 0x7f157c15d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48564/0 (socket says 172.21.15.161:48564) 2023-11-24T08:05:10.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 -- 172.21.15.161:0/1044463337 learned_addr learned my addr 172.21.15.161:0/1044463337 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:10.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f158153b640 1 --2- 172.21.15.161:0/1044463337 >> v2:172.21.15.175:3300/0 conn(0x7f157c15d840 0x7f157c0b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 -- 172.21.15.161:0/1044463337 >> v2:172.21.15.175:3300/0 conn(0x7f157c15d840 msgr2=0x7f157c0b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 --2- 172.21.15.161:0/1044463337 >> v2:172.21.15.175:3300/0 conn(0x7f157c15d840 0x7f157c0b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 -- 172.21.15.161:0/1044463337 >> v1:172.21.15.161:6789/0 conn(0x7f157c072230 legacy=0x7f157c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f1573fff640 1 -- 172.21.15.161:0/1044463337 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c150ba0 con 0x7f157c150760 2023-11-24T08:05:10.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.042+0000 7f15737fe640 1 -- 172.21.15.161:0/1044463337 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565543891 0 0) 0x7f157c15dc70 con 0x7f157c072230 2023-11-24T08:05:10.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.043+0000 7f1573fff640 1 --2- 172.21.15.161:0/1044463337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c15d300 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f157c0cb740 tx=0x7f156c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e02cb317adde4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f15737fe640 1 -- 172.21.15.161:0/1044463337 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c030860 con 0x7f157c150760 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f15737fe640 1 -- 172.21.15.161:0/1044463337 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c0309c0 con 0x7f157c150760 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f15737fe640 1 -- 172.21.15.161:0/1044463337 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c030d50 con 0x7f157c150760 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 -- 172.21.15.161:0/1044463337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 msgr2=0x7f157c15d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 --2- 172.21.15.161:0/1044463337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c15d300 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f157c0cb740 tx=0x7f156c02b9a0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 -- 172.21.15.161:0/1044463337 shutdown_connections 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 --2- 172.21.15.161:0/1044463337 >> v2:172.21.15.175:3300/0 conn(0x7f157c15d840 0x7f157c0b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 --2- 172.21.15.161:0/1044463337 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c15d300 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 -- 172.21.15.161:0/1044463337 >> 172.21.15.161:0/1044463337 conn(0x7f157c06a800 msgr2=0x7f157c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 -- 172.21.15.161:0/1044463337 shutdown_connections 2023-11-24T08:05:10.047 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.044+0000 7f1582f9e640 1 -- 172.21.15.161:0/1044463337 wait complete. 2023-11-24T08:05:10.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.046+0000 7f1582f9e640 1 Processor -- start 2023-11-24T08:05:10.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.046+0000 7f1582f9e640 1 -- start start 2023-11-24T08:05:10.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.047+0000 7f1582f9e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f157c072230 0x7f157c0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.047+0000 7f1582f9e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c1474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.047+0000 7f1582f9e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157c15d840 0x7f157c147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.047+0000 7f1582f9e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0ccab0 con 0x7f157c150760 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.047+0000 7f1582f9e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0cbea0 con 0x7f157c15d840 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.047+0000 7f1582f9e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157c0cc180 con 0x7f157c072230 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c1474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c1474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48578/0 (socket says 172.21.15.161:48578) 2023-11-24T08:05:10.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 -- 172.21.15.161:0/3166113903 learned_addr learned my addr 172.21.15.161:0/3166113903 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f158153b640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157c15d840 0x7f157c147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1580d3a640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f157c072230 0x7f157c0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 -- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f157c072230 msgr2=0x7f157c0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f157c072230 0x7f157c0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 -- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157c15d840 msgr2=0x7f157c147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157c15d840 0x7f157c147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 -- 172.21.15.161:0/3166113903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c0094d0 con 0x7f157c150760 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1580d3a640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f157c072230 0x7f157c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.048+0000 7f1573fff640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c1474f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f156c02b9e0 tx=0x7f156c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.049+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c030850 con 0x7f157c150760 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.049+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156c043400 con 0x7f157c150760 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.049+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156c0437b0 con 0x7f157c150760 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.049+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157c0cc460 con 0x7f157c150760 2023-11-24T08:05:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.049+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157c0cea20 con 0x7f157c150760 2023-11-24T08:05:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.050+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f157c0ccc60 con 0x7f157c150760 2023-11-24T08:05:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.051+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f156c043910 con 0x7f157c150760 2023-11-24T08:05:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.052+0000 7f15717fa640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f156806aff0 0x7f156806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.052+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f156c03e070 con 0x7f157c150760 2023-11-24T08:05:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.053+0000 7f1580d3a640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f156806aff0 0x7f156806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.054+0000 7f1580d3a640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f156806aff0 0x7f156806d4b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1578000f60 tx=0x7f1578009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.057+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f157c0ccc60 con 0x7f157c150760 2023-11-24T08:05:10.108 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:10.118 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.249+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f157c0675d0 con 0x7f157c150760 2023-11-24T08:05:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.250+0000 7f15717fa640 1 -- 172.21.15.161:0/3166113903 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f156c077b90 con 0x7f157c150760 2023-11-24T08:05:10.252 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.252+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f156806aff0 msgr2=0x7f156806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.252+0000 7f1582f9e640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f156806aff0 0x7f156806d4b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1578000f60 tx=0x7f1578009040 comp rx=0 tx=0).stop 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.252+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 msgr2=0x7f157c1474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.252+0000 7f1582f9e640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c1474f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f156c02b9e0 tx=0x7f156c004730 comp rx=0 tx=0).stop 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 shutdown_connections 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f156806aff0 0x7f156806d4b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f157c15d840 0x7f157c147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f157c150760 0x7f157c1474f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 --2- 172.21.15.161:0/3166113903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f157c072230 0x7f157c0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 >> 172.21.15.161:0/3166113903 conn(0x7f157c06a800 msgr2=0x7f157c0b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 shutdown_connections 2023-11-24T08:05:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.253+0000 7f1582f9e640 1 -- 172.21.15.161:0/3166113903 wait complete. 2023-11-24T08:05:10.274 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:10.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.535+0000 7fd40b59e640 1 Processor -- start 2023-11-24T08:05:10.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.535+0000 7fd40b59e640 1 -- start start 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40b59e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd40c13fcb0 0x7fd40c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c0cdc20 0x7fd40c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40b59e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40c0ce440 con 0x7fd40c13cf10 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40b59e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd40c0ce720 con 0x7fd40c13fcb0 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c0cea00 con 0x7fd40c0cdc20 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd40c13fcb0 0x7fd40c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd40c13fcb0 0x7fd40c0cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48592/0 (socket says 172.21.15.161:48592) 2023-11-24T08:05:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 -- 172.21.15.161:0/1649424066 learned_addr learned my addr 172.21.15.161:0/1649424066 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40a59c640 1 --1- 172.21.15.161:0/1649424066 >> v1:172.21.15.161:6789/0 conn(0x7fd40c13cf10 0x7fd40c13f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40846/0 (socket says 172.21.15.161:40846) 2023-11-24T08:05:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40ad9d640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c0cdc20 0x7fd40c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 -- 172.21.15.161:0/1649424066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c0cdc20 msgr2=0x7fd40c0b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c0cdc20 0x7fd40c0b2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 -- 172.21.15.161:0/1649424066 >> v1:172.21.15.161:6789/0 conn(0x7fd40c13cf10 legacy=0x7fd40c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd403fff640 1 -- 172.21.15.161:0/1649424066 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c0b1d90 con 0x7fd40c13fcb0 2023-11-24T08:05:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.537+0000 7fd40ad9d640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c0cdc20 0x7fd40c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.539+0000 7fd403fff640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c13fcb0 0x7fd40c0cd6e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009870 tx=0x7fd3f402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac8addb1ef98e9a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.539+0000 7fd409d9b640 1 -- 172.21.15.161:0/1649424066 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4030840 con 0x7fd40c13fcb0 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.539+0000 7fd409d9b640 1 -- 172.21.15.161:0/1649424066 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f40309a0 con 0x7fd40c13fcb0 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.539+0000 7fd409d9b640 1 -- 172.21.15.161:0/1649424066 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4030d30 con 0x7fd40c13fcb0 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 -- 172.21.15.161:0/1649424066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c13fcb0 msgr2=0x7fd40c0cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c13fcb0 0x7fd40c0cd6e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4009870 tx=0x7fd3f402b980 comp rx=0 tx=0).stop 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 -- 172.21.15.161:0/1649424066 shutdown_connections 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c0cdc20 0x7fd40c0b2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 --2- 172.21.15.161:0/1649424066 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c13fcb0 0x7fd40c0cd6e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 -- 172.21.15.161:0/1649424066 >> 172.21.15.161:0/1649424066 conn(0x7fd40c06a7d0 msgr2=0x7fd40c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 -- 172.21.15.161:0/1649424066 shutdown_connections 2023-11-24T08:05:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.540+0000 7fd40b59e640 1 -- 172.21.15.161:0/1649424066 wait complete. 2023-11-24T08:05:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.542+0000 7fd40b59e640 1 Processor -- start 2023-11-24T08:05:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.542+0000 7fd40b59e640 1 -- start start 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40b59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 0x7fd40c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40b59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c13cf10 0x7fd40c152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40b59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c13fcb0 0x7fd40c1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40b59e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c15bcc0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40b59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c13d6a0 con 0x7fd40c13cf10 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40b59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c1f4150 con 0x7fd40c13fcb0 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 0x7fd40c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 0x7fd40c159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48596/0 (socket says 172.21.15.161:48596) 2023-11-24T08:05:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 -- 172.21.15.161:0/3300541698 learned_addr learned my addr 172.21.15.161:0/3300541698 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 -- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c13fcb0 msgr2=0x7fd40c1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c13fcb0 0x7fd40c1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 -- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c13cf10 msgr2=0x7fd40c152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c13cf10 0x7fd40c152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.543+0000 7fd40a59c640 1 -- 172.21.15.161:0/3300541698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f40094d0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.544+0000 7fd40a59c640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 0x7fd40c159100 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00c4d0 tx=0x7fd3fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.544+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc007480 con 0x7fd40c0cdc20 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.544+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc0075e0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.544+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c1f3e70 con 0x7fd40c0cdc20 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.544+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc0049e0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.544+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c15b8e0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.545+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c15be00 con 0x7fd40c0cdc20 2023-11-24T08:05:10.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.546+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd3fc004b40 con 0x7fd40c0cdc20 2023-11-24T08:05:10.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.547+0000 7fd402ffd640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd3ec06aff0 0x7fd3ec06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.547+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3fc088de0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.548+0000 7fd403fff640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd3ec06aff0 0x7fd3ec06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.549+0000 7fd403fff640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd3ec06aff0 0x7fd3ec06d4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4036000 tx=0x7fd3f403b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.551+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd3fc053ca0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.745 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.743+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd40c067450 con 0x7fd40c0cdc20 2023-11-24T08:05:10.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.744+0000 7fd402ffd640 1 -- 172.21.15.161:0/3300541698 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd3fc0180a0 con 0x7fd40c0cdc20 2023-11-24T08:05:10.747 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:05:10.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd3ec06aff0 msgr2=0x7fd3ec06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd3ec06aff0 0x7fd3ec06d4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4036000 tx=0x7fd3f403b040 comp rx=0 tx=0).stop 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 msgr2=0x7fd40c159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 0x7fd40c159100 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00c4d0 tx=0x7fd3fc00c990 comp rx=0 tx=0).stop 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 shutdown_connections 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd3ec06aff0 0x7fd3ec06d4b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd40c13fcb0 0x7fd40c1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd40c13cf10 0x7fd40c152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 --2- 172.21.15.161:0/3300541698 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd40c0cdc20 0x7fd40c159100 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.747+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 >> 172.21.15.161:0/3300541698 conn(0x7fd40c06a7d0 msgr2=0x7fd40c0aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.748+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 shutdown_connections 2023-11-24T08:05:10.750 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.748+0000 7fd40b59e640 1 -- 172.21.15.161:0/3300541698 wait complete. 2023-11-24T08:05:10.768 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.975+0000 7febd9d7a640 1 Processor -- start 2023-11-24T08:05:10.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.975+0000 7febd9d7a640 1 -- start start 2023-11-24T08:05:10.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd9d7a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 0x7febd4161900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd9d7a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd4161470 con 0x7febd40cf740 2023-11-24T08:05:10.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd9d7a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd415e410 con 0x7febd40b2430 2023-11-24T08:05:10.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd9d7a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40b3ff0 con 0x7febd40b2050 2023-11-24T08:05:10.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd9579640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7febd40cf740 0x7febd415d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55312/0 (socket says 172.21.15.161:55312) 2023-11-24T08:05:10.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd9579640 1 -- 172.21.15.161:0/2866232351 learned_addr learned my addr 172.21.15.161:0/2866232351 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd8d78640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 0x7febd4161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243160818 0 0) 0x7febd4161470 con 0x7febd40cf740 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.977+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc4003520 con 0x7febd40cf740 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1087747680 0 0) 0x7febc4003520 con 0x7febd40cf740 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 msgr2=0x7febd4161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 0x7febd4161900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 >> v1:172.21.15.175:6789/0 conn(0x7febd40b2430 legacy=0x7febd40cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd415e6f0 con 0x7febd40cf740 2023-11-24T08:05:10.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7febcc0019f0 con 0x7febd40cf740 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 >> v1:172.21.15.161:6789/0 conn(0x7febd40cf740 legacy=0x7febd415d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febc40039a0 0x7febc4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 0x7febc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40b3ff0 con 0x7febc40039a0 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc40054e0 con 0x7febc40047c0 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc400bec0 con 0x7febd40b2050 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd8d78640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febc40039a0 0x7febc4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.978+0000 7febd3fff640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.979+0000 7febd8d78640 1 -- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 msgr2=0x7febc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.979+0000 7febd8d78640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd40b2050 0x7febc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.979+0000 7febd8d78640 1 -- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40047c0 msgr2=0x7febc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:10.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.979+0000 7febd8d78640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.979+0000 7febd8d78640 1 -- 172.21.15.161:0/2866232351 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc4003520 con 0x7febc40039a0 2023-11-24T08:05:10.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.979+0000 7febd3fff640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40047c0 0x7febc4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd8d78640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febc40039a0 0x7febc4003dc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7febc800ba30 tx=0x7febc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8591a47ea3489c9e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8032680 con 0x7febc40039a0 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc80327e0 con 0x7febc40039a0 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd37fe640 1 -- 172.21.15.161:0/2866232351 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8032b70 con 0x7febc40039a0 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd9d7a640 1 -- 172.21.15.161:0/2866232351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febc40039a0 msgr2=0x7febc4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd9d7a640 1 --2- 172.21.15.161:0/2866232351 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febc40039a0 0x7febc4003dc0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7febc800ba30 tx=0x7febc40057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd9579640 1 -- 172.21.15.161:0/2866232351 reap_dead start 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd9d7a640 1 -- 172.21.15.161:0/2866232351 shutdown_connections 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.980+0000 7febd9d7a640 1 -- 172.21.15.161:0/2866232351 >> 172.21.15.161:0/2866232351 conn(0x7febd406a800 msgr2=0x7febd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:10.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.981+0000 7febd9d7a640 1 -- 172.21.15.161:0/2866232351 shutdown_connections 2023-11-24T08:05:10.985 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.981+0000 7febd9d7a640 1 -- 172.21.15.161:0/2866232351 wait complete. 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.982+0000 7febd9d7a640 1 Processor -- start 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.982+0000 7febd9d7a640 1 -- start start 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.983+0000 7febd9d7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40039a0 0x7febd4144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.983+0000 7febd9d7a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd406c650 0x7febd406cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.983+0000 7febd9d7a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 0x7febd409ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.983+0000 7febd9d7a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd406d010 con 0x7febd409a6b0 2023-11-24T08:05:10.986 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.983+0000 7febd9d7a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4144bc0 con 0x7febc40039a0 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.983+0000 7febd9d7a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd415a1c0 con 0x7febd406c650 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 0x7febd409ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 0x7febd409ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53638/0 (socket says 172.21.15.161:53638) 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 -- 172.21.15.161:0/87534188 learned_addr learned my addr 172.21.15.161:0/87534188 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 -- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd406c650 msgr2=0x7febd406cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd406c650 0x7febd406cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 -- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40039a0 msgr2=0x7febd4144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40039a0 0x7febd4144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 -- 172.21.15.161:0/87534188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd409b3e0 con 0x7febd409a6b0 2023-11-24T08:05:10.987 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.984+0000 7febd9579640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 0x7febd409ab30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7febd40b3680 tx=0x7febcc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.985+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc00a610 con 0x7febd409a6b0 2023-11-24T08:05:10.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.985+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc00a790 con 0x7febd409a6b0 2023-11-24T08:05:10.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.985+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc00ab40 con 0x7febd409a6b0 2023-11-24T08:05:10.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.985+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd409b6c0 con 0x7febd409a6b0 2023-11-24T08:05:10.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.985+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd409bc80 con 0x7febd409a6b0 2023-11-24T08:05:10.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.986+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd4067450 con 0x7febd409a6b0 2023-11-24T08:05:10.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.987+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7febcc00aca0 con 0x7febd409a6b0 2023-11-24T08:05:10.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.988+0000 7febd17fa640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7febb806b020 0x7febb806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:10.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.988+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febcc0891f0 con 0x7febd409a6b0 2023-11-24T08:05:10.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.988+0000 7febd8d78640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7febb806b020 0x7febb806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:10.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.990+0000 7febd8d78640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7febb806b020 0x7febb806d4e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7febc800ba00 tx=0x7febc8032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:10.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:10.992+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7febcc054010 con 0x7febd409a6b0 2023-11-24T08:05:11.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.179+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7febd415a380 con 0x7febd409a6b0 2023-11-24T08:05:11.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.180+0000 7febd17fa640 1 -- 172.21.15.161:0/87534188 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7febcc057630 con 0x7febd409a6b0 2023-11-24T08:05:11.182 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.182+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7febb806b020 msgr2=0x7febb806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.182+0000 7febd9d7a640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7febb806b020 0x7febb806d4e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7febc800ba00 tx=0x7febc8032000 comp rx=0 tx=0).stop 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.182+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 msgr2=0x7febd409ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.182+0000 7febd9d7a640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 0x7febd409ab30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7febd40b3680 tx=0x7febcc00ccb0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 shutdown_connections 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7febb806b020 0x7febb806d4e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febd409a6b0 0x7febd409ab30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7febd406c650 0x7febd406cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 --2- 172.21.15.161:0/87534188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7febc40039a0 0x7febd4144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 >> 172.21.15.161:0/87534188 conn(0x7febd406a800 msgr2=0x7febd4145960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 shutdown_connections 2023-11-24T08:05:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.183+0000 7febd9d7a640 1 -- 172.21.15.161:0/87534188 wait complete. 2023-11-24T08:05:11.203 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi161.front.sepia.ceph.com... 2023-11-24T08:05:11.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:11.203 DEBUG:teuthology.orchestra.run.smithi161:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-24T08:05:11.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi161.stderr:ceph-fuse[109459]: fuse finished with error 0 and tester_r 0 2023-11-24T08:05:11.295 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:05:11.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:11.295 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T08:05:11.470 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:05:11.470 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:11.530 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.751+0000 7f95ca821640 1 Processor -- start 2023-11-24T08:05:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.751+0000 7f95ca821640 1 -- start start 2023-11-24T08:05:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.752+0000 7f95ca821640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f95c4160920 0x7f95c40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.752+0000 7f95ca821640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95c40cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95ca821640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c40d0a10 con 0x7f95c4161010 2023-11-24T08:05:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95ca821640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c40d03b0 con 0x7f95c4160920 2023-11-24T08:05:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95ca821640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40d1f50 con 0x7f95c40cf9f0 2023-11-24T08:05:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95ca020640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f95c4161010 0x7f95c41614a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55314/0 (socket says 172.21.15.161:55314) 2023-11-24T08:05:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95ca020640 1 -- 172.21.15.161:0/2862958338 learned_addr learned my addr 172.21.15.161:0/2862958338 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604172119 0 0) 0x7f95c40d0a10 con 0x7f95c4161010 2023-11-24T08:05:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95c901e640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95c40cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95c981f640 1 --2- 172.21.15.161:0/2862958338 >> v2:172.21.15.175:3300/0 conn(0x7f95c4160920 0x7f95c40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.753+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b0003520 con 0x7f95c4161010 2023-11-24T08:05:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 725645838 0 0) 0x7f95b0003520 con 0x7f95c4161010 2023-11-24T08:05:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 msgr2=0x7f95c40cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95c40cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 >> v2:172.21.15.175:3300/0 conn(0x7f95c4160920 msgr2=0x7f95c40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 --2- 172.21.15.161:0/2862958338 >> v2:172.21.15.175:3300/0 conn(0x7f95c4160920 0x7f95c40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40cf080 con 0x7f95c4161010 2023-11-24T08:05:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f95bc0019f0 con 0x7f95c4161010 2023-11-24T08:05:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c981f640 1 --2- 172.21.15.161:0/2862958338 >> v2:172.21.15.175:3300/0 conn(0x7f95c4160920 0x7f95c40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c901e640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95c40cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 >> v1:172.21.15.161:6789/0 conn(0x7f95c4161010 legacy=0x7f95c41614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b0003970 0x7f95b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b00047c0 0x7f95b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40d03b0 con 0x7f95b00047c0 2023-11-24T08:05:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40d1f50 con 0x7f95b0003970 2023-11-24T08:05:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b000ba00 con 0x7f95c40cf9f0 2023-11-24T08:05:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c901e640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b00047c0 0x7f95b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c981f640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b0003970 0x7f95b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95ca020640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.754+0000 7f95c901e640 1 -- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 msgr2=0x7f95b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.755+0000 7f95c901e640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.755+0000 7f95c901e640 1 -- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b0003970 msgr2=0x7f95b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.755+0000 7f95c901e640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b0003970 0x7f95b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.755+0000 7f95c901e640 1 -- 172.21.15.161:0/2862958338 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0003520 con 0x7f95b00047c0 2023-11-24T08:05:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.755+0000 7f95ca020640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c40cf9f0 0x7f95b0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:11.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.755+0000 7f95c981f640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b0003970 0x7f95b0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:11.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95c901e640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b00047c0 0x7f95b0004c40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f95b40098a0 tx=0x7f95b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f1ea83aeefbcae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4004230 con 0x7f95b00047c0 2023-11-24T08:05:11.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4004390 con 0x7f95b00047c0 2023-11-24T08:05:11.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95c881d640 1 -- 172.21.15.161:0/2862958338 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4003830 con 0x7f95b00047c0 2023-11-24T08:05:11.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95ca821640 1 -- 172.21.15.161:0/2862958338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b00047c0 msgr2=0x7f95b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95ca821640 1 --2- 172.21.15.161:0/2862958338 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95b00047c0 0x7f95b0004c40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f95b40098a0 tx=0x7f95b00057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.756+0000 7f95ca020640 1 -- 172.21.15.161:0/2862958338 reap_dead start 2023-11-24T08:05:11.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.757+0000 7f95ca821640 1 -- 172.21.15.161:0/2862958338 shutdown_connections 2023-11-24T08:05:11.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.757+0000 7f95ca821640 1 -- 172.21.15.161:0/2862958338 >> 172.21.15.161:0/2862958338 conn(0x7f95c40d3090 msgr2=0x7f95c40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.757+0000 7f95ca821640 1 -- 172.21.15.161:0/2862958338 shutdown_connections 2023-11-24T08:05:11.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.757+0000 7f95ca821640 1 -- 172.21.15.161:0/2862958338 wait complete. 2023-11-24T08:05:11.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.758+0000 7f95ca821640 1 Processor -- start 2023-11-24T08:05:11.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 -- start start 2023-11-24T08:05:11.767 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b00047c0 0x7f95c415af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 0x7f95c415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c414a260 0x7f95c40b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4149e40 con 0x7f95c40c60a0 2023-11-24T08:05:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c40cbdd0 con 0x7f95b00047c0 2023-11-24T08:05:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.759+0000 7f95ca821640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4149570 con 0x7f95c414a260 2023-11-24T08:05:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 0x7f95c415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 0x7f95c415b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53666/0 (socket says 172.21.15.161:53666) 2023-11-24T08:05:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 -- 172.21.15.161:0/3993017403 learned_addr learned my addr 172.21.15.161:0/3993017403 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c981f640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b00047c0 0x7f95c415af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95ca020640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c414a260 0x7f95c40b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 -- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c414a260 msgr2=0x7f95c40b7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c414a260 0x7f95c40b7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 -- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b00047c0 msgr2=0x7f95c415af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b00047c0 0x7f95c415af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95c901e640 1 -- 172.21.15.161:0/3993017403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c40b89f0 con 0x7f95c40c60a0 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.760+0000 7f95ca020640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c414a260 0x7f95c40b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.761+0000 7f95c901e640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 0x7f95c415b4a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f95b40099c0 tx=0x7f95b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.761+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4030610 con 0x7f95c40c60a0 2023-11-24T08:05:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.761+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4030770 con 0x7f95c40c60a0 2023-11-24T08:05:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.761+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4030b00 con 0x7f95c40c60a0 2023-11-24T08:05:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.761+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c4149780 con 0x7f95c40c60a0 2023-11-24T08:05:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.761+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c40b8240 con 0x7f95c40c60a0 2023-11-24T08:05:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.762+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c4067450 con 0x7f95c40c60a0 2023-11-24T08:05:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.763+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f95b4030c60 con 0x7f95c40c60a0 2023-11-24T08:05:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.764+0000 7f95ba7fc640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f95a806aff0 0x7f95a806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.764+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95b40ab540 con 0x7f95c40c60a0 2023-11-24T08:05:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.765+0000 7f95c981f640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f95a806aff0 0x7f95a806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:11.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.766+0000 7f95c981f640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f95a806aff0 0x7f95a806d4b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f95c0006fd0 tx=0x7f95c0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:11.773 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.769+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95b4076360 con 0x7f95c40c60a0 2023-11-24T08:05:11.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.960+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95c40b7ae0 con 0x7f95c40c60a0 2023-11-24T08:05:11.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.961+0000 7f95ba7fc640 1 -- 172.21.15.161:0/3993017403 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7f95b4006e10 con 0x7f95c40c60a0 2023-11-24T08:05:11.964 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:11.964 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:11.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f95a806aff0 msgr2=0x7f95a806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f95a806aff0 0x7f95a806d4b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f95c0006fd0 tx=0x7f95c0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 msgr2=0x7f95c415b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 0x7f95c415b4a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f95b40099c0 tx=0x7f95b4004730 comp rx=0 tx=0).stop 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 shutdown_connections 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f95a806aff0 0x7f95a806d4b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f95c414a260 0x7f95c40b7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f95c40c60a0 0x7f95c415b4a0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 --2- 172.21.15.161:0/3993017403 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f95b00047c0 0x7f95c415af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 >> 172.21.15.161:0/3993017403 conn(0x7f95c40d3090 msgr2=0x7f95c406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.964+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 shutdown_connections 2023-11-24T08:05:11.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:11.965+0000 7f95ca821640 1 -- 172.21.15.161:0/3993017403 wait complete. 2023-11-24T08:05:11.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:53.068861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:54.318999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:11.986 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:12.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.200+0000 7f1e77dec640 1 Processor -- start 2023-11-24T08:05:12.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.200+0000 7f1e77dec640 1 -- start start 2023-11-24T08:05:12.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e77dec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1e7013e360 0x7f1e700cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e77dec640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7015c5f0 con 0x7f1e7015f9c0 2023-11-24T08:05:12.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e77dec640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7006c470 con 0x7f1e7013df80 2023-11-24T08:05:12.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e77dec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7006c750 con 0x7f1e7013e360 2023-11-24T08:05:12.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e76389640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1e7015f9c0 0x7f1e700cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55326/0 (socket says 172.21.15.161:55326) 2023-11-24T08:05:12.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e76389640 1 -- 172.21.15.161:0/2649215456 learned_addr learned my addr 172.21.15.161:0/2649215456 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.202+0000 7f1e75387640 1 --2- 172.21.15.161:0/2649215456 >> v2:172.21.15.175:3300/0 conn(0x7f1e7013e360 0x7f1e700cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2121767917 0 0) 0x7f1e7015c5f0 con 0x7f1e7015f9c0 2023-11-24T08:05:12.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e5c003520 con 0x7f1e7015f9c0 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 10060371 0 0) 0x7f1e5c003520 con 0x7f1e7015f9c0 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 >> v2:172.21.15.175:3300/0 conn(0x7f1e7013e360 msgr2=0x7f1e700cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 --2- 172.21.15.161:0/2649215456 >> v2:172.21.15.175:3300/0 conn(0x7f1e7013e360 0x7f1e700cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 >> v1:172.21.15.175:6789/0 conn(0x7f1e7013df80 legacy=0x7f1e7015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7006ca30 con 0x7f1e7015f9c0 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f1e68001a10 con 0x7f1e7015f9c0 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 >> v1:172.21.15.161:6789/0 conn(0x7f1e7015f9c0 legacy=0x7f1e700cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e5c003970 0x7f1e5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e5c0047c0 0x7f1e5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c005180 0x7f1e5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7006c750 con 0x7f1e5c003970 2023-11-24T08:05:12.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c00c020 con 0x7f1e5c0047c0 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.203+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5c00c1e0 con 0x7f1e5c005180 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75b88640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e5c003970 0x7f1e5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75387640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e5c0047c0 0x7f1e5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75b88640 1 -- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c005180 msgr2=0x7f1e5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75b88640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c005180 0x7f1e5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75b88640 1 -- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e5c0047c0 msgr2=0x7f1e5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75b88640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e5c0047c0 0x7f1e5c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e75b88640 1 -- 172.21.15.161:0/2649215456 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c003520 con 0x7f1e5c003970 2023-11-24T08:05:12.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.204+0000 7f1e76389640 1 -- 172.21.15.161:0/2649215456 reap_dead start 2023-11-24T08:05:12.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.205+0000 7f1e75b88640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e5c003970 0x7f1e5c003d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c001750 tx=0x7f1e5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec38c64355e19e74 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0052d0 con 0x7f1e5c003970 2023-11-24T08:05:12.209 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c02e050 con 0x7f1e5c003970 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e74b86640 1 -- 172.21.15.161:0/2649215456 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c003830 con 0x7f1e5c003970 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 -- 172.21.15.161:0/2649215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e5c003970 msgr2=0x7f1e5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e5c003970 0x7f1e5c003d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c001750 tx=0x7f1e5c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 -- 172.21.15.161:0/2649215456 shutdown_connections 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 --2- 172.21.15.161:0/2649215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e5c003970 0x7f1e5c003d90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 -- 172.21.15.161:0/2649215456 >> 172.21.15.161:0/2649215456 conn(0x7f1e7006a800 msgr2=0x7f1e7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 -- 172.21.15.161:0/2649215456 shutdown_connections 2023-11-24T08:05:12.210 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.206+0000 7f1e77dec640 1 -- 172.21.15.161:0/2649215456 wait complete. 2023-11-24T08:05:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.208+0000 7f1e77dec640 1 Processor -- start 2023-11-24T08:05:12.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.208+0000 7f1e77dec640 1 -- start start 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.209+0000 7f1e77dec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c003970 0x7f1e700702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.209+0000 7f1e77dec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70151430 0x7f1e700b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.209+0000 7f1e77dec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 0x7f1e701f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.209+0000 7f1e77dec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700714b0 con 0x7f1e701f3290 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.209+0000 7f1e77dec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e700708a0 con 0x7f1e70151430 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.209+0000 7f1e77dec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e70070b80 con 0x7f1e5c003970 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 0x7f1e701f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 0x7f1e701f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53690/0 (socket says 172.21.15.161:53690) 2023-11-24T08:05:12.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 -- 172.21.15.161:0/3996170802 learned_addr learned my addr 172.21.15.161:0/3996170802 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:12.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e75387640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70151430 0x7f1e700b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e75b88640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c003970 0x7f1e700702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 -- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c003970 msgr2=0x7f1e700702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c003970 0x7f1e700702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 -- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70151430 msgr2=0x7f1e700b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70151430 0x7f1e700b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 -- 172.21.15.161:0/3996170802 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70070e60 con 0x7f1e701f3290 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e75b88640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c003970 0x7f1e700702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e75387640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70151430 0x7f1e700b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.210+0000 7f1e76389640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 0x7f1e701f36f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1e700cfea0 tx=0x7f1e6800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.211+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800a610 con 0x7f1e701f3290 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.211+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800a790 con 0x7f1e701f3290 2023-11-24T08:05:12.214 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.211+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800ab40 con 0x7f1e701f3290 2023-11-24T08:05:12.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.211+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e70071140 con 0x7f1e701f3290 2023-11-24T08:05:12.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.211+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e70151a90 con 0x7f1e701f3290 2023-11-24T08:05:12.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.212+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e70071660 con 0x7f1e701f3290 2023-11-24T08:05:12.215 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.213+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f1e6800aca0 con 0x7f1e701f3290 2023-11-24T08:05:12.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.214+0000 7f1e667fc640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1e5406b020 0x7f1e5406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.214+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e680891c0 con 0x7f1e701f3290 2023-11-24T08:05:12.216 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.215+0000 7f1e75b88640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1e5406b020 0x7f1e5406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.217 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.216+0000 7f1e75b88640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1e5406b020 0x7f1e5406d4e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c033000 tx=0x7f1e6c009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.220 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.218+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e70071660 con 0x7f1e701f3290 2023-11-24T08:05:12.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.410+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e700675d0 con 0x7f1e701f3290 2023-11-24T08:05:12.413 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.411+0000 7f1e667fc640 1 -- 172.21.15.161:0/3996170802 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e6801a0a0 con 0x7f1e701f3290 2023-11-24T08:05:12.414 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:05:12.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1e5406b020 msgr2=0x7f1e5406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1e5406b020 0x7f1e5406d4e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c033000 tx=0x7f1e6c009030 comp rx=0 tx=0).stop 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 msgr2=0x7f1e701f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 0x7f1e701f36f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1e700cfea0 tx=0x7f1e6800cc00 comp rx=0 tx=0).stop 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 shutdown_connections 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f1e5406b020 0x7f1e5406d4e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1e701f3290 0x7f1e701f36f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1e70151430 0x7f1e700b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 --2- 172.21.15.161:0/3996170802 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1e5c003970 0x7f1e700702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 >> 172.21.15.161:0/3996170802 conn(0x7f1e7006a800 msgr2=0x7f1e700cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 shutdown_connections 2023-11-24T08:05:12.417 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.414+0000 7f1e77dec640 1 -- 172.21.15.161:0/3996170802 wait complete. 2023-11-24T08:05:12.436 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:12.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.652+0000 7f554bfff640 1 Processor -- start 2023-11-24T08:05:12.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.652+0000 7f554bfff640 1 -- start start 2023-11-24T08:05:12.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.654+0000 7f554bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f554c13cf10 0x7f554c13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.654+0000 7f554bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f554c13fae0 0x7f554c0cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.654+0000 7f554bfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c0ce440 con 0x7f554c0cdc20 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.654+0000 7f554bfff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c13ff90 con 0x7f554c13fae0 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.654+0000 7f554bfff640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0ce720 con 0x7f554c13cf10 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f554b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f554c0cdc20 0x7f554c15d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55342/0 (socket says 172.21.15.161:55342) 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f554b7fe640 1 -- 172.21.15.161:0/3646887939 learned_addr learned my addr 172.21.15.161:0/3646887939 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f55427fc640 1 --2- 172.21.15.161:0/3646887939 >> v2:172.21.15.161:3300/0 conn(0x7f554c13fae0 0x7f554c0cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f554affd640 1 --2- 172.21.15.161:0/3646887939 >> v2:172.21.15.175:3300/0 conn(0x7f554c13cf10 0x7f554c13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f554a7fc640 1 -- 172.21.15.161:0/3646887939 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164301079 0 0) 0x7f554c0ce440 con 0x7f554c0cdc20 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f55427fc640 1 -- 172.21.15.161:0/3646887939 >> v2:172.21.15.175:3300/0 conn(0x7f554c13cf10 msgr2=0x7f554c13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f55427fc640 1 --2- 172.21.15.161:0/3646887939 >> v2:172.21.15.175:3300/0 conn(0x7f554c13cf10 0x7f554c13f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f55427fc640 1 -- 172.21.15.161:0/3646887939 >> v1:172.21.15.161:6789/0 conn(0x7f554c0cdc20 legacy=0x7f554c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.655+0000 7f55427fc640 1 -- 172.21.15.161:0/3646887939 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c0cea00 con 0x7f554c13fae0 2023-11-24T08:05:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.656+0000 7f55427fc640 1 --2- 172.21.15.161:0/3646887939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c0cd6e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f554c06e390 tx=0x7f553402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cbe4454ec25235 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.657+0000 7f554a7fc640 1 -- 172.21.15.161:0/3646887939 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534031830 con 0x7f554c13fae0 2023-11-24T08:05:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.657+0000 7f554a7fc640 1 -- 172.21.15.161:0/3646887939 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5534031990 con 0x7f554c13fae0 2023-11-24T08:05:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.657+0000 7f554a7fc640 1 -- 172.21.15.161:0/3646887939 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5534031d20 con 0x7f554c13fae0 2023-11-24T08:05:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.657+0000 7f554bfff640 1 -- 172.21.15.161:0/3646887939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 msgr2=0x7f554c0cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.657+0000 7f554bfff640 1 --2- 172.21.15.161:0/3646887939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c0cd6e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f554c06e390 tx=0x7f553402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.658+0000 7f554bfff640 1 -- 172.21.15.161:0/3646887939 shutdown_connections 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.658+0000 7f554bfff640 1 --2- 172.21.15.161:0/3646887939 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c0cd6e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.658+0000 7f554bfff640 1 --2- 172.21.15.161:0/3646887939 >> v2:172.21.15.175:3300/0 conn(0x7f554c13cf10 0x7f554c13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.658+0000 7f554bfff640 1 -- 172.21.15.161:0/3646887939 >> 172.21.15.161:0/3646887939 conn(0x7f554c06a7d0 msgr2=0x7f554c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.658+0000 7f554bfff640 1 -- 172.21.15.161:0/3646887939 shutdown_connections 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.658+0000 7f554bfff640 1 -- 172.21.15.161:0/3646887939 wait complete. 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.659+0000 7f554bfff640 1 Processor -- start 2023-11-24T08:05:12.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.660+0000 7f554bfff640 1 -- start start 2023-11-24T08:05:12.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554c0cdc20 0x7f554c165700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554c13cf10 0x7f554c135950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554bfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c14d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554bfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c165c40 con 0x7f554c13fae0 2023-11-24T08:05:12.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554bfff640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c1368c0 con 0x7f554c0cdc20 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554bfff640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c165ec0 con 0x7f554c13cf10 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c14d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c14d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53722/0 (socket says 172.21.15.161:53722) 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 -- 172.21.15.161:0/3963432634 learned_addr learned my addr 172.21.15.161:0/3963432634 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554affd640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554c0cdc20 0x7f554c165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f55427fc640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554c13cf10 0x7f554c135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 -- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554c13cf10 msgr2=0x7f554c135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554c13cf10 0x7f554c135950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 -- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554c0cdc20 msgr2=0x7f554c165700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554c0cdc20 0x7f554c165700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f554b7fe640 1 -- 172.21.15.161:0/3963432634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534009400 con 0x7f554c13fae0 2023-11-24T08:05:12.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.661+0000 7f55427fc640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554c13cf10 0x7f554c135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:12.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.662+0000 7f554b7fe640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c14d6b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f554400c7e0 tx=0x7f554400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.662+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400a640 con 0x7f554c13fae0 2023-11-24T08:05:12.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.662+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400a7c0 con 0x7f554c13fae0 2023-11-24T08:05:12.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.662+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c14c8f0 con 0x7f554c13fae0 2023-11-24T08:05:12.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.662+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400ab70 con 0x7f554c13fae0 2023-11-24T08:05:12.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.662+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c14ceb0 con 0x7f554c13fae0 2023-11-24T08:05:12.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.663+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c067450 con 0x7f554c13fae0 2023-11-24T08:05:12.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.664+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f554400acd0 con 0x7f554c13fae0 2023-11-24T08:05:12.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.666+0000 7f5543fff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f552c06b020 0x7f552c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:12.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.666+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55440891f0 con 0x7f554c13fae0 2023-11-24T08:05:12.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.666+0000 7f554affd640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f552c06b020 0x7f552c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:12.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.667+0000 7f554affd640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f552c06b020 0x7f552c06d4e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f553c006fd0 tx=0x7f553c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:12.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.670+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5544053f80 con 0x7f554c13fae0 2023-11-24T08:05:12.863 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.861+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f554c13f380 con 0x7f554c13fae0 2023-11-24T08:05:12.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.862+0000 7f5543fff640 1 -- 172.21.15.161:0/3963432634 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55440575a0 con 0x7f554c13fae0 2023-11-24T08:05:12.864 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:05:12.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f552c06b020 msgr2=0x7f552c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f552c06b020 0x7f552c06d4e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f553c006fd0 tx=0x7f553c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 msgr2=0x7f554c14d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c14d6b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f554400c7e0 tx=0x7f554400cca0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 shutdown_connections 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f552c06b020 0x7f552c06d4e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f554c13fae0 0x7f554c14d6b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f554c13cf10 0x7f554c135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 --2- 172.21.15.161:0/3963432634 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f554c0cdc20 0x7f554c165700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 >> 172.21.15.161:0/3963432634 conn(0x7f554c06a7d0 msgr2=0x7f554c15a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 shutdown_connections 2023-11-24T08:05:12.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:12.865+0000 7f554bfff640 1 -- 172.21.15.161:0/3963432634 wait complete. 2023-11-24T08:05:12.886 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:13.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.100+0000 7f6bad741640 1 Processor -- start 2023-11-24T08:05:13.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.100+0000 7f6bad741640 1 -- start start 2023-11-24T08:05:13.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.101+0000 7f6bad741640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6ba815e3b0 0x7f6ba8164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.101+0000 7f6bad741640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80b1ee0 con 0x7f6ba8143ae0 2023-11-24T08:05:13.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.101+0000 7f6bad741640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba80b2780 con 0x7f6ba80cf9a0 2023-11-24T08:05:13.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.101+0000 7f6bad741640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba815e990 con 0x7f6ba815e3b0 2023-11-24T08:05:13.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba6ffd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6ba8143ae0 0x7f6ba80cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55350/0 (socket says 172.21.15.161:55350) 2023-11-24T08:05:13.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba6ffd640 1 -- 172.21.15.161:0/1346204334 learned_addr learned my addr 172.21.15.161:0/1346204334 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632049362 0 0) 0x7f6ba80b1ee0 con 0x7f6ba8143ae0 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b90003520 con 0x7f6ba8143ae0 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba77fe640 1 --2- 172.21.15.161:0/1346204334 >> v2:172.21.15.175:3300/0 conn(0x7f6ba815e3b0 0x7f6ba8164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2294404711 0 0) 0x7f6b90003520 con 0x7f6ba8143ae0 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 >> v2:172.21.15.175:3300/0 conn(0x7f6ba815e3b0 msgr2=0x7f6ba8164de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 --2- 172.21.15.161:0/1346204334 >> v2:172.21.15.175:3300/0 conn(0x7f6ba815e3b0 0x7f6ba8164de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 >> v1:172.21.15.175:6789/0 conn(0x7f6ba80cf9a0 legacy=0x7f6ba815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80b2130 con 0x7f6ba8143ae0 2023-11-24T08:05:13.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.102+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6b98001670 con 0x7f6ba8143ae0 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 >> v1:172.21.15.161:6789/0 conn(0x7f6ba8143ae0 legacy=0x7f6ba80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b90003970 0x7f6b90003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b900047c0 0x7f6b90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90005180 0x7f6b9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba815e990 con 0x7f6b90003970 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000c0b0 con 0x7f6b90005180 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9000c270 con 0x7f6b900047c0 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b90003970 0x7f6b90003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba77fe640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90005180 0x7f6b9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba6ffd640 1 -- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b900047c0 msgr2=0x7f6b90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b900047c0 0x7f6b90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.107 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba6ffd640 1 -- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90005180 msgr2=0x7f6b9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:13.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b90005180 0x7f6b9000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba6ffd640 1 -- 172.21.15.161:0/1346204334 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b90003520 con 0x7f6b90003970 2023-11-24T08:05:13.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.103+0000 7f6ba77fe640 1 -- 172.21.15.161:0/1346204334 reap_dead start 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b90003970 0x7f6b90003d70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6b98001eb0 tx=0x7f6b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b31e6d1a5b5806 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005ad0 con 0x7f6b90003970 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b98005c50 con 0x7f6b90003970 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6ba5ffb640 1 -- 172.21.15.161:0/1346204334 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9802c8b0 con 0x7f6b90003970 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6bad741640 1 -- 172.21.15.161:0/1346204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b90003970 msgr2=0x7f6b90003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6bad741640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b90003970 0x7f6b90003d70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f6b98001eb0 tx=0x7f6b900057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6bad741640 1 -- 172.21.15.161:0/1346204334 shutdown_connections 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6bad741640 1 --2- 172.21.15.161:0/1346204334 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b90003970 0x7f6b90003d70 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.105+0000 7f6bad741640 1 -- 172.21.15.161:0/1346204334 >> 172.21.15.161:0/1346204334 conn(0x7f6ba806a800 msgr2=0x7f6ba806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:13.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.106+0000 7f6bad741640 1 -- 172.21.15.161:0/1346204334 shutdown_connections 2023-11-24T08:05:13.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.106+0000 7f6bad741640 1 -- 172.21.15.161:0/1346204334 wait complete. 2023-11-24T08:05:13.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.107+0000 7f6bad741640 1 Processor -- start 2023-11-24T08:05:13.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.108+0000 7f6bad741640 1 -- start start 2023-11-24T08:05:13.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.108+0000 7f6bad741640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b90003970 0x7f6ba80ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.108+0000 7f6bad741640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 0x7f6ba80ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6bad741640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ba8141180 0x7f6ba8141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6bad741640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba8141b40 con 0x7f6ba8137ef0 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6bad741640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80ae790 con 0x7f6ba8141180 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6bad741640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba80adba0 con 0x7f6b90003970 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 0x7f6ba80ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 0x7f6ba80ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53748/0 (socket says 172.21.15.161:53748) 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 -- 172.21.15.161:0/1523749043 learned_addr learned my addr 172.21.15.161:0/1523749043 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b90003970 0x7f6ba80ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba77fe640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ba8141180 0x7f6ba8141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 -- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b90003970 msgr2=0x7f6ba80ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b90003970 0x7f6ba80ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 -- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ba8141180 msgr2=0x7f6ba8141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ba8141180 0x7f6ba8141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.109+0000 7f6ba67fc640 1 -- 172.21.15.161:0/1523749043 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba80acf90 con 0x7f6ba8137ef0 2023-11-24T08:05:13.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.110+0000 7f6ba67fc640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 0x7f6ba80ae250 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c420 tx=0x7f6b9c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.110+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c011790 con 0x7f6ba8137ef0 2023-11-24T08:05:13.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.110+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c0118f0 con 0x7f6ba8137ef0 2023-11-24T08:05:13.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.110+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba80ad270 con 0x7f6ba8137ef0 2023-11-24T08:05:13.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.110+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c011ca0 con 0x7f6ba8137ef0 2023-11-24T08:05:13.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.110+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba80ad830 con 0x7f6ba8137ef0 2023-11-24T08:05:13.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.111+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba80675d0 con 0x7f6ba8137ef0 2023-11-24T08:05:13.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.112+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6b9c01c460 con 0x7f6ba8137ef0 2023-11-24T08:05:13.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.113+0000 7f6b8f7fe640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b9406aff0 0x7f6b9406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.113+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b9c089680 con 0x7f6ba8137ef0 2023-11-24T08:05:13.115 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.114+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b9406aff0 0x7f6b9406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.117 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.115+0000 7f6ba6ffd640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b9406aff0 0x7f6b9406d4b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6b98034000 tx=0x7f6b98009030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.119 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.117+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b9c054560 con 0x7f6ba8137ef0 2023-11-24T08:05:13.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.302+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ba81426a0 con 0x7f6ba8137ef0 2023-11-24T08:05:13.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.303+0000 7f6b8f7fe640 1 -- 172.21.15.161:0/1523749043 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b9c057b80 con 0x7f6ba8137ef0 2023-11-24T08:05:13.305 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b9406aff0 msgr2=0x7f6b9406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b9406aff0 0x7f6b9406d4b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6b98034000 tx=0x7f6b98009030 comp rx=0 tx=0).stop 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 msgr2=0x7f6ba80ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 0x7f6ba80ae250 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00c420 tx=0x7f6b9c00c820 comp rx=0 tx=0).stop 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 shutdown_connections 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6b9406aff0 0x7f6b9406d4b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ba8141180 0x7f6ba8141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ba8137ef0 0x7f6ba80ae250 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 --2- 172.21.15.161:0/1523749043 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b90003970 0x7f6ba80ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.305+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 >> 172.21.15.161:0/1523749043 conn(0x7f6ba806a800 msgr2=0x7f6ba80b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:13.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.306+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 shutdown_connections 2023-11-24T08:05:13.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.306+0000 7f6bad741640 1 -- 172.21.15.161:0/1523749043 wait complete. 2023-11-24T08:05:13.325 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T08:05:13.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.524+0000 7fa2085b0640 1 Processor -- start 2023-11-24T08:05:13.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.524+0000 7fa2085b0640 1 -- start start 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa2085b0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa20014b2c0 0x7fa2000cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa2085b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa200071070 0x7fa2000cc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa2085b0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000cfbf0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa2085b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20014b6a0 con 0x7fa200071070 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa2085b0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa200071690 con 0x7fa20014b2c0 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa205b4b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa2000cf7d0 0x7fa200070960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55364/0 (socket says 172.21.15.161:55364) 2023-11-24T08:05:13.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa205b4b640 1 -- 172.21.15.161:0/2828433627 learned_addr learned my addr 172.21.15.161:0/2828433627 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:13.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa206b4d640 1 --2- 172.21.15.161:0/2828433627 >> v2:172.21.15.161:3300/0 conn(0x7fa200071070 0x7fa2000cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.526+0000 7fa20634c640 1 --2- 172.21.15.161:0/2828433627 >> v2:172.21.15.175:3300/0 conn(0x7fa20014b2c0 0x7fa2000cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.527+0000 7fa20534a640 1 -- 172.21.15.161:0/2828433627 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010140031 0 0) 0x7fa2000cfbf0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.527+0000 7fa20534a640 1 -- 172.21.15.161:0/2828433627 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ec003520 con 0x7fa2000cf7d0 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.527+0000 7fa206b4d640 1 -- 172.21.15.161:0/2828433627 >> v2:172.21.15.175:3300/0 conn(0x7fa20014b2c0 msgr2=0x7fa2000cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.527+0000 7fa206b4d640 1 --2- 172.21.15.161:0/2828433627 >> v2:172.21.15.175:3300/0 conn(0x7fa20014b2c0 0x7fa2000cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.527+0000 7fa206b4d640 1 -- 172.21.15.161:0/2828433627 >> v1:172.21.15.161:6789/0 conn(0x7fa2000cf7d0 legacy=0x7fa200070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.527+0000 7fa206b4d640 1 -- 172.21.15.161:0/2828433627 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa200071970 con 0x7fa200071070 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.528+0000 7fa206b4d640 1 --2- 172.21.15.161:0/2828433627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa200071070 0x7fa2000cc160 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa20006e650 tx=0x7fa1f802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f5760c025faa4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.528+0000 7fa20534a640 1 -- 172.21.15.161:0/2828433627 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f802cc80 con 0x7fa200071070 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.528+0000 7fa20534a640 1 -- 172.21.15.161:0/2828433627 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f802cde0 con 0x7fa200071070 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.528+0000 7fa20534a640 1 -- 172.21.15.161:0/2828433627 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8034660 con 0x7fa200071070 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 -- 172.21.15.161:0/2828433627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa200071070 msgr2=0x7fa2000cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 --2- 172.21.15.161:0/2828433627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa200071070 0x7fa2000cc160 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa20006e650 tx=0x7fa1f802bed0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 -- 172.21.15.161:0/2828433627 shutdown_connections 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 --2- 172.21.15.161:0/2828433627 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa200071070 0x7fa2000cc160 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 --2- 172.21.15.161:0/2828433627 >> v2:172.21.15.175:3300/0 conn(0x7fa20014b2c0 0x7fa2000cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 -- 172.21.15.161:0/2828433627 >> 172.21.15.161:0/2828433627 conn(0x7fa20006a800 msgr2=0x7fa20006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 -- 172.21.15.161:0/2828433627 shutdown_connections 2023-11-24T08:05:13.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.529+0000 7fa2085b0640 1 -- 172.21.15.161:0/2828433627 wait complete. 2023-11-24T08:05:13.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.531+0000 7fa2085b0640 1 Processor -- start 2023-11-24T08:05:13.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.531+0000 7fa2085b0640 1 -- start start 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa2085b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa200071070 0x7fa2001645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa2085b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 0x7fa2001f6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa2085b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20014b2c0 0x7fa2001f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa2085b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001f6d00 con 0x7fa2000cf7d0 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa2085b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000cd5e0 con 0x7fa20014b2c0 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa2085b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000cd8c0 con 0x7fa200071070 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 0x7fa2001f6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 0x7fa2001f6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53764/0 (socket says 172.21.15.161:53764) 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 -- 172.21.15.161:0/3179453084 learned_addr learned my addr 172.21.15.161:0/3179453084 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 -- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa200071070 msgr2=0x7fa2001645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa20634c640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa200071070 0x7fa2001645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa200071070 0x7fa2001645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa206b4d640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20014b2c0 0x7fa2001f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 -- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20014b2c0 msgr2=0x7fa2001f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20014b2c0 0x7fa2001f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa205b4b640 1 -- 172.21.15.161:0/3179453084 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f8009a70 con 0x7fa2000cf7d0 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.532+0000 7fa20634c640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa200071070 0x7fa2001645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.533+0000 7fa205b4b640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 0x7fa2001f6280 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c500 tx=0x7fa1f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.533+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0005ce0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.533+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f0005e40 con 0x7fa2000cf7d0 2023-11-24T08:05:13.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.533+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2000cdba0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.533+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0007330 con 0x7fa2000cf7d0 2023-11-24T08:05:13.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.533+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2000ce160 con 0x7fa2000cf7d0 2023-11-24T08:05:13.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.534+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2000675d0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.535+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa1f0007550 con 0x7fa2000cf7d0 2023-11-24T08:05:13.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.536+0000 7fa1f6ffd640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e406aff0 0x7fa1e406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:13.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.536+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1f0088fe0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.537+0000 7fa20634c640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e406aff0 0x7fa1e406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:13.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.538+0000 7fa20634c640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e406aff0 0x7fa1e406d4b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc006fd0 tx=0x7fa1fc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:13.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.541+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa1f0053ec0 con 0x7fa2000cf7d0 2023-11-24T08:05:13.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.727+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa200067c00 con 0x7fa2000cf7d0 2023-11-24T08:05:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.728+0000 7fa1f6ffd640 1 -- 172.21.15.161:0/3179453084 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa1f0017020 con 0x7fa2000cf7d0 2023-11-24T08:05:13.730 INFO:teuthology.orchestra.run.smithi161.stderr:listed 0 entries 2023-11-24T08:05:13.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.730+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e406aff0 msgr2=0x7fa1e406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.730+0000 7fa2085b0640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e406aff0 0x7fa1e406d4b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc006fd0 tx=0x7fa1fc008040 comp rx=0 tx=0).stop 2023-11-24T08:05:13.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.730+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 msgr2=0x7fa2001f6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:13.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 0x7fa2001f6280 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000c500 tx=0x7fa1f000c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 shutdown_connections 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa1e406aff0 0x7fa1e406d4b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa20014b2c0 0x7fa2001f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2000cf7d0 0x7fa2001f6280 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 --2- 172.21.15.161:0/3179453084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa200071070 0x7fa2001645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 >> 172.21.15.161:0/3179453084 conn(0x7fa20006a800 msgr2=0x7fa20006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 shutdown_connections 2023-11-24T08:05:13.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:13.731+0000 7fa2085b0640 1 -- 172.21.15.161:0/3179453084 wait complete. 2023-11-24T08:05:13.751 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi175.front.sepia.ceph.com... 2023-11-24T08:05:13.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:13.752 DEBUG:teuthology.orchestra.run.smithi175:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-24T08:05:13.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi175.stderr:ceph-fuse[97016]: fuse finished with error 0 and tester_r 0 2023-11-24T08:05:13.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:05:13.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:13.854 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T08:05:14.029 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:05:14.029 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:14.086 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:05:14.086 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:05:14.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:14.087 DEBUG:teuthology.orchestra.run.smithi161:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T08:05:14.138 INFO:teuthology.orchestra.run.smithi161.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-24T08:05:14.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:05:14.139 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:05:14.139 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:14.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:05:14.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:05:14.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:14.198 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T08:05:14.251 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-24T08:05:14.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:05:14.253 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:14.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.471+0000 7f9bda094640 1 Processor -- start 2023-11-24T08:05:14.473 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.471+0000 7f9bda094640 1 -- start start 2023-11-24T08:05:14.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bda094640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9bd413e360 0x7f9bd40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bda094640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bd415f9c0 0x7f9bd40cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bda094640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd415c5f0 con 0x7f9bd413df80 2023-11-24T08:05:14.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bda094640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd406c470 con 0x7f9bd415f9c0 2023-11-24T08:05:14.475 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bda094640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd406c750 con 0x7f9bd413e360 2023-11-24T08:05:14.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bd415f9c0 0x7f9bd40cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9bd415f9c0 0x7f9bd40cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53770/0 (socket says 172.21.15.161:53770) 2023-11-24T08:05:14.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bd3fff640 1 -- 172.21.15.161:0/2368799233 learned_addr learned my addr 172.21.15.161:0/2368799233 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:14.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.473+0000 7f9bcbfff640 1 --2- 172.21.15.161:0/2368799233 >> v2:172.21.15.175:3300/0 conn(0x7f9bd413e360 0x7f9bd40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.474+0000 7f9bd3fff640 1 -- 172.21.15.161:0/2368799233 >> v2:172.21.15.175:3300/0 conn(0x7f9bd413e360 msgr2=0x7f9bd40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:14.476 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.474+0000 7f9bd3fff640 1 --2- 172.21.15.161:0/2368799233 >> v2:172.21.15.175:3300/0 conn(0x7f9bd413e360 0x7f9bd40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.474+0000 7f9bd3fff640 1 -- 172.21.15.161:0/2368799233 >> v1:172.21.15.175:6789/0 conn(0x7f9bd413df80 legacy=0x7f9bd415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.474+0000 7f9bd3fff640 1 -- 172.21.15.161:0/2368799233 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd406ca30 con 0x7f9bd415f9c0 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.475+0000 7f9bd3fff640 1 --2- 172.21.15.161:0/2368799233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd415f9c0 0x7f9bd40cf7d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9bd406ded0 tx=0x7f9bcc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cfe4b5ae24bde8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.475+0000 7f9bd2ffd640 1 -- 172.21.15.161:0/2368799233 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc02cb20 con 0x7f9bd415f9c0 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.475+0000 7f9bd2ffd640 1 -- 172.21.15.161:0/2368799233 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc02cc80 con 0x7f9bd415f9c0 2023-11-24T08:05:14.477 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.475+0000 7f9bd2ffd640 1 -- 172.21.15.161:0/2368799233 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0343f0 con 0x7f9bd415f9c0 2023-11-24T08:05:14.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 -- 172.21.15.161:0/2368799233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd415f9c0 msgr2=0x7f9bd40cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 --2- 172.21.15.161:0/2368799233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd415f9c0 0x7f9bd40cf7d0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9bd406ded0 tx=0x7f9bcc02bf80 comp rx=0 tx=0).stop 2023-11-24T08:05:14.478 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 -- 172.21.15.161:0/2368799233 shutdown_connections 2023-11-24T08:05:14.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 --2- 172.21.15.161:0/2368799233 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd415f9c0 0x7f9bd40cf7d0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 --2- 172.21.15.161:0/2368799233 >> v2:172.21.15.175:3300/0 conn(0x7f9bd413e360 0x7f9bd40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 -- 172.21.15.161:0/2368799233 >> 172.21.15.161:0/2368799233 conn(0x7f9bd406a800 msgr2=0x7f9bd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:14.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 -- 172.21.15.161:0/2368799233 shutdown_connections 2023-11-24T08:05:14.479 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.476+0000 7f9bda094640 1 -- 172.21.15.161:0/2368799233 wait complete. 2023-11-24T08:05:14.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.478+0000 7f9bda094640 1 Processor -- start 2023-11-24T08:05:14.480 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.478+0000 7f9bda094640 1 -- start start 2023-11-24T08:05:14.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bda094640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd413df80 0x7f9bd413d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bda094640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 0x7f9bd4071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bda094640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd415f9c0 0x7f9bd414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.481 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bda094640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd414c180 con 0x7f9bd413e360 2023-11-24T08:05:14.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bda094640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4071220 con 0x7f9bd415f9c0 2023-11-24T08:05:14.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bda094640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd41f3f00 con 0x7f9bd413df80 2023-11-24T08:05:14.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 0x7f9bd4071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bcbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 0x7f9bd4071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53784/0 (socket says 172.21.15.161:53784) 2023-11-24T08:05:14.482 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.479+0000 7f9bcbfff640 1 -- 172.21.15.161:0/713464405 learned_addr learned my addr 172.21.15.161:0/713464405 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:14.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bd37fe640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd413df80 0x7f9bd413d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bd3fff640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd415f9c0 0x7f9bd414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bcbfff640 1 -- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd413df80 msgr2=0x7f9bd413d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bcbfff640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd413df80 0x7f9bd413d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.483 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bcbfff640 1 -- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd415f9c0 msgr2=0x7f9bd414d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bcbfff640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd415f9c0 0x7f9bd414d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bcbfff640 1 -- 172.21.15.161:0/713464405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bcc009b30 con 0x7f9bd413e360 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bd3fff640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd415f9c0 0x7f9bd414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bcbfff640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 0x7f9bd4071640 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00e8d0 tx=0x7f9bbc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.480+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc009650 con 0x7f9bd413e360 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.481+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc004240 con 0x7f9bd413e360 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.481+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00c730 con 0x7f9bd413e360 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.481+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd4070320 con 0x7f9bd413e360 2023-11-24T08:05:14.484 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.481+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd4070b60 con 0x7f9bd413e360 2023-11-24T08:05:14.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.482+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd4071360 con 0x7f9bd413e360 2023-11-24T08:05:14.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.483+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9bbc00c890 con 0x7f9bd413e360 2023-11-24T08:05:14.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.484+0000 7f9bd0ff9640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bb406aff0 0x7f9bb406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.484+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bbc089e20 con 0x7f9bd413e360 2023-11-24T08:05:14.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.484+0000 7f9bd37fe640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bb406aff0 0x7f9bb406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.487 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.485+0000 7f9bd37fe640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bb406aff0 0x7f9bb406d4b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4007fd0 tx=0x7f9bc4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.488+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9bd4071360 con 0x7f9bd413e360 2023-11-24T08:05:14.718 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.716+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bd4071360 con 0x7f9bd413e360 2023-11-24T08:05:14.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.717+0000 7f9bd0ff9640 1 -- 172.21.15.161:0/713464405 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f9bd4071360 con 0x7f9bd413e360 2023-11-24T08:05:14.719 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:14.719 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:55.289954+0000","modified":"2023-11-24T08:04:58.365831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4018716146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4018716146},{"type":"v1","addr":"172.21.15.161:6835","nonce":4018716146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:05:14.720 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 37 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bb406aff0 msgr2=0x7f9bb406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bb406aff0 0x7f9bb406d4b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4007fd0 tx=0x7f9bc4009040 comp rx=0 tx=0).stop 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 msgr2=0x7f9bd4071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 0x7f9bd4071640 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc00e8d0 tx=0x7f9bbc00ed90 comp rx=0 tx=0).stop 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 shutdown_connections 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9bb406aff0 0x7f9bb406d4b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bd415f9c0 0x7f9bd414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9bd413e360 0x7f9bd4071640 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 --2- 172.21.15.161:0/713464405 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bd413df80 0x7f9bd413d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 >> 172.21.15.161:0/713464405 conn(0x7f9bd406a800 msgr2=0x7f9bd415d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 shutdown_connections 2023-11-24T08:05:14.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.720+0000 7f9bda094640 1 -- 172.21.15.161:0/713464405 wait complete. 2023-11-24T08:05:14.742 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:14.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.957+0000 7fc893cbb640 1 Processor -- start 2023-11-24T08:05:14.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.957+0000 7fc893cbb640 1 -- start start 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.958+0000 7fc893cbb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc88c14b2c0 0x7fc88c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.958+0000 7fc893cbb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc88c0cf7d0 0x7fc88c070960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc893cbb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c070ea0 0x7fc88c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc893cbb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c14b6a0 con 0x7fc88c0cf7d0 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc893cbb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88c0cfbf0 con 0x7fc88c14b2c0 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc893cbb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c071690 con 0x7fc88c070ea0 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc88c0cf7d0 0x7fc88c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc88c0cf7d0 0x7fc88c070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53796/0 (socket says 172.21.15.161:53796) 2023-11-24T08:05:14.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 -- 172.21.15.161:0/1463932116 learned_addr learned my addr 172.21.15.161:0/1463932116 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891a57640 1 --2- 172.21.15.161:0/1463932116 >> v2:172.21.15.175:3300/0 conn(0x7fc88c14b2c0 0x7fc88c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 -- 172.21.15.161:0/1463932116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c070ea0 msgr2=0x7fc88c0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:14.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc892258640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c070ea0 0x7fc88c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c070ea0 0x7fc88c0b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 -- 172.21.15.161:0/1463932116 >> v2:172.21.15.175:3300/0 conn(0x7fc88c14b2c0 msgr2=0x7fc88c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 --2- 172.21.15.161:0/1463932116 >> v2:172.21.15.175:3300/0 conn(0x7fc88c14b2c0 0x7fc88c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891256640 1 -- 172.21.15.161:0/1463932116 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c071970 con 0x7fc88c0cf7d0 2023-11-24T08:05:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc891a57640 1 --2- 172.21.15.161:0/1463932116 >> v2:172.21.15.175:3300/0 conn(0x7fc88c14b2c0 0x7fc88c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:14.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.959+0000 7fc892258640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c070ea0 0x7fc88c0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.961+0000 7fc891256640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c0cf7d0 0x7fc88c070960 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc88c06e650 tx=0x7fc88002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e03c02918a0c18 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.961+0000 7fc890a55640 1 -- 172.21.15.161:0/1463932116 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880031870 con 0x7fc88c0cf7d0 2023-11-24T08:05:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.961+0000 7fc890a55640 1 -- 172.21.15.161:0/1463932116 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8800319d0 con 0x7fc88c0cf7d0 2023-11-24T08:05:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.961+0000 7fc890a55640 1 -- 172.21.15.161:0/1463932116 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880031d60 con 0x7fc88c0cf7d0 2023-11-24T08:05:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 -- 172.21.15.161:0/1463932116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c0cf7d0 msgr2=0x7fc88c070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c0cf7d0 0x7fc88c070960 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fc88c06e650 tx=0x7fc88002b910 comp rx=0 tx=0).stop 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 -- 172.21.15.161:0/1463932116 shutdown_connections 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c070ea0 0x7fc88c0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 --2- 172.21.15.161:0/1463932116 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c0cf7d0 0x7fc88c070960 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 --2- 172.21.15.161:0/1463932116 >> v2:172.21.15.175:3300/0 conn(0x7fc88c14b2c0 0x7fc88c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 -- 172.21.15.161:0/1463932116 >> 172.21.15.161:0/1463932116 conn(0x7fc88c06a800 msgr2=0x7fc88c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 -- 172.21.15.161:0/1463932116 shutdown_connections 2023-11-24T08:05:14.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.962+0000 7fc893cbb640 1 -- 172.21.15.161:0/1463932116 wait complete. 2023-11-24T08:05:14.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.964+0000 7fc893cbb640 1 Processor -- start 2023-11-24T08:05:14.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.964+0000 7fc893cbb640 1 -- start start 2023-11-24T08:05:14.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.965+0000 7fc893cbb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 0x7fc88c0a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.965+0000 7fc893cbb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88c0cf7d0 0x7fc88c1fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.965+0000 7fc893cbb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c14b2c0 0x7fc88c1fadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.965+0000 7fc893cbb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c156600 con 0x7fc88c070ea0 2023-11-24T08:05:14.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc893cbb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c0a8ea0 con 0x7fc88c0cf7d0 2023-11-24T08:05:14.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc893cbb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88c146fd0 con 0x7fc88c14b2c0 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 0x7fc88c0a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 0x7fc88c0a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53798/0 (socket says 172.21.15.161:53798) 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 -- 172.21.15.161:0/3587642265 learned_addr learned my addr 172.21.15.161:0/3587642265 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 -- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c14b2c0 msgr2=0x7fc88c1fadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c14b2c0 0x7fc88c1fadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 -- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88c0cf7d0 msgr2=0x7fc88c1fa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88c0cf7d0 0x7fc88c1fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:14.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 -- 172.21.15.161:0/3587642265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800094d0 con 0x7fc88c070ea0 2023-11-24T08:05:14.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.966+0000 7fc891a57640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 0x7fc88c0a8960 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c7f0 tx=0x7fc88800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.967+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888007a30 con 0x7fc88c070ea0 2023-11-24T08:05:14.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.967+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888007b90 con 0x7fc88c070ea0 2023-11-24T08:05:14.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.967+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800ce40 con 0x7fc88c070ea0 2023-11-24T08:05:14.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.967+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c1472b0 con 0x7fc88c070ea0 2023-11-24T08:05:14.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.967+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88c147870 con 0x7fc88c070ea0 2023-11-24T08:05:14.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.968+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88c0675d0 con 0x7fc88c070ea0 2023-11-24T08:05:14.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.969+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc8880113f0 con 0x7fc88c070ea0 2023-11-24T08:05:14.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.970+0000 7fc87e7fc640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc87006b040 0x7fc87006d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:14.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.970+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc888089af0 con 0x7fc88c070ea0 2023-11-24T08:05:14.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.970+0000 7fc891256640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc87006b040 0x7fc87006d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:14.973 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.972+0000 7fc891256640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc87006b040 0x7fc87006d500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc880036000 tx=0x7fc880030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:14.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:14.975+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8880548f0 con 0x7fc88c070ea0 2023-11-24T08:05:15.174 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.172+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc88c06aec0 con 0x7fc88c070ea0 2023-11-24T08:05:15.175 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.173+0000 7fc87e7fc640 1 -- 172.21.15.161:0/3587642265 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fc88801f090 con 0x7fc88c070ea0 2023-11-24T08:05:15.175 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:15.176 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:15.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc87006b040 msgr2=0x7fc87006d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc87006b040 0x7fc87006d500 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc880036000 tx=0x7fc880030000 comp rx=0 tx=0).stop 2023-11-24T08:05:15.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 msgr2=0x7fc88c0a8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 0x7fc88c0a8960 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c7f0 tx=0x7fc88800cbf0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 shutdown_connections 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc87006b040 0x7fc87006d500 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc88c14b2c0 0x7fc88c1fadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc88c0cf7d0 0x7fc88c1fa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 --2- 172.21.15.161:0/3587642265 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc88c070ea0 0x7fc88c0a8960 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 >> 172.21.15.161:0/3587642265 conn(0x7fc88c06a800 msgr2=0x7fc88c0aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 shutdown_connections 2023-11-24T08:05:15.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.176+0000 7fc893cbb640 1 -- 172.21.15.161:0/3587642265 wait complete. 2023-11-24T08:05:15.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T08:00:18.609101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T08:04:53.068861+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T08:04:54.318999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T08:05:15.198 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T08:05:15.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.414+0000 7f8ce5485640 1 Processor -- start 2023-11-24T08:05:15.416 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.414+0000 7f8ce5485640 1 -- start start 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce5485640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ce015d2c0 0x7f8ce015d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce5485640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 0x7f8ce00cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce5485640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00d0220 con 0x7f8ce00cfdd0 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce5485640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce00b2630 con 0x7f8ce015d2c0 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce5485640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00ceca0 con 0x7f8ce00d3bd0 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce4c84640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8ce00cfdd0 0x7f8ce00d0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55380/0 (socket says 172.21.15.161:55380) 2023-11-24T08:05:15.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8ce4c84640 1 -- 172.21.15.161:0/3421801904 learned_addr learned my addr 172.21.15.161:0/3421801904 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:15.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8cdffff640 1 --2- 172.21.15.161:0/3421801904 >> v2:172.21.15.175:3300/0 conn(0x7f8ce015d2c0 0x7f8ce015d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.416+0000 7f8cd7fff640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 0x7f8ce00cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311847475 0 0) 0x7f8cd8001490 con 0x7f8ce00cfdd0 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc003520 con 0x7f8ce00cfdd0 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2418005385 0 0) 0x7f8ccc003520 con 0x7f8ce00cfdd0 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 msgr2=0x7f8ce00cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 0x7f8ce00cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 >> v2:172.21.15.175:3300/0 conn(0x7f8ce015d2c0 msgr2=0x7f8ce015d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 --2- 172.21.15.161:0/3421801904 >> v2:172.21.15.175:3300/0 conn(0x7f8ce015d2c0 0x7f8ce015d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00cef80 con 0x7f8ce00cfdd0 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f8cd8001b80 con 0x7f8ce00cfdd0 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 >> v1:172.21.15.161:6789/0 conn(0x7f8ce00cfdd0 legacy=0x7f8ce00d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 0x7f8ccc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc003f40 0x7f8ccc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ccc004d00 0x7f8ccc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00b2630 con 0x7f8ccc004d00 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00ceca0 con 0x7f8ccc003f40 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.417+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc00ba30 con 0x7f8ce00d3bd0 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ccc004d00 0x7f8ccc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8cdffff640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 0x7f8ccc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8cd7fff640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc003f40 0x7f8ccc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8ce4c84640 1 -- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 msgr2=0x7f8ccc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce00d3bd0 0x7f8ccc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8ce4c84640 1 -- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc003f40 msgr2=0x7f8ccc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc003f40 0x7f8ccc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8ce4c84640 1 -- 172.21.15.161:0/3421801904 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc003520 con 0x7f8ccc004d00 2023-11-24T08:05:15.422 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.418+0000 7f8cd7fff640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc003f40 0x7f8ccc0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:15.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.419+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ccc004d00 0x7f8ccc005180 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800a780 tx=0x7f8ccc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306f106955816ffa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.423 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.419+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8034630 con 0x7f8ccc004d00 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.419+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd802f070 con 0x7f8ccc004d00 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.419+0000 7f8cdf7fe640 1 -- 172.21.15.161:0/3421801904 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8034a30 con 0x7f8ccc004d00 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce5485640 1 -- 172.21.15.161:0/3421801904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ccc004d00 msgr2=0x7f8ccc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce5485640 1 --2- 172.21.15.161:0/3421801904 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ccc004d00 0x7f8ccc005180 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800a780 tx=0x7f8ccc0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce4c84640 1 -- 172.21.15.161:0/3421801904 reap_dead start 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce5485640 1 -- 172.21.15.161:0/3421801904 shutdown_connections 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce5485640 1 -- 172.21.15.161:0/3421801904 >> 172.21.15.161:0/3421801904 conn(0x7f8ce00d30b0 msgr2=0x7f8ce00d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce5485640 1 -- 172.21.15.161:0/3421801904 shutdown_connections 2023-11-24T08:05:15.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.420+0000 7f8ce5485640 1 -- 172.21.15.161:0/3421801904 wait complete. 2023-11-24T08:05:15.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.422+0000 7f8ce5485640 1 Processor -- start 2023-11-24T08:05:15.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.422+0000 7f8ce5485640 1 -- start start 2023-11-24T08:05:15.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce5485640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc004d00 0x7f8ce00ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce5485640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce015b450 0x7f8ce00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce5485640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 0x7f8ce009ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce5485640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00cb420 con 0x7f8ce015ad30 2023-11-24T08:05:15.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce5485640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce015bca0 con 0x7f8ccc004d00 2023-11-24T08:05:15.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce5485640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00ca810 con 0x7f8ce015b450 2023-11-24T08:05:15.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce4c84640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 0x7f8ce009ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce4c84640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 0x7f8ce009ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53814/0 (socket says 172.21.15.161:53814) 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.423+0000 7f8ce4c84640 1 -- 172.21.15.161:0/4016354711 learned_addr learned my addr 172.21.15.161:0/4016354711 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8cdffff640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc004d00 0x7f8ce00ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce4c84640 1 -- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce015b450 msgr2=0x7f8ce00cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce015b450 0x7f8ce00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce4c84640 1 -- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc004d00 msgr2=0x7f8ce00ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc004d00 0x7f8ce00ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce4c84640 1 -- 172.21.15.161:0/4016354711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00caaf0 con 0x7f8ce015ad30 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce4c84640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 0x7f8ce009ecd0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802cad0 tx=0x7f8cd8001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8002090 con 0x7f8ce015ad30 2023-11-24T08:05:15.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd8040480 con 0x7f8ce015ad30 2023-11-24T08:05:15.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce00cadd0 con 0x7f8ce015ad30 2023-11-24T08:05:15.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd80407f0 con 0x7f8ce015ad30 2023-11-24T08:05:15.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.424+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce015b1b0 con 0x7f8ce015ad30 2023-11-24T08:05:15.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.425+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0067450 con 0x7f8ce015ad30 2023-11-24T08:05:15.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.427+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8cd8031030 con 0x7f8ce015ad30 2023-11-24T08:05:15.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.427+0000 7f8cdd7fa640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8cc006b020 0x7f8cc006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.428+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cd80ab720 con 0x7f8ce015ad30 2023-11-24T08:05:15.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.428+0000 7f8cdffff640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8cc006b020 0x7f8cc006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.429+0000 7f8cdffff640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8cc006b020 0x7f8cc006d4e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00099d0 tx=0x7f8cd0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.432+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cd8076420 con 0x7f8ce015ad30 2023-11-24T08:05:15.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.621+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ce00d0220 con 0x7f8ce015ad30 2023-11-24T08:05:15.623 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.621+0000 7f8cdd7fa640 1 -- 172.21.15.161:0/4016354711 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8ce00d0220 con 0x7f8ce015ad30 2023-11-24T08:05:15.624 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 1 2023-11-24T08:05:15.626 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8cc006b020 msgr2=0x7f8cc006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8cc006b020 0x7f8cc006d4e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00099d0 tx=0x7f8cd0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 msgr2=0x7f8ce009ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 0x7f8ce009ecd0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802cad0 tx=0x7f8cd8001e40 comp rx=0 tx=0).stop 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 shutdown_connections 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8cc006b020 0x7f8cc006d4e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8ce015ad30 0x7f8ce009ecd0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ce015b450 0x7f8ce00cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 --2- 172.21.15.161:0/4016354711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ccc004d00 0x7f8ce00ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.624+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 >> 172.21.15.161:0/4016354711 conn(0x7f8ce00d30b0 msgr2=0x7f8ce00afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.625+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 shutdown_connections 2023-11-24T08:05:15.627 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.625+0000 7f8ce5485640 1 -- 172.21.15.161:0/4016354711 wait complete. 2023-11-24T08:05:15.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T08:05:15.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.866+0000 7f943f901640 1 Processor -- start 2023-11-24T08:05:15.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.866+0000 7f943f901640 1 -- start start 2023-11-24T08:05:15.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.867+0000 7f943f901640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9438143ae0 0x7f94380cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.867+0000 7f943f901640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943815e3b0 0x7f94380702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.867+0000 7f943f901640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94380cfc30 con 0x7f94380cf7d0 2023-11-24T08:05:15.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.867+0000 7f943f901640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380b1ee0 con 0x7f9438143ae0 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.867+0000 7f943f901640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380b2780 con 0x7f943815e3b0 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.868+0000 7f943d69d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9438143ae0 0x7f94380cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.868+0000 7f943ce9c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f94380cf7d0 0x7f943815dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55382/0 (socket says 172.21.15.161:55382) 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.868+0000 7f943ce9c640 1 -- 172.21.15.161:0/1301718434 learned_addr learned my addr 172.21.15.161:0/1301718434 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.868+0000 7f943de9e640 1 --2- 172.21.15.161:0/1301718434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943815e3b0 0x7f94380702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.868+0000 7f942ffff640 1 -- 172.21.15.161:0/1301718434 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908852882 0 0) 0x7f94380cfc30 con 0x7f94380cf7d0 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.869+0000 7f942ffff640 1 -- 172.21.15.161:0/1301718434 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9424003520 con 0x7f94380cf7d0 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.869+0000 7f943d69d640 1 -- 172.21.15.161:0/1301718434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943815e3b0 msgr2=0x7f94380702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.869+0000 7f943d69d640 1 --2- 172.21.15.161:0/1301718434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943815e3b0 0x7f94380702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.869+0000 7f943d69d640 1 -- 172.21.15.161:0/1301718434 >> v1:172.21.15.161:6789/0 conn(0x7f94380cf7d0 legacy=0x7f943815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.869+0000 7f943d69d640 1 -- 172.21.15.161:0/1301718434 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943815e990 con 0x7f9438143ae0 2023-11-24T08:05:15.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.870+0000 7f943d69d640 1 --2- 172.21.15.161:0/1301718434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380cf290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f94340097a0 tx=0x7f943402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dbd1ee05f8c2f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.870+0000 7f942ffff640 1 -- 172.21.15.161:0/1301718434 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943402d040 con 0x7f9438143ae0 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.870+0000 7f942ffff640 1 -- 172.21.15.161:0/1301718434 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9434031810 con 0x7f9438143ae0 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.870+0000 7f942ffff640 1 -- 172.21.15.161:0/1301718434 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434031ba0 con 0x7f9438143ae0 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 -- 172.21.15.161:0/1301718434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 msgr2=0x7f94380cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 --2- 172.21.15.161:0/1301718434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380cf290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f94340097a0 tx=0x7f943402b8b0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 -- 172.21.15.161:0/1301718434 shutdown_connections 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 --2- 172.21.15.161:0/1301718434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f943815e3b0 0x7f94380702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 --2- 172.21.15.161:0/1301718434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380cf290 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 -- 172.21.15.161:0/1301718434 >> 172.21.15.161:0/1301718434 conn(0x7f943806a800 msgr2=0x7f943806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 -- 172.21.15.161:0/1301718434 shutdown_connections 2023-11-24T08:05:15.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.871+0000 7f943f901640 1 -- 172.21.15.161:0/1301718434 wait complete. 2023-11-24T08:05:15.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.873+0000 7f943f901640 1 Processor -- start 2023-11-24T08:05:15.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.873+0000 7f943f901640 1 -- start start 2023-11-24T08:05:15.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943f901640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94380cf7d0 0x7f943813fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943f901640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943f901640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943815e3b0 0x7f94380cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943f901640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9438140090 con 0x7f9438143ae0 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943f901640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380af1f0 con 0x7f943815e3b0 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943f901640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380ce480 con 0x7f94380cf7d0 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53830/0 (socket says 172.21.15.161:53830) 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 -- 172.21.15.161:0/324934871 learned_addr learned my addr 172.21.15.161:0/324934871 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:15.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943d69d640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94380cf7d0 0x7f943813fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 -- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94380cf7d0 msgr2=0x7f943813fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94380cf7d0 0x7f943813fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 -- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943815e3b0 msgr2=0x7f94380cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:15.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943815e3b0 0x7f94380cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:15.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.874+0000 7f943ce9c640 1 -- 172.21.15.161:0/324934871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9434009400 con 0x7f9438143ae0 2023-11-24T08:05:15.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.875+0000 7f943ce9c640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380acb40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f942800c500 tx=0x7f942800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.875+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9428005ce0 con 0x7f9438143ae0 2023-11-24T08:05:15.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.875+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9428005e40 con 0x7f9438143ae0 2023-11-24T08:05:15.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.875+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94280072b0 con 0x7f9438143ae0 2023-11-24T08:05:15.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.875+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94380aeba0 con 0x7f9438143ae0 2023-11-24T08:05:15.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.875+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9438159ce0 con 0x7f9438143ae0 2023-11-24T08:05:15.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.877+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94380675d0 con 0x7f9438143ae0 2023-11-24T08:05:15.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.877+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f94280074d0 con 0x7f9438143ae0 2023-11-24T08:05:15.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.879+0000 7f942dffb640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f941c06aff0 0x7f941c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:15.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.879+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9428088f80 con 0x7f9438143ae0 2023-11-24T08:05:15.881 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.879+0000 7f943d69d640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f941c06aff0 0x7f941c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:15.882 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.881+0000 7f943d69d640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f941c06aff0 0x7f941c06d4b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9434036000 tx=0x7f943403c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:15.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:15.883+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9428053e60 con 0x7f9438143ae0 2023-11-24T08:05:16.074 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.072+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94380af330 con 0x7f9438143ae0 2023-11-24T08:05:16.075 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.073+0000 7f942dffb640 1 -- 172.21.15.161:0/324934871 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94280170a0 con 0x7f9438143ae0 2023-11-24T08:05:16.075 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 32 2023-11-24T08:05:16.077 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f941c06aff0 msgr2=0x7f941c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f941c06aff0 0x7f941c06d4b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9434036000 tx=0x7f943403c040 comp rx=0 tx=0).stop 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 msgr2=0x7f94380acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380acb40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f942800c500 tx=0x7f942800c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 shutdown_connections 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f941c06aff0 0x7f941c06d4b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f943815e3b0 0x7f94380cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9438143ae0 0x7f94380acb40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 --2- 172.21.15.161:0/324934871 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94380cf7d0 0x7f943813fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.075+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 >> 172.21.15.161:0/324934871 conn(0x7f943806a800 msgr2=0x7f943815ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.076+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 shutdown_connections 2023-11-24T08:05:16.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.076+0000 7f943f901640 1 -- 172.21.15.161:0/324934871 wait complete. 2023-11-24T08:05:16.097 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T08:05:16.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.316+0000 7fbd343c9640 1 Processor -- start 2023-11-24T08:05:16.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.316+0000 7fbd343c9640 1 -- start start 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd343c9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbd2c13e360 0x7fbd2c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd343c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd2c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd343c9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2c15c5f0 con 0x7fbd2c13df80 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd343c9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2c06c470 con 0x7fbd2c13e360 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd343c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c06c750 con 0x7fbd2c15f9c0 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd32165640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbd2c13df80 0x7fbd2c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55394/0 (socket says 172.21.15.161:55394) 2023-11-24T08:05:16.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd32165640 1 -- 172.21.15.161:0/3235148204 learned_addr learned my addr 172.21.15.161:0/3235148204 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:16.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd31964640 1 --2- 172.21.15.161:0/3235148204 >> v2:172.21.15.175:3300/0 conn(0x7fbd2c13e360 0x7fbd2c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd32966640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd2c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118834793 0 0) 0x7fbd2c15c5f0 con 0x7fbd2c13df80 2023-11-24T08:05:16.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.318+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd18003520 con 0x7fbd2c13df80 2023-11-24T08:05:16.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284740705 0 0) 0x7fbd18003520 con 0x7fbd2c13df80 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 msgr2=0x7fbd2c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd2c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 >> v2:172.21.15.175:3300/0 conn(0x7fbd2c13e360 msgr2=0x7fbd2c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 --2- 172.21.15.161:0/3235148204 >> v2:172.21.15.175:3300/0 conn(0x7fbd2c13e360 0x7fbd2c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c06ca30 con 0x7fbd2c13df80 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fbd28001690 con 0x7fbd2c13df80 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 >> v1:172.21.15.161:6789/0 conn(0x7fbd2c13df80 legacy=0x7fbd2c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd18003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd18003f40 0x7fbd180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18004d00 0x7fbd18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c06c470 con 0x7fbd18003f40 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c06c750 con 0x7fbd18004d00 2023-11-24T08:05:16.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1800b980 con 0x7fbd2c15f9c0 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.319+0000 7fbd31964640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd18003f40 0x7fbd180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd32966640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18004d00 0x7fbd18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd31964640 1 -- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 msgr2=0x7fbd18003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd32165640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd18003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd31964640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd18003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd31964640 1 -- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18004d00 msgr2=0x7fbd18005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd31964640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18004d00 0x7fbd18005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd31964640 1 -- 172.21.15.161:0/3235148204 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18003520 con 0x7fbd18003f40 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd32165640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c15f9c0 0x7fbd18003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:16.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.320+0000 7fbd32966640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18004d00 0x7fbd18005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:16.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.321+0000 7fbd31964640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd18003f40 0x7fbd180047c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009ac0 tx=0x7fbd180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40941bb174fcdd00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.321+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2002c6b0 con 0x7fbd18003f40 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.321+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2002c810 con 0x7fbd18003f40 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.321+0000 7fbd31163640 1 -- 172.21.15.161:0/3235148204 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2002cbc0 con 0x7fbd18003f40 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd343c9640 1 -- 172.21.15.161:0/3235148204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd18003f40 msgr2=0x7fbd180047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd343c9640 1 --2- 172.21.15.161:0/3235148204 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd18003f40 0x7fbd180047c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009ac0 tx=0x7fbd180057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd32966640 1 -- 172.21.15.161:0/3235148204 reap_dead start 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd343c9640 1 -- 172.21.15.161:0/3235148204 shutdown_connections 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd343c9640 1 -- 172.21.15.161:0/3235148204 >> 172.21.15.161:0/3235148204 conn(0x7fbd2c06a800 msgr2=0x7fbd2c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd343c9640 1 -- 172.21.15.161:0/3235148204 shutdown_connections 2023-11-24T08:05:16.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.322+0000 7fbd343c9640 1 -- 172.21.15.161:0/3235148204 wait complete. 2023-11-24T08:05:16.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.324+0000 7fbd343c9640 1 Processor -- start 2023-11-24T08:05:16.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.324+0000 7fbd343c9640 1 -- start start 2023-11-24T08:05:16.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd343c9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18003f40 0x7fbd2c0addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd343c9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 0x7fbd2c132960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd343c9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c132ea0 0x7fbd2c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd343c9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c1304b0 con 0x7fbd2c0ac370 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd343c9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c0ae300 con 0x7fbd18003f40 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd343c9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2c12f830 con 0x7fbd2c132ea0 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 0x7fbd2c132960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 0x7fbd2c132960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53838/0 (socket says 172.21.15.161:53838) 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 -- 172.21.15.161:0/4267609448 learned_addr learned my addr 172.21.15.161:0/4267609448 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd32966640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c132ea0 0x7fbd2c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd32165640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18003f40 0x7fbd2c0addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 -- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c132ea0 msgr2=0x7fbd2c0b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c132ea0 0x7fbd2c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 -- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18003f40 msgr2=0x7fbd2c0addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18003f40 0x7fbd2c0addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.325+0000 7fbd31964640 1 -- 172.21.15.161:0/4267609448 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c12fb10 con 0x7fbd2c0ac370 2023-11-24T08:05:16.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.326+0000 7fbd31964640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 0x7fbd2c132960 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009be0 tx=0x7fbd20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.326+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20034a10 con 0x7fbd2c0ac370 2023-11-24T08:05:16.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.326+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20034b70 con 0x7fbd2c0ac370 2023-11-24T08:05:16.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.326+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2c12fdf0 con 0x7fbd2c0ac370 2023-11-24T08:05:16.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.326+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2003e400 con 0x7fbd2c0ac370 2023-11-24T08:05:16.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.326+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2c12f470 con 0x7fbd2c0ac370 2023-11-24T08:05:16.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.327+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd2c0675d0 con 0x7fbd2c0ac370 2023-11-24T08:05:16.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.328+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbd2003e560 con 0x7fbd2c0ac370 2023-11-24T08:05:16.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.330+0000 7fbd1effd640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd1006aff0 0x7fbd1006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.330+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd200ab8a0 con 0x7fbd2c0ac370 2023-11-24T08:05:16.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.330+0000 7fbd32165640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd1006aff0 0x7fbd1006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.331+0000 7fbd32165640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd1006aff0 0x7fbd1006d4b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbd28001010 tx=0x7fbd28009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.335 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.334+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd20076770 con 0x7fbd2c0ac370 2023-11-24T08:05:16.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.522+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd2c06df00 con 0x7fbd2c0ac370 2023-11-24T08:05:16.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.523+0000 7fbd1effd640 1 -- 172.21.15.161:0/4267609448 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd20079d90 con 0x7fbd2c0ac370 2023-11-24T08:05:16.525 INFO:teuthology.orchestra.run.smithi161.stdout:pg_num: 64 2023-11-24T08:05:16.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd1006aff0 msgr2=0x7fbd1006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd1006aff0 0x7fbd1006d4b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbd28001010 tx=0x7fbd28009040 comp rx=0 tx=0).stop 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 msgr2=0x7fbd2c132960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 0x7fbd2c132960 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009be0 tx=0x7fbd20004730 comp rx=0 tx=0).stop 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 shutdown_connections 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd1006aff0 0x7fbd1006d4b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd2c132ea0 0x7fbd2c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd2c0ac370 0x7fbd2c132960 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 --2- 172.21.15.161:0/4267609448 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd18003f40 0x7fbd2c0addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.525+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 >> 172.21.15.161:0/4267609448 conn(0x7fbd2c06a800 msgr2=0x7fbd2c15be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.526+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 shutdown_connections 2023-11-24T08:05:16.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.526+0000 7fbd343c9640 1 -- 172.21.15.161:0/4267609448 wait complete. 2023-11-24T08:05:16.545 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:16.751 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.749+0000 7f7fa5c09640 1 Processor -- start 2023-11-24T08:05:16.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.749+0000 7f7fa5c09640 1 -- start start 2023-11-24T08:05:16.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7fa5c09640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7fa013df80 0x7f7fa015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7fa5c09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 0x7f7fa00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7fa5c09640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa006c470 con 0x7f7fa015f9c0 2023-11-24T08:05:16.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7fa5c09640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa006c750 con 0x7f7fa013df80 2023-11-24T08:05:16.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7fa5c09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006ca30 con 0x7f7fa013e360 2023-11-24T08:05:16.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7f9ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7fa015f9c0 0x7f7fa01408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55400/0 (socket says 172.21.15.161:55400) 2023-11-24T08:05:16.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.751+0000 7f7f9ffff640 1 -- 172.21.15.161:0/4144523435 learned_addr learned my addr 172.21.15.161:0/4144523435 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:16.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f97fff640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 0x7f7fa00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.755 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/4144523435 >> v2:172.21.15.175:3300/0 conn(0x7f7fa013df80 0x7f7fa015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809514489 0 0) 0x7f7fa006c470 con 0x7f7fa015f9c0 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f8c003520 con 0x7f7fa015f9c0 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2033548891 0 0) 0x7f7f8c003520 con 0x7f7fa015f9c0 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 msgr2=0x7f7fa00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 0x7f7fa00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 >> v2:172.21.15.175:3300/0 conn(0x7f7fa013df80 msgr2=0x7f7fa015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 --2- 172.21.15.161:0/4144523435 >> v2:172.21.15.175:3300/0 conn(0x7f7fa013df80 0x7f7fa015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa006cd10 con 0x7f7fa015f9c0 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f7f980019f0 con 0x7f7fa015f9c0 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 >> v1:172.21.15.161:6789/0 conn(0x7f7fa015f9c0 legacy=0x7f7fa01408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c0047c0 0x7f7f8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 0x7f7f8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006c750 con 0x7f7f8c003970 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.752+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa006ca30 con 0x7f7f8c0047c0 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c00b980 con 0x7f7fa013e360 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 msgr2=0x7f7f8c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa013e360 0x7f7f8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c0047c0 msgr2=0x7f7f8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f8c0047c0 0x7f7f8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.753+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/4144523435 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c003520 con 0x7f7f8c003970 2023-11-24T08:05:16.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.754+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009ac0 tx=0x7f7f8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a52e2e9e61cdd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.758 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.754+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9002c710 con 0x7f7f8c003970 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.754+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9002c870 con 0x7f7f8c003970 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.754+0000 7f7f9effd640 1 -- 172.21.15.161:0/4144523435 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9002cc00 con 0x7f7f8c003970 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7fa5c09640 1 -- 172.21.15.161:0/4144523435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 msgr2=0x7f7f8c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/4144523435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7f8c003d90 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009ac0 tx=0x7f7f8c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7f9ffff640 1 -- 172.21.15.161:0/4144523435 reap_dead start 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7fa5c09640 1 -- 172.21.15.161:0/4144523435 shutdown_connections 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7fa5c09640 1 -- 172.21.15.161:0/4144523435 >> 172.21.15.161:0/4144523435 conn(0x7f7fa006a800 msgr2=0x7f7fa006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7fa5c09640 1 -- 172.21.15.161:0/4144523435 shutdown_connections 2023-11-24T08:05:16.759 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.755+0000 7f7fa5c09640 1 -- 172.21.15.161:0/4144523435 wait complete. 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.757+0000 7f7fa5c09640 1 Processor -- start 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.757+0000 7f7fa5c09640 1 -- start start 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7fa5c09640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7fa014c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7fa5c09640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa014fc30 0x7f7fa00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7fa5c09640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa00b21e0 0x7f7fa00b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7fa5c09640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa014d9a0 con 0x7f7f8c003970 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7fa5c09640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa014cc00 con 0x7f7fa00b21e0 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7fa5c09640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa014d320 con 0x7f7fa014fc30 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7f9f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7fa014c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7f9f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7fa014c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53870/0 (socket says 172.21.15.161:53870) 2023-11-24T08:05:16.761 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.758+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/2488511785 learned_addr learned my addr 172.21.15.161:0/2488511785 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f97fff640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa014fc30 0x7f7fa00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa014fc30 msgr2=0x7f7fa00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9ffff640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa00b21e0 0x7f7fa00b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa014fc30 0x7f7fa00b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa00b21e0 msgr2=0x7f7fa00b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa00b21e0 0x7f7fa00b2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:16.762 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9f7fe640 1 -- 172.21.15.161:0/2488511785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa0153580 con 0x7f7f8c003970 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9f7fe640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7fa014c6c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7f9002c2b0 tx=0x7f7f90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90003810 con 0x7f7f8c003970 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9002de90 con 0x7f7f8c003970 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90003b70 con 0x7f7f8c003970 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.759+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa014d5c0 con 0x7f7f8c003970 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.760+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa0153860 con 0x7f7f8c003970 2023-11-24T08:05:16.763 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.761+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa00675d0 con 0x7f7f8c003970 2023-11-24T08:05:16.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.762+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f7f90003cd0 con 0x7f7f8c003970 2023-11-24T08:05:16.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.762+0000 7f7f9cff9640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7f8006b020 0x7f7f8006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:16.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.763+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f900ab7b0 con 0x7f7f8c003970 2023-11-24T08:05:16.765 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.763+0000 7f7f97fff640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7f8006b020 0x7f7f8006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:16.766 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.764+0000 7f7f97fff640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7f8006b020 0x7f7f8006d4e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0151d70 tx=0x7f7f88008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:16.769 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.767+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f900765e0 con 0x7f7f8c003970 2023-11-24T08:05:17.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:16.998+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fa006df00 con 0x7f7f8c003970 2023-11-24T08:05:17.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.000+0000 7f7f9cff9640 1 -- 172.21.15.161:0/2488511785 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f7f90079c00 con 0x7f7f8c003970 2023-11-24T08:05:17.002 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:17.002 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:55.289954+0000","modified":"2023-11-24T08:04:58.365831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4018716146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4018716146},{"type":"v1","addr":"172.21.15.161:6835","nonce":4018716146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:05:17.003 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 37 2023-11-24T08:05:17.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7f8006b020 msgr2=0x7f7f8006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7f8006b020 0x7f7f8006d4e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0151d70 tx=0x7f7f88008040 comp rx=0 tx=0).stop 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 msgr2=0x7f7fa014c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7fa014c6c0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f7f9002c2b0 tx=0x7f7f90004730 comp rx=0 tx=0).stop 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 shutdown_connections 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f7f8006b020 0x7f7f8006d4e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7fa00b21e0 0x7f7fa00b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7fa014fc30 0x7f7fa00b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 --2- 172.21.15.161:0/2488511785 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7f8c003970 0x7f7fa014c6c0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 >> 172.21.15.161:0/2488511785 conn(0x7f7fa006a800 msgr2=0x7f7fa0154610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 shutdown_connections 2023-11-24T08:05:17.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.003+0000 7f7fa5c09640 1 -- 172.21.15.161:0/2488511785 wait complete. 2023-11-24T08:05:17.023 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:17.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.228+0000 7fc9a7b78640 1 Processor -- start 2023-11-24T08:05:17.231 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.229+0000 7fc9a7b78640 1 -- start start 2023-11-24T08:05:17.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a7b78640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 0x7fc9a00d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a7b78640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00d2180 con 0x7fc9a015d610 2023-11-24T08:05:17.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a7b78640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9a00b3400 con 0x7fc9a00b3890 2023-11-24T08:05:17.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a7b78640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00d1390 con 0x7fc9a00d17e0 2023-11-24T08:05:17.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a5914640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc9a015d610 0x7fc9a00ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55414/0 (socket says 172.21.15.161:55414) 2023-11-24T08:05:17.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a5914640 1 -- 172.21.15.161:0/1776272706 learned_addr learned my addr 172.21.15.161:0/1776272706 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:17.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a5113640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 0x7fc9a00d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739171466 0 0) 0x7fc9a00d2180 con 0x7fc9a015d610 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc98c003520 con 0x7fc9a015d610 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083916273 0 0) 0x7fc98c003520 con 0x7fc9a015d610 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 msgr2=0x7fc9a00d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 0x7fc9a00d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 >> v1:172.21.15.175:6789/0 conn(0x7fc9a00b3890 legacy=0x7fc9a00b3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00b27f0 con 0x7fc9a015d610 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc99c001670 con 0x7fc9a015d610 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 >> v1:172.21.15.161:6789/0 conn(0x7fc9a015d610 legacy=0x7fc9a00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c0039a0 0x7fc98c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 0x7fc98c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.235 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c004d00 0x7fc98c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00d1390 con 0x7fc98c004d00 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c00ba60 con 0x7fc98c0039a0 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.231+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c00bc20 con 0x7fc9a00d17e0 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c004d00 0x7fc98c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a5914640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c0039a0 0x7fc98c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a6115640 1 -- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 msgr2=0x7fc98c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a5113640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 0x7fc98c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a00d17e0 0x7fc98c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a6115640 1 -- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c0039a0 msgr2=0x7fc98c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c0039a0 0x7fc98c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.236 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a6115640 1 -- 172.21.15.161:0/1776272706 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c003520 con 0x7fc98c004d00 2023-11-24T08:05:17.237 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.232+0000 7fc9a5914640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c0039a0 0x7fc98c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.233+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c004d00 0x7fc98c005180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc998001e20 tx=0x7fc98c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e911a177651863 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.233+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998003b70 con 0x7fc98c004d00 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998003cd0 con 0x7fc98c004d00 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a4912640 1 -- 172.21.15.161:0/1776272706 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998005310 con 0x7fc98c004d00 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1776272706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c004d00 msgr2=0x7fc98c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1776272706 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc98c004d00 0x7fc98c005180 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fc998001e20 tx=0x7fc98c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a6115640 1 -- 172.21.15.161:0/1776272706 reap_dead start 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1776272706 shutdown_connections 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1776272706 >> 172.21.15.161:0/1776272706 conn(0x7fc9a009c540 msgr2=0x7fc9a00d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1776272706 shutdown_connections 2023-11-24T08:05:17.238 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.234+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1776272706 wait complete. 2023-11-24T08:05:17.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.236+0000 7fc9a7b78640 1 Processor -- start 2023-11-24T08:05:17.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.236+0000 7fc9a7b78640 1 -- start start 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a7b78640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c004d00 0x7fc9a00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a7b78640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a0152930 0x7fc9a00b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a7b78640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 0x7fc9a00b8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a7b78640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0157110 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a7b78640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0156e00 con 0x7fc98c004d00 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a7b78640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a00b8bd0 con 0x7fc9a0152930 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a6115640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 0x7fc9a00b8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a6115640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 0x7fc9a00b8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53888/0 (socket says 172.21.15.161:53888) 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.237+0000 7fc9a6115640 1 -- 172.21.15.161:0/1599658473 learned_addr learned my addr 172.21.15.161:0/1599658473 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a5914640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c004d00 0x7fc9a00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a5113640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a0152930 0x7fc9a00b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a6115640 1 -- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a0152930 msgr2=0x7fc9a00b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a0152930 0x7fc9a00b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a6115640 1 -- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c004d00 msgr2=0x7fc9a00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c004d00 0x7fc9a00c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a6115640 1 -- 172.21.15.161:0/1599658473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00b8eb0 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9a6115640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 0x7fc9a00b8140 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc998001f40 tx=0x7fc9980014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99803e070 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc998007db0 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.238+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998006d70 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.239+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a00c99e0 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.239+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a00b8680 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.240+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9a00b8930 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.241+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc998007030 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.242+0000 7fc9967fc640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc98406b020 0x7fc98406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.242+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9980aacb0 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.242+0000 7fc9a5914640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc98406b020 0x7fc98406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.243+0000 7fc9a5914640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc98406b020 0x7fc98406d4e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc99c000ff0 tx=0x7fc99c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.246+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc9980758a0 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.424 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.422+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9a00675d0 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.425+0000 7fc9967fc640 1 -- 172.21.15.161:0/1599658473 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fc998048070 con 0x7fc9a00b7cc0 2023-11-24T08:05:17.427 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:17.428 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc98406b020 msgr2=0x7fc98406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc98406b020 0x7fc98406d4e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc99c000ff0 tx=0x7fc99c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 msgr2=0x7fc9a00b8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 0x7fc9a00b8140 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc998001f40 tx=0x7fc9980014a0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 shutdown_connections 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc98406b020 0x7fc98406d4e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc9a00b7cc0 0x7fc9a00b8140 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc9a0152930 0x7fc9a00b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 --2- 172.21.15.161:0/1599658473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc98c004d00 0x7fc9a00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 >> 172.21.15.161:0/1599658473 conn(0x7fc9a009c540 msgr2=0x7fc9a00b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 shutdown_connections 2023-11-24T08:05:17.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.428+0000 7fc9a7b78640 1 -- 172.21.15.161:0/1599658473 wait complete. 2023-11-24T08:05:17.448 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:05:17.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:17.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.655+0000 7efd2e048640 1 Processor -- start 2023-11-24T08:05:17.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.656+0000 7efd2e048640 1 -- start start 2023-11-24T08:05:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd2e048640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd2815e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd2e048640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efd280cf290 0x7efd280cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd2e048640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd28070c40 con 0x7efd280ae5a0 2023-11-24T08:05:17.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd2e048640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd28071450 con 0x7efd280cf290 2023-11-24T08:05:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd2e048640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd280cfc60 con 0x7efd280b3ae0 2023-11-24T08:05:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd277fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efd280ae5a0 0x7efd2806cbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55426/0 (socket says 172.21.15.161:55426) 2023-11-24T08:05:17.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd277fe640 1 -- 172.21.15.161:0/3493175951 learned_addr learned my addr 172.21.15.161:0/3493175951 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd27fff640 1 --2- 172.21.15.161:0/3493175951 >> v2:172.21.15.175:3300/0 conn(0x7efd280cf290 0x7efd280cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd1ffff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd2815e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010052091 0 0) 0x7efd28070c40 con 0x7efd280ae5a0 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd14003520 con 0x7efd280ae5a0 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283631239 0 0) 0x7efd14003520 con 0x7efd280ae5a0 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 msgr2=0x7efd2815e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd2815e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 >> v2:172.21.15.175:3300/0 conn(0x7efd280cf290 msgr2=0x7efd280cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 --2- 172.21.15.161:0/3493175951 >> v2:172.21.15.175:3300/0 conn(0x7efd280cf290 0x7efd280cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2806c470 con 0x7efd280ae5a0 2023-11-24T08:05:17.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7efd18001670 con 0x7efd280ae5a0 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 >> v1:172.21.15.161:6789/0 conn(0x7efd280ae5a0 legacy=0x7efd2806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.658+0000 7efd26ffd640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd14003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd26ffd640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14003ef0 0x7efd140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd26ffd640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd14004d00 0x7efd14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd28071450 con 0x7efd14004d00 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd280cfc60 con 0x7efd14003ef0 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400b9b0 con 0x7efd280b3ae0 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd27fff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd14004d00 0x7efd14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd1ffff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14003ef0 0x7efd140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd277fe640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd14003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd27fff640 1 -- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 msgr2=0x7efd14003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd27fff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd14003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd27fff640 1 -- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14003ef0 msgr2=0x7efd140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:17.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd27fff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14003ef0 0x7efd140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd27fff640 1 -- 172.21.15.161:0/3493175951 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd14003520 con 0x7efd14004d00 2023-11-24T08:05:17.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd277fe640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd280b3ae0 0x7efd14003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:17.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.659+0000 7efd1ffff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14003ef0 0x7efd140047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:17.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.660+0000 7efd27fff640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd14004d00 0x7efd14005180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7efd20009fc0 tx=0x7efd140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1326d9b36aa21daf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2002cc60 con 0x7efd14004d00 2023-11-24T08:05:17.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2000f040 con 0x7efd14004d00 2023-11-24T08:05:17.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd26ffd640 1 -- 172.21.15.161:0/3493175951 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd20034440 con 0x7efd14004d00 2023-11-24T08:05:17.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd2e048640 1 -- 172.21.15.161:0/3493175951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd14004d00 msgr2=0x7efd14005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd2e048640 1 --2- 172.21.15.161:0/3493175951 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd14004d00 0x7efd14005180 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7efd20009fc0 tx=0x7efd140057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd27fff640 1 -- 172.21.15.161:0/3493175951 reap_dead start 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd2e048640 1 -- 172.21.15.161:0/3493175951 shutdown_connections 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd2e048640 1 -- 172.21.15.161:0/3493175951 >> 172.21.15.161:0/3493175951 conn(0x7efd2806a800 msgr2=0x7efd2806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd2e048640 1 -- 172.21.15.161:0/3493175951 shutdown_connections 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.661+0000 7efd2e048640 1 -- 172.21.15.161:0/3493175951 wait complete. 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.663+0000 7efd2e048640 1 Processor -- start 2023-11-24T08:05:17.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.663+0000 7efd2e048640 1 -- start start 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd2e048640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14004d00 0x7efd2814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd2e048640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 0x7efd28157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd2e048640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd2815c980 0x7efd2815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd2e048640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2815c220 con 0x7efd28157330 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd2e048640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd28150480 con 0x7efd14004d00 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd2e048640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd28157cd0 con 0x7efd2815c980 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.664+0000 7efd1ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 0x7efd28157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 0x7efd28157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53906/0 (socket says 172.21.15.161:53906) 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 -- 172.21.15.161:0/3758430694 learned_addr learned my addr 172.21.15.161:0/3758430694 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:17.668 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 -- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd2815c980 msgr2=0x7efd2815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd2815c980 0x7efd2815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 -- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14004d00 msgr2=0x7efd2814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14004d00 0x7efd2814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 -- 172.21.15.161:0/3758430694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2815d340 con 0x7efd28157330 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd1ffff640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 0x7efd28157790 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7efd100108e0 tx=0x7efd10010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000ec20 con 0x7efd28157330 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000ed80 con 0x7efd28157330 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1001c600 con 0x7efd28157330 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.665+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2815b5a0 con 0x7efd28157330 2023-11-24T08:05:17.669 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.666+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2815bb60 con 0x7efd28157330 2023-11-24T08:05:17.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.667+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd280675d0 con 0x7efd28157330 2023-11-24T08:05:17.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.668+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7efd1001c760 con 0x7efd28157330 2023-11-24T08:05:17.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.668+0000 7efd24ff9640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd0806aff0 0x7efd0806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:17.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.669+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd10089fe0 con 0x7efd28157330 2023-11-24T08:05:17.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.669+0000 7efd277fe640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd0806aff0 0x7efd0806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:17.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.670+0000 7efd277fe640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd0806aff0 0x7efd0806d4b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efd180017a0 tx=0x7efd18009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:17.674 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.673+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efd10054ed0 con 0x7efd28157330 2023-11-24T08:05:17.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.905+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd280cb520 con 0x7efd28157330 2023-11-24T08:05:17.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.906+0000 7efd24ff9640 1 -- 172.21.15.161:0/3758430694 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4916 (secure 0 0 0) 0x7efd100584f0 con 0x7efd28157330 2023-11-24T08:05:17.908 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:17.908 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:55.289954+0000","modified":"2023-11-24T08:04:58.365831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4018716146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4018716146},{"type":"v1","addr":"172.21.15.161:6835","nonce":4018716146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:05:17.909 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 37 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.908+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd0806aff0 msgr2=0x7efd0806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.908+0000 7efd2e048640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd0806aff0 0x7efd0806d4b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efd180017a0 tx=0x7efd18009040 comp rx=0 tx=0).stop 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.908+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 msgr2=0x7efd28157790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.908+0000 7efd2e048640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 0x7efd28157790 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7efd100108e0 tx=0x7efd10010da0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 shutdown_connections 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7efd0806aff0 0x7efd0806d4b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd2815c980 0x7efd2815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.911 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efd28157330 0x7efd28157790 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 --2- 172.21.15.161:0/3758430694 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd14004d00 0x7efd2814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:17.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 >> 172.21.15.161:0/3758430694 conn(0x7efd2806a800 msgr2=0x7efd28159920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:17.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 shutdown_connections 2023-11-24T08:05:17.912 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:17.909+0000 7efd2e048640 1 -- 172.21.15.161:0/3758430694 wait complete. 2023-11-24T08:05:17.928 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.128+0000 7f414359e640 1 Processor -- start 2023-11-24T08:05:18.130 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.128+0000 7f414359e640 1 -- start start 2023-11-24T08:05:18.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.129+0000 7f414359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 0x7f41440cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.129+0000 7f414359e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4144070e50 con 0x7f4144143c40 2023-11-24T08:05:18.131 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.129+0000 7f414359e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41440ccea0 con 0x7f414406d160 2023-11-24T08:05:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.129+0000 7f414359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440723c0 con 0x7f41440cc500 2023-11-24T08:05:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f414259c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4144143c40 0x7f4144071290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55432/0 (socket says 172.21.15.161:55432) 2023-11-24T08:05:18.132 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f414259c640 1 -- 172.21.15.161:0/3958741970 learned_addr learned my addr 172.21.15.161:0/3958741970 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 772938550 0 0) 0x7f4144070e50 con 0x7f4144143c40 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4130003520 con 0x7f4144143c40 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f413bfff640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 0x7f41440cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 466004741 0 0) 0x7f4130003520 con 0x7f4144143c40 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 msgr2=0x7f41440cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 0x7f41440cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 >> v1:172.21.15.175:6789/0 conn(0x7f414406d160 legacy=0x7f414406d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.134 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4144144020 con 0x7f4144143c40 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f4134001670 con 0x7f4144143c40 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 >> v1:172.21.15.161:6789/0 conn(0x7f4144143c40 legacy=0x7f4144071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.130+0000 7f4141d9b640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 0x7f41300039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f4141d9b640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4130003fd0 0x7f41300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f4141d9b640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130004d00 0x7f4130005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440723c0 con 0x7f4130003fd0 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413000bbc0 con 0x7f4130004d00 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413000bd80 con 0x7f41440cc500 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f413bfff640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4130003fd0 0x7f41300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.135 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f414259c640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 0x7f41300039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f413bfff640 1 -- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 msgr2=0x7f41300039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f413bfff640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440cc500 0x7f41300039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f4142d9d640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130004d00 0x7f4130005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f413bfff640 1 -- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130004d00 msgr2=0x7f4130005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f413bfff640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130004d00 0x7f4130005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.136 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.131+0000 7f413bfff640 1 -- 172.21.15.161:0/3958741970 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130003520 con 0x7f4130003fd0 2023-11-24T08:05:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.132+0000 7f413bfff640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4130003fd0 0x7f41300047c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f412c00ba30 tx=0x7f41300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306e87f18f849549 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c032640 con 0x7f4130003fd0 2023-11-24T08:05:18.137 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c0327a0 con 0x7f4130003fd0 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f4141d9b640 1 -- 172.21.15.161:0/3958741970 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c032b30 con 0x7f4130003fd0 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f414359e640 1 -- 172.21.15.161:0/3958741970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4130003fd0 msgr2=0x7f41300047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f414359e640 1 --2- 172.21.15.161:0/3958741970 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4130003fd0 0x7f41300047c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f412c00ba30 tx=0x7f41300057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f4142d9d640 1 -- 172.21.15.161:0/3958741970 reap_dead start 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f414359e640 1 -- 172.21.15.161:0/3958741970 shutdown_connections 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f414359e640 1 -- 172.21.15.161:0/3958741970 >> 172.21.15.161:0/3958741970 conn(0x7f414406a800 msgr2=0x7f414406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f414359e640 1 -- 172.21.15.161:0/3958741970 shutdown_connections 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.133+0000 7f414359e640 1 -- 172.21.15.161:0/3958741970 wait complete. 2023-11-24T08:05:18.138 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.135+0000 7f414359e640 1 Processor -- start 2023-11-24T08:05:18.139 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.135+0000 7f414359e640 1 -- start start 2023-11-24T08:05:18.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.136+0000 7f414359e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130003fd0 0x7f41440c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.140 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.136+0000 7f414359e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440c3d70 0x7f4144138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.136+0000 7f414359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 0x7f41440c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.136+0000 7f414359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144139400 con 0x7f414413be70 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.136+0000 7f414359e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440c41f0 con 0x7f4130003fd0 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.136+0000 7f414359e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440c44a0 con 0x7f41440c3d70 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 0x7f41440c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 0x7f41440c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53920/0 (socket says 172.21.15.161:53920) 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 -- 172.21.15.161:0/1372597264 learned_addr learned my addr 172.21.15.161:0/1372597264 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f413bfff640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440c3d70 0x7f4144138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f414259c640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130003fd0 0x7f41440c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.141 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 -- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440c3d70 msgr2=0x7f4144138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440c3d70 0x7f4144138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 -- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130003fd0 msgr2=0x7f41440c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130003fd0 0x7f41440c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 -- 172.21.15.161:0/1372597264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440c4780 con 0x7f414413be70 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f4142d9d640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 0x7f41440c8e50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f414406e3c0 tx=0x7f413c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.137+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c003b70 con 0x7f414413be70 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.138+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c003cd0 con 0x7f414413be70 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.138+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0052b0 con 0x7f414413be70 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.138+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41440c4a60 con 0x7f414413be70 2023-11-24T08:05:18.142 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.138+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41440c5020 con 0x7f414413be70 2023-11-24T08:05:18.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.139+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41440c5240 con 0x7f414413be70 2023-11-24T08:05:18.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.140+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f413c005410 con 0x7f414413be70 2023-11-24T08:05:18.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.141+0000 7f413affd640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f412406aff0 0x7f412406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.141+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f413c089380 con 0x7f414413be70 2023-11-24T08:05:18.143 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.141+0000 7f414259c640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f412406aff0 0x7f412406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.144 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.144+0000 7f414259c640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f412406aff0 0x7f412406d4b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4134001050 tx=0x7f4134001d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.147 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.146+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f413c0540a0 con 0x7f414413be70 2023-11-24T08:05:18.357 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.354+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41440ce210 con 0x7f414413be70 2023-11-24T08:05:18.358 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.357+0000 7f413affd640 1 -- 172.21.15.161:0/1372597264 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f413c0576c0 con 0x7f414413be70 2023-11-24T08:05:18.358 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:18.358 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T08:04:55.289954+0000","modified":"2023-11-24T08:04:58.365831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6324},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6324":{"gid":6324,"name":"c","rank":0,"incarnation":32,"state":"up:active","state_seq":3,"addr":"172.21.15.161:6835/4018716146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4018716146},{"type":"v1","addr":"172.21.15.161:6835","nonce":4018716146}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-11-24T08:05:18.358 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 37 2023-11-24T08:05:18.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.358+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f412406aff0 msgr2=0x7f412406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.358+0000 7f414359e640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f412406aff0 0x7f412406d4b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f4134001050 tx=0x7f4134001d40 comp rx=0 tx=0).stop 2023-11-24T08:05:18.361 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 msgr2=0x7f41440c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 0x7f41440c8e50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f414406e3c0 tx=0x7f413c00dc00 comp rx=0 tx=0).stop 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 shutdown_connections 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f412406aff0 0x7f412406d4b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f414413be70 0x7f41440c8e50 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41440c3d70 0x7f4144138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 --2- 172.21.15.161:0/1372597264 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4130003fd0 0x7f41440c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.362 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 >> 172.21.15.161:0/1372597264 conn(0x7f414406a800 msgr2=0x7f414406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 shutdown_connections 2023-11-24T08:05:18.363 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.360+0000 7f414359e640 1 -- 172.21.15.161:0/1372597264 wait complete. 2023-11-24T08:05:18.378 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:18.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.584+0000 7fa4c7851640 1 Processor -- start 2023-11-24T08:05:18.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.584+0000 7fa4c7851640 1 -- start start 2023-11-24T08:05:18.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c7851640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c013e360 0x7fa4c00cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c7851640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa4c015f9c0 0x7fa4c00cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c7851640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c015c5f0 con 0x7fa4c013df80 2023-11-24T08:05:18.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c7851640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c006c470 con 0x7fa4c015f9c0 2023-11-24T08:05:18.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c7851640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c006c750 con 0x7fa4c013e360 2023-11-24T08:05:18.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c55ed640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa4c013df80 0x7fa4c015bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55440/0 (socket says 172.21.15.161:55440) 2023-11-24T08:05:18.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4c55ed640 1 -- 172.21.15.161:0/3260510252 learned_addr learned my addr 172.21.15.161:0/3260510252 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:18.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.586+0000 7fa4c5dee640 1 --2- 172.21.15.161:0/3260510252 >> v2:172.21.15.161:3300/0 conn(0x7fa4c015f9c0 0x7fa4c00cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.589 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4c4dec640 1 --2- 172.21.15.161:0/3260510252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c013e360 0x7fa4c00cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4b7fff640 1 -- 172.21.15.161:0/3260510252 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000382363 0 0) 0x7fa4c015c5f0 con 0x7fa4c013df80 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4b7fff640 1 -- 172.21.15.161:0/3260510252 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac003520 con 0x7fa4c013df80 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4c5dee640 1 -- 172.21.15.161:0/3260510252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c013e360 msgr2=0x7fa4c00cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4c5dee640 1 --2- 172.21.15.161:0/3260510252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c013e360 0x7fa4c00cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4c5dee640 1 -- 172.21.15.161:0/3260510252 >> v1:172.21.15.161:6789/0 conn(0x7fa4c013df80 legacy=0x7fa4c015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.587+0000 7fa4c5dee640 1 -- 172.21.15.161:0/3260510252 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c006ca30 con 0x7fa4c015f9c0 2023-11-24T08:05:18.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.588+0000 7fa4c5dee640 1 --2- 172.21.15.161:0/3260510252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c015f9c0 0x7fa4c00cf7d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38a14d96e97c6aa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.589+0000 7fa4b7fff640 1 -- 172.21.15.161:0/3260510252 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b802cc50 con 0x7fa4c015f9c0 2023-11-24T08:05:18.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.589+0000 7fa4b7fff640 1 -- 172.21.15.161:0/3260510252 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b802cdb0 con 0x7fa4c015f9c0 2023-11-24T08:05:18.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.589+0000 7fa4b7fff640 1 -- 172.21.15.161:0/3260510252 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8034660 con 0x7fa4c015f9c0 2023-11-24T08:05:18.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 -- 172.21.15.161:0/3260510252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c015f9c0 msgr2=0x7fa4c00cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 --2- 172.21.15.161:0/3260510252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c015f9c0 0x7fa4c00cf7d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009d90 tx=0x7fa4b802bea0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 -- 172.21.15.161:0/3260510252 shutdown_connections 2023-11-24T08:05:18.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 --2- 172.21.15.161:0/3260510252 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c015f9c0 0x7fa4c00cf7d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 --2- 172.21.15.161:0/3260510252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c013e360 0x7fa4c00cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 -- 172.21.15.161:0/3260510252 >> 172.21.15.161:0/3260510252 conn(0x7fa4c006a800 msgr2=0x7fa4c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 -- 172.21.15.161:0/3260510252 shutdown_connections 2023-11-24T08:05:18.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.590+0000 7fa4c7851640 1 -- 172.21.15.161:0/3260510252 wait complete. 2023-11-24T08:05:18.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.592+0000 7fa4c7851640 1 Processor -- start 2023-11-24T08:05:18.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.592+0000 7fa4c7851640 1 -- start start 2023-11-24T08:05:18.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c7851640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 0x7fa4c013cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c7851640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c013e360 0x7fa4c01e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c7851640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c015f9c0 0x7fa4c01e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c7851640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c013d250 con 0x7fa4c013df80 2023-11-24T08:05:18.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c7851640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01f6e40 con 0x7fa4c013e360 2023-11-24T08:05:18.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c7851640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c01f7120 con 0x7fa4c015f9c0 2023-11-24T08:05:18.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 0x7fa4c013cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.597 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 0x7fa4c013cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53926/0 (socket says 172.21.15.161:53926) 2023-11-24T08:05:18.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 -- 172.21.15.161:0/39586345 learned_addr learned my addr 172.21.15.161:0/39586345 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:18.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c4dec640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c013e360 0x7fa4c01e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 -- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c015f9c0 msgr2=0x7fa4c01e61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c5dee640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c015f9c0 0x7fa4c01e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c015f9c0 0x7fa4c01e61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 -- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c013e360 msgr2=0x7fa4c01e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.599 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c013e360 0x7fa4c01e5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.593+0000 7fa4c55ed640 1 -- 172.21.15.161:0/39586345 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b8009a70 con 0x7fa4c013df80 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4c4dec640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c013e360 0x7fa4c01e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4c55ed640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 0x7fa4c013cd10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c390 tx=0x7fa4bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc005ce0 con 0x7fa4c013df80 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc005e40 con 0x7fa4c013df80 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0072f0 con 0x7fa4c013df80 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c01f7400 con 0x7fa4c013df80 2023-11-24T08:05:18.600 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.594+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c01e6ab0 con 0x7fa4c013df80 2023-11-24T08:05:18.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.595+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c01e9050 con 0x7fa4c013df80 2023-11-24T08:05:18.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.596+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fa4bc007450 con 0x7fa4c013df80 2023-11-24T08:05:18.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.597+0000 7fa4b5ffb640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa4a406aff0 0x7fa4a406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:18.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.597+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4bc088ff0 con 0x7fa4c013df80 2023-11-24T08:05:18.601 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.598+0000 7fa4c4dec640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa4a406aff0 0x7fa4a406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:18.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.599+0000 7fa4c4dec640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa4a406aff0 0x7fa4a406d4b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa4c015e950 tx=0x7fa4b0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:18.602 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.602+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4bc053d80 con 0x7fa4c013df80 2023-11-24T08:05:18.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.796+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4c00675d0 con 0x7fa4c013df80 2023-11-24T08:05:18.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.798+0000 7fa4b5ffb640 1 -- 172.21.15.161:0/39586345 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16589 (secure 0 0 0) 0x7fa4bc017020 con 0x7fa4c013df80 2023-11-24T08:05:18.799 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:18.799 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":60,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:04:56.571926+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-11-24T08:04:53.068861+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-11-24T08:04:54.318999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:18.801 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa4a406aff0 msgr2=0x7fa4a406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa4a406aff0 0x7fa4a406d4b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa4c015e950 tx=0x7fa4b0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 msgr2=0x7fa4c013cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 0x7fa4c013cd10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00c390 tx=0x7fa4bc00c850 comp rx=0 tx=0).stop 2023-11-24T08:05:18.802 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 shutdown_connections 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fa4a406aff0 0x7fa4a406d4b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4c015f9c0 0x7fa4c01e61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa4c013e360 0x7fa4c01e5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 --2- 172.21.15.161:0/39586345 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4c013df80 0x7fa4c013cd10 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 >> 172.21.15.161:0/39586345 conn(0x7fa4c006a800 msgr2=0x7fa4c006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.800+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 shutdown_connections 2023-11-24T08:05:18.803 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:18.801+0000 7fa4c7851640 1 -- 172.21.15.161:0/39586345 wait complete. 2023-11-24T08:05:18.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T08:05:19.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.038+0000 7f6f7a0bb640 1 Processor -- start 2023-11-24T08:05:19.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.038+0000 7f6f7a0bb640 1 -- start start 2023-11-24T08:05:19.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.039+0000 7f6f7a0bb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6f7413cfa0 0x7f6f7415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.039+0000 7f6f7a0bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f7413f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.039+0000 7f6f7a0bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f740cd9b0 0x7f6f7413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.039+0000 7f6f7a0bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740cdec0 con 0x7f6f740cd9b0 2023-11-24T08:05:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.039+0000 7f6f7a0bb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740ce1a0 con 0x7f6f7413cfa0 2023-11-24T08:05:19.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.039+0000 7f6f7a0bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740ce480 con 0x7f6f740cd530 2023-11-24T08:05:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f740cd9b0 0x7f6f7413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6f740cd9b0 0x7f6f7413fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53930/0 (socket says 172.21.15.161:53930) 2023-11-24T08:05:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 -- 172.21.15.161:0/2481479829 learned_addr learned my addr 172.21.15.161:0/2481479829 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f790b9640 1 --2- 172.21.15.161:0/2481479829 >> v2:172.21.15.175:3300/0 conn(0x7f6f7413cfa0 0x7f6f7415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f788b8640 1 --2- 172.21.15.161:0/2481479829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f7413f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.042 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 -- 172.21.15.161:0/2481479829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 msgr2=0x7f6f7413f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 --2- 172.21.15.161:0/2481479829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f7413f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 -- 172.21.15.161:0/2481479829 >> v2:172.21.15.175:3300/0 conn(0x7f6f7413cfa0 msgr2=0x7f6f7415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 --2- 172.21.15.161:0/2481479829 >> v2:172.21.15.175:3300/0 conn(0x7f6f7413cfa0 0x7f6f7415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.040+0000 7f6f798ba640 1 -- 172.21.15.161:0/2481479829 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740ce760 con 0x7f6f740cd9b0 2023-11-24T08:05:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.042+0000 7f6f798ba640 1 --2- 172.21.15.161:0/2481479829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f740cd9b0 0x7f6f7413fae0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6f7406cf00 tx=0x7f6f6c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30492651e3c1be88 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.042+0000 7f6f6bfff640 1 -- 172.21.15.161:0/2481479829 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c02c9e0 con 0x7f6f740cd9b0 2023-11-24T08:05:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.042+0000 7f6f6bfff640 1 -- 172.21.15.161:0/2481479829 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c02cb40 con 0x7f6f740cd9b0 2023-11-24T08:05:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.042+0000 7f6f6bfff640 1 -- 172.21.15.161:0/2481479829 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0343f0 con 0x7f6f740cd9b0 2023-11-24T08:05:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.042+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2481479829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f740cd9b0 msgr2=0x7f6f7413fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.042+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2481479829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f740cd9b0 0x7f6f7413fae0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6f7406cf00 tx=0x7f6f6c02be40 comp rx=0 tx=0).stop 2023-11-24T08:05:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2481479829 shutdown_connections 2023-11-24T08:05:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2481479829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f740cd9b0 0x7f6f7413fae0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2481479829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f7413f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2481479829 >> v2:172.21.15.175:3300/0 conn(0x7f6f7413cfa0 0x7f6f7415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2481479829 >> 172.21.15.161:0/2481479829 conn(0x7f6f7406a800 msgr2=0x7f6f7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2481479829 shutdown_connections 2023-11-24T08:05:19.046 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.043+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2481479829 wait complete. 2023-11-24T08:05:19.048 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.044+0000 7f6f7a0bb640 1 Processor -- start 2023-11-24T08:05:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.045+0000 7f6f7a0bb640 1 -- start start 2023-11-24T08:05:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f7a0bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f74157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f7a0bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f740cd9b0 0x7f6f74154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.049 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f7a0bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 0x7f6f74070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f7a0bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f741551c0 con 0x7f6f7413cfa0 2023-11-24T08:05:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f7a0bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f741554a0 con 0x7f6f740cd9b0 2023-11-24T08:05:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f7a0bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74155780 con 0x7f6f740cd530 2023-11-24T08:05:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f798ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 0x7f6f74070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.050 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f798ba640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 0x7f6f74070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53938/0 (socket says 172.21.15.161:53938) 2023-11-24T08:05:19.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.046+0000 7f6f798ba640 1 -- 172.21.15.161:0/2482421814 learned_addr learned my addr 172.21.15.161:0/2482421814 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:19.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f788b8640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f740cd9b0 0x7f6f74154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f790b9640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f74157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f798ba640 1 -- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 msgr2=0x7f6f74157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.051 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f798ba640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f74157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f798ba640 1 -- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f740cd9b0 msgr2=0x7f6f74154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f798ba640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f740cd9b0 0x7f6f74154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f798ba640 1 -- 172.21.15.161:0/2482421814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c009b30 con 0x7f6f7413cfa0 2023-11-24T08:05:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f798ba640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 0x7f6f74070f10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c036040 tx=0x7f6f6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c009510 con 0x7f6f7413cfa0 2023-11-24T08:05:19.052 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c03e450 con 0x7f6f7413cfa0 2023-11-24T08:05:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c03e800 con 0x7f6f7413cfa0 2023-11-24T08:05:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.047+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f74155a60 con 0x7f6f7413cfa0 2023-11-24T08:05:19.053 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.048+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f74071450 con 0x7f6f7413cfa0 2023-11-24T08:05:19.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.049+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74067450 con 0x7f6f7413cfa0 2023-11-24T08:05:19.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.050+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6f6c03e960 con 0x7f6f7413cfa0 2023-11-24T08:05:19.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.051+0000 7f6f69ffb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6f5806aff0 0x7f6f5806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.051+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f6c0ac6d0 con 0x7f6f7413cfa0 2023-11-24T08:05:19.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.051+0000 7f6f790b9640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6f5806aff0 0x7f6f5806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.053+0000 7f6f790b9640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6f5806aff0 0x7f6f5806d4b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6f70006fd0 tx=0x7f6f70008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.056 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.056+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f6c077620 con 0x7f6f7413cfa0 2023-11-24T08:05:19.291 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.290+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6f740b38d0 con 0x7f6f7413cfa0 2023-11-24T08:05:19.291 INFO:tasks.ceph.mon.a.smithi161.stderr:2023-11-24T08:05:19.291+0000 7f2aa1f75640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T08:05:19.294 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.293+0000 7f6f69ffb640 1 -- 172.21.15.161:0/2482421814 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6f6c081020 con 0x7f6f7413cfa0 2023-11-24T08:05:19.295 INFO:teuthology.orchestra.run.smithi161.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T08:05:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6f5806aff0 msgr2=0x7f6f5806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.297 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6f5806aff0 0x7f6f5806d4b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6f70006fd0 tx=0x7f6f70008040 comp rx=0 tx=0).stop 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 msgr2=0x7f6f74070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 0x7f6f74070f10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c036040 tx=0x7f6f6c004a40 comp rx=0 tx=0).stop 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 shutdown_connections 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6f5806aff0 0x7f6f5806d4b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6f7413cfa0 0x7f6f74070f10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f740cd9b0 0x7f6f74154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 --2- 172.21.15.161:0/2482421814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f740cd530 0x7f6f74157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.296+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 >> 172.21.15.161:0/2482421814 conn(0x7f6f7406a800 msgr2=0x7f6f7415b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.297+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 shutdown_connections 2023-11-24T08:05:19.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.297+0000 7f6f7a0bb640 1 -- 172.21.15.161:0/2482421814 wait complete. 2023-11-24T08:05:19.313 INFO:tasks.ceph.mds.c.smithi161.stderr: -1017> 2023-11-24T08:05:01.800+0000 7fe5b7141640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T08:05:19.316 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T08:05:19.371 INFO:tasks.ceph.mds.c.smithi161.stdout:starting mds.c at 2023-11-24T08:05:19.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.511+0000 7fdeba4e0640 1 Processor -- start 2023-11-24T08:05:19.512 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.511+0000 7fdeba4e0640 1 -- start start 2023-11-24T08:05:19.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeba4e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb4143ae0 0x7fdeb40cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeba4e0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdeb415e3b0 0x7fdeb40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeba4e0640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb40cfc30 con 0x7fdeb40cf7d0 2023-11-24T08:05:19.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeba4e0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb40b1ee0 con 0x7fdeb415e3b0 2023-11-24T08:05:19.515 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeba4e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb40b2780 con 0x7fdeb4143ae0 2023-11-24T08:05:19.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeb37fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fdeb40cf7d0 0x7fdeb415dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:55454/0 (socket says 172.21.15.161:55454) 2023-11-24T08:05:19.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeb37fe640 1 -- 172.21.15.161:0/2546808457 learned_addr learned my addr 172.21.15.161:0/2546808457 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:19.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.513+0000 7fdeb8a7d640 1 --2- 172.21.15.161:0/2546808457 >> v2:172.21.15.161:3300/0 conn(0x7fdeb415e3b0 0x7fdeb40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb3fff640 1 --2- 172.21.15.161:0/2546808457 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb4143ae0 0x7fdeb40cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb2ffd640 1 -- 172.21.15.161:0/2546808457 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 866841513 0 0) 0x7fdeb40cfc30 con 0x7fdeb40cf7d0 2023-11-24T08:05:19.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb2ffd640 1 -- 172.21.15.161:0/2546808457 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde94003520 con 0x7fdeb40cf7d0 2023-11-24T08:05:19.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb8a7d640 1 -- 172.21.15.161:0/2546808457 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb4143ae0 msgr2=0x7fdeb40cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:19.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb8a7d640 1 --2- 172.21.15.161:0/2546808457 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb4143ae0 0x7fdeb40cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb8a7d640 1 -- 172.21.15.161:0/2546808457 >> v1:172.21.15.161:6789/0 conn(0x7fdeb40cf7d0 legacy=0x7fdeb415dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.514+0000 7fdeb8a7d640 1 -- 172.21.15.161:0/2546808457 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb415e990 con 0x7fdeb415e3b0 2023-11-24T08:05:19.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.515+0000 7fdeb8a7d640 1 --2- 172.21.15.161:0/2546808457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb415e3b0 0x7fdeb40702c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fdea40097a0 tx=0x7fdea402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2baba0c9741092 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.515+0000 7fdeb2ffd640 1 -- 172.21.15.161:0/2546808457 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4031830 con 0x7fdeb415e3b0 2023-11-24T08:05:19.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.515+0000 7fdeb2ffd640 1 -- 172.21.15.161:0/2546808457 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea4031990 con 0x7fdeb415e3b0 2023-11-24T08:05:19.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.515+0000 7fdeb2ffd640 1 -- 172.21.15.161:0/2546808457 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea4031d20 con 0x7fdeb415e3b0 2023-11-24T08:05:19.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 -- 172.21.15.161:0/2546808457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb415e3b0 msgr2=0x7fdeb40702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.519 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/2546808457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb415e3b0 0x7fdeb40702c0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fdea40097a0 tx=0x7fdea402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 -- 172.21.15.161:0/2546808457 shutdown_connections 2023-11-24T08:05:19.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/2546808457 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb415e3b0 0x7fdeb40702c0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/2546808457 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb4143ae0 0x7fdeb40cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 -- 172.21.15.161:0/2546808457 >> 172.21.15.161:0/2546808457 conn(0x7fdeb406a800 msgr2=0x7fdeb406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:19.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 -- 172.21.15.161:0/2546808457 shutdown_connections 2023-11-24T08:05:19.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.516+0000 7fdeba4e0640 1 -- 172.21.15.161:0/2546808457 wait complete. 2023-11-24T08:05:19.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.518+0000 7fdeba4e0640 1 Processor -- start 2023-11-24T08:05:19.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.518+0000 7fdeba4e0640 1 -- start start 2023-11-24T08:05:19.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeba4e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb40cf7d0 0x7fdeb4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeba4e0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 0x7fdeb41f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeba4e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb415e3b0 0x7fdeb40b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeba4e0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb415cb70 con 0x7fdeb4143ae0 2023-11-24T08:05:19.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeba4e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41f4700 con 0x7fdeb40cf7d0 2023-11-24T08:05:19.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeba4e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb41f39d0 con 0x7fdeb415e3b0 2023-11-24T08:05:19.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 0x7fdeb41f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 0x7fdeb41f41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53972/0 (socket says 172.21.15.161:53972) 2023-11-24T08:05:19.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeb37fe640 1 -- 172.21.15.161:0/305041283 learned_addr learned my addr 172.21.15.161:0/305041283 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:19.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeb8a7d640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb415e3b0 0x7fdeb40b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.519+0000 7fdeb3fff640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb40cf7d0 0x7fdeb4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb37fe640 1 -- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb415e3b0 msgr2=0x7fdeb40b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb37fe640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb415e3b0 0x7fdeb40b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb37fe640 1 -- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb40cf7d0 msgr2=0x7fdeb4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:19.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb37fe640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb40cf7d0 0x7fdeb4159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:19.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb37fe640 1 -- 172.21.15.161:0/305041283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea4009400 con 0x7fdeb4143ae0 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb37fe640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 0x7fdeb41f41c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00c500 tx=0x7fde9c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c005ce0 con 0x7fdeb4143ae0 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c005e40 con 0x7fdeb4143ae0 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb41f3cb0 con 0x7fdeb4143ae0 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c007330 con 0x7fdeb4143ae0 2023-11-24T08:05:19.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.520+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb40acd30 con 0x7fdeb4143ae0 2023-11-24T08:05:19.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.521+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb41f3ed0 con 0x7fdeb4143ae0 2023-11-24T08:05:19.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.522+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fde9c007490 con 0x7fdeb4143ae0 2023-11-24T08:05:19.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.523+0000 7fdeb0ff9640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde9806b020 0x7fde9806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:19.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.523+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fde9c088ff0 con 0x7fdeb4143ae0 2023-11-24T08:05:19.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.524+0000 7fdeb3fff640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde9806b020 0x7fde9806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:19.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.525+0000 7fdeb3fff640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde9806b020 0x7fde9806d4e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009f30 tx=0x7fdeac00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:19.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.528+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde9c0bbe90 con 0x7fdeb4143ae0 2023-11-24T08:05:19.764 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:19.763+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdeb40675d0 con 0x7fdeb4143ae0 2023-11-24T08:05:20.298 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.297+0000 7fdeb0ff9640 1 -- 172.21.15.161:0/305041283 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7fde9c0170a0 con 0x7fdeb4143ae0 2023-11-24T08:05:20.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde9806b020 msgr2=0x7fde9806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde9806b020 0x7fde9806d4e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fdeac009f30 tx=0x7fdeac00b040 comp rx=0 tx=0).stop 2023-11-24T08:05:20.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 msgr2=0x7fdeb41f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 0x7fdeb41f41c0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00c500 tx=0x7fde9c00c9c0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.302 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 shutdown_connections 2023-11-24T08:05:20.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fde9806b020 0x7fde9806d4e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdeb415e3b0 0x7fdeb40b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdeb4143ae0 0x7fdeb41f41c0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 --2- 172.21.15.161:0/305041283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdeb40cf7d0 0x7fdeb4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.303 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.300+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 >> 172.21.15.161:0/305041283 conn(0x7fdeb406a800 msgr2=0x7fdeb4142bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:20.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.301+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 shutdown_connections 2023-11-24T08:05:20.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.301+0000 7fdeba4e0640 1 -- 172.21.15.161:0/305041283 wait complete. 2023-11-24T08:05:20.321 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T08:05:20.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.535+0000 7fb4fd14e640 1 Processor -- start 2023-11-24T08:05:20.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.535+0000 7fb4fd14e640 1 -- start start 2023-11-24T08:05:20.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.537+0000 7fb4fd14e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4f81447f0 0x7fb4f815c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.537+0000 7fb4fd14e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f815c5c0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.537+0000 7fb4fd14e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f806ca10 con 0x7fb4f806c470 2023-11-24T08:05:20.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.537+0000 7fb4fd14e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f806d690 con 0x7fb4f81447f0 2023-11-24T08:05:20.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.537+0000 7fb4f7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4f81447f0 0x7fb4f815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.538+0000 7fb4f7fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb4f81447f0 0x7fb4f815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53982/0 (socket says 172.21.15.161:53982) 2023-11-24T08:05:20.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.538+0000 7fb4f7fff640 1 -- 172.21.15.161:0/134599176 learned_addr learned my addr 172.21.15.161:0/134599176 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:20.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.538+0000 7fb4f7fff640 1 -- 172.21.15.161:0/134599176 >> v1:172.21.15.175:6789/0 conn(0x7fb4f806c470 legacy=0x7fb4f80cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:20.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.538+0000 7fb4f7fff640 1 -- 172.21.15.161:0/134599176 >> v1:172.21.15.161:6789/0 conn(0x7fb4f80cccf0 legacy=0x7fb4f815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.538+0000 7fb4f7fff640 1 -- 172.21.15.161:0/134599176 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f806ccf0 con 0x7fb4f81447f0 2023-11-24T08:05:20.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.538+0000 7fb4f77fe640 1 -- 172.21.15.161:0/134599176 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300645649 0 0) 0x7fb4f815c5c0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.539+0000 7fb4f7fff640 1 --2- 172.21.15.161:0/134599176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f81447f0 0x7fb4f815c080 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009870 tx=0x7fb4e802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8194cc7699a60e37 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.539+0000 7fb4f77fe640 1 -- 172.21.15.161:0/134599176 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8031860 con 0x7fb4f81447f0 2023-11-24T08:05:20.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.539+0000 7fb4f77fe640 1 -- 172.21.15.161:0/134599176 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e80319c0 con 0x7fb4f81447f0 2023-11-24T08:05:20.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.539+0000 7fb4f77fe640 1 -- 172.21.15.161:0/134599176 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e8031d50 con 0x7fb4f81447f0 2023-11-24T08:05:20.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 -- 172.21.15.161:0/134599176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f81447f0 msgr2=0x7fb4f815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/134599176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f81447f0 0x7fb4f815c080 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8009870 tx=0x7fb4e802b900 comp rx=0 tx=0).stop 2023-11-24T08:05:20.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 -- 172.21.15.161:0/134599176 shutdown_connections 2023-11-24T08:05:20.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/134599176 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f81447f0 0x7fb4f815c080 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 -- 172.21.15.161:0/134599176 >> 172.21.15.161:0/134599176 conn(0x7fb4f806a3e0 msgr2=0x7fb4f806a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:20.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 -- 172.21.15.161:0/134599176 shutdown_connections 2023-11-24T08:05:20.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.540+0000 7fb4fd14e640 1 -- 172.21.15.161:0/134599176 wait complete. 2023-11-24T08:05:20.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.542+0000 7fb4fd14e640 1 Processor -- start 2023-11-24T08:05:20.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.542+0000 7fb4fd14e640 1 -- start start 2023-11-24T08:05:20.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4fd14e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4f806c470 0x7fb4f80a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4fd14e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 0x7fb4f81503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4fd14e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4f81447f0 0x7fb4f813f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4fd14e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80a8ca0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4fd14e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80a8a00 con 0x7fb4f806c470 2023-11-24T08:05:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4fd14e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f813eb50 con 0x7fb4f81447f0 2023-11-24T08:05:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 0x7fb4f81503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4effff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 0x7fb4f81503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:53994/0 (socket says 172.21.15.161:53994) 2023-11-24T08:05:20.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.543+0000 7fb4effff640 1 -- 172.21.15.161:0/461782108 learned_addr learned my addr 172.21.15.161:0/461782108 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:20.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4f7fff640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4f806c470 0x7fb4f80a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4fc94d640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4f81447f0 0x7fb4f813f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4effff640 1 -- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4f81447f0 msgr2=0x7fb4f813f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4effff640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4f81447f0 0x7fb4f813f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4effff640 1 -- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4f806c470 msgr2=0x7fb4f80a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4effff640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4f806c470 0x7fb4f80a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4effff640 1 -- 172.21.15.161:0/461782108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e80094d0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4effff640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 0x7fb4f81503f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c430 tx=0x7fb4e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0011790 con 0x7fb4f80cccf0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00118f0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0011ce0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.544+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f813ee30 con 0x7fb4f80cccf0 2023-11-24T08:05:20.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.545+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f813f3f0 con 0x7fb4f80cccf0 2023-11-24T08:05:20.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.545+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f813f610 con 0x7fb4f80cccf0 2023-11-24T08:05:20.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.547+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb4e001c460 con 0x7fb4f80cccf0 2023-11-24T08:05:20.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.548+0000 7fb4f57fa640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb4d806b020 0x7fb4d806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:20.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.548+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb4e0089960 con 0x7fb4f80cccf0 2023-11-24T08:05:20.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.549+0000 7fb4f7fff640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb4d806b020 0x7fb4d806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:20.551 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.550+0000 7fb4f7fff640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb4d806b020 0x7fb4d806d4e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8036000 tx=0x7fb4e803c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:20.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.553+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4e0054690 con 0x7fb4f80cccf0 2023-11-24T08:05:20.746 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:20.745+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4f8067450 con 0x7fb4f80cccf0 2023-11-24T08:05:21.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.635+0000 7fb4f57fa640 1 -- 172.21.15.161:0/461782108 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb4e0057cb0 con 0x7fb4f80cccf0 2023-11-24T08:05:21.636 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_metadata' removed 2023-11-24T08:05:21.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb4d806b020 msgr2=0x7fb4d806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb4d806b020 0x7fb4d806d4e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8036000 tx=0x7fb4e803c040 comp rx=0 tx=0).stop 2023-11-24T08:05:21.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 msgr2=0x7fb4f81503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 0x7fb4f81503f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000c430 tx=0x7fb4e000c8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 shutdown_connections 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb4d806b020 0x7fb4d806d4e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4f81447f0 0x7fb4f813f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.639+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb4f80cccf0 0x7fb4f81503f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.640+0000 7fb4fd14e640 1 --2- 172.21.15.161:0/461782108 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb4f806c470 0x7fb4f80a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.640+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 >> 172.21.15.161:0/461782108 conn(0x7fb4f806a3e0 msgr2=0x7fb4f80afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.641+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 shutdown_connections 2023-11-24T08:05:21.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.641+0000 7fb4fd14e640 1 -- 172.21.15.161:0/461782108 wait complete. 2023-11-24T08:05:21.663 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T08:05:21.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.876+0000 7f868bcda640 1 Processor -- start 2023-11-24T08:05:21.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.876+0000 7f868bcda640 1 -- start start 2023-11-24T08:05:21.883 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.877+0000 7f868bcda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f8684161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.877+0000 7f868bcda640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86840cf1b0 con 0x7f86840ced50 2023-11-24T08:05:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.877+0000 7f868bcda640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86841618a0 con 0x7f86840ce8f0 2023-11-24T08:05:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.877+0000 7f868bcda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840d0a00 con 0x7f8684160f80 2023-11-24T08:05:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f868a277640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f86840ced50 0x7f86840d02f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40144/0 (socket says 172.21.15.161:40144) 2023-11-24T08:05:21.884 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f868a277640 1 -- 172.21.15.161:0/2800453946 learned_addr learned my addr 172.21.15.161:0/2800453946 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8689a76640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f8684161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058180757 0 0) 0x7f86840cf1b0 con 0x7f86840ced50 2023-11-24T08:05:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8670003520 con 0x7f86840ced50 2023-11-24T08:05:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077695383 0 0) 0x7f8670003520 con 0x7f86840ced50 2023-11-24T08:05:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 msgr2=0x7f8684161360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.885 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8688a74640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f8684161360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.878+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 >> v1:172.21.15.175:6789/0 conn(0x7f86840ce8f0 legacy=0x7f86840cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840d0de0 con 0x7f86840ced50 2023-11-24T08:05:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f867c0019f0 con 0x7f86840ced50 2023-11-24T08:05:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 >> v1:172.21.15.161:6789/0 conn(0x7f86840ced50 legacy=0x7f86840d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.886 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f86700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670003f20 0x7f86700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8670004d00 0x7f8670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840d0a00 con 0x7f8670004d00 2023-11-24T08:05:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867000ba60 con 0x7f8670003f20 2023-11-24T08:05:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867000bc20 con 0x7f8684160f80 2023-11-24T08:05:21.887 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f868a277640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8670004d00 0x7f8670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8689a76640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f86700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f8689275640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670003f20 0x7f86700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f868a277640 1 -- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 msgr2=0x7f86700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f868a277640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f86700039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f868a277640 1 -- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670003f20 msgr2=0x7f86700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.879+0000 7f868a277640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670003f20 0x7f86700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.880+0000 7f868a277640 1 -- 172.21.15.161:0/2800453946 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670003520 con 0x7f8670004d00 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.880+0000 7f8689a76640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8684160f80 0x7f86700039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f868a277640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8670004d00 0x7f8670005180 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f867c00a830 tx=0x7f86700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3cfe005d9bd9ff6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0072d0 con 0x7f8670004d00 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c02f070 con 0x7f8670004d00 2023-11-24T08:05:21.888 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f8688a74640 1 -- 172.21.15.161:0/2800453946 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0076f0 con 0x7f8670004d00 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f868bcda640 1 -- 172.21.15.161:0/2800453946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8670004d00 msgr2=0x7f8670005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f868bcda640 1 --2- 172.21.15.161:0/2800453946 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8670004d00 0x7f8670005180 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f867c00a830 tx=0x7f86700057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f868a277640 1 -- 172.21.15.161:0/2800453946 reap_dead start 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f868bcda640 1 -- 172.21.15.161:0/2800453946 shutdown_connections 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.881+0000 7f868bcda640 1 -- 172.21.15.161:0/2800453946 >> 172.21.15.161:0/2800453946 conn(0x7f868409c550 msgr2=0x7f86840d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.882+0000 7f868bcda640 1 -- 172.21.15.161:0/2800453946 shutdown_connections 2023-11-24T08:05:21.889 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.882+0000 7f868bcda640 1 -- 172.21.15.161:0/2800453946 wait complete. 2023-11-24T08:05:21.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.883+0000 7f868bcda640 1 Processor -- start 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.883+0000 7f868bcda640 1 -- start start 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.884+0000 7f868bcda640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670004d00 0x7f86840b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.884+0000 7f868bcda640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 0x7f86840cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.884+0000 7f868bcda640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86840cc750 0x7f868414f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.884+0000 7f868bcda640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840b7370 con 0x7f86840b1100 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.884+0000 7f868bcda640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840b8300 con 0x7f8670004d00 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.884+0000 7f868bcda640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840ccc40 con 0x7f86840cc750 2023-11-24T08:05:21.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 0x7f86840cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 0x7f86840cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58200/0 (socket says 172.21.15.161:58200) 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 -- 172.21.15.161:0/3395617633 learned_addr learned my addr 172.21.15.161:0/3395617633 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 -- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86840cc750 msgr2=0x7f868414f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86840cc750 0x7f868414f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 -- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670004d00 msgr2=0x7f86840b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670004d00 0x7f86840b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 -- 172.21.15.161:0/3395617633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840ccf20 con 0x7f86840b1100 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.885+0000 7f8689275640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 0x7f86840cc210 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f867800e550 tx=0x7f867800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.886+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780052e0 con 0x7f86840b1100 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.886+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8678005440 con 0x7f86840b1100 2023-11-24T08:05:21.893 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.886+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678003810 con 0x7f86840b1100 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.886+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840b75c0 con 0x7f86840b1100 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.886+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868415cc50 con 0x7f86840b1100 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.887+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86840675d0 con 0x7f86840b1100 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.888+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8678003970 con 0x7f86840b1100 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.889+0000 7f86767fc640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f866806aff0 0x7f866806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.889+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f8678089460 con 0x7f86840b1100 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.889+0000 7f8689a76640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f866806aff0 0x7f866806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:21.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.891+0000 7f8689a76640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f866806aff0 0x7f866806d4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f86800099e0 tx=0x7f8680008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:21.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:21.893+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8678054480 con 0x7f86840b1100 2023-11-24T08:05:22.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.083+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86840d3920 con 0x7f86840b1100 2023-11-24T08:05:22.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.638+0000 7f86767fc640 1 -- 172.21.15.161:0/3395617633 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8678057aa0 con 0x7f86840b1100 2023-11-24T08:05:22.640 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'cephfs_data' removed 2023-11-24T08:05:22.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f866806aff0 msgr2=0x7f866806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f866806aff0 0x7f866806d4b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f86800099e0 tx=0x7f8680008040 comp rx=0 tx=0).stop 2023-11-24T08:05:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 msgr2=0x7f86840cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 0x7f86840cc210 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f867800e550 tx=0x7f867800ea10 comp rx=0 tx=0).stop 2023-11-24T08:05:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 shutdown_connections 2023-11-24T08:05:22.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f866806aff0 0x7f866806d4b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86840cc750 0x7f868414f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f86840b1100 0x7f86840cc210 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 --2- 172.21.15.161:0/3395617633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8670004d00 0x7f86840b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 >> 172.21.15.161:0/3395617633 conn(0x7f868409c550 msgr2=0x7f86840b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 shutdown_connections 2023-11-24T08:05:22.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.642+0000 7f868bcda640 1 -- 172.21.15.161:0/3395617633 wait complete. 2023-11-24T08:05:22.669 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T08:05:22.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.951+0000 7fd550607640 1 Processor -- start 2023-11-24T08:05:22.952 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.951+0000 7fd550607640 1 -- start start 2023-11-24T08:05:22.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd550607640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 0x7fd5480ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd550607640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd548071de0 con 0x7fd5480d0b60 2023-11-24T08:05:22.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd550607640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5480af270 con 0x7fd5480aede0 2023-11-24T08:05:22.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd550607640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd548072030 con 0x7fd54806a3e0 2023-11-24T08:05:22.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd54dba2640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd5480d0b60 0x7fd54806a7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40160/0 (socket says 172.21.15.161:40160) 2023-11-24T08:05:22.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd54dba2640 1 -- 172.21.15.161:0/3190480633 learned_addr learned my addr 172.21.15.161:0/3190480633 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:22.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.953+0000 7fd54e3a3640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 0x7fd5480ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831725591 0 0) 0x7fd548071de0 con 0x7fd5480d0b60 2023-11-24T08:05:22.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd534003520 con 0x7fd5480d0b60 2023-11-24T08:05:22.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245324065 0 0) 0x7fd534003520 con 0x7fd5480d0b60 2023-11-24T08:05:22.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 msgr2=0x7fd5480ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 0x7fd5480ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.958 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 >> v1:172.21.15.175:6789/0 conn(0x7fd5480aede0 legacy=0x7fd54806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd548072310 con 0x7fd5480d0b60 2023-11-24T08:05:22.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fd538001670 con 0x7fd5480d0b60 2023-11-24T08:05:22.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 >> v1:172.21.15.161:6789/0 conn(0x7fd5480d0b60 legacy=0x7fd54806a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340039a0 0x7fd534003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 0x7fd5340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd534005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd548072030 con 0x7fd534004d00 2023-11-24T08:05:22.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53400ba30 con 0x7fd5340039a0 2023-11-24T08:05:22.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53400bbf0 con 0x7fd54806a3e0 2023-11-24T08:05:22.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.954+0000 7fd54eba4640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd534005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54dba2640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 0x7fd5340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54e3a3640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340039a0 0x7fd534003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54eba4640 1 -- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 msgr2=0x7fd5340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54eba4640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd54806a3e0 0x7fd5340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54eba4640 1 -- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340039a0 msgr2=0x7fd534003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:22.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54eba4640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5340039a0 0x7fd534003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.955+0000 7fd54eba4640 1 -- 172.21.15.161:0/3190480633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534003520 con 0x7fd534004d00 2023-11-24T08:05:22.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.956+0000 7fd54eba4640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd534005180 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd540001e20 tx=0x7fd5340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5197625c0d51479 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.956+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540003b70 con 0x7fd534004d00 2023-11-24T08:05:22.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.956+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540003cd0 con 0x7fd534004d00 2023-11-24T08:05:22.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.956+0000 7fd54d3a1640 1 -- 172.21.15.161:0/3190480633 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540005310 con 0x7fd534004d00 2023-11-24T08:05:22.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd550607640 1 -- 172.21.15.161:0/3190480633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 msgr2=0x7fd534005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd550607640 1 --2- 172.21.15.161:0/3190480633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd534005180 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd540001e20 tx=0x7fd5340057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd54eba4640 1 -- 172.21.15.161:0/3190480633 reap_dead start 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd550607640 1 -- 172.21.15.161:0/3190480633 shutdown_connections 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd550607640 1 -- 172.21.15.161:0/3190480633 >> 172.21.15.161:0/3190480633 conn(0x7fd5480cfef0 msgr2=0x7fd5480d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd550607640 1 -- 172.21.15.161:0/3190480633 shutdown_connections 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.957+0000 7fd550607640 1 -- 172.21.15.161:0/3190480633 wait complete. 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.959+0000 7fd550607640 1 Processor -- start 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.959+0000 7fd550607640 1 -- start start 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd550607640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd548156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd550607640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd548153ce0 0x7fd5480cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd550607640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5480b0d50 0x7fd5480b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd550607640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480ce9d0 con 0x7fd534004d00 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd550607640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5480b1710 con 0x7fd5480b0d50 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd550607640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5481f34b0 con 0x7fd548153ce0 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd548156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd548156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58214/0 (socket says 172.21.15.161:58214) 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 -- 172.21.15.161:0/2311774853 learned_addr learned my addr 172.21.15.161:0/2311774853 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54dba2640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd548153ce0 0x7fd5480cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54eba4640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5480b0d50 0x7fd5480b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 -- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd548153ce0 msgr2=0x7fd5480cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd548153ce0 0x7fd5480cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 -- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5480b0d50 msgr2=0x7fd5480b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.960+0000 7fd54e3a3640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5480b0d50 0x7fd5480b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd54e3a3640 1 -- 172.21.15.161:0/2311774853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480cded0 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd54e3a3640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd548156e90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd544011630 tx=0x7fd544011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400f8c0 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54400fa20 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400fd90 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd548154140 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.961+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5480ce410 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.962+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54815a650 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.963+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd544015460 con 0x7fd534004d00 2023-11-24T08:05:22.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.965+0000 7fd53effd640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd52c06aff0 0x7fd52c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:22.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.965+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd544089b90 con 0x7fd534004d00 2023-11-24T08:05:22.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.965+0000 7fd54dba2640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd52c06aff0 0x7fd52c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:22.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.966+0000 7fd54dba2640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd52c06aff0 0x7fd52c06d4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd538001eb0 tx=0x7fd538001d60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:22.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:22.969+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd544054c20 con 0x7fd534004d00 2023-11-24T08:05:23.161 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.160+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd5480675d0 con 0x7fd534004d00 2023-11-24T08:05:23.167 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.166+0000 7fd53effd640 1 -- 172.21.15.161:0/2311774853 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd544058240 con 0x7fd534004d00 2023-11-24T08:05:23.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.169+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd52c06aff0 msgr2=0x7fd52c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.169+0000 7fd550607640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd52c06aff0 0x7fd52c06d4b0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd538001eb0 tx=0x7fd538001d60 comp rx=0 tx=0).stop 2023-11-24T08:05:23.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.169+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 msgr2=0x7fd548156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.169+0000 7fd550607640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd548156e90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd544011630 tx=0x7fd544011af0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 shutdown_connections 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd52c06aff0 0x7fd52c06d4b0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5480b0d50 0x7fd5480b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd548153ce0 0x7fd5480cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 --2- 172.21.15.161:0/2311774853 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd534004d00 0x7fd548156e90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 >> 172.21.15.161:0/2311774853 conn(0x7fd5480cfef0 msgr2=0x7fd5480adfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 shutdown_connections 2023-11-24T08:05:23.172 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.170+0000 7fd550607640 1 -- 172.21.15.161:0/2311774853 wait complete. 2023-11-24T08:05:23.190 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2023-11-24T08:05:23.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.384+0000 7fbc76e0e640 1 Processor -- start 2023-11-24T08:05:23.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.384+0000 7fbc76e0e640 1 -- start start 2023-11-24T08:05:23.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.385+0000 7fbc76e0e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc70143ae0 0x7fbc700cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc76e0e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbc7015e3b0 0x7fbc700702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc76e0e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc700cfc30 con 0x7fbc700cf7d0 2023-11-24T08:05:23.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc76e0e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700b1ee0 con 0x7fbc70143ae0 2023-11-24T08:05:23.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc76e0e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc700b2780 con 0x7fbc7015e3b0 2023-11-24T08:05:23.387 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc6ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbc700cf7d0 0x7fbc7015dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40176/0 (socket says 172.21.15.161:40176) 2023-11-24T08:05:23.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc74baa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbc70143ae0 0x7fbc700cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.388 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc6ffff640 1 -- 172.21.15.161:0/2311124080 learned_addr learned my addr 172.21.15.161:0/2311124080 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc753ab640 1 --2- 172.21.15.161:0/2311124080 >> v2:172.21.15.175:3300/0 conn(0x7fbc7015e3b0 0x7fbc700702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc74baa640 1 -- 172.21.15.161:0/2311124080 >> v2:172.21.15.175:3300/0 conn(0x7fbc7015e3b0 msgr2=0x7fbc700702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc74baa640 1 --2- 172.21.15.161:0/2311124080 >> v2:172.21.15.175:3300/0 conn(0x7fbc7015e3b0 0x7fbc700702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.386+0000 7fbc74baa640 1 -- 172.21.15.161:0/2311124080 >> v1:172.21.15.161:6789/0 conn(0x7fbc700cf7d0 legacy=0x7fbc7015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.387+0000 7fbc6f7fe640 1 -- 172.21.15.161:0/2311124080 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072660433 0 0) 0x7fbc700cfc30 con 0x7fbc700cf7d0 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.387+0000 7fbc74baa640 1 -- 172.21.15.161:0/2311124080 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7015e990 con 0x7fbc70143ae0 2023-11-24T08:05:23.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.387+0000 7fbc753ab640 1 --2- 172.21.15.161:0/2311124080 >> v2:172.21.15.175:3300/0 conn(0x7fbc7015e3b0 0x7fbc700702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:23.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.388+0000 7fbc74baa640 1 --2- 172.21.15.161:0/2311124080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70143ae0 0x7fbc700cf290 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fbc7006e4f0 tx=0x7fbc6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5ca1d6f9992213 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.388+0000 7fbc6f7fe640 1 -- 172.21.15.161:0/2311124080 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64031830 con 0x7fbc70143ae0 2023-11-24T08:05:23.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.388+0000 7fbc6f7fe640 1 -- 172.21.15.161:0/2311124080 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64031990 con 0x7fbc70143ae0 2023-11-24T08:05:23.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.388+0000 7fbc6f7fe640 1 -- 172.21.15.161:0/2311124080 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc64031d20 con 0x7fbc70143ae0 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.388+0000 7fbc76e0e640 1 -- 172.21.15.161:0/2311124080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70143ae0 msgr2=0x7fbc700cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.388+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/2311124080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70143ae0 0x7fbc700cf290 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fbc7006e4f0 tx=0x7fbc6402b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.389+0000 7fbc76e0e640 1 -- 172.21.15.161:0/2311124080 shutdown_connections 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.389+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/2311124080 >> v2:172.21.15.175:3300/0 conn(0x7fbc7015e3b0 0x7fbc700702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.389+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/2311124080 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc70143ae0 0x7fbc700cf290 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.389+0000 7fbc76e0e640 1 -- 172.21.15.161:0/2311124080 >> 172.21.15.161:0/2311124080 conn(0x7fbc7006a800 msgr2=0x7fbc7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:23.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.389+0000 7fbc76e0e640 1 -- 172.21.15.161:0/2311124080 shutdown_connections 2023-11-24T08:05:23.392 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.389+0000 7fbc76e0e640 1 -- 172.21.15.161:0/2311124080 wait complete. 2023-11-24T08:05:23.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.390+0000 7fbc76e0e640 1 Processor -- start 2023-11-24T08:05:23.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.391+0000 7fbc76e0e640 1 -- start start 2023-11-24T08:05:23.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc76e0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc700cf7d0 0x7fbc7013cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc76e0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc70143ae0 0x7fbc7013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc76e0e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 0x7fbc700afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc76e0e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7013c3b0 con 0x7fbc7015e3b0 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc76e0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7013e4c0 con 0x7fbc700cf7d0 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc76e0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc700ada30 con 0x7fbc70143ae0 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 0x7fbc700afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 0x7fbc700afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58244/0 (socket says 172.21.15.161:58244) 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 -- 172.21.15.161:0/3366111503 learned_addr learned my addr 172.21.15.161:0/3366111503 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc74baa640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc700cf7d0 0x7fbc7013cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.395 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 -- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc70143ae0 msgr2=0x7fbc7013f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc70143ae0 0x7fbc7013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 -- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc700cf7d0 msgr2=0x7fbc7013cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc700cf7d0 0x7fbc7013cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc753ab640 1 -- 172.21.15.161:0/3366111503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc64009400 con 0x7fbc7015e3b0 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.392+0000 7fbc74baa640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc700cf7d0 0x7fbc7013cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.393+0000 7fbc753ab640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 0x7fbc700afa70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800cd50 tx=0x7fbc6800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.393+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800f680 con 0x7fbc7015e3b0 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.393+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6800f800 con 0x7fbc7015e3b0 2023-11-24T08:05:23.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.393+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6800fbb0 con 0x7fbc7015e3b0 2023-11-24T08:05:23.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.393+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc700ad750 con 0x7fbc7015e3b0 2023-11-24T08:05:23.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.393+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7013e9d0 con 0x7fbc7015e3b0 2023-11-24T08:05:23.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.394+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc700675d0 con 0x7fbc7015e3b0 2023-11-24T08:05:23.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.395+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbc6800b040 con 0x7fbc7015e3b0 2023-11-24T08:05:23.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.396+0000 7fbc6d7fa640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc5406b020 0x7fbc5406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:23.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.396+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbc6808a1c0 con 0x7fbc7015e3b0 2023-11-24T08:05:23.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.397+0000 7fbc74baa640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc5406b020 0x7fbc5406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:23.399 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.398+0000 7fbc74baa640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc5406b020 0x7fbc5406d4e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbc64036000 tx=0x7fbc64008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:23.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.400+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc680551d0 con 0x7fbc7015e3b0 2023-11-24T08:05:23.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:23.663+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) v1 -- 0x7fbc70070b60 con 0x7fbc7015e3b0 2023-11-24T08:05:24.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.660+0000 7fbc6d7fa640 1 -- 172.21.15.161:0/3366111503 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v267) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbc680587f0 con 0x7fbc7015e3b0 2023-11-24T08:05:24.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc5406b020 msgr2=0x7fbc5406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc5406b020 0x7fbc5406d4e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbc64036000 tx=0x7fbc64008030 comp rx=0 tx=0).stop 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 msgr2=0x7fbc700afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 0x7fbc700afa70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbc6800cd50 tx=0x7fbc6800a650 comp rx=0 tx=0).stop 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 shutdown_connections 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbc5406b020 0x7fbc5406d4e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbc7015e3b0 0x7fbc700afa70 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.666 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc70143ae0 0x7fbc7013f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 --2- 172.21.15.161:0/3366111503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc700cf7d0 0x7fbc7013cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:24.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 >> 172.21.15.161:0/3366111503 conn(0x7fbc7006a800 msgr2=0x7fbc7015b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:24.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 shutdown_connections 2023-11-24T08:05:24.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:24.664+0000 7fbc76e0e640 1 -- 172.21.15.161:0/3366111503 wait complete. 2023-11-24T08:05:24.690 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ERROR 2023-11-24T08:05:24.691 INFO:tasks.cephfs_test_runner: 2023-11-24T08:05:24.691 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:05:24.691 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:05:24.691 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:05:24.691 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:05:24.691 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:05:24.692 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 7874, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T08:05:24.692 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T08:05:24.692 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:05:24.692 INFO:tasks.cephfs_test_runner: 2023-11-24T08:05:24.692 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:05:24.692 INFO:tasks.cephfs_test_runner:Ran 3 tests in 258.498s 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner: 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner: 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner:ERROR: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system 2023-11-24T08:05:24.693 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T08:05:24.694 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T08:05:24.694 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs/test_volumes.py", line 7874, in test_malicious_metafile_on_legacy_to_v1_upgrade 2023-11-24T08:05:24.694 INFO:tasks.cephfs_test_runner: subvol1, subvol2 = self._generate_random_subvolume_name(2) 2023-11-24T08:05:24.694 INFO:tasks.cephfs_test_runner:AttributeError: 'TestMisc' object has no attribute '_generate_random_subvolume_name' 2023-11-24T08:05:24.694 INFO:tasks.cephfs_test_runner: 2023-11-24T08:05:24.694 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:05:24.771 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=05e36c0efe9d45da964d44280b10191f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_rishabh-d-dave_ceph_73843baf45f8a92d8e3fcbea3f024c97e73036da/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2023-11-24T08:05:24.772 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T08:05:24.782 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-24T08:05:24.910 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-24T08:05:24.911 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:05:24.911 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:24.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:05:24.984 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-11-24T08:05:24.984 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:25.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-24T08:05:25.038 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:05:25.038 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:25.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:05:25.101 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2023-11-24T08:05:25.101 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T08:05:25.154 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054289,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249400k,nr_inodes=812350,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498808k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-24T08:05:25.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.154 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2023-11-24T08:05:25.207 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T08:05:25.207 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T08:05:25.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.208 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T08:05:25.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.307 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T08:05:25.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.398 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2023-11-24T08:05:25.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.520 DEBUG:teuthology.orchestra.run.smithi161:> ip netns list 2023-11-24T08:05:25.580 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T08:05:25.580 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T08:05:25.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.581 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T08:05:25.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.677 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T08:05:25.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T08:05:25.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo ip link delete ceph-brx 2023-11-24T08:05:25.894 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T08:05:25.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T08:05:25.908 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:26.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.095+0000 7f60e89fa640 1 Processor -- start 2023-11-24T08:05:26.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.095+0000 7f60e89fa640 1 -- start start 2023-11-24T08:05:26.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.096+0000 7f60e89fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e4143c40 0x7f60e4071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.096+0000 7f60e89fa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60e40ccc10 0x7f60e406d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.096+0000 7f60e89fa640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e4070e50 con 0x7f60e40717d0 2023-11-24T08:05:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.096+0000 7f60e89fa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e40723c0 con 0x7f60e40ccc10 2023-11-24T08:05:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.096+0000 7f60e89fa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e4144020 con 0x7f60e4143c40 2023-11-24T08:05:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60e40ccc10 0x7f60e406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f60e40ccc10 0x7f60e406d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58254/0 (socket says 172.21.15.161:58254) 2023-11-24T08:05:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 -- 172.21.15.161:0/17452525 learned_addr learned my addr 172.21.15.161:0/17452525 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:26.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e37fe640 1 --2- 172.21.15.161:0/17452525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e4143c40 0x7f60e4071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 -- 172.21.15.161:0/17452525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e4143c40 msgr2=0x7f60e4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 --2- 172.21.15.161:0/17452525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e4143c40 0x7f60e4071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 -- 172.21.15.161:0/17452525 >> v1:172.21.15.175:6789/0 conn(0x7f60e40717d0 legacy=0x7f60e40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:26.100 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.097+0000 7f60e3fff640 1 -- 172.21.15.161:0/17452525 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e4071e00 con 0x7f60e40ccc10 2023-11-24T08:05:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.099+0000 7f60e3fff640 1 --2- 172.21.15.161:0/17452525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e40ccc10 0x7f60e406d160 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009e50 tx=0x7f60dc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1256a22ba4fe87 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.099+0000 7f60e2ffd640 1 -- 172.21.15.161:0/17452525 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc02c9e0 con 0x7f60e40ccc10 2023-11-24T08:05:26.101 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.099+0000 7f60e2ffd640 1 -- 172.21.15.161:0/17452525 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc02cb40 con 0x7f60e40ccc10 2023-11-24T08:05:26.102 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.099+0000 7f60e2ffd640 1 -- 172.21.15.161:0/17452525 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0343f0 con 0x7f60e40ccc10 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 -- 172.21.15.161:0/17452525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e40ccc10 msgr2=0x7f60e406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 --2- 172.21.15.161:0/17452525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e40ccc10 0x7f60e406d160 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009e50 tx=0x7f60dc02be40 comp rx=0 tx=0).stop 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 -- 172.21.15.161:0/17452525 shutdown_connections 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 --2- 172.21.15.161:0/17452525 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e40ccc10 0x7f60e406d160 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 --2- 172.21.15.161:0/17452525 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e4143c40 0x7f60e4071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 -- 172.21.15.161:0/17452525 >> 172.21.15.161:0/17452525 conn(0x7f60e406a800 msgr2=0x7f60e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 -- 172.21.15.161:0/17452525 shutdown_connections 2023-11-24T08:05:26.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.100+0000 7f60e89fa640 1 -- 172.21.15.161:0/17452525 wait complete. 2023-11-24T08:05:26.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.101+0000 7f60e89fa640 1 Processor -- start 2023-11-24T08:05:26.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.102+0000 7f60e89fa640 1 -- start start 2023-11-24T08:05:26.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e89fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e40717d0 0x7f60e413c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e89fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e40ccc10 0x7f60e40adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e89fa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 0x7f60e413dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e89fa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40b1f00 con 0x7f60e4143c40 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e89fa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40b31f0 con 0x7f60e40717d0 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e89fa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e40b2150 con 0x7f60e40ccc10 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 0x7f60e413dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 0x7f60e413dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58260/0 (socket says 172.21.15.161:58260) 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 -- 172.21.15.161:0/2619261433 learned_addr learned my addr 172.21.15.161:0/2619261433 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:26.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e37fe640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e40717d0 0x7f60e413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60dbfff640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e40ccc10 0x7f60e40adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 -- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e40ccc10 msgr2=0x7f60e40adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e40ccc10 0x7f60e40adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 -- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e40717d0 msgr2=0x7f60e413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e40717d0 0x7f60e413c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e3fff640 1 -- 172.21.15.161:0/2619261433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc009b30 con 0x7f60e4143c40 2023-11-24T08:05:26.111 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.103+0000 7f60e37fe640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e40717d0 0x7f60e413c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.104+0000 7f60e3fff640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 0x7f60e413dfa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f60dc036040 tx=0x7f60dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.104+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc009510 con 0x7f60e4143c40 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.104+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc03e450 con 0x7f60e4143c40 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.104+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e40b2430 con 0x7f60e4143c40 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.104+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc03e7e0 con 0x7f60e4143c40 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.104+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e40b29f0 con 0x7f60e4143c40 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.105+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e4067450 con 0x7f60e4143c40 2023-11-24T08:05:26.112 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.106+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f60dc03e940 con 0x7f60e4143c40 2023-11-24T08:05:26.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.107+0000 7f60e0ff9640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f60c406aff0 0x7f60c406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.107+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f60dc0ac480 con 0x7f60e4143c40 2023-11-24T08:05:26.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.108+0000 7f60e37fe640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f60c406aff0 0x7f60c406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.113 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.109+0000 7f60e37fe640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f60c406aff0 0x7f60c406d4b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006fd0 tx=0x7f60d4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.114 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.112+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60dc077510 con 0x7f60e4143c40 2023-11-24T08:05:26.301 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.298+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60e406cc40 con 0x7f60c406aff0 2023-11-24T08:05:26.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.304+0000 7f60e0ff9640 1 -- 172.21.15.161:0/2619261433 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48274 (secure 0 0 0) 0x7f60d4009550 con 0x7f60c406aff0 2023-11-24T08:05:26.306 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:26.306 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:26.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.306+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f60c406aff0 msgr2=0x7f60c406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.306+0000 7f60e89fa640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f60c406aff0 0x7f60c406d4b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f60d4006fd0 tx=0x7f60d4008040 comp rx=0 tx=0).stop 2023-11-24T08:05:26.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.306+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 msgr2=0x7f60e413dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.306+0000 7f60e89fa640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 0x7f60e413dfa0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f60dc036040 tx=0x7f60dc004a40 comp rx=0 tx=0).stop 2023-11-24T08:05:26.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 shutdown_connections 2023-11-24T08:05:26.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f60c406aff0 0x7f60c406d4b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f60e4143c40 0x7f60e413dfa0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f60e40ccc10 0x7f60e40adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 --2- 172.21.15.161:0/2619261433 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f60e40717d0 0x7f60e413c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 >> 172.21.15.161:0/2619261433 conn(0x7f60e406a800 msgr2=0x7f60e40af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 shutdown_connections 2023-11-24T08:05:26.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.307+0000 7f60e89fa640 1 -- 172.21.15.161:0/2619261433 wait complete. 2023-11-24T08:05:26.326 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2023-11-24T08:05:24.637501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":244008,"kb_used_data":7032,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730712,"statfs":{"total":773094113280,"available":772844249088,"internally_reserved":0,"allocated":7200768,"data_stored":3678921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001893"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T08:05:22.194566+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:05:22.194566+0000","last_peered":"2023-11-24T08:05:22.194566+0000","last_clean":"2023-11-24T08:05:22.194566+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:05:22.194566+0000","last_undegraded":"2023-11-24T08:05:22.194566+0000","last_fullsized":"2023-11-24T08:05:22.194566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.135},"min":{"1min":0.73199999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.474,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.087,"15min":1.0549999999999999},"min":{"1min":0.84799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4950000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.147}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1699999999999999,"15min":1.1639999999999999},"min":{"1min":0.86599999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6719999999999999,"5min":1.929,"15min":1.929},"last":1.506},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.181,"15min":1.194},"min":{"1min":0.94199999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5700000000000001,"5min":2.02,"15min":2.02},"last":1.008}]},{"osd":2,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.169,"15min":1.125},"min":{"1min":0.92200000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.429,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.1539999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7450000000000001,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.601}]},{"osd":3,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.244,"15min":1.1779999999999999},"min":{"1min":1.087,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.706,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.397},{"interface":"front","average":{"1min":1.423,"5min":1.419,"15min":1.415},"min":{"1min":1.0629999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.768,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.665}]},{"osd":4,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":1.05,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6120000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.252},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.0880000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.861,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4970000000000001,"15min":1.542},"min":{"1min":1.1060000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6890000000000001,"5min":2.504,"15min":2.504},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5049999999999999,"15min":1.528},"min":{"1min":1.2370000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.7390000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.5429999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5960000000000001,"15min":1.6020000000000001},"min":{"1min":1.2729999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3479999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.5329999999999999,"15min":1.526},"min":{"1min":1.3440000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.984,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.296}]}]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.012,"15min":0.95399999999999996},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4810000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.212,"5min":1.087,"15min":1.0629999999999999},"min":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.528,"5min":1.593,"15min":1.593},"last":1.1180000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2250000000000001,"15min":1.204},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.622},"max":{"1min":1.6850000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7350000000000001,"5min":2.597,"15min":2.597},"last":1.5169999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1859999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4930000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.232},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2869999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":2.831,"15min":2.831},"last":1.347}]},{"osd":3,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.92400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.478,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8069999999999999,"5min":1.974,"15min":1.974},"last":1.7689999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5740000000000001,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.72},{"interface":"front","average":{"1min":1.242,"5min":1.337,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.573,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.8200000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.518,"15min":1.571},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6439999999999999,"5min":2.105,"15min":2.105},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5009999999999999,"15min":1.5249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.528,"15min":1.5920000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7050000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.964},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5329999999999999,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.8640000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":2.0310000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.1140000000000001,"15min":1.0840000000000001},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.589,"5min":2.431,"15min":2.431},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.093,"15min":1.0369999999999999},"min":{"1min":0.871,"5min":0.63,"15min":0.63},"max":{"1min":1.4670000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0449999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.464,"5min":1.653,"15min":1.653},"last":1.258},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.80000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.4810000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.88100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.77900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5860000000000001,"5min":1.768,"15min":1.768},"last":1.161}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3029999999999999,"15min":1.3400000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7889999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.3340000000000001},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.429}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2889999999999999,"15min":1.3560000000000001},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8260000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.401,"15min":1.4990000000000001},"min":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9019999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.653}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3979999999999999,"15min":1.4279999999999999},"min":{"1min":0.94399999999999995,"5min":0.629,"15min":0.629},"max":{"1min":2.0209999999999999,"5min":2.569,"15min":2.569},"last":1.601},{"interface":"front","average":{"1min":1.363,"5min":1.464,"15min":1.522},"min":{"1min":1.0049999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7270000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.6879999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.5529999999999999,"15min":1.675},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.948,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.8},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5580000000000001,"15min":1.5760000000000001},"min":{"1min":0.86599999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.72}]}]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":308795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.628,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2490000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.82699999999999996},"min":{"1min":0.73199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.202,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.02,"15min":0.97499999999999998},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.45,"5min":1.871,"15min":1.871},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.056,"15min":1.034},"min":{"1min":0.60399999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.542},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0960000000000001,"15min":1.0289999999999999},"min":{"1min":0.69999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.91300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6419999999999999,"5min":1.875,"15min":1.875},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.262,"15min":1.204},"min":{"1min":1.127,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7430000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3380000000000001,"15min":1.296},"min":{"1min":1.1519999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.8180000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.177},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.27},"min":{"1min":1.161,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7270000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.494}]},{"osd":6,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.298,"15min":1.26},"min":{"1min":1.208,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.776,"5min":1.861,"15min":1.861},"last":1.617},{"interface":"front","average":{"1min":1.49,"5min":1.421,"15min":1.3819999999999999},"min":{"1min":1.254,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.742,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3109999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.393,"15min":1.325},"min":{"1min":1.234,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7330000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.3480000000000001,"15min":1.288},"min":{"1min":1.2390000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.788,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.7170000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90200000000000002,"15min":0.99199999999999999},"min":{"1min":0.64100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.175,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.127,"5min":0.96499999999999997,"15min":0.89000000000000001},"min":{"1min":0.77200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5369999999999999,"5min":3.343,"15min":3.343},"last":0.749}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.069,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.514},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.72399999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4550000000000001,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0589999999999999,"15min":1.002},"min":{"1min":0.87,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4490000000000001,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":0.622}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4930000000000001,"15min":1.518},"min":{"1min":1.218,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.9199999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5109999999999999,"15min":1.569},"min":{"1min":1.0149999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7889999999999999,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":1.407}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4199999999999999,"15min":1.504},"min":{"1min":1.167,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9159999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.448,"15min":1.3580000000000001},"min":{"1min":1.109,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9810000000000001,"5min":12.798,"15min":12.798},"last":1.262}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4630000000000001,"15min":1.415},"min":{"1min":1.1319999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.9159999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.042},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4850000000000001,"15min":1.585},"min":{"1min":1.1930000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0190000000000001,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.6040000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.4810000000000001,"15min":1.423},"min":{"1min":1.1180000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0369999999999999,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":0.879},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5049999999999999,"15min":1.5840000000000001},"min":{"1min":0.98499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0569999999999999,"5min":6.399,"15min":6.399},"last":0.999}]}]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":308795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0589999999999999,"15min":1.0880000000000001},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0740000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9319999999999999,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.9319999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.81799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.71,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8220000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.8220000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"min":{"1min":0.88800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.522},{"interface":"front","average":{"1min":1.383,"5min":1.3839999999999999,"15min":1.4319999999999999},"min":{"1min":0.91000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9419999999999999,"5min":1.966,"15min":1.966},"last":1.772}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.82799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3480000000000001,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7270000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.452}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4179999999999999,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6000000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.508,"15min":1.512},"min":{"1min":1.1180000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.857,"5min":2.073,"15min":2.073},"last":1.885}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.448,"15min":1.528},"min":{"1min":1.131,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6379999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.51,"15min":1.5940000000000001},"min":{"1min":1.05,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.6659999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.5469999999999999,"15min":1.5920000000000001},"min":{"1min":0.91000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0259999999999998,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6779999999999999},"min":{"1min":1.274,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.8280000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":2.0609999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.60799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.556,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.032,"5min":0.93999999999999995,"15min":0.999},"min":{"1min":0.70099999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.369,"5min":3.266,"15min":3.266},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.72399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3109999999999999,"5min":1.706,"15min":1.706},"last":0.505},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.82899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4259999999999999,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.169,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.825,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.91100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.649,"5min":1.976,"15min":1.976},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3300000000000001,"15min":1.472},"min":{"1min":0.98099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.552,"5min":4.367,"15min":4.367},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.375,"15min":1.4339999999999999},"min":{"1min":1.0840000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0790000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3999999999999999,"15min":1.54},"min":{"1min":1.1180000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6599999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.46,"15min":1.4950000000000001},"min":{"1min":1.274,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1459999999999999,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.395},"min":{"1min":1.103,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.917,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5409999999999999,"15min":1.643},"min":{"1min":1.3069999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.875,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3979999999999999,"15min":1.4319999999999999},"min":{"1min":1.131,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7849999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5329999999999999,"15min":1.663},"min":{"1min":1.1559999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7929999999999999,"5min":4.452,"15min":4.452},"last":0.73799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":1335296,"data_stored":899163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.83899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.421,"5min":1.46,"15min":1.46},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3360000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.038},"min":{"1min":0.85199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.391}]},{"osd":3,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0669999999999999},"min":{"1min":0.99399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5329999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1699999999999999,"15min":1.1299999999999999},"min":{"1min":1.0940000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6990000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.222,"15min":1.226},"min":{"1min":0.72599999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4970000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.456},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3,"15min":1.3240000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.24}]},{"osd":5,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4390000000000001,"15min":1.4970000000000001},"min":{"1min":1.1890000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0680000000000001,"5min":2.839,"15min":2.839},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3620000000000001,"15min":1.387},"min":{"1min":1.2569999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6539999999999999,"5min":2.823,"15min":2.823},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.333,"15min":1.351},"min":{"1min":1.0609999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.552,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":1.089,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9730000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.792}]},{"osd":7,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4630000000000001,"15min":1.51},"min":{"1min":1.1739999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.891,"5min":2.875,"15min":2.875},"last":1.9470000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.7669999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:26.328 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:26.542 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.541+0000 7f389cdc5640 1 Processor -- start 2023-11-24T08:05:26.543 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.542+0000 7f389cdc5640 1 -- start start 2023-11-24T08:05:26.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f389cdc5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 0x7f38980cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f389cdc5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f389815e3b0 0x7f38980702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f389cdc5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38980cfc30 con 0x7f38980cf7d0 2023-11-24T08:05:26.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f389cdc5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38980b1ee0 con 0x7f389815e3b0 2023-11-24T08:05:26.544 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f389cdc5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b2780 con 0x7f3898143ae0 2023-11-24T08:05:26.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f389659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 0x7f38980cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.543+0000 7f3896d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f389815e3b0 0x7f38980702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.545 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.544+0000 7f389659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 0x7f38980cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:52924/0 (socket says 172.21.15.161:52924) 2023-11-24T08:05:26.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.544+0000 7f389659c640 1 -- 172.21.15.161:0/4022165853 learned_addr learned my addr 172.21.15.161:0/4022165853 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:26.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.544+0000 7f389659c640 1 -- 172.21.15.161:0/4022165853 >> v2:172.21.15.175:3300/0 conn(0x7f389815e3b0 msgr2=0x7f38980702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:26.546 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.544+0000 7f389659c640 1 --2- 172.21.15.161:0/4022165853 >> v2:172.21.15.175:3300/0 conn(0x7f389815e3b0 0x7f38980702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.544+0000 7f389659c640 1 -- 172.21.15.161:0/4022165853 >> v1:172.21.15.175:6789/0 conn(0x7f38980cf7d0 legacy=0x7f389815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.547 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.544+0000 7f389659c640 1 -- 172.21.15.161:0/4022165853 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389815e990 con 0x7f3898143ae0 2023-11-24T08:05:26.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.546+0000 7f389659c640 1 --2- 172.21.15.161:0/4022165853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 0x7f38980cf290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f388802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bac7af882c8e63bd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.548 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.546+0000 7f3895d9b640 1 -- 172.21.15.161:0/4022165853 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888030840 con 0x7f3898143ae0 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.546+0000 7f3895d9b640 1 -- 172.21.15.161:0/4022165853 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38880309a0 con 0x7f3898143ae0 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.546+0000 7f3895d9b640 1 -- 172.21.15.161:0/4022165853 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888030d30 con 0x7f3898143ae0 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 -- 172.21.15.161:0/4022165853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 msgr2=0x7f38980cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 --2- 172.21.15.161:0/4022165853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 0x7f38980cf290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3888009870 tx=0x7f388802b980 comp rx=0 tx=0).stop 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 -- 172.21.15.161:0/4022165853 shutdown_connections 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 --2- 172.21.15.161:0/4022165853 >> v2:172.21.15.175:3300/0 conn(0x7f389815e3b0 0x7f38980702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.549 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 --2- 172.21.15.161:0/4022165853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3898143ae0 0x7f38980cf290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 -- 172.21.15.161:0/4022165853 >> 172.21.15.161:0/4022165853 conn(0x7f389806a800 msgr2=0x7f389806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 -- 172.21.15.161:0/4022165853 shutdown_connections 2023-11-24T08:05:26.550 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.547+0000 7f389cdc5640 1 -- 172.21.15.161:0/4022165853 wait complete. 2023-11-24T08:05:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.549+0000 7f389cdc5640 1 Processor -- start 2023-11-24T08:05:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.549+0000 7f389cdc5640 1 -- start start 2023-11-24T08:05:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389cdc5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38980cf7d0 0x7f3898165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389cdc5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3898143ae0 0x7f38980b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389cdc5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 0x7f3898141f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.553 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389cdc5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38981663a0 con 0x7f389815e3b0 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389cdc5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b02b0 con 0x7f3898143ae0 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389cdc5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38980b0930 con 0x7f38980cf7d0 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f3896d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 0x7f3898141f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f3896d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 0x7f3898141f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58272/0 (socket says 172.21.15.161:58272) 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f3896d9d640 1 -- 172.21.15.161:0/2171341519 learned_addr learned my addr 172.21.15.161:0/2171341519 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f389659c640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38980cf7d0 0x7f3898165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.554 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.550+0000 7f388ffff640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3898143ae0 0x7f38980b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f3896d9d640 1 -- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38980cf7d0 msgr2=0x7f3898165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f3896d9d640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38980cf7d0 0x7f3898165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f3896d9d640 1 -- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3898143ae0 msgr2=0x7f38980b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f3896d9d640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3898143ae0 0x7f38980b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f3896d9d640 1 -- 172.21.15.161:0/2171341519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38880094d0 con 0x7f389815e3b0 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f3896d9d640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 0x7f3898141f20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f389000efc0 tx=0x7f389000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890009ba0 con 0x7f389815e3b0 2023-11-24T08:05:26.555 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000f040 con 0x7f389815e3b0 2023-11-24T08:05:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38900146c0 con 0x7f389815e3b0 2023-11-24T08:05:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38980b0c10 con 0x7f389815e3b0 2023-11-24T08:05:26.556 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.551+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38980b1930 con 0x7f389815e3b0 2023-11-24T08:05:26.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.552+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38980675d0 con 0x7f389815e3b0 2023-11-24T08:05:26.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.553+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f3890014820 con 0x7f389815e3b0 2023-11-24T08:05:26.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.555+0000 7f388effd640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f387806aff0 0x7f387806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.555+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f389008a5e0 con 0x7f389815e3b0 2023-11-24T08:05:26.557 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.556+0000 7f389659c640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f387806aff0 0x7f387806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:26.558 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.557+0000 7f389659c640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f387806aff0 0x7f387806d4b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3888036000 tx=0x7f3888008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:26.560 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.559+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3890055560 con 0x7f389815e3b0 2023-11-24T08:05:26.747 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.746+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38980b2410 con 0x7f387806aff0 2023-11-24T08:05:26.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.752+0000 7f388effd640 1 -- 172.21.15.161:0/2171341519 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48274 (secure 0 0 0) 0x7f3888039450 con 0x7f387806aff0 2023-11-24T08:05:26.754 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:26.755 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:26.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.754+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f387806aff0 msgr2=0x7f387806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.754+0000 7f389cdc5640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f387806aff0 0x7f387806d4b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3888036000 tx=0x7f3888008030 comp rx=0 tx=0).stop 2023-11-24T08:05:26.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.754+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 msgr2=0x7f3898141f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:26.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.754+0000 7f389cdc5640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 0x7f3898141f20 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f389000efc0 tx=0x7f389000c490 comp rx=0 tx=0).stop 2023-11-24T08:05:26.756 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 shutdown_connections 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f387806aff0 0x7f387806d4b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f389815e3b0 0x7f3898141f20 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3898143ae0 0x7f38980b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 --2- 172.21.15.161:0/2171341519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f38980cf7d0 0x7f3898165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 >> 172.21.15.161:0/2171341519 conn(0x7f389806a800 msgr2=0x7f38980cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 shutdown_connections 2023-11-24T08:05:26.757 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.755+0000 7f389cdc5640 1 -- 172.21.15.161:0/2171341519 wait complete. 2023-11-24T08:05:26.775 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-11-24T08:05:26.638128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":244008,"kb_used_data":7032,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730712,"statfs":{"total":773094113280,"available":772844249088,"internally_reserved":0,"allocated":7200768,"data_stored":3678921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.340892"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T08:05:22.194566+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:05:22.194566+0000","last_peered":"2023-11-24T08:05:22.194566+0000","last_clean":"2023-11-24T08:05:22.194566+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:05:22.194566+0000","last_undegraded":"2023-11-24T08:05:22.194566+0000","last_fullsized":"2023-11-24T08:05:22.194566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.135},"min":{"1min":0.73199999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.474,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.087,"15min":1.0549999999999999},"min":{"1min":0.84799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4950000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.147}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1699999999999999,"15min":1.1639999999999999},"min":{"1min":0.86599999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6719999999999999,"5min":1.929,"15min":1.929},"last":1.506},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.181,"15min":1.194},"min":{"1min":0.94199999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5700000000000001,"5min":2.02,"15min":2.02},"last":1.008}]},{"osd":2,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.169,"15min":1.125},"min":{"1min":0.92200000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.429,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.1539999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7450000000000001,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.601}]},{"osd":3,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.244,"15min":1.1779999999999999},"min":{"1min":1.087,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.706,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.397},{"interface":"front","average":{"1min":1.423,"5min":1.419,"15min":1.415},"min":{"1min":1.0629999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.768,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.665}]},{"osd":4,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":1.05,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6120000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.252},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.0880000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.861,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4970000000000001,"15min":1.542},"min":{"1min":1.1060000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6890000000000001,"5min":2.504,"15min":2.504},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5049999999999999,"15min":1.528},"min":{"1min":1.2370000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.7390000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.5429999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5960000000000001,"15min":1.6020000000000001},"min":{"1min":1.2729999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3479999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.5329999999999999,"15min":1.526},"min":{"1min":1.3440000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.984,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.296}]}]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.012,"15min":0.95399999999999996},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4810000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.212,"5min":1.087,"15min":1.0629999999999999},"min":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.528,"5min":1.593,"15min":1.593},"last":1.1180000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2250000000000001,"15min":1.204},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.622},"max":{"1min":1.6850000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7350000000000001,"5min":2.597,"15min":2.597},"last":1.5169999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1859999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4930000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.232},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2869999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":2.831,"15min":2.831},"last":1.347}]},{"osd":3,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.92400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.478,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8069999999999999,"5min":1.974,"15min":1.974},"last":1.7689999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5740000000000001,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.72},{"interface":"front","average":{"1min":1.242,"5min":1.337,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.573,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.8200000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.518,"15min":1.571},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6439999999999999,"5min":2.105,"15min":2.105},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5009999999999999,"15min":1.5249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.528,"15min":1.5920000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7050000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.964},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5329999999999999,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.8640000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":2.0310000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.1140000000000001,"15min":1.0840000000000001},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.589,"5min":2.431,"15min":2.431},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.093,"15min":1.0369999999999999},"min":{"1min":0.871,"5min":0.63,"15min":0.63},"max":{"1min":1.4670000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0449999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.464,"5min":1.653,"15min":1.653},"last":1.258},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.80000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.4810000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.88100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.77900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5860000000000001,"5min":1.768,"15min":1.768},"last":1.161}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3029999999999999,"15min":1.3400000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7889999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.3340000000000001},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.429}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2889999999999999,"15min":1.3560000000000001},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8260000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.401,"15min":1.4990000000000001},"min":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9019999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.653}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3979999999999999,"15min":1.4279999999999999},"min":{"1min":0.94399999999999995,"5min":0.629,"15min":0.629},"max":{"1min":2.0209999999999999,"5min":2.569,"15min":2.569},"last":1.601},{"interface":"front","average":{"1min":1.363,"5min":1.464,"15min":1.522},"min":{"1min":1.0049999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7270000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.6879999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.5529999999999999,"15min":1.675},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.948,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.8},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5580000000000001,"15min":1.5760000000000001},"min":{"1min":0.86599999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.72}]}]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":308795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.628,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2490000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.82699999999999996},"min":{"1min":0.73199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.202,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.02,"15min":0.97499999999999998},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.45,"5min":1.871,"15min":1.871},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.056,"15min":1.034},"min":{"1min":0.60399999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.542},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0960000000000001,"15min":1.0289999999999999},"min":{"1min":0.69999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.91300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6419999999999999,"5min":1.875,"15min":1.875},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.262,"15min":1.204},"min":{"1min":1.127,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7430000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3380000000000001,"15min":1.296},"min":{"1min":1.1519999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.8180000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.177},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.27},"min":{"1min":1.161,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7270000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.494}]},{"osd":6,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.298,"15min":1.26},"min":{"1min":1.208,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.776,"5min":1.861,"15min":1.861},"last":1.617},{"interface":"front","average":{"1min":1.49,"5min":1.421,"15min":1.3819999999999999},"min":{"1min":1.254,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.742,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3109999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.393,"15min":1.325},"min":{"1min":1.234,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7330000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.3480000000000001,"15min":1.288},"min":{"1min":1.2390000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.788,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.7170000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90200000000000002,"15min":0.99199999999999999},"min":{"1min":0.64100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.175,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.127,"5min":0.96499999999999997,"15min":0.89000000000000001},"min":{"1min":0.77200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5369999999999999,"5min":3.343,"15min":3.343},"last":0.749}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.069,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.514},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.72399999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4550000000000001,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0589999999999999,"15min":1.002},"min":{"1min":0.87,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4490000000000001,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":0.622}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4930000000000001,"15min":1.518},"min":{"1min":1.218,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.9199999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5109999999999999,"15min":1.569},"min":{"1min":1.0149999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7889999999999999,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":1.407}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4199999999999999,"15min":1.504},"min":{"1min":1.167,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9159999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.448,"15min":1.3580000000000001},"min":{"1min":1.109,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9810000000000001,"5min":12.798,"15min":12.798},"last":1.262}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4630000000000001,"15min":1.415},"min":{"1min":1.1319999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.9159999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.042},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4850000000000001,"15min":1.585},"min":{"1min":1.1930000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0190000000000001,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.6040000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.4810000000000001,"15min":1.423},"min":{"1min":1.1180000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0369999999999999,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":0.879},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5049999999999999,"15min":1.5840000000000001},"min":{"1min":0.98499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0569999999999999,"5min":6.399,"15min":6.399},"last":0.999}]}]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":308795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0589999999999999,"15min":1.0880000000000001},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0740000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9319999999999999,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.9319999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.81799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.71,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8220000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.8220000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"min":{"1min":0.88800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.522},{"interface":"front","average":{"1min":1.383,"5min":1.3839999999999999,"15min":1.4319999999999999},"min":{"1min":0.91000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9419999999999999,"5min":1.966,"15min":1.966},"last":1.772}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.82799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3480000000000001,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7270000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.452}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4179999999999999,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6000000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.508,"15min":1.512},"min":{"1min":1.1180000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.857,"5min":2.073,"15min":2.073},"last":1.885}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.448,"15min":1.528},"min":{"1min":1.131,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6379999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.51,"15min":1.5940000000000001},"min":{"1min":1.05,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.6659999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.5469999999999999,"15min":1.5920000000000001},"min":{"1min":0.91000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0259999999999998,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6779999999999999},"min":{"1min":1.274,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.8280000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":2.0609999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.60799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.556,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.032,"5min":0.93999999999999995,"15min":0.999},"min":{"1min":0.70099999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.369,"5min":3.266,"15min":3.266},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.72399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3109999999999999,"5min":1.706,"15min":1.706},"last":0.505},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.82899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4259999999999999,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.169,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.825,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.91100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.649,"5min":1.976,"15min":1.976},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3300000000000001,"15min":1.472},"min":{"1min":0.98099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.552,"5min":4.367,"15min":4.367},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.375,"15min":1.4339999999999999},"min":{"1min":1.0840000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0790000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3999999999999999,"15min":1.54},"min":{"1min":1.1180000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6599999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.46,"15min":1.4950000000000001},"min":{"1min":1.274,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1459999999999999,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.395},"min":{"1min":1.103,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.917,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5409999999999999,"15min":1.643},"min":{"1min":1.3069999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.875,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3979999999999999,"15min":1.4319999999999999},"min":{"1min":1.131,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7849999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5329999999999999,"15min":1.663},"min":{"1min":1.1559999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7929999999999999,"5min":4.452,"15min":4.452},"last":0.73799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":1335296,"data_stored":899163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.83899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.421,"5min":1.46,"15min":1.46},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3360000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.038},"min":{"1min":0.85199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.391}]},{"osd":3,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0669999999999999},"min":{"1min":0.99399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5329999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1699999999999999,"15min":1.1299999999999999},"min":{"1min":1.0940000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6990000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.222,"15min":1.226},"min":{"1min":0.72599999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4970000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.456},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3,"15min":1.3240000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.24}]},{"osd":5,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4390000000000001,"15min":1.4970000000000001},"min":{"1min":1.1890000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0680000000000001,"5min":2.839,"15min":2.839},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3620000000000001,"15min":1.387},"min":{"1min":1.2569999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6539999999999999,"5min":2.823,"15min":2.823},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.333,"15min":1.351},"min":{"1min":1.0609999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.552,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":1.089,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9730000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.792}]},{"osd":7,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4630000000000001,"15min":1.51},"min":{"1min":1.1739999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.891,"5min":2.875,"15min":2.875},"last":1.9470000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.7669999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:26.777 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T08:05:26.777 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:26.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.995+0000 7f04c9c40640 1 Processor -- start 2023-11-24T08:05:26.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.995+0000 7f04c9c40640 1 -- start start 2023-11-24T08:05:26.997 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.996+0000 7f04c9c40640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 0x7f04c4071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.996+0000 7f04c9c40640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c4070e50 con 0x7f04c40717d0 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.996+0000 7f04c9c40640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c4144020 con 0x7f04c40ccc10 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.996+0000 7f04c9c40640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40723c0 con 0x7f04c4143c40 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.997+0000 7f04c3fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f04c40717d0 0x7f04c40cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40180/0 (socket says 172.21.15.161:40180) 2023-11-24T08:05:26.998 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.997+0000 7f04c3fff640 1 -- 172.21.15.161:0/2398143715 learned_addr learned my addr 172.21.15.161:0/2398143715 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:27.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.997+0000 7f04c8c3e640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 0x7f04c4071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.997+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727089177 0 0) 0x7f04c4070e50 con 0x7f04c40717d0 2023-11-24T08:05:27.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.997+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04b4003520 con 0x7f04c40717d0 2023-11-24T08:05:27.000 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2797605059 0 0) 0x7f04b4003520 con 0x7f04c40717d0 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 msgr2=0x7f04c4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 0x7f04c4071290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 >> v1:172.21.15.175:6789/0 conn(0x7f04c40ccc10 legacy=0x7f04c406d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4071e00 con 0x7f04c40717d0 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f04b0001670 con 0x7f04c40717d0 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 >> v1:172.21.15.161:6789/0 conn(0x7f04c40717d0 legacy=0x7f04c40cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b40039a0 0x7f04b4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.001 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 0x7f04b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04b4004d00 0x7f04b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40723c0 con 0x7f04b4004d00 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b400ba60 con 0x7f04b40039a0 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b400bc20 con 0x7f04c4143c40 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.998+0000 7f04c943f640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04b4004d00 0x7f04b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c8c3e640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b40039a0 0x7f04b4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c3fff640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 0x7f04b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c943f640 1 -- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 msgr2=0x7f04b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c943f640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04c4143c40 0x7f04b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c943f640 1 -- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b40039a0 msgr2=0x7f04b4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c943f640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04b40039a0 0x7f04b4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:26.999+0000 7f04c943f640 1 -- 172.21.15.161:0/2398143715 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4003520 con 0x7f04b4004d00 2023-11-24T08:05:27.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.000+0000 7f04c943f640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04b4004d00 0x7f04b4005180 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f04bc001f60 tx=0x7f04b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a402cfe5d9353e43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.000+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc02d6f0 con 0x7f04b4004d00 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.000+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc02d870 con 0x7f04b4004d00 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.000+0000 7f04c37fe640 1 -- 172.21.15.161:0/2398143715 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc02dc20 con 0x7f04b4004d00 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c9c40640 1 -- 172.21.15.161:0/2398143715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04b4004d00 msgr2=0x7f04b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2398143715 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04b4004d00 0x7f04b4005180 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f04bc001f60 tx=0x7f04b40057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c943f640 1 -- 172.21.15.161:0/2398143715 reap_dead start 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c9c40640 1 -- 172.21.15.161:0/2398143715 shutdown_connections 2023-11-24T08:05:27.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c9c40640 1 -- 172.21.15.161:0/2398143715 >> 172.21.15.161:0/2398143715 conn(0x7f04c406a800 msgr2=0x7f04c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c9c40640 1 -- 172.21.15.161:0/2398143715 shutdown_connections 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.001+0000 7f04c9c40640 1 -- 172.21.15.161:0/2398143715 wait complete. 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.003+0000 7f04c9c40640 1 Processor -- start 2023-11-24T08:05:27.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.003+0000 7f04c9c40640 1 -- start start 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.004+0000 7f04c9c40640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b4004d00 0x7f04c4153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c9c40640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 0x7f04c4157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c9c40640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04c41580a0 0x7f04c4158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c9c40640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4154470 con 0x7f04c41571f0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c9c40640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c412b320 con 0x7f04c41580a0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c9c40640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c41547d0 con 0x7f04b4004d00 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 0x7f04c4157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 0x7f04c4157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58292/0 (socket says 172.21.15.161:58292) 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 -- 172.21.15.161:0/2428611592 learned_addr learned my addr 172.21.15.161:0/2428611592 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c943f640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04c41580a0 0x7f04c4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 -- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b4004d00 msgr2=0x7f04c4153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b4004d00 0x7f04c4153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 -- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04c41580a0 msgr2=0x7f04c4158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04c41580a0 0x7f04c4158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c3fff640 1 -- 172.21.15.161:0/2428611592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c4157760 con 0x7f04c41571f0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.005+0000 7f04c943f640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04c41580a0 0x7f04c4158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.006+0000 7f04c3fff640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 0x7f04c4157b60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e730 tx=0x7f04b000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.006+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000c6c0 con 0x7f04c41571f0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.006+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000c820 con 0x7f04c41571f0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.006+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000cbd0 con 0x7f04c41571f0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.006+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c412b570 con 0x7f04c41571f0 2023-11-24T08:05:27.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.006+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c412bb30 con 0x7f04c41571f0 2023-11-24T08:05:27.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.007+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c4067450 con 0x7f04c41571f0 2023-11-24T08:05:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.008+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f04b000cd30 con 0x7f04c41571f0 2023-11-24T08:05:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.009+0000 7f04c17fa640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f04a806b020 0x7f04a806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.009+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f04b0089500 con 0x7f04c41571f0 2023-11-24T08:05:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.010+0000 7f04c8c3e640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f04a806b020 0x7f04a806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.011+0000 7f04c8c3e640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f04a806b020 0x7f04a806d4e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009910 tx=0x7f04b8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.013+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04b0054620 con 0x7f04c41571f0 2023-11-24T08:05:27.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.201+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04c406cc40 con 0x7f04a806b020 2023-11-24T08:05:27.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.207+0000 7f04c17fa640 1 -- 172.21.15.161:0/2428611592 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48274 (secure 0 0 0) 0x7f04b8011860 con 0x7f04a806b020 2023-11-24T08:05:27.209 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:27.210 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f04a806b020 msgr2=0x7f04a806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.211 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f04a806b020 0x7f04a806d4e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009910 tx=0x7f04b8008040 comp rx=0 tx=0).stop 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 msgr2=0x7f04c4157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 0x7f04c4157b60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f04b000e730 tx=0x7f04b000ebf0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 shutdown_connections 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f04a806b020 0x7f04a806d4e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04c41580a0 0x7f04c4158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04c41571f0 0x7f04c4157b60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.212 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 --2- 172.21.15.161:0/2428611592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04b4004d00 0x7f04c4153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 >> 172.21.15.161:0/2428611592 conn(0x7f04c406a800 msgr2=0x7f04c40cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 shutdown_connections 2023-11-24T08:05:27.213 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.210+0000 7f04c9c40640 1 -- 172.21.15.161:0/2428611592 wait complete. 2023-11-24T08:05:27.231 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-11-24T08:05:26.638128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":144,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":244008,"kb_used_data":7032,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730712,"statfs":{"total":773094113280,"available":772844249088,"internally_reserved":0,"allocated":7200768,"data_stored":3678921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":242535987},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4388,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-51,"num_write_kb":-20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.340892"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T08:05:22.194566+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:05:22.194566+0000","last_peered":"2023-11-24T08:05:22.194566+0000","last_clean":"2023-11-24T08:05:22.194566+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:05:22.194566+0000","last_undegraded":"2023-11-24T08:05:22.194566+0000","last_fullsized":"2023-11-24T08:05:22.194566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509505,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.1200000000000001,"15min":1.135},"min":{"1min":0.73199999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.474,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.087,"15min":1.0549999999999999},"min":{"1min":0.84799999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4950000000000001,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.147}]},{"osd":1,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1699999999999999,"15min":1.1639999999999999},"min":{"1min":0.86599999999999999,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.6719999999999999,"5min":1.929,"15min":1.929},"last":1.506},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.181,"15min":1.194},"min":{"1min":0.94199999999999995,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.5700000000000001,"5min":2.02,"15min":2.02},"last":1.008}]},{"osd":2,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.169,"15min":1.125},"min":{"1min":0.92200000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.429,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.379,"5min":1.3779999999999999,"15min":1.3839999999999999},"min":{"1min":1.1539999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.7450000000000001,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.601}]},{"osd":3,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.333,"5min":1.244,"15min":1.1779999999999999},"min":{"1min":1.087,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.706,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.397},{"interface":"front","average":{"1min":1.423,"5min":1.419,"15min":1.415},"min":{"1min":1.0629999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.768,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.665}]},{"osd":4,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.3620000000000001,"15min":1.3979999999999999},"min":{"1min":1.05,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.6120000000000001,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.252},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3620000000000001,"15min":1.3240000000000001},"min":{"1min":1.0880000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.861,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.1919999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4970000000000001,"15min":1.542},"min":{"1min":1.1060000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"max":{"1min":1.6890000000000001,"5min":2.504,"15min":2.504},"last":1.7170000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.5049999999999999,"15min":1.528},"min":{"1min":1.2370000000000001,"5min":1.01,"15min":1.01},"max":{"1min":1.7390000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.5429999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:04:22 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5960000000000001,"15min":1.6020000000000001},"min":{"1min":1.2729999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":2.3479999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.51,"5min":1.5329999999999999,"15min":1.526},"min":{"1min":1.3440000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.984,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.296}]}]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.012,"15min":0.95399999999999996},"min":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.4810000000000001,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.212,"5min":1.087,"15min":1.0629999999999999},"min":{"1min":0.78700000000000003,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.528,"5min":1.593,"15min":1.593},"last":1.1180000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.2250000000000001,"15min":1.204},"min":{"1min":0.81200000000000006,"5min":0.622,"15min":0.622},"max":{"1min":1.6850000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.7350000000000001,"5min":2.597,"15min":2.597},"last":1.5169999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.1859999999999999,"15min":1.2410000000000001},"min":{"1min":0.85599999999999998,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4930000000000001,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":1.232},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2769999999999999,"15min":1.2869999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5620000000000001,"5min":2.831,"15min":2.831},"last":1.347}]},{"osd":3,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.92400000000000004,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.478,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.6619999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2929999999999999,"15min":1.304},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.8069999999999999,"5min":1.974,"15min":1.974},"last":1.7689999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.3129999999999999,"15min":1.359},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.5740000000000001,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.72},{"interface":"front","average":{"1min":1.242,"5min":1.337,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.573,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.8200000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.518,"15min":1.571},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6439999999999999,"5min":2.105,"15min":2.105},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5009999999999999,"15min":1.5249999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7769999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.8660000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:24 2023","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.528,"15min":1.5920000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.7050000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.964},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5329999999999999,"15min":1.571},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.8640000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":2.0310000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3,"5min":1.1140000000000001,"15min":1.0840000000000001},"min":{"1min":0.84499999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.589,"5min":2.431,"15min":2.431},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.093,"15min":1.0369999999999999},"min":{"1min":0.871,"5min":0.63,"15min":0.63},"max":{"1min":1.4670000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.0449999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.64300000000000002,"5min":0.441,"15min":0.441},"max":{"1min":1.464,"5min":1.653,"15min":1.653},"last":1.258},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1899999999999999,"15min":1.1890000000000001},"min":{"1min":0.80000000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.4810000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.88100000000000001,"5min":0.623,"15min":0.623},"max":{"1min":1.75,"5min":1.75,"15min":1.75},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1899999999999999,"15min":1.218},"min":{"1min":0.77900000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.5860000000000001,"5min":1.768,"15min":1.768},"last":1.161}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3029999999999999,"15min":1.3400000000000001},"min":{"1min":0.749,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7889999999999999,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.427,"5min":1.363,"15min":1.3340000000000001},"min":{"1min":0.92600000000000005,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.429}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2889999999999999,"15min":1.3560000000000001},"min":{"1min":0.70299999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.8260000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.5309999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.401,"15min":1.4990000000000001},"min":{"1min":0.65800000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9019999999999999,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.653}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.3979999999999999,"15min":1.4279999999999999},"min":{"1min":0.94399999999999995,"5min":0.629,"15min":0.629},"max":{"1min":2.0209999999999999,"5min":2.569,"15min":2.569},"last":1.601},{"interface":"front","average":{"1min":1.363,"5min":1.464,"15min":1.522},"min":{"1min":1.0049999999999999,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.7270000000000001,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.6879999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.5529999999999999,"15min":1.675},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.948,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.8},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.5580000000000001,"15min":1.5760000000000001},"min":{"1min":0.86599999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.72}]}]},{"osd":3,"up_from":15,"seq":64424509505,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":308795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.52900000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.85899999999999999,"15min":0.79100000000000004},"min":{"1min":0.628,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2490000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.873,"15min":0.82699999999999996},"min":{"1min":0.73199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.202,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.876},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.02,"15min":0.97499999999999998},"min":{"1min":0.627,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.45,"5min":1.871,"15min":1.871},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.056,"15min":1.034},"min":{"1min":0.60399999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.542},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.0960000000000001,"15min":1.0289999999999999},"min":{"1min":0.69999999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.81599999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.167,"15min":1.123},"min":{"1min":0.91300000000000003,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6419999999999999,"5min":1.875,"15min":1.875},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.262,"15min":1.204},"min":{"1min":1.127,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7430000000000001,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.3380000000000001,"15min":1.296},"min":{"1min":1.1519999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.8180000000000001,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.177},{"interface":"front","average":{"1min":1.379,"5min":1.323,"15min":1.27},"min":{"1min":1.161,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.7270000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.494}]},{"osd":6,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.298,"15min":1.26},"min":{"1min":1.208,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.776,"5min":1.861,"15min":1.861},"last":1.617},{"interface":"front","average":{"1min":1.49,"5min":1.421,"15min":1.3819999999999999},"min":{"1min":1.254,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.742,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.3109999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:25 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.393,"15min":1.325},"min":{"1min":1.234,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.7330000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.3480000000000001,"15min":1.288},"min":{"1min":1.2390000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.788,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.7170000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.90200000000000002,"15min":0.99199999999999999},"min":{"1min":0.64100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.175,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.127,"5min":0.96499999999999997,"15min":0.89000000000000001},"min":{"1min":0.77200000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.5369999999999999,"5min":3.343,"15min":3.343},"last":0.749}]},{"osd":1,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.069,"15min":1.1459999999999999},"min":{"1min":0.83499999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.4370000000000001,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.514},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0600000000000001,"15min":1.1200000000000001},"min":{"1min":0.72399999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.4550000000000001,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":0.82199999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.0589999999999999,"15min":1.002},"min":{"1min":0.87,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.403,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1870000000000001,"15min":1.2150000000000001},"min":{"1min":0.84799999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.4490000000000001,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":0.622}]},{"osd":4,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.4930000000000001,"15min":1.518},"min":{"1min":1.218,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.9199999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.5109999999999999,"15min":1.569},"min":{"1min":1.0149999999999999,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.7889999999999999,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":1.407}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4199999999999999,"15min":1.504},"min":{"1min":1.167,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.9159999999999999,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.448,"15min":1.3580000000000001},"min":{"1min":1.109,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.9810000000000001,"5min":12.798,"15min":12.798},"last":1.262}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.4630000000000001,"15min":1.415},"min":{"1min":1.1319999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.9159999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.042},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4850000000000001,"15min":1.585},"min":{"1min":1.1930000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.0190000000000001,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.6040000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.5600000000000001,"5min":1.4810000000000001,"15min":1.423},"min":{"1min":1.1180000000000001,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.0369999999999999,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":0.879},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.5049999999999999,"15min":1.5840000000000001},"min":{"1min":0.98499999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.0569999999999999,"5min":6.399,"15min":6.399},"last":0.999}]}]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31904,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339936,"statfs":{"total":96636764160,"available":96604094464,"internally_reserved":0,"allocated":741376,"data_stored":308795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0589999999999999,"15min":1.0880000000000001},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0740000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9319999999999999,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.9319999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.81799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.71,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8220000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.8220000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2230000000000001,"15min":1.2290000000000001},"min":{"1min":0.88800000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.522},{"interface":"front","average":{"1min":1.383,"5min":1.3839999999999999,"15min":1.4319999999999999},"min":{"1min":0.91000000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9419999999999999,"5min":1.966,"15min":1.966},"last":1.772}]},{"osd":3,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2370000000000001,"15min":1.2430000000000001},"min":{"1min":0.82799999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3480000000000001,"15min":1.407},"min":{"1min":0.80500000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.7270000000000001,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.452}]},{"osd":5,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.4179999999999999,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.6000000000000001,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.508,"15min":1.512},"min":{"1min":1.1180000000000001,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.857,"5min":2.073,"15min":2.073},"last":1.885}]},{"osd":6,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.448,"15min":1.528},"min":{"1min":1.131,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.6379999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.7210000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.51,"15min":1.5940000000000001},"min":{"1min":1.05,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.873,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.6659999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:28 2023","interfaces":[{"interface":"back","average":{"1min":1.462,"5min":1.5469999999999999,"15min":1.5920000000000001},"min":{"1min":0.91000000000000003,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.0259999999999998,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.5509999999999999,"5min":1.6040000000000001,"15min":1.6779999999999999},"min":{"1min":1.274,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.8280000000000001,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":2.0609999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.94399999999999995},"min":{"1min":0.60799999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.556,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":1.032,"5min":0.93999999999999995,"15min":0.999},"min":{"1min":0.70099999999999996,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.369,"5min":3.266,"15min":3.266},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.89000000000000001,"15min":0.90400000000000003},"min":{"1min":0.72399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3109999999999999,"5min":1.706,"15min":1.706},"last":0.505},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0669999999999999,"15min":1.119},"min":{"1min":0.82899999999999996,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4259999999999999,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.169,"15min":1.1910000000000001},"min":{"1min":0.96099999999999997,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.825,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.91100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.649,"5min":1.976,"15min":1.976},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.3300000000000001,"15min":1.472},"min":{"1min":0.98099999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.552,"5min":4.367,"15min":4.367},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.4399999999999999,"5min":1.375,"15min":1.4339999999999999},"min":{"1min":1.0840000000000001,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.0790000000000002,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":0.81200000000000006}]},{"osd":5,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3999999999999999,"15min":1.54},"min":{"1min":1.1180000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6599999999999999,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.46,"15min":1.4950000000000001},"min":{"1min":1.274,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":2.1459999999999999,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.367,"15min":1.395},"min":{"1min":1.103,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.917,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.5429999999999999,"5min":1.5409999999999999,"15min":1.643},"min":{"1min":1.3069999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.875,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":0.86399999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:04:26 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.3979999999999999,"15min":1.4319999999999999},"min":{"1min":1.131,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.7849999999999999,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5329999999999999,"15min":1.663},"min":{"1min":1.1559999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7929999999999999,"5min":4.452,"15min":4.452},"last":0.73799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542208,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":1335296,"data_stored":899163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.83899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.421,"5min":1.46,"15min":1.46},"last":0.99399999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.81699999999999995,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.3360000000000001,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.038},"min":{"1min":0.85199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":1.391}]},{"osd":3,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.1020000000000001,"15min":1.0669999999999999},"min":{"1min":0.99399999999999999,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.5329999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.1699999999999999,"15min":1.1299999999999999},"min":{"1min":1.0940000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.6699999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.6990000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.222,"15min":1.226},"min":{"1min":0.72599999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4970000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.456},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3,"15min":1.3240000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.24}]},{"osd":5,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.498,"5min":1.4390000000000001,"15min":1.4970000000000001},"min":{"1min":1.1890000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0680000000000001,"5min":2.839,"15min":2.839},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.3620000000000001,"15min":1.387},"min":{"1min":1.2569999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.6539999999999999,"5min":2.823,"15min":2.823},"last":1.3080000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.333,"15min":1.351},"min":{"1min":1.0609999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.552,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4139999999999999,"15min":1.4379999999999999},"min":{"1min":1.089,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9730000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.792}]},{"osd":7,"last update":"Fri Nov 24 08:04:27 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.4630000000000001,"15min":1.51},"min":{"1min":1.1739999999999999,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.891,"5min":2.875,"15min":2.875},"last":1.9470000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3340000000000001,"15min":1.353},"min":{"1min":1.0980000000000001,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.7669999999999999,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.5620000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:27.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T08:05:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.446+0000 7fdcd429b640 1 Processor -- start 2023-11-24T08:05:27.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.446+0000 7fdcd429b640 1 -- start start 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.447+0000 7fdcd429b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc143ae0 0x7fdccc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.447+0000 7fdcd429b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdccc15e3b0 0x7fdccc0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd429b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0cfc30 con 0x7fdccc0cf7d0 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd429b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc0b1ee0 con 0x7fdccc15e3b0 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd429b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b2780 con 0x7fdccc143ae0 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdccc15e3b0 0x7fdccc0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.449 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdccc15e3b0 0x7fdccc0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58306/0 (socket says 172.21.15.161:58306) 2023-11-24T08:05:27.450 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 -- 172.21.15.161:0/762389709 learned_addr learned my addr 172.21.15.161:0/762389709 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:27.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2037640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc143ae0 0x7fdccc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 -- 172.21.15.161:0/762389709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc143ae0 msgr2=0x7fdccc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc143ae0 0x7fdccc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 -- 172.21.15.161:0/762389709 >> v1:172.21.15.175:6789/0 conn(0x7fdccc0cf7d0 legacy=0x7fdccc15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:27.451 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2838640 1 -- 172.21.15.161:0/762389709 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc15e990 con 0x7fdccc15e3b0 2023-11-24T08:05:27.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.448+0000 7fdcd2037640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc143ae0 0x7fdccc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:27.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.449+0000 7fdcd2838640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc15e3b0 0x7fdccc0702c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009870 tx=0x7fdcc402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357ed807df37447c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd1035640 1 -- 172.21.15.161:0/762389709 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4031640 con 0x7fdccc15e3b0 2023-11-24T08:05:27.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd1035640 1 -- 172.21.15.161:0/762389709 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc40317a0 con 0x7fdccc15e3b0 2023-11-24T08:05:27.452 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd1035640 1 -- 172.21.15.161:0/762389709 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4031b30 con 0x7fdccc15e3b0 2023-11-24T08:05:27.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd429b640 1 -- 172.21.15.161:0/762389709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc15e3b0 msgr2=0x7fdccc0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd429b640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc15e3b0 0x7fdccc0702c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009870 tx=0x7fdcc402b8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd429b640 1 -- 172.21.15.161:0/762389709 shutdown_connections 2023-11-24T08:05:27.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd429b640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc15e3b0 0x7fdccc0702c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.453 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd429b640 1 --2- 172.21.15.161:0/762389709 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc143ae0 0x7fdccc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.450+0000 7fdcd429b640 1 -- 172.21.15.161:0/762389709 >> 172.21.15.161:0/762389709 conn(0x7fdccc06a800 msgr2=0x7fdccc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.451+0000 7fdcd429b640 1 -- 172.21.15.161:0/762389709 shutdown_connections 2023-11-24T08:05:27.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.451+0000 7fdcd429b640 1 -- 172.21.15.161:0/762389709 wait complete. 2023-11-24T08:05:27.454 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.452+0000 7fdcd429b640 1 Processor -- start 2023-11-24T08:05:27.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.452+0000 7fdcd429b640 1 -- start start 2023-11-24T08:05:27.456 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.453+0000 7fdcd429b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc0cf7d0 0x7fdccc13ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.453+0000 7fdcd429b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 0x7fdccc1f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.453+0000 7fdcd429b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdccc15e3b0 0x7fdccc13ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.453+0000 7fdcd429b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc13c0f0 con 0x7fdccc143ae0 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.453+0000 7fdcd429b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc1f7300 con 0x7fdccc15e3b0 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.453+0000 7fdcd429b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc1f6d40 con 0x7fdccc0cf7d0 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 0x7fdccc1f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 0x7fdccc1f63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58320/0 (socket says 172.21.15.161:58320) 2023-11-24T08:05:27.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 -- 172.21.15.161:0/372568426 learned_addr learned my addr 172.21.15.161:0/372568426 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd2838640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdccc15e3b0 0x7fdccc13ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd2037640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc0cf7d0 0x7fdccc13ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 -- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc0cf7d0 msgr2=0x7fdccc13ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc0cf7d0 0x7fdccc13ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 -- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdccc15e3b0 msgr2=0x7fdccc13ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdccc15e3b0 0x7fdccc13ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.454+0000 7fdcd1836640 1 -- 172.21.15.161:0/372568426 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40094d0 con 0x7fdccc143ae0 2023-11-24T08:05:27.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.455+0000 7fdcd1836640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 0x7fdccc1f63f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c430 tx=0x7fdcb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.455+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8011790 con 0x7fdccc143ae0 2023-11-24T08:05:27.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.455+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb80118f0 con 0x7fdccc143ae0 2023-11-24T08:05:27.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.455+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc1f7020 con 0x7fdccc143ae0 2023-11-24T08:05:27.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.455+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb8011ce0 con 0x7fdccc143ae0 2023-11-24T08:05:27.459 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.455+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc13e8e0 con 0x7fdccc143ae0 2023-11-24T08:05:27.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.456+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc13e460 con 0x7fdccc143ae0 2023-11-24T08:05:27.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.457+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fdcb801c460 con 0x7fdccc143ae0 2023-11-24T08:05:27.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.458+0000 7fdccaffd640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdcb006aff0 0x7fdcb006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:27.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.458+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdcb8089600 con 0x7fdccc143ae0 2023-11-24T08:05:27.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.458+0000 7fdcd2037640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdcb006aff0 0x7fdcb006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:27.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.459+0000 7fdcd2037640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdcb006aff0 0x7fdcb006d4b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0008f80 tx=0x7fdcc00084d0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:27.463 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.462+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdccc13e460 con 0x7fdccc143ae0 2023-11-24T08:05:27.665 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.664+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdccc13e460 con 0x7fdccc143ae0 2023-11-24T08:05:27.667 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.666+0000 7fdccaffd640 1 -- 172.21.15.161:0/372568426 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13012 (secure 0 0 0) 0x7fdccc13e460 con 0x7fdccc143ae0 2023-11-24T08:05:27.667 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:27.668 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":63,"fsid":"2e355083-a16f-42dd-a3ed-5276a3fda4f7","created":"2023-11-24T07:59:59.711952+0000","modified":"2023-11-24T08:05:22.635094+0000","last_up_change":"2023-11-24T08:00:18.269126+0000","last_in_change":"2023-11-24T08:00:09.403272+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T08:00:18.609101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46f41f23-320c-498b-91f5-49a7b529ac6b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6801","nonce":2118422527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6803","nonce":2118422527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6807","nonce":2118422527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":2118422527},{"type":"v1","addr":"172.21.15.161:6805","nonce":2118422527}]},"public_addr":"172.21.15.161:6801/2118422527","cluster_addr":"172.21.15.161:6803/2118422527","heartbeat_back_addr":"172.21.15.161:6807/2118422527","heartbeat_front_addr":"172.21.15.161:6805/2118422527","state":["exists","up"]},{"osd":1,"uuid":"c0e9552a-d166-4735-83e3-1d79a7d22341","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6809","nonce":555346844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6811","nonce":555346844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6814","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6815","nonce":555346844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":555346844},{"type":"v1","addr":"172.21.15.161:6813","nonce":555346844}]},"public_addr":"172.21.15.161:6809/555346844","cluster_addr":"172.21.15.161:6811/555346844","heartbeat_back_addr":"172.21.15.161:6815/555346844","heartbeat_front_addr":"172.21.15.161:6813/555346844","state":["exists","up"]},{"osd":2,"uuid":"16771a82-8008-4c02-bce5-cafc171f8a77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6817","nonce":4193711640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6819","nonce":4193711640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6823","nonce":4193711640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6820","nonce":4193711640},{"type":"v1","addr":"172.21.15.161:6821","nonce":4193711640}]},"public_addr":"172.21.15.161:6817/4193711640","cluster_addr":"172.21.15.161:6819/4193711640","heartbeat_back_addr":"172.21.15.161:6823/4193711640","heartbeat_front_addr":"172.21.15.161:6821/4193711640","state":["exists","up"]},{"osd":3,"uuid":"a6aeaf53-bb6f-40f6-bbc7-f22b3707fec6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6825","nonce":3270873402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6826","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6827","nonce":3270873402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6830","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6831","nonce":3270873402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":3270873402},{"type":"v1","addr":"172.21.15.161:6829","nonce":3270873402}]},"public_addr":"172.21.15.161:6825/3270873402","cluster_addr":"172.21.15.161:6827/3270873402","heartbeat_back_addr":"172.21.15.161:6831/3270873402","heartbeat_front_addr":"172.21.15.161:6829/3270873402","state":["exists","up"]},{"osd":4,"uuid":"5d00fb16-0ce1-4464-a1e6-c255f0a1482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6803","nonce":972684895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6805","nonce":972684895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6815","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6820","nonce":972684895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6807","nonce":972684895},{"type":"v1","addr":"172.21.15.175:6811","nonce":972684895}]},"public_addr":"172.21.15.175:6803/972684895","cluster_addr":"172.21.15.175:6805/972684895","heartbeat_back_addr":"172.21.15.175:6820/972684895","heartbeat_front_addr":"172.21.15.175:6811/972684895","state":["exists","up"]},{"osd":5,"uuid":"d457bb4c-6fcf-40bc-a1d9-bfd46ec0442c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6816","nonce":1039296029}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6821","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6824","nonce":1039296029}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6833","nonce":1039296029}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1039296029},{"type":"v1","addr":"172.21.15.175:6831","nonce":1039296029}]},"public_addr":"172.21.15.175:6816/1039296029","cluster_addr":"172.21.15.175:6824/1039296029","heartbeat_back_addr":"172.21.15.175:6833/1039296029","heartbeat_front_addr":"172.21.15.175:6831/1039296029","state":["exists","up"]},{"osd":6,"uuid":"fd1f3893-8cce-4403-8702-f45955ee137d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6809","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6814","nonce":1496030978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6822","nonce":1496030978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6829","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6830","nonce":1496030978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6825","nonce":1496030978},{"type":"v1","addr":"172.21.15.175:6827","nonce":1496030978}]},"public_addr":"172.21.15.175:6814/1496030978","cluster_addr":"172.21.15.175:6822/1496030978","heartbeat_back_addr":"172.21.15.175:6830/1496030978","heartbeat_front_addr":"172.21.15.175:6827/1496030978","state":["exists","up"]},{"osd":7,"uuid":"10f19481-8ef8-4199-a1e3-5f2bd70d891d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6808","nonce":296022395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6813","nonce":296022395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6823","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6826","nonce":296022395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6817","nonce":296022395},{"type":"v1","addr":"172.21.15.175:6819","nonce":296022395}]},"public_addr":"172.21.15.175:6808/296022395","cluster_addr":"172.21.15.175:6813/296022395","heartbeat_back_addr":"172.21.15.175:6826/296022395","heartbeat_front_addr":"172.21.15.175:6819/296022395","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.675225+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.661991+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.961614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.967471+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.695722+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:15.021546+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.763284+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T08:00:14.909053+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.161:6835/4018716146":"2023-11-25T08:05:19.291139+0000","172.21.15.161:6834/4018716146":"2023-11-25T08:05:19.291139+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T08:05:27.670 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdcb006aff0 msgr2=0x7fdcb006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdcb006aff0 0x7fdcb006d4b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0008f80 tx=0x7fdcc00084d0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 msgr2=0x7fdccc1f63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 0x7fdccc1f63f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fdcb800c430 tx=0x7fdcb800c8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 shutdown_connections 2023-11-24T08:05:27.671 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fdcb006aff0 0x7fdcb006d4b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdccc15e3b0 0x7fdccc13ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdccc143ae0 0x7fdccc1f63f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 --2- 172.21.15.161:0/372568426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdccc0cf7d0 0x7fdccc13ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:27.672 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 >> 172.21.15.161:0/372568426 conn(0x7fdccc06a800 msgr2=0x7fdccc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:27.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 shutdown_connections 2023-11-24T08:05:27.673 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:27.669+0000 7fdcd429b640 1 -- 172.21.15.161:0/372568426 wait complete. 2023-11-24T08:05:28.691 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T08:05:28.692 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:28.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.913+0000 7f6af2636640 1 Processor -- start 2023-11-24T08:05:28.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.913+0000 7f6af2636640 1 -- start start 2023-11-24T08:05:28.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af2636640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6aec15af80 0x7f6aec0adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af2636640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 0x7f6aec06b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af2636640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aec15ee50 con 0x7f6aec06b930 2023-11-24T08:05:28.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af2636640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aec06bda0 con 0x7f6aec15af80 2023-11-24T08:05:28.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af2636640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec15b360 con 0x7f6aec15d960 2023-11-24T08:05:28.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af0bd3640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6aec06b930 0x7f6aec160f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40186/0 (socket says 172.21.15.161:40186) 2023-11-24T08:05:28.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.915+0000 7f6af0bd3640 1 -- 172.21.15.161:0/4285927526 learned_addr learned my addr 172.21.15.161:0/4285927526 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:28.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173086656 0 0) 0x7f6aec15ee50 con 0x7f6aec06b930 2023-11-24T08:05:28.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad8003520 con 0x7f6aec06b930 2023-11-24T08:05:28.920 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aebfff640 1 --2- 172.21.15.161:0/4285927526 >> v2:172.21.15.175:3300/0 conn(0x7f6aec15af80 0x7f6aec0adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6ae3fff640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 0x7f6aec06b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3643031643 0 0) 0x7f6ad8003520 con 0x7f6aec06b930 2023-11-24T08:05:28.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 msgr2=0x7f6aec06b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 0x7f6aec06b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 >> v2:172.21.15.175:3300/0 conn(0x7f6aec15af80 msgr2=0x7f6aec0adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.921 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 --2- 172.21.15.161:0/4285927526 >> v2:172.21.15.175:3300/0 conn(0x7f6aec15af80 0x7f6aec0adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec15e220 con 0x7f6aec06b930 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f6ae40019f0 con 0x7f6aec06b930 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 >> v1:172.21.15.161:6789/0 conn(0x7f6aec06b930 legacy=0x7f6aec160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8003970 0x7f6ad8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.916+0000 7f6aeb7fe640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 0x7f6ad80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aeb7fe640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ad8004d00 0x7f6ad8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.922 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec06bda0 con 0x7f6ad8003970 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec15b360 con 0x7f6ad8004d00 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad800ba30 con 0x7f6aec15d960 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aebfff640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8003970 0x7f6ad8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aebfff640 1 -- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 msgr2=0x7f6ad80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6ae3fff640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 0x7f6ad80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aebfff640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec15d960 0x7f6ad80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.923 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aebfff640 1 -- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ad8004d00 msgr2=0x7f6ad8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:28.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aebfff640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ad8004d00 0x7f6ad8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.917+0000 7f6aebfff640 1 -- 172.21.15.161:0/4285927526 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad8003520 con 0x7f6ad8003970 2023-11-24T08:05:28.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.918+0000 7f6aebfff640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8003970 0x7f6ad8003d90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00ba60 tx=0x7f6ad80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e6776e17bc8c6f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.918+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc032680 con 0x7f6ad8003970 2023-11-24T08:05:28.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.918+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc0327e0 con 0x7f6ad8003970 2023-11-24T08:05:28.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.918+0000 7f6aeb7fe640 1 -- 172.21.15.161:0/4285927526 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc032b70 con 0x7f6ad8003970 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af2636640 1 -- 172.21.15.161:0/4285927526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8003970 msgr2=0x7f6ad8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af2636640 1 --2- 172.21.15.161:0/4285927526 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6ad8003970 0x7f6ad8003d90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00ba60 tx=0x7f6ad80057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af0bd3640 1 -- 172.21.15.161:0/4285927526 reap_dead start 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af2636640 1 -- 172.21.15.161:0/4285927526 shutdown_connections 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af2636640 1 -- 172.21.15.161:0/4285927526 >> 172.21.15.161:0/4285927526 conn(0x7f6aec070b10 msgr2=0x7f6aec070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af2636640 1 -- 172.21.15.161:0/4285927526 shutdown_connections 2023-11-24T08:05:28.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.919+0000 7f6af2636640 1 -- 172.21.15.161:0/4285927526 wait complete. 2023-11-24T08:05:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.921+0000 7f6af2636640 1 Processor -- start 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.921+0000 7f6af2636640 1 -- start start 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6af2636640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ad8003970 0x7f6aec0c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6af2636640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec0c45e0 0x7f6aec15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6af2636640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec06ece0 0x7f6aec157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6af2636640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0c4a70 con 0x7f6aec0c45e0 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6af2636640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0c4d50 con 0x7f6ad8003970 2023-11-24T08:05:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6af2636640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aec0c5030 con 0x7f6aec06ece0 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec0c45e0 0x7f6aec15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6ae3fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec0c45e0 0x7f6aec15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58328/0 (socket says 172.21.15.161:58328) 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.922+0000 7f6ae3fff640 1 -- 172.21.15.161:0/2358165752 learned_addr learned my addr 172.21.15.161:0/2358165752 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae3fff640 1 -- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec06ece0 msgr2=0x7f6aec157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae3fff640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6aec06ece0 0x7f6aec157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae3fff640 1 -- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ad8003970 msgr2=0x7f6aec0c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae3fff640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ad8003970 0x7f6aec0c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae3fff640 1 -- 172.21.15.161:0/2358165752 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0c5310 con 0x7f6aec0c45e0 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae3fff640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec0c45e0 0x7f6aec15cac0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e7e0 tx=0x7f6ad400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400c6d0 con 0x7f6aec0c45e0 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400c830 con 0x7f6aec0c45e0 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400cba0 con 0x7f6aec0c45e0 2023-11-24T08:05:28.931 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.923+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aec0c55f0 con 0x7f6aec0c45e0 2023-11-24T08:05:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.924+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aec15d1e0 con 0x7f6aec0c45e0 2023-11-24T08:05:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.924+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6aec071800 con 0x7f6aec0c45e0 2023-11-24T08:05:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.926+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f6ad400cd00 con 0x7f6aec0c45e0 2023-11-24T08:05:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6ae97fa640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6acc06aff0 0x7f6acc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ad4089350 con 0x7f6aec0c45e0 2023-11-24T08:05:28.932 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6ae97fa640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f6acc070e50 0x7f6acc073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:28.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 --> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6acc073920 con 0x7f6acc070e50 2023-11-24T08:05:28.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad408b9f0 con 0x7f6aec0c45e0 2023-11-24T08:05:28.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6af0bd3640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f6acc070e50 0x7f6acc073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.927+0000 7f6aebfff640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6acc06aff0 0x7f6acc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:28.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.928+0000 7f6af0bd3640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f6acc070e50 0x7f6acc073270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.928+0000 7f6aebfff640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6acc06aff0 0x7f6acc06d4b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00ba30 tx=0x7f6adc032000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:28.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.928+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== osd.0 v2:172.21.15.161:6800/2118422527 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6acc073920 con 0x7f6acc070e50 2023-11-24T08:05:28.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.943+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 --> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6aec15eac0 con 0x7f6acc070e50 2023-11-24T08:05:28.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.943+0000 7f6ae97fa640 1 -- 172.21.15.161:0/2358165752 <== osd.0 v2:172.21.15.161:6800/2118422527 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6ae4001e60 con 0x7f6acc070e50 2023-11-24T08:05:28.945 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:28.945 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:28.946 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:28.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.943+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f6acc070e50 msgr2=0x7f6acc073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.943+0000 7f6af2636640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:6800/2118422527,v1:172.21.15.161:6801/2118422527] conn(0x7f6acc070e50 0x7f6acc073270 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6acc06aff0 msgr2=0x7f6acc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f6acc06aff0 0x7f6acc06d4b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00ba30 tx=0x7f6adc032000 comp rx=0 tx=0).stop 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec0c45e0 msgr2=0x7f6aec15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 --2- 172.21.15.161:0/2358165752 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6aec0c45e0 0x7f6aec15cac0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f6ad400e7e0 tx=0x7f6ad400eca0 comp rx=0 tx=0).stop 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af0bd3640 1 -- 172.21.15.161:0/2358165752 reap_dead start 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 shutdown_connections 2023-11-24T08:05:28.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 >> 172.21.15.161:0/2358165752 conn(0x7f6aec070b10 msgr2=0x7f6aec06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:28.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 shutdown_connections 2023-11-24T08:05:28.949 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:28.944+0000 7f6af2636640 1 -- 172.21.15.161:0/2358165752 wait complete. 2023-11-24T08:05:28.962 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T08:05:29.176 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.174+0000 7f30f45b0640 1 Processor -- start 2023-11-24T08:05:29.177 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.174+0000 7f30f45b0640 1 -- start start 2023-11-24T08:05:29.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.176+0000 7f30f45b0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30ec13e360 0x7f30ec0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.176+0000 7f30f45b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.176+0000 7f30f45b0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ec15c5f0 con 0x7f30ec13df80 2023-11-24T08:05:29.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.176+0000 7f30f45b0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ec06c470 con 0x7f30ec13e360 2023-11-24T08:05:29.178 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.176+0000 7f30f45b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec06c750 con 0x7f30ec15f9c0 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.176+0000 7f30f1b4b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30ec13e360 0x7f30ec0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f1b4b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f30ec13e360 0x7f30ec0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58330/0 (socket says 172.21.15.161:58330) 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f1b4b640 1 -- 172.21.15.161:0/2872057624 learned_addr learned my addr 172.21.15.161:0/2872057624 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f2b4d640 1 --2- 172.21.15.161:0/2872057624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f1b4b640 1 -- 172.21.15.161:0/2872057624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 msgr2=0x7f30ec0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f1b4b640 1 --2- 172.21.15.161:0/2872057624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec0cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.179 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f1b4b640 1 -- 172.21.15.161:0/2872057624 >> v1:172.21.15.175:6789/0 conn(0x7f30ec13df80 legacy=0x7f30ec15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.177+0000 7f30f1b4b640 1 -- 172.21.15.161:0/2872057624 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec06ca30 con 0x7f30ec13e360 2023-11-24T08:05:29.180 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.178+0000 7f30f1b4b640 1 --2- 172.21.15.161:0/2872057624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13e360 0x7f30ec0cf290 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f30ec06ded0 tx=0x7f30dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3802b19a91aa22e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.178+0000 7f30f134a640 1 -- 172.21.15.161:0/2872057624 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc031640 con 0x7f30ec13e360 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.178+0000 7f30f134a640 1 -- 172.21.15.161:0/2872057624 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30dc0317a0 con 0x7f30ec13e360 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.178+0000 7f30f134a640 1 -- 172.21.15.161:0/2872057624 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30dc031b30 con 0x7f30ec13e360 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 -- 172.21.15.161:0/2872057624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13e360 msgr2=0x7f30ec0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 --2- 172.21.15.161:0/2872057624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13e360 0x7f30ec0cf290 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f30ec06ded0 tx=0x7f30dc02b8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 -- 172.21.15.161:0/2872057624 shutdown_connections 2023-11-24T08:05:29.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 --2- 172.21.15.161:0/2872057624 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec0cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 --2- 172.21.15.161:0/2872057624 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13e360 0x7f30ec0cf290 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 -- 172.21.15.161:0/2872057624 >> 172.21.15.161:0/2872057624 conn(0x7f30ec06a800 msgr2=0x7f30ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 -- 172.21.15.161:0/2872057624 shutdown_connections 2023-11-24T08:05:29.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.179+0000 7f30f45b0640 1 -- 172.21.15.161:0/2872057624 wait complete. 2023-11-24T08:05:29.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.181+0000 7f30f45b0640 1 Processor -- start 2023-11-24T08:05:29.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.181+0000 7f30f45b0640 1 -- start start 2023-11-24T08:05:29.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f45b0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 0x7f30ec1366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f45b0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30ec13e360 0x7f30ec14af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.183 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f45b0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f45b0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec15d2d0 con 0x7f30ec13df80 2023-11-24T08:05:29.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f45b0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec137a70 con 0x7f30ec13e360 2023-11-24T08:05:29.184 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f45b0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ec136c20 con 0x7f30ec15f9c0 2023-11-24T08:05:29.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f234c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 0x7f30ec1366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f234c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 0x7f30ec1366e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58334/0 (socket says 172.21.15.161:58334) 2023-11-24T08:05:29.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.182+0000 7f30f234c640 1 -- 172.21.15.161:0/1742875532 learned_addr learned my addr 172.21.15.161:0/1742875532 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30f234c640 1 -- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 msgr2=0x7f30ec135b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30f234c640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30f234c640 1 -- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30ec13e360 msgr2=0x7f30ec14af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30f234c640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30ec13e360 0x7f30ec14af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30f234c640 1 -- 172.21.15.161:0/1742875532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0094d0 con 0x7f30ec13df80 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30f234c640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 0x7f30ec1366e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b3e0 tx=0x7f30e800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8011830 con 0x7f30ec13df80 2023-11-24T08:05:29.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e80119b0 con 0x7f30ec13df80 2023-11-24T08:05:29.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.183+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e8011d60 con 0x7f30ec13df80 2023-11-24T08:05:29.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.184+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ec14b470 con 0x7f30ec13df80 2023-11-24T08:05:29.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.184+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ec137140 con 0x7f30ec13df80 2023-11-24T08:05:29.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.185+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ec0675d0 con 0x7f30ec13df80 2023-11-24T08:05:29.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.186+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f30e801a400 con 0x7f30ec13df80 2023-11-24T08:05:29.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.186+0000 7f30e2ffd640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f30d006aff0 0x7f30d006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.187+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f30e80897b0 con 0x7f30ec13df80 2023-11-24T08:05:29.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.187+0000 7f30f1b4b640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f30d006aff0 0x7f30d006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.189 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.188+0000 7f30f1b4b640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f30d006aff0 0x7f30d006d4b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f30dc036000 tx=0x7f30dc030000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.191+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30e80548e0 con 0x7f30ec13df80 2023-11-24T08:05:29.385 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.384+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f30ec06cff0 con 0x7f30d006aff0 2023-11-24T08:05:29.386 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.385+0000 7f30e2ffd640 1 -- 172.21.15.161:0/1742875532 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f30dc031a10 con 0x7f30d006aff0 2023-11-24T08:05:29.386 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T08:05:29.389 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f30d006aff0 msgr2=0x7f30d006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f30d006aff0 0x7f30d006d4b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f30dc036000 tx=0x7f30dc030000 comp rx=0 tx=0).stop 2023-11-24T08:05:29.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 msgr2=0x7f30ec1366e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 0x7f30ec1366e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b3e0 tx=0x7f30e800b8a0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 shutdown_connections 2023-11-24T08:05:29.390 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f30d006aff0 0x7f30d006d4b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30ec15f9c0 0x7f30ec135b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30ec13e360 0x7f30ec14af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 --2- 172.21.15.161:0/1742875532 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30ec13df80 0x7f30ec1366e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 >> 172.21.15.161:0/1742875532 conn(0x7f30ec06a800 msgr2=0x7f30ec15d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 shutdown_connections 2023-11-24T08:05:29.391 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.388+0000 7f30f45b0640 1 -- 172.21.15.161:0/1742875532 wait complete. 2023-11-24T08:05:29.407 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T08:05:29.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:29.629 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.628+0000 7fb8c721a640 1 Processor -- start 2023-11-24T08:05:29.630 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.628+0000 7fb8c721a640 1 -- start start 2023-11-24T08:05:29.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c721a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c0071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c721a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb8c00717d0 0x7fb8c00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c721a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8c00cca40 0x7fb8c015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.634 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c721a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00723c0 con 0x7fb8c00cca40 2023-11-24T08:05:29.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c721a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c0070e50 con 0x7fb8c00717d0 2023-11-24T08:05:29.635 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c721a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00cce70 con 0x7fb8c0143c40 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c6a19640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8c00cca40 0x7fb8c015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c6a19640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb8c00cca40 0x7fb8c015eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58346/0 (socket says 172.21.15.161:58346) 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.630+0000 7fb8c6a19640 1 -- 172.21.15.161:0/831186027 learned_addr learned my addr 172.21.15.161:0/831186027 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.631+0000 7fb8c6a19640 1 -- 172.21.15.161:0/831186027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 msgr2=0x7fb8c0071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.631+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/831186027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c0071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.631+0000 7fb8c6a19640 1 -- 172.21.15.161:0/831186027 >> v2:172.21.15.175:3300/0 conn(0x7fb8c00717d0 msgr2=0x7fb8c00cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.636 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.631+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/831186027 >> v2:172.21.15.175:3300/0 conn(0x7fb8c00717d0 0x7fb8c00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.631+0000 7fb8c6a19640 1 -- 172.21.15.161:0/831186027 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c0144020 con 0x7fb8c00cca40 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.632+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/831186027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c015eab0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb8c006e440 tx=0x7fb8b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1934afa93f48ed6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.632+0000 7fb8c5216640 1 -- 172.21.15.161:0/831186027 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b802c9e0 con 0x7fb8c00cca40 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.632+0000 7fb8c5216640 1 -- 172.21.15.161:0/831186027 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b802cb40 con 0x7fb8c00cca40 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.632+0000 7fb8c5216640 1 -- 172.21.15.161:0/831186027 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80343f0 con 0x7fb8c00cca40 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 -- 172.21.15.161:0/831186027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 msgr2=0x7fb8c015eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.637 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 --2- 172.21.15.161:0/831186027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c015eab0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb8c006e440 tx=0x7fb8b802be40 comp rx=0 tx=0).stop 2023-11-24T08:05:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 -- 172.21.15.161:0/831186027 shutdown_connections 2023-11-24T08:05:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 --2- 172.21.15.161:0/831186027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c015eab0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 --2- 172.21.15.161:0/831186027 >> v2:172.21.15.175:3300/0 conn(0x7fb8c00717d0 0x7fb8c00cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 --2- 172.21.15.161:0/831186027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c0071290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 -- 172.21.15.161:0/831186027 >> 172.21.15.161:0/831186027 conn(0x7fb8c006a800 msgr2=0x7fb8c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 -- 172.21.15.161:0/831186027 shutdown_connections 2023-11-24T08:05:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.633+0000 7fb8c721a640 1 -- 172.21.15.161:0/831186027 wait complete. 2023-11-24T08:05:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.635+0000 7fb8c721a640 1 Processor -- start 2023-11-24T08:05:29.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.635+0000 7fb8c721a640 1 -- start start 2023-11-24T08:05:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c721a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c00717d0 0x7fb8c00ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c721a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c012d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c721a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c00c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c721a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00ad140 con 0x7fb8c00cca40 2023-11-24T08:05:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c721a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00ac4c0 con 0x7fb8c00717d0 2023-11-24T08:05:29.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c721a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00ac7a0 con 0x7fb8c0143c40 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c5a17640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c012d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c5a17640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c012d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58354/0 (socket says 172.21.15.161:58354) 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.636+0000 7fb8c5a17640 1 -- 172.21.15.161:0/481323983 learned_addr learned my addr 172.21.15.161:0/481323983 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c00c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c6218640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c00717d0 0x7fb8c00ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c5a17640 1 -- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 msgr2=0x7fb8c00c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c5a17640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c00c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c5a17640 1 -- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c00717d0 msgr2=0x7fb8c00ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c5a17640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c00717d0 0x7fb8c00ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c5a17640 1 -- 172.21.15.161:0/481323983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009b30 con 0x7fb8c00cca40 2023-11-24T08:05:29.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb8c0143c40 0x7fb8c00c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:29.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c6218640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8c00717d0 0x7fb8c00ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:29.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8c5a17640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c012d3b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000b410 tx=0x7fb8b000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.637+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0011830 con 0x7fb8c00cca40 2023-11-24T08:05:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.638+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b00119b0 con 0x7fb8c00cca40 2023-11-24T08:05:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.638+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00aca80 con 0x7fb8c00cca40 2023-11-24T08:05:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.638+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0011d60 con 0x7fb8c00cca40 2023-11-24T08:05:29.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.638+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c00adaa0 con 0x7fb8c00cca40 2023-11-24T08:05:29.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.639+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb8c0141230 con 0x7fb8c00cca40 2023-11-24T08:05:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.640+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb8b001a400 con 0x7fb8c00cca40 2023-11-24T08:05:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8b6ffd640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb8a406b070 0x7fb8a406d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb8b0089730 con 0x7fb8c00cca40 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8b6ffd640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7fb8a4070ed0 0x7fb8a40732f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 --> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8a40739a0 con 0x7fb8a4070ed0 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b008bcb0 con 0x7fb8c00cca40 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7fb8a4070ed0 0x7fb8a40732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.641+0000 7fb8c6218640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb8a406b070 0x7fb8a406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.642+0000 7fb8c6a19640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7fb8a4070ed0 0x7fb8a40732f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.642+0000 7fb8c6218640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb8a406b070 0x7fb8a406d530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc006fd0 tx=0x7fb8bc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.643+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== osd.1 v2:172.21.15.161:6808/555346844 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb8a40739a0 con 0x7fb8a4070ed0 2023-11-24T08:05:29.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.657+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 --> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb8c006c960 con 0x7fb8a4070ed0 2023-11-24T08:05:29.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8b6ffd640 1 -- 172.21.15.161:0/481323983 <== osd.1 v2:172.21.15.161:6808/555346844 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb8b8040410 con 0x7fb8a4070ed0 2023-11-24T08:05:29.660 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:29.660 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:29.660 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:29.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7fb8a4070ed0 msgr2=0x7fb8a40732f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:6808/555346844,v1:172.21.15.161:6809/555346844] conn(0x7fb8a4070ed0 0x7fb8a40732f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb8a406b070 msgr2=0x7fb8a406d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.662 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb8a406b070 0x7fb8a406d530 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc006fd0 tx=0x7fb8bc008040 comp rx=0 tx=0).stop 2023-11-24T08:05:29.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 msgr2=0x7fb8c012d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 --2- 172.21.15.161:0/481323983 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8c00cca40 0x7fb8c012d3b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000b410 tx=0x7fb8b000b8d0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.663 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c6a19640 1 -- 172.21.15.161:0/481323983 reap_dead start 2023-11-24T08:05:29.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 shutdown_connections 2023-11-24T08:05:29.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 >> 172.21.15.161:0/481323983 conn(0x7fb8c006a800 msgr2=0x7fb8c006abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 shutdown_connections 2023-11-24T08:05:29.664 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.658+0000 7fb8c721a640 1 -- 172.21.15.161:0/481323983 wait complete. 2023-11-24T08:05:29.678 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T08:05:29.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.888+0000 7f0b9373c640 1 Processor -- start 2023-11-24T08:05:29.890 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.888+0000 7f0b9373c640 1 -- start start 2023-11-24T08:05:29.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b9373c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 0x7f0b8c0b3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b9373c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0b8c09a170 0x7f0b8c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b9373c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b8c06cea0 con 0x7f0b8c06c6b0 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b9373c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b8c06cbc0 con 0x7f0b8c09a170 2023-11-24T08:05:29.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b9373c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c06f350 con 0x7f0b8c0cd240 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b90cd7640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0b8c06c6b0 0x7f0b8c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40196/0 (socket says 172.21.15.161:40196) 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.890+0000 7f0b90cd7640 1 -- 172.21.15.161:0/3153407829 learned_addr learned my addr 172.21.15.161:0/3153407829 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b914d8640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 0x7f0b8c0b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.898 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b91cd9640 1 --2- 172.21.15.161:0/3153407829 >> v2:172.21.15.175:3300/0 conn(0x7f0b8c09a170 0x7f0b8c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454680185 0 0) 0x7f0b8c06cea0 con 0x7f0b8c06c6b0 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b7c003520 con 0x7f0b8c06c6b0 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274403806 0 0) 0x7f0b7c003520 con 0x7f0b8c06c6b0 2023-11-24T08:05:29.899 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 msgr2=0x7f0b8c0b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 0x7f0b8c0b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 >> v2:172.21.15.175:3300/0 conn(0x7f0b8c09a170 msgr2=0x7f0b8c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 --2- 172.21.15.161:0/3153407829 >> v2:172.21.15.175:3300/0 conn(0x7f0b8c09a170 0x7f0b8c0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.900 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c06f630 con 0x7f0b8c06c6b0 2023-11-24T08:05:29.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f0b78001670 con 0x7f0b8c06c6b0 2023-11-24T08:05:29.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 >> v1:172.21.15.161:6789/0 conn(0x7f0b8c06c6b0 legacy=0x7f0b8c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.901 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 0x7f0b7c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b7c003ef0 0x7f0b7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c004d00 0x7f0b7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c06cbc0 con 0x7f0b7c003ef0 2023-11-24T08:05:29.902 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c06f350 con 0x7f0b7c004d00 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.891+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7c00b980 con 0x7f0b8c0cd240 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b90cd7640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b7c003ef0 0x7f0b7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.903 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b914d8640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 0x7f0b7c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b90cd7640 1 -- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 msgr2=0x7f0b7c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.904 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b91cd9640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c004d00 0x7f0b7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b90cd7640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c0cd240 0x7f0b7c003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b90cd7640 1 -- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c004d00 msgr2=0x7f0b7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:29.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b90cd7640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c004d00 0x7f0b7c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.905 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.892+0000 7f0b90cd7640 1 -- 172.21.15.161:0/3153407829 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7c003520 con 0x7f0b7c003ef0 2023-11-24T08:05:29.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.893+0000 7f0b90cd7640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b7c003ef0 0x7f0b7c0047c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c210 tx=0x7f0b7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3619f2036a587a4e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.893+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b78005ad0 con 0x7f0b7c003ef0 2023-11-24T08:05:29.907 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.893+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b78005c30 con 0x7f0b7c003ef0 2023-11-24T08:05:29.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.893+0000 7f0b8bfff640 1 -- 172.21.15.161:0/3153407829 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7802cae0 con 0x7f0b7c003ef0 2023-11-24T08:05:29.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b9373c640 1 -- 172.21.15.161:0/3153407829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b7c003ef0 msgr2=0x7f0b7c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3153407829 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b7c003ef0 0x7f0b7c0047c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800c210 tx=0x7f0b7c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b91cd9640 1 -- 172.21.15.161:0/3153407829 reap_dead start 2023-11-24T08:05:29.908 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b9373c640 1 -- 172.21.15.161:0/3153407829 shutdown_connections 2023-11-24T08:05:29.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b9373c640 1 -- 172.21.15.161:0/3153407829 >> 172.21.15.161:0/3153407829 conn(0x7f0b8c0b2d00 msgr2=0x7f0b8c0b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:29.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b9373c640 1 -- 172.21.15.161:0/3153407829 shutdown_connections 2023-11-24T08:05:29.909 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.894+0000 7f0b9373c640 1 -- 172.21.15.161:0/3153407829 wait complete. 2023-11-24T08:05:29.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.896+0000 7f0b9373c640 1 Processor -- start 2023-11-24T08:05:29.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.896+0000 7f0b9373c640 1 -- start start 2023-11-24T08:05:29.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b9373c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c003ef0 0x7f0b8c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b9373c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c15d910 0x7f0b8c0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.914 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b9373c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 0x7f0b8c0b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b9373c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0b6ed0 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b9373c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0b44b0 con 0x7f0b7c003ef0 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b9373c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c0b4790 con 0x7f0b8c15d910 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b91cd9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 0x7f0b8c0b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.897+0000 7f0b91cd9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 0x7f0b8c0b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58370/0 (socket says 172.21.15.161:58370) 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 -- 172.21.15.161:0/3385768633 learned_addr learned my addr 172.21.15.161:0/3385768633 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:29.915 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b90cd7640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c15d910 0x7f0b8c0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b914d8640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c003ef0 0x7f0b8c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 -- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c15d910 msgr2=0x7f0b8c0b5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c15d910 0x7f0b8c0b5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 -- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c003ef0 msgr2=0x7f0b8c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c003ef0 0x7f0b8c154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 -- 172.21.15.161:0/3385768633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0b4a70 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b90cd7640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c15d910 0x7f0b8c0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:29.916 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b91cd9640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 0x7f0b8c0b6990 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0722b0 tx=0x7f0b84010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.898+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400e8a0 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.899+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8400ea20 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.899+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8400edd0 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.899+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c0b4d50 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.899+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c154ad0 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.900+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c0b5270 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.901+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f0b84021460 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.917 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.902+0000 7f0b89ffb640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b7006b020 0x7f0b7006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.902+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0b840893c0 con 0x7f0b8c0b64e0 2023-11-24T08:05:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.902+0000 7f0b914d8640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b7006b020 0x7f0b7006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.903+0000 7f0b914d8640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b7006b020 0x7f0b7006d4e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009fd0 tx=0x7f0b8000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:29.918 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:29.906+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b8c0b5270 con 0x7f0b8c0b64e0 2023-11-24T08:05:30.098 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.097+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0b8c0cd620 con 0x7f0b7006b020 2023-11-24T08:05:30.099 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.098+0000 7f0b89ffb640 1 -- 172.21.15.161:0/3385768633 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b80009c10 con 0x7f0b7006b020 2023-11-24T08:05:30.099 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T08:05:30.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.100+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b7006b020 msgr2=0x7f0b7006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.100+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b7006b020 0x7f0b7006d4e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009fd0 tx=0x7f0b8000d040 comp rx=0 tx=0).stop 2023-11-24T08:05:30.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.100+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 msgr2=0x7f0b8c0b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.103 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.100+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 0x7f0b8c0b6990 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0722b0 tx=0x7f0b84010c20 comp rx=0 tx=0).stop 2023-11-24T08:05:30.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 shutdown_connections 2023-11-24T08:05:30.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f0b7006b020 0x7f0b7006d4e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0b8c0b64e0 0x7f0b8c0b6990 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0b8c15d910 0x7f0b8c0b5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.104 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 --2- 172.21.15.161:0/3385768633 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0b7c003ef0 0x7f0b8c154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 >> 172.21.15.161:0/3385768633 conn(0x7f0b8c0b2d00 msgr2=0x7f0b8c0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 shutdown_connections 2023-11-24T08:05:30.105 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.101+0000 7f0b9373c640 1 -- 172.21.15.161:0/3385768633 wait complete. 2023-11-24T08:05:30.119 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T08:05:30.120 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:30.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.317+0000 7fbec40ad640 1 Processor -- start 2023-11-24T08:05:30.318 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.317+0000 7fbec40ad640 1 -- start start 2023-11-24T08:05:30.319 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec40ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec40ad640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbebc13e360 0x7fbebc0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec40ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbebc06c470 con 0x7fbebc15f9c0 2023-11-24T08:05:30.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec40ad640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbebc06c750 con 0x7fbebc13e360 2023-11-24T08:05:30.320 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec40ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc06ca30 con 0x7fbebc13df80 2023-11-24T08:05:30.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec1e49640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec1e49640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc15bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:53058/0 (socket says 172.21.15.161:53058) 2023-11-24T08:05:30.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec1648640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbebc13e360 0x7fbebc0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.321 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.319+0000 7fbec1e49640 1 -- 172.21.15.161:0/1857412739 learned_addr learned my addr 172.21.15.161:0/1857412739 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:30.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.320+0000 7fbec1e49640 1 -- 172.21.15.161:0/1857412739 >> v2:172.21.15.175:3300/0 conn(0x7fbebc13e360 msgr2=0x7fbebc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.320+0000 7fbec1e49640 1 --2- 172.21.15.161:0/1857412739 >> v2:172.21.15.175:3300/0 conn(0x7fbebc13e360 0x7fbebc0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.320+0000 7fbec1e49640 1 -- 172.21.15.161:0/1857412739 >> v1:172.21.15.175:6789/0 conn(0x7fbebc15f9c0 legacy=0x7fbebc1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.322 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.320+0000 7fbec1e49640 1 -- 172.21.15.161:0/1857412739 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc06cd10 con 0x7fbebc13df80 2023-11-24T08:05:30.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.321+0000 7fbec1e49640 1 --2- 172.21.15.161:0/1857412739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc15bee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009870 tx=0x7fbeb802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1517c4bcc28becec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.322+0000 7fbec0e47640 1 -- 172.21.15.161:0/1857412739 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8030840 con 0x7fbebc13df80 2023-11-24T08:05:30.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.322+0000 7fbec0e47640 1 -- 172.21.15.161:0/1857412739 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb80309a0 con 0x7fbebc13df80 2023-11-24T08:05:30.323 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.322+0000 7fbec0e47640 1 -- 172.21.15.161:0/1857412739 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8030d30 con 0x7fbebc13df80 2023-11-24T08:05:30.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.322+0000 7fbec40ad640 1 -- 172.21.15.161:0/1857412739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 msgr2=0x7fbebc15bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.322+0000 7fbec40ad640 1 --2- 172.21.15.161:0/1857412739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc15bee0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8009870 tx=0x7fbeb802b980 comp rx=0 tx=0).stop 2023-11-24T08:05:30.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.323+0000 7fbec40ad640 1 -- 172.21.15.161:0/1857412739 shutdown_connections 2023-11-24T08:05:30.324 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.323+0000 7fbec40ad640 1 --2- 172.21.15.161:0/1857412739 >> v2:172.21.15.175:3300/0 conn(0x7fbebc13e360 0x7fbebc0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.323+0000 7fbec40ad640 1 --2- 172.21.15.161:0/1857412739 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc15bee0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.323+0000 7fbec40ad640 1 -- 172.21.15.161:0/1857412739 >> 172.21.15.161:0/1857412739 conn(0x7fbebc06a800 msgr2=0x7fbebc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.323+0000 7fbec40ad640 1 -- 172.21.15.161:0/1857412739 shutdown_connections 2023-11-24T08:05:30.325 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.323+0000 7fbec40ad640 1 -- 172.21.15.161:0/1857412739 wait complete. 2023-11-24T08:05:30.326 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.325+0000 7fbec40ad640 1 Processor -- start 2023-11-24T08:05:30.327 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.325+0000 7fbec40ad640 1 -- start start 2023-11-24T08:05:30.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec40ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc1335a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec40ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbebc13e360 0x7fbebc150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec40ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbebc15f9c0 0x7fbebc14ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec40ad640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc14ea40 con 0x7fbebc13e360 2023-11-24T08:05:30.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec40ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc15a330 con 0x7fbebc15f9c0 2023-11-24T08:05:30.328 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec40ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc15a610 con 0x7fbebc13df80 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.326+0000 7fbec1648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbebc13e360 0x7fbebc150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbebc13e360 0x7fbebc150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58380/0 (socket says 172.21.15.161:58380) 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 -- 172.21.15.161:0/1218959450 learned_addr learned my addr 172.21.15.161:0/1218959450 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1e49640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc1335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec264a640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbebc15f9c0 0x7fbebc14ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 -- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 msgr2=0x7fbebc1335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.329 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbebc13df80 0x7fbebc1335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 -- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbebc15f9c0 msgr2=0x7fbebc14ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbebc15f9c0 0x7fbebc14ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.330 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 -- 172.21.15.161:0/1218959450 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb80094d0 con 0x7fbebc13e360 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.327+0000 7fbec1648640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbebc13e360 0x7fbebc150f00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00e9b0 tx=0x7fbeac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.328+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac009670 con 0x7fbebc13e360 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.328+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac00c9a0 con 0x7fbebc13e360 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.328+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac00cd50 con 0x7fbebc13e360 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.328+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc15a8f0 con 0x7fbebc13e360 2023-11-24T08:05:30.331 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.328+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc133ae0 con 0x7fbebc13e360 2023-11-24T08:05:30.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.329+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbebc155d30 con 0x7fbebc13e360 2023-11-24T08:05:30.332 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.330+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbeac013470 con 0x7fbebc13e360 2023-11-24T08:05:30.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.331+0000 7fbeb27fc640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbea006aff0 0x7fbea006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.331+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbeac0898e0 con 0x7fbebc13e360 2023-11-24T08:05:30.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.331+0000 7fbeb27fc640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fbea0070e50 0x7fbea0073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.331+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 --> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbea0073920 con 0x7fbea0070e50 2023-11-24T08:05:30.333 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.331+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbeac08e2a0 con 0x7fbebc13e360 2023-11-24T08:05:30.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.332+0000 7fbec264a640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fbea0070e50 0x7fbea0073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.332+0000 7fbec1e49640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbea006aff0 0x7fbea006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.332+0000 7fbec264a640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fbea0070e50 0x7fbea0073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.333+0000 7fbec1e49640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbea006aff0 0x7fbea006d4b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8036000 tx=0x7fbeb803b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.334 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.333+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== osd.2 v2:172.21.15.161:6816/4193711640 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbea0073920 con 0x7fbea0070e50 2023-11-24T08:05:30.348 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.347+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 --> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbebc0ce850 con 0x7fbea0070e50 2023-11-24T08:05:30.349 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.348+0000 7fbeb27fc640 1 -- 172.21.15.161:0/1218959450 <== osd.2 v2:172.21.15.161:6816/4193711640 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbeb40019d0 con 0x7fbea0070e50 2023-11-24T08:05:30.349 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:30.349 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:30.350 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:30.350 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.348+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fbea0070e50 msgr2=0x7fbea0073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.348+0000 7fbec40ad640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:6816/4193711640,v1:172.21.15.161:6817/4193711640] conn(0x7fbea0070e50 0x7fbea0073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbea006aff0 msgr2=0x7fbea006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbea006aff0 0x7fbea006d4b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8036000 tx=0x7fbeb803b040 comp rx=0 tx=0).stop 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbebc13e360 msgr2=0x7fbebc150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 --2- 172.21.15.161:0/1218959450 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbebc13e360 0x7fbebc150f00 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00e9b0 tx=0x7fbeac00ee70 comp rx=0 tx=0).stop 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec264a640 1 -- 172.21.15.161:0/1218959450 reap_dead start 2023-11-24T08:05:30.351 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 shutdown_connections 2023-11-24T08:05:30.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 >> 172.21.15.161:0/1218959450 conn(0x7fbebc06a800 msgr2=0x7fbebc06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 shutdown_connections 2023-11-24T08:05:30.352 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.349+0000 7fbec40ad640 1 -- 172.21.15.161:0/1218959450 wait complete. 2023-11-24T08:05:30.367 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T08:05:30.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.576+0000 7fd4608d3640 1 Processor -- start 2023-11-24T08:05:30.577 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.576+0000 7fd4608d3640 1 -- start start 2023-11-24T08:05:30.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.577+0000 7fd4608d3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd45c13e360 0x7fd45c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.582 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.577+0000 7fd4608d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd45c0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.577+0000 7fd4608d3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45c15c5f0 con 0x7fd45c13df80 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.577+0000 7fd4608d3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd45c06c470 con 0x7fd45c13e360 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.577+0000 7fd4608d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c06c750 con 0x7fd45c15f9c0 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.578+0000 7fd45a59c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd45c13df80 0x7fd45c15bee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:40198/0 (socket says 172.21.15.161:40198) 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.578+0000 7fd45a59c640 1 -- 172.21.15.161:0/2626960137 learned_addr learned my addr 172.21.15.161:0/2626960137 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.578+0000 7fd45ad9d640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd45c0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.583 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.578+0000 7fd453fff640 1 --2- 172.21.15.161:0/2626960137 >> v2:172.21.15.175:3300/0 conn(0x7fd45c13e360 0x7fd45c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.578+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280541058 0 0) 0x7fd45c15c5f0 con 0x7fd45c13df80 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.578+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd448003520 con 0x7fd45c13df80 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616447175 0 0) 0x7fd448003520 con 0x7fd45c13df80 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 msgr2=0x7fd45c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd45c0cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 >> v2:172.21.15.175:3300/0 conn(0x7fd45c13e360 msgr2=0x7fd45c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.584 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 --2- 172.21.15.161:0/2626960137 >> v2:172.21.15.175:3300/0 conn(0x7fd45c13e360 0x7fd45c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c06ca30 con 0x7fd45c13df80 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fd44c001690 con 0x7fd45c13df80 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 >> v1:172.21.15.161:6789/0 conn(0x7fd45c13df80 legacy=0x7fd45c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd448003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448003ef0 0x7fd4480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd448004d00 0x7fd448005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c06c470 con 0x7fd448004d00 2023-11-24T08:05:30.585 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c06c750 con 0x7fd448003ef0 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44800b980 con 0x7fd45c15f9c0 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45ad9d640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd448004d00 0x7fd448005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45a59c640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd448003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd453fff640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448003ef0 0x7fd4480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45ad9d640 1 -- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 msgr2=0x7fd448003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45ad9d640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd448003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.586 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45ad9d640 1 -- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448003ef0 msgr2=0x7fd4480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45ad9d640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd448003ef0 0x7fd4480047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45ad9d640 1 -- 172.21.15.161:0/2626960137 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448003520 con 0x7fd448004d00 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.579+0000 7fd45a59c640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd45c15f9c0 0x7fd448003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.580+0000 7fd45ad9d640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd448004d00 0x7fd448005180 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fd454009f90 tx=0x7fd4480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f26efddee0051c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45402cbc0 con 0x7fd448004d00 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45400f040 con 0x7fd448004d00 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd459d9b640 1 -- 172.21.15.161:0/2626960137 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454034440 con 0x7fd448004d00 2023-11-24T08:05:30.587 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd4608d3640 1 -- 172.21.15.161:0/2626960137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd448004d00 msgr2=0x7fd448005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd4608d3640 1 --2- 172.21.15.161:0/2626960137 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd448004d00 0x7fd448005180 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fd454009f90 tx=0x7fd4480057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd45ad9d640 1 -- 172.21.15.161:0/2626960137 reap_dead start 2023-11-24T08:05:30.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd4608d3640 1 -- 172.21.15.161:0/2626960137 shutdown_connections 2023-11-24T08:05:30.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.581+0000 7fd4608d3640 1 -- 172.21.15.161:0/2626960137 >> 172.21.15.161:0/2626960137 conn(0x7fd45c06a800 msgr2=0x7fd45c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.582+0000 7fd4608d3640 1 -- 172.21.15.161:0/2626960137 shutdown_connections 2023-11-24T08:05:30.588 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.582+0000 7fd4608d3640 1 -- 172.21.15.161:0/2626960137 wait complete. 2023-11-24T08:05:30.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.583+0000 7fd4608d3640 1 Processor -- start 2023-11-24T08:05:30.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.584+0000 7fd4608d3640 1 -- start start 2023-11-24T08:05:30.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.584+0000 7fd4608d3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd448004d00 0x7fd45c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.591 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd4608d3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 0x7fd45c0b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd4608d3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c1526f0 0x7fd45c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd4608d3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1538a0 con 0x7fd45c152270 2023-11-24T08:05:30.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd4608d3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c153d30 con 0x7fd45c1526f0 2023-11-24T08:05:30.592 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd4608d3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1507a0 con 0x7fd448004d00 2023-11-24T08:05:30.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 0x7fd45c0b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 0x7fd45c0b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:58400/0 (socket says 172.21.15.161:58400) 2023-11-24T08:05:30.593 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 -- 172.21.15.161:0/822662055 learned_addr learned my addr 172.21.15.161:0/822662055 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:30.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 -- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd448004d00 msgr2=0x7fd45c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd448004d00 0x7fd45c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 -- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c1526f0 msgr2=0x7fd45c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c1526f0 0x7fd45c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.594 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.585+0000 7fd453fff640 1 -- 172.21.15.161:0/822662055 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c152c90 con 0x7fd45c152270 2023-11-24T08:05:30.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.586+0000 7fd453fff640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 0x7fd45c0b2cf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fd4440108d0 tx=0x7fd444010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.586+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd444009650 con 0x7fd45c152270 2023-11-24T08:05:30.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.586+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44400ea80 con 0x7fd45c152270 2023-11-24T08:05:30.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.586+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c152f70 con 0x7fd45c152270 2023-11-24T08:05:30.595 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.586+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44400ee10 con 0x7fd45c152270 2023-11-24T08:05:30.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.586+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c153530 con 0x7fd45c152270 2023-11-24T08:05:30.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.587+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c0ce630 con 0x7fd45c152270 2023-11-24T08:05:30.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.588+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fd44401c400 con 0x7fd45c152270 2023-11-24T08:05:30.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.589+0000 7fd452ffd640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd43c06aff0 0x7fd43c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:30.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.589+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd444089c80 con 0x7fd45c152270 2023-11-24T08:05:30.596 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.590+0000 7fd45a59c640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd43c06aff0 0x7fd43c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:30.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.591+0000 7fd45a59c640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd43c06aff0 0x7fd43c06d4b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0017c0 tx=0x7fd44c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:30.598 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.593+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd444054d10 con 0x7fd45c152270 2023-11-24T08:05:30.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.787+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd45c06cff0 con 0x7fd43c06aff0 2023-11-24T08:05:30.790 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.788+0000 7fd452ffd640 1 -- 172.21.15.161:0/822662055 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd44c00d8c0 con 0x7fd43c06aff0 2023-11-24T08:05:30.790 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T08:05:30.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd43c06aff0 msgr2=0x7fd43c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd43c06aff0 0x7fd43c06d4b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd44c0017c0 tx=0x7fd44c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:30.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 msgr2=0x7fd45c0b2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:30.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 0x7fd45c0b2cf0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fd4440108d0 tx=0x7fd444010d90 comp rx=0 tx=0).stop 2023-11-24T08:05:30.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 shutdown_connections 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fd43c06aff0 0x7fd43c06d4b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd45c1526f0 0x7fd45c0b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd45c152270 0x7fd45c0b2cf0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 --2- 172.21.15.161:0/822662055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd448004d00 0x7fd45c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 >> 172.21.15.161:0/822662055 conn(0x7fd45c06a800 msgr2=0x7fd45c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 shutdown_connections 2023-11-24T08:05:30.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:30.791+0000 7fd4608d3640 1 -- 172.21.15.161:0/822662055 wait complete. 2023-11-24T08:05:30.811 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T08:05:30.811 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:31.024 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.023+0000 7fbd50a51640 1 Processor -- start 2023-11-24T08:05:31.025 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.023+0000 7fbd50a51640 1 -- start start 2023-11-24T08:05:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd50a51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 0x7fbd4c15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd50a51640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbd4c13e360 0x7fbd4c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd50a51640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c06c470 con 0x7fbd4c15f9c0 2023-11-24T08:05:31.026 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd50a51640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c06c750 con 0x7fbd4c13e360 2023-11-24T08:05:31.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd50a51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06ca30 con 0x7fbd4c13df80 2023-11-24T08:05:31.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd4ad9d640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fbd4c15f9c0 0x7fbd4c1408d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39320/0 (socket says 172.21.15.161:39320) 2023-11-24T08:05:31.027 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd4ad9d640 1 -- 172.21.15.161:0/2412758421 learned_addr learned my addr 172.21.15.161:0/2412758421 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:31.028 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.025+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/2412758421 >> v2:172.21.15.175:3300/0 conn(0x7fbd4c13e360 0x7fbd4c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4a59c640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 0x7fbd4c15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261393575 0 0) 0x7fbd4c06c470 con 0x7fbd4c15f9c0 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd34003520 con 0x7fbd4c15f9c0 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771908035 0 0) 0x7fbd34003520 con 0x7fbd4c15f9c0 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 msgr2=0x7fbd4c15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 0x7fbd4c15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.029 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 >> v2:172.21.15.175:3300/0 conn(0x7fbd4c13e360 msgr2=0x7fbd4c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 --2- 172.21.15.161:0/2412758421 >> v2:172.21.15.175:3300/0 conn(0x7fbd4c13e360 0x7fbd4c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c06cd10 con 0x7fbd4c15f9c0 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fbd440019f0 con 0x7fbd4c15f9c0 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 >> v1:172.21.15.161:6789/0 conn(0x7fbd4c15f9c0 legacy=0x7fbd4c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd34003970 0x7fbd34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd340047c0 0x7fbd34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.030 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 0x7fbd34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06c750 con 0x7fbd340047c0 2023-11-24T08:05:31.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c06ca30 con 0x7fbd34003970 2023-11-24T08:05:31.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3400b980 con 0x7fbd4c13df80 2023-11-24T08:05:31.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.026+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd340047c0 0x7fbd34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.027+0000 7fbd49d9b640 1 -- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 msgr2=0x7fbd34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.031 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.027+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c13df80 0x7fbd34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.027+0000 7fbd49d9b640 1 -- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd34003970 msgr2=0x7fbd34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.027+0000 7fbd4a59c640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd34003970 0x7fbd34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.027+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd34003970 0x7fbd34003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.032 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.027+0000 7fbd49d9b640 1 -- 172.21.15.161:0/2412758421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd34003520 con 0x7fbd340047c0 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.028+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd340047c0 0x7fbd34004c40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009ac0 tx=0x7fbd340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fa89216c992a0d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.028+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4002c6d0 con 0x7fbd340047c0 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.028+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4002c830 con 0x7fbd340047c0 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.028+0000 7fbd4959a640 1 -- 172.21.15.161:0/2412758421 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4002cbc0 con 0x7fbd340047c0 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd50a51640 1 -- 172.21.15.161:0/2412758421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd340047c0 msgr2=0x7fbd34004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd50a51640 1 --2- 172.21.15.161:0/2412758421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd340047c0 0x7fbd34004c40 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009ac0 tx=0x7fbd340057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.036 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd4ad9d640 1 -- 172.21.15.161:0/2412758421 reap_dead start 2023-11-24T08:05:31.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd50a51640 1 -- 172.21.15.161:0/2412758421 shutdown_connections 2023-11-24T08:05:31.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd50a51640 1 -- 172.21.15.161:0/2412758421 >> 172.21.15.161:0/2412758421 conn(0x7fbd4c06a800 msgr2=0x7fbd4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd50a51640 1 -- 172.21.15.161:0/2412758421 shutdown_connections 2023-11-24T08:05:31.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.029+0000 7fbd50a51640 1 -- 172.21.15.161:0/2412758421 wait complete. 2023-11-24T08:05:31.037 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.031+0000 7fbd50a51640 1 Processor -- start 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.031+0000 7fbd50a51640 1 -- start start 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd50a51640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd340047c0 0x7fbd4c12eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd50a51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd4c1f0750 0x7fbd4c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd50a51640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c1f0bd0 0x7fbd4c15d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd50a51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c150070 con 0x7fbd4c1f0750 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd50a51640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c12f420 con 0x7fbd340047c0 2023-11-24T08:05:31.038 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd50a51640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c14ec00 con 0x7fbd4c1f0bd0 2023-11-24T08:05:31.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.032+0000 7fbd49d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd4c1f0750 0x7fbd4c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd4c1f0750 0x7fbd4c15d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41798/0 (socket says 172.21.15.161:41798) 2023-11-24T08:05:31.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 -- 172.21.15.161:0/3143418671 learned_addr learned my addr 172.21.15.161:0/3143418671 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:31.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd4ad9d640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c1f0bd0 0x7fbd4c15d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd4a59c640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd340047c0 0x7fbd4c12eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.039 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 -- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c1f0bd0 msgr2=0x7fbd4c15d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c1f0bd0 0x7fbd4c15d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 -- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd340047c0 msgr2=0x7fbd4c12eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd340047c0 0x7fbd4c12eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 -- 172.21.15.161:0/3143418671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c14e920 con 0x7fbd4c1f0750 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd4ad9d640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd4c1f0bd0 0x7fbd4c15d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd4a59c640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd340047c0 0x7fbd4c12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:31.040 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.033+0000 7fbd49d9b640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd4c1f0750 0x7fbd4c15d420 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002c2d0 tx=0x7fbd40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.034+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003810 con 0x7fbd4c1f0750 2023-11-24T08:05:31.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.034+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40003970 con 0x7fbd4c1f0750 2023-11-24T08:05:31.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.034+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003ce0 con 0x7fbd4c1f0750 2023-11-24T08:05:31.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.034+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c14b7e0 con 0x7fbd4c1f0750 2023-11-24T08:05:31.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.034+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c14e580 con 0x7fbd4c1f0750 2023-11-24T08:05:31.041 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.035+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd4c14e710 con 0x7fbd4c1f0750 2023-11-24T08:05:31.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.036+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbd40040450 con 0x7fbd4c1f0750 2023-11-24T08:05:31.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd3affd640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd2c06aff0 0x7fbd2c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd400ab5b0 con 0x7fbd4c1f0750 2023-11-24T08:05:31.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd3affd640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7fbd2c070e50 0x7fbd2c073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 --> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd2c073920 con 0x7fbd2c070e50 2023-11-24T08:05:31.043 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd400adda0 con 0x7fbd4c1f0750 2023-11-24T08:05:31.044 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd4ad9d640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7fbd2c070e50 0x7fbd2c073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.037+0000 7fbd4a59c640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd2c06aff0 0x7fbd2c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.038+0000 7fbd4ad9d640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7fbd2c070e50 0x7fbd2c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.038+0000 7fbd4a59c640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd2c06aff0 0x7fbd2c06d4b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009910 tx=0x7fbd3c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.045 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.039+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== osd.3 v2:172.21.15.161:6824/3270873402 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd2c073920 con 0x7fbd2c070e50 2023-11-24T08:05:31.054 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.053+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 --> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbd4c14b640 con 0x7fbd2c070e50 2023-11-24T08:05:31.055 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.053+0000 7fbd3affd640 1 -- 172.21.15.161:0/3143418671 <== osd.3 v2:172.21.15.161:6824/3270873402 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fbd4c14b640 con 0x7fbd2c070e50 2023-11-24T08:05:31.055 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:31.056 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:31.056 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:31.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7fbd2c070e50 msgr2=0x7fbd2c073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.057 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:6824/3270873402,v1:172.21.15.161:6825/3270873402] conn(0x7fbd2c070e50 0x7fbd2c073270 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd2c06aff0 msgr2=0x7fbd2c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbd2c06aff0 0x7fbd2c06d4b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009910 tx=0x7fbd3c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:31.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd4c1f0750 msgr2=0x7fbd4c15d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.058 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 --2- 172.21.15.161:0/3143418671 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd4c1f0750 0x7fbd4c15d420 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fbd4002c2d0 tx=0x7fbd40004730 comp rx=0 tx=0).stop 2023-11-24T08:05:31.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd4ad9d640 1 -- 172.21.15.161:0/3143418671 reap_dead start 2023-11-24T08:05:31.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 shutdown_connections 2023-11-24T08:05:31.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 >> 172.21.15.161:0/3143418671 conn(0x7fbd4c06a800 msgr2=0x7fbd4c1545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.059 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 shutdown_connections 2023-11-24T08:05:31.060 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.054+0000 7fbd50a51640 1 -- 172.21.15.161:0/3143418671 wait complete. 2023-11-24T08:05:31.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T08:05:31.276 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.275+0000 7f32908bb640 1 Processor -- start 2023-11-24T08:05:31.277 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.276+0000 7f32908bb640 1 -- start start 2023-11-24T08:05:31.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f32908bb640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f328c0cccf0 0x7f328c15c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f32908bb640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c06ca10 con 0x7f328c1447f0 2023-11-24T08:05:31.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f32908bb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c06ccf0 con 0x7f328c06c470 2023-11-24T08:05:31.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f32908bb640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328c06d690 con 0x7f328c0cccf0 2023-11-24T08:05:31.278 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f328bfff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f328c0cccf0 0x7f328c15c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f328b7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f328c1447f0 0x7f328c15c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39330/0 (socket says 172.21.15.161:39330) 2023-11-24T08:05:31.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.277+0000 7f328b7fe640 1 -- 172.21.15.161:0/1877290610 learned_addr learned my addr 172.21.15.161:0/1877290610 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:31.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.278+0000 7f328bfff640 1 -- 172.21.15.161:0/1877290610 >> v1:172.21.15.175:6789/0 conn(0x7f328c06c470 legacy=0x7f328c0cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.278+0000 7f328bfff640 1 -- 172.21.15.161:0/1877290610 >> v1:172.21.15.161:6789/0 conn(0x7f328c1447f0 legacy=0x7f328c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.278+0000 7f328bfff640 1 -- 172.21.15.161:0/1877290610 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c06cfd0 con 0x7f328c0cccf0 2023-11-24T08:05:31.280 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.278+0000 7f328affd640 1 -- 172.21.15.161:0/1877290610 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631256377 0 0) 0x7f328c06ca10 con 0x7f328c1447f0 2023-11-24T08:05:31.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.279+0000 7f328bfff640 1 --2- 172.21.15.161:0/1877290610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c0cccf0 0x7f328c15c7c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3284009d90 tx=0x7f328402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a63d664d79256fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.279+0000 7f328affd640 1 -- 172.21.15.161:0/1877290610 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328402cbd0 con 0x7f328c0cccf0 2023-11-24T08:05:31.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.279+0000 7f328affd640 1 -- 172.21.15.161:0/1877290610 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328402cd30 con 0x7f328c0cccf0 2023-11-24T08:05:31.281 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.279+0000 7f328affd640 1 -- 172.21.15.161:0/1877290610 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328402cea0 con 0x7f328c0cccf0 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 -- 172.21.15.161:0/1877290610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c0cccf0 msgr2=0x7f328c15c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 --2- 172.21.15.161:0/1877290610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c0cccf0 0x7f328c15c7c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3284009d90 tx=0x7f328402be20 comp rx=0 tx=0).stop 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 -- 172.21.15.161:0/1877290610 shutdown_connections 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 --2- 172.21.15.161:0/1877290610 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c0cccf0 0x7f328c15c7c0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 -- 172.21.15.161:0/1877290610 >> 172.21.15.161:0/1877290610 conn(0x7f328c06a3e0 msgr2=0x7f328c06a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 -- 172.21.15.161:0/1877290610 shutdown_connections 2023-11-24T08:05:31.282 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.280+0000 7f32908bb640 1 -- 172.21.15.161:0/1877290610 wait complete. 2023-11-24T08:05:31.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.281+0000 7f32908bb640 1 Processor -- start 2023-11-24T08:05:31.283 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.282+0000 7f32908bb640 1 -- start start 2023-11-24T08:05:31.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f32908bb640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 0x7f328c1f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f32908bb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f328c0cccf0 0x7f328c0b0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f32908bb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c1447f0 0x7f328c0c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f32908bb640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c1f2910 con 0x7f328c06c470 2023-11-24T08:05:31.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f32908bb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0af6b0 con 0x7f328c1447f0 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f32908bb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0af990 con 0x7f328c0cccf0 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 0x7f328c1f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 0x7f328c1f23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41804/0 (socket says 172.21.15.161:41804) 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 -- 172.21.15.161:0/3627375917 learned_addr learned my addr 172.21.15.161:0/3627375917 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 -- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f328c0cccf0 msgr2=0x7f328c0b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f3283fff640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f328c0cccf0 0x7f328c0b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.286 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328bfff640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c1447f0 0x7f328c0c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f328c0cccf0 0x7f328c0b0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 -- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c1447f0 msgr2=0x7f328c0c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c1447f0 0x7f328c0c5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.283+0000 7f328b7fe640 1 -- 172.21.15.161:0/3627375917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284009a70 con 0x7f328c06c470 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.284+0000 7f328b7fe640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 0x7f328c1f23d0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f327c00c430 tx=0x7f327c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.284+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0074e0 con 0x7f328c06c470 2023-11-24T08:05:31.287 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.284+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c007660 con 0x7f328c06c470 2023-11-24T08:05:31.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.284+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c0afc70 con 0x7f328c06c470 2023-11-24T08:05:31.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.284+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c004a20 con 0x7f328c06c470 2023-11-24T08:05:31.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.284+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0b0ba0 con 0x7f328c06c470 2023-11-24T08:05:31.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.285+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c0b0190 con 0x7f328c06c470 2023-11-24T08:05:31.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.286+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f327c004b80 con 0x7f328c06c470 2023-11-24T08:05:31.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.287+0000 7f3288ff9640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f326c06aff0 0x7f326c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.287+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f327c0895b0 con 0x7f328c06c470 2023-11-24T08:05:31.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.288+0000 7f3283fff640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f326c06aff0 0x7f326c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.289+0000 7f3283fff640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f326c06aff0 0x7f326c06d4b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f328c0b1b60 tx=0x7f3274009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.292 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.291+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f327c054640 con 0x7f328c06c470 2023-11-24T08:05:31.485 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.484+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f328c0afb00 con 0x7f326c06aff0 2023-11-24T08:05:31.486 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.485+0000 7f3288ff9640 1 -- 172.21.15.161:0/3627375917 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f328c0afb00 con 0x7f326c06aff0 2023-11-24T08:05:31.486 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T08:05:31.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.487+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f326c06aff0 msgr2=0x7f326c06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.487+0000 7f32908bb640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f326c06aff0 0x7f326c06d4b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f328c0b1b60 tx=0x7f3274009040 comp rx=0 tx=0).stop 2023-11-24T08:05:31.489 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.487+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 msgr2=0x7f328c1f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.487+0000 7f32908bb640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 0x7f328c1f23d0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f327c00c430 tx=0x7f327c00c8f0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 shutdown_connections 2023-11-24T08:05:31.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f326c06aff0 0x7f326c06d4b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.490 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f328c1447f0 0x7f328c0c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f328c0cccf0 0x7f328c0b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 --2- 172.21.15.161:0/3627375917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f328c06c470 0x7f328c1f23d0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 >> 172.21.15.161:0/3627375917 conn(0x7f328c06a3e0 msgr2=0x7f328c15e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 shutdown_connections 2023-11-24T08:05:31.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.488+0000 7f32908bb640 1 -- 172.21.15.161:0/3627375917 wait complete. 2023-11-24T08:05:31.508 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T08:05:31.508 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:31.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.716+0000 7f9ab759e640 1 Processor -- start 2023-11-24T08:05:31.717 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.716+0000 7f9ab759e640 1 -- start start 2023-11-24T08:05:31.719 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.717+0000 7f9ab759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9ab8143c40 0x7f9ab8071290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.717+0000 7f9ab759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab80ccc10 0x7f9ab806d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab8070e50 con 0x7f9ab80717d0 2023-11-24T08:05:31.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab80723c0 con 0x7f9ab8143c40 2023-11-24T08:05:31.720 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8144020 con 0x7f9ab80ccc10 2023-11-24T08:05:31.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab659c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9ab8143c40 0x7f9ab8071290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9aaffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f9ab80717d0 0x7f9ab80cc500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39342/0 (socket says 172.21.15.161:39342) 2023-11-24T08:05:31.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9aaffff640 1 -- 172.21.15.161:0/1208407544 learned_addr learned my addr 172.21.15.161:0/1208407544 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:31.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab659c640 1 -- 172.21.15.161:0/1208407544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab80ccc10 msgr2=0x7f9ab806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.721 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab659c640 1 --2- 172.21.15.161:0/1208407544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab80ccc10 0x7f9ab806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab659c640 1 -- 172.21.15.161:0/1208407544 >> v1:172.21.15.161:6789/0 conn(0x7f9ab80717d0 legacy=0x7f9ab80cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab5d9b640 1 -- 172.21.15.161:0/1208407544 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4101136776 0 0) 0x7f9ab8070e50 con 0x7f9ab80717d0 2023-11-24T08:05:31.722 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.718+0000 7f9ab659c640 1 -- 172.21.15.161:0/1208407544 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8071e00 con 0x7f9ab8143c40 2023-11-24T08:05:31.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.719+0000 7f9ab659c640 1 --2- 172.21.15.161:0/1208407544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab8143c40 0x7f9ab8071290 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80097a0 tx=0x7f9aa802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f559f939f6aa7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab5d9b640 1 -- 172.21.15.161:0/1208407544 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa802e070 con 0x7f9ab8143c40 2023-11-24T08:05:31.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab5d9b640 1 -- 172.21.15.161:0/1208407544 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa80315a0 con 0x7f9ab8143c40 2023-11-24T08:05:31.724 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab5d9b640 1 -- 172.21.15.161:0/1208407544 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8031930 con 0x7f9ab8143c40 2023-11-24T08:05:31.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab759e640 1 -- 172.21.15.161:0/1208407544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab8143c40 msgr2=0x7f9ab8071290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab759e640 1 --2- 172.21.15.161:0/1208407544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab8143c40 0x7f9ab8071290 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80097a0 tx=0x7f9aa802b840 comp rx=0 tx=0).stop 2023-11-24T08:05:31.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab759e640 1 -- 172.21.15.161:0/1208407544 shutdown_connections 2023-11-24T08:05:31.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab759e640 1 --2- 172.21.15.161:0/1208407544 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab80ccc10 0x7f9ab806d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.720+0000 7f9ab759e640 1 --2- 172.21.15.161:0/1208407544 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab8143c40 0x7f9ab8071290 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.725 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.721+0000 7f9ab759e640 1 -- 172.21.15.161:0/1208407544 >> 172.21.15.161:0/1208407544 conn(0x7f9ab806a800 msgr2=0x7f9ab806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.721+0000 7f9ab759e640 1 -- 172.21.15.161:0/1208407544 shutdown_connections 2023-11-24T08:05:31.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.721+0000 7f9ab759e640 1 -- 172.21.15.161:0/1208407544 wait complete. 2023-11-24T08:05:31.726 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.722+0000 7f9ab759e640 1 Processor -- start 2023-11-24T08:05:31.727 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.723+0000 7f9ab759e640 1 -- start start 2023-11-24T08:05:31.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.723+0000 7f9ab759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab80717d0 0x7f9ab8141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.729 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ab80ccc10 0x7f9ab80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab8143c40 0x7f9ab80b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80b28a0 con 0x7f9ab80717d0 2023-11-24T08:05:31.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab815abb0 con 0x7f9ab80ccc10 2023-11-24T08:05:31.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80b3dc0 con 0x7f9ab8143c40 2023-11-24T08:05:31.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab80717d0 0x7f9ab8141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.730 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab80717d0 0x7f9ab8141e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41816/0 (socket says 172.21.15.161:41816) 2023-11-24T08:05:31.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 -- 172.21.15.161:0/104269533 learned_addr learned my addr 172.21.15.161:0/104269533 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:31.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9aaffff640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ab80ccc10 0x7f9ab80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab6d9d640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab8143c40 0x7f9ab80b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 -- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab8143c40 msgr2=0x7f9ab80b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.731 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab8143c40 0x7f9ab80b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 -- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ab80ccc10 msgr2=0x7f9ab80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ab80ccc10 0x7f9ab80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab659c640 1 -- 172.21.15.161:0/104269533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa8009400 con 0x7f9ab80717d0 2023-11-24T08:05:31.732 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9aaffff640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ab80ccc10 0x7f9ab80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:31.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.724+0000 7f9ab6d9d640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ab8143c40 0x7f9ab80b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:31.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.725+0000 7f9ab659c640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab80717d0 0x7f9ab8141e10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8034040 tx=0x7f9aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.725+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8032900 con 0x7f9ab80717d0 2023-11-24T08:05:31.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.725+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8032a60 con 0x7f9ab80717d0 2023-11-24T08:05:31.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.725+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8032e10 con 0x7f9ab80717d0 2023-11-24T08:05:31.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.725+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab80b1f00 con 0x7f9ab80717d0 2023-11-24T08:05:31.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.725+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab80b24c0 con 0x7f9ab80717d0 2023-11-24T08:05:31.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.726+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ab806cc40 con 0x7f9ab80717d0 2023-11-24T08:05:31.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.727+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f9aa803b3f0 con 0x7f9ab80717d0 2023-11-24T08:05:31.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.728+0000 7f9aaeffd640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a9806b040 0x7f9a9806d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.728+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9aa80ab6a0 con 0x7f9ab80717d0 2023-11-24T08:05:31.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.728+0000 7f9aaeffd640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f9a98070ea0 0x7f9a980732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.728+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 --> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a98073970 con 0x7f9a98070ea0 2023-11-24T08:05:31.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.729+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aa80add90 con 0x7f9ab80717d0 2023-11-24T08:05:31.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.729+0000 7f9aaffff640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a9806b040 0x7f9a9806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.729+0000 7f9ab6d9d640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f9a98070ea0 0x7f9a980732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.730+0000 7f9aaffff640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a9806b040 0x7f9a9806d500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80cb710 tx=0x7f9aa0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.730+0000 7f9ab6d9d640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f9a98070ea0 0x7f9a980732c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.732+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== osd.4 v2:172.21.15.175:6802/972684895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9a98073970 con 0x7f9a98070ea0 2023-11-24T08:05:31.748 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.747+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 --> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9ab806c960 con 0x7f9a98070ea0 2023-11-24T08:05:31.749 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.748+0000 7f9aaeffd640 1 -- 172.21.15.161:0/104269533 <== osd.4 v2:172.21.15.175:6802/972684895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9ab0007ac0 con 0x7f9a98070ea0 2023-11-24T08:05:31.750 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:31.751 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:31.751 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:31.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f9a98070ea0 msgr2=0x7f9a980732c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6802/972684895,v1:172.21.15.175:6803/972684895] conn(0x7f9a98070ea0 0x7f9a980732c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a9806b040 msgr2=0x7f9a9806d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.752 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f9a9806b040 0x7f9a9806d500 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80cb710 tx=0x7f9aa0009040 comp rx=0 tx=0).stop 2023-11-24T08:05:31.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab80717d0 msgr2=0x7f9ab8141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 --2- 172.21.15.161:0/104269533 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ab80717d0 0x7f9ab8141e10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8034040 tx=0x7f9aa80046c0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.753 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab6d9d640 1 -- 172.21.15.161:0/104269533 reap_dead start 2023-11-24T08:05:31.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 shutdown_connections 2023-11-24T08:05:31.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 >> 172.21.15.161:0/104269533 conn(0x7f9ab806a800 msgr2=0x7f9ab813fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 shutdown_connections 2023-11-24T08:05:31.754 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.749+0000 7f9ab759e640 1 -- 172.21.15.161:0/104269533 wait complete. 2023-11-24T08:05:31.767 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T08:05:31.977 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.976+0000 7f87523e3640 1 Processor -- start 2023-11-24T08:05:31.978 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.976+0000 7f87523e3640 1 -- start start 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f87523e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 0x7f874c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f87523e3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f874c15e3b0 0x7f874c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f87523e3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874c0cfc30 con 0x7f874c0cf7d0 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f87523e3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874c0b1ee0 con 0x7f874c15e3b0 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f87523e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0b2780 con 0x7f874c143ae0 2023-11-24T08:05:31.979 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f8743fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f874c0cf7d0 0x7f874c15dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39346/0 (socket says 172.21.15.161:39346) 2023-11-24T08:05:31.980 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f8743fff640 1 -- 172.21.15.161:0/1972841962 learned_addr learned my addr 172.21.15.161:0/1972841962 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.978+0000 7f874bfff640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 0x7f874c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.981 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f8750980640 1 --2- 172.21.15.161:0/1972841962 >> v2:172.21.15.175:3300/0 conn(0x7f874c15e3b0 0x7f874c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885329457 0 0) 0x7f874c0cfc30 con 0x7f874c0cf7d0 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8738003520 con 0x7f874c0cf7d0 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4168874379 0 0) 0x7f8738003520 con 0x7f874c0cf7d0 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 msgr2=0x7f874c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 0x7f874c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.982 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 >> v2:172.21.15.175:3300/0 conn(0x7f874c15e3b0 msgr2=0x7f874c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 --2- 172.21.15.161:0/1972841962 >> v2:172.21.15.175:3300/0 conn(0x7f874c15e3b0 0x7f874c0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c15e990 con 0x7f874c0cf7d0 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f8734001670 con 0x7f874c0cf7d0 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 >> v1:172.21.15.161:6789/0 conn(0x7f874c0cf7d0 legacy=0x7f874c15dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738003970 0x7f8738003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87380047c0 0x7f8738004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 0x7f8738005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0b1ee0 con 0x7f87380047c0 2023-11-24T08:05:31.983 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0b2780 con 0x7f8738003970 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873800b980 con 0x7f874c143ae0 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.979+0000 7f8743fff640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87380047c0 0x7f8738004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.980+0000 7f874bfff640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738003970 0x7f8738003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.980+0000 7f8743fff640 1 -- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 msgr2=0x7f8738005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.980+0000 7f8743fff640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c143ae0 0x7f8738005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.980+0000 7f8743fff640 1 -- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738003970 msgr2=0x7f8738003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.980+0000 7f8743fff640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8738003970 0x7f8738003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.984 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.980+0000 7f8743fff640 1 -- 172.21.15.161:0/1972841962 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8738003520 con 0x7f87380047c0 2023-11-24T08:05:31.988 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.981+0000 7f8743fff640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87380047c0 0x7f8738004c40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f873400c210 tx=0x7f87380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6a0affa44b4f8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.981+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873402cae0 con 0x7f87380047c0 2023-11-24T08:05:31.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.981+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873402cc40 con 0x7f87380047c0 2023-11-24T08:05:31.989 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.981+0000 7f874b7fe640 1 -- 172.21.15.161:0/1972841962 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340058d0 con 0x7f87380047c0 2023-11-24T08:05:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f87523e3640 1 -- 172.21.15.161:0/1972841962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87380047c0 msgr2=0x7f8738004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f87523e3640 1 --2- 172.21.15.161:0/1972841962 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87380047c0 0x7f8738004c40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f873400c210 tx=0x7f87380057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f8750980640 1 -- 172.21.15.161:0/1972841962 reap_dead start 2023-11-24T08:05:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f87523e3640 1 -- 172.21.15.161:0/1972841962 shutdown_connections 2023-11-24T08:05:31.990 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f87523e3640 1 -- 172.21.15.161:0/1972841962 >> 172.21.15.161:0/1972841962 conn(0x7f874c06a800 msgr2=0x7f874c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f87523e3640 1 -- 172.21.15.161:0/1972841962 shutdown_connections 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.982+0000 7f87523e3640 1 -- 172.21.15.161:0/1972841962 wait complete. 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.984+0000 7f87523e3640 1 Processor -- start 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.984+0000 7f87523e3640 1 -- start start 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f87523e3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87380047c0 0x7f874c141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f87523e3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 0x7f874c1f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f87523e3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c0cdd30 0x7f874c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.991 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f87523e3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c0c5a90 con 0x7f874c1f26f0 2023-11-24T08:05:31.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f87523e3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c1f3e50 con 0x7f87380047c0 2023-11-24T08:05:31.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f87523e3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c1f3720 con 0x7f874c0cdd30 2023-11-24T08:05:31.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f8743fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 0x7f874c1f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f8743fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 0x7f874c1f3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41846/0 (socket says 172.21.15.161:41846) 2023-11-24T08:05:31.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.985+0000 7f8743fff640 1 -- 172.21.15.161:0/3776171741 learned_addr learned my addr 172.21.15.161:0/3776171741 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:31.992 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8750980640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c0cdd30 0x7f874c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f874bfff640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87380047c0 0x7f874c141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8743fff640 1 -- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c0cdd30 msgr2=0x7f874c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8743fff640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c0cdd30 0x7f874c15b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8743fff640 1 -- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87380047c0 msgr2=0x7f874c141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8743fff640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87380047c0 0x7f874c141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8743fff640 1 -- 172.21.15.161:0/3776171741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c1f2ba0 con 0x7f874c1f26f0 2023-11-24T08:05:31.993 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f8743fff640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 0x7f874c1f3910 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f873400c210 tx=0x7f874c0b26f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.986+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734039070 con 0x7f874c1f26f0 2023-11-24T08:05:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.987+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734001630 con 0x7f874c1f26f0 2023-11-24T08:05:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.987+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874c1f2e80 con 0x7f874c1f26f0 2023-11-24T08:05:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.987+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873403c040 con 0x7f874c1f26f0 2023-11-24T08:05:31.994 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.987+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874c1f3440 con 0x7f874c1f26f0 2023-11-24T08:05:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.988+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874c0675d0 con 0x7f874c1f26f0 2023-11-24T08:05:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.989+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8734032070 con 0x7f874c1f26f0 2023-11-24T08:05:31.995 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.990+0000 7f87497fa640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f872c06af80 0x7f872c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:31.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.990+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f87340aacb0 con 0x7f874c1f26f0 2023-11-24T08:05:31.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.991+0000 7f874bfff640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f872c06af80 0x7f872c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:31.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.992+0000 7f874bfff640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f872c06af80 0x7f872c06d440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f874c15d3f0 tx=0x7f873c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:31.996 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:31.994+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8734075d40 con 0x7f874c1f26f0 2023-11-24T08:05:32.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.185+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f874c0b2410 con 0x7f872c06af80 2023-11-24T08:05:32.188 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.187+0000 7f87497fa640 1 -- 172.21.15.161:0/3776171741 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f873c009e20 con 0x7f872c06af80 2023-11-24T08:05:32.188 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T08:05:32.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f872c06af80 msgr2=0x7f872c06d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f872c06af80 0x7f872c06d440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f874c15d3f0 tx=0x7f873c008040 comp rx=0 tx=0).stop 2023-11-24T08:05:32.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 msgr2=0x7f874c1f3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 0x7f874c1f3910 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f873400c210 tx=0x7f874c0b26f0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 shutdown_connections 2023-11-24T08:05:32.191 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f872c06af80 0x7f872c06d440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f874c0cdd30 0x7f874c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f874c1f26f0 0x7f874c1f3910 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 --2- 172.21.15.161:0/3776171741 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87380047c0 0x7f874c141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.189+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 >> 172.21.15.161:0/3776171741 conn(0x7f874c06a800 msgr2=0x7f874c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.190+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 shutdown_connections 2023-11-24T08:05:32.192 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.190+0000 7f87523e3640 1 -- 172.21.15.161:0/3776171741 wait complete. 2023-11-24T08:05:32.211 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T08:05:32.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:32.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.424+0000 7fcc0af01640 1 Processor -- start 2023-11-24T08:05:32.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.424+0000 7fcc0af01640 1 -- start start 2023-11-24T08:05:32.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.425+0000 7fcc0af01640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcc040cf9a0 0x7fcc04166030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.425+0000 7fcc0af01640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0415c5f0 con 0x7fcc0413e360 2023-11-24T08:05:32.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.425+0000 7fcc0af01640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0406c470 con 0x7fcc0413df80 2023-11-24T08:05:32.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.425+0000 7fcc0af01640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0406c750 con 0x7fcc040cf9a0 2023-11-24T08:05:32.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.426+0000 7fcc03fff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fcc0413e360 0x7fcc040cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39360/0 (socket says 172.21.15.161:39360) 2023-11-24T08:05:32.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.426+0000 7fcc03fff640 1 -- 172.21.15.161:0/2832819035 learned_addr learned my addr 172.21.15.161:0/2832819035 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.426+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2832819035 >> v2:172.21.15.175:3300/0 conn(0x7fcc040cf9a0 0x7fcc04166030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.426+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238669784 0 0) 0x7fcc0415c5f0 con 0x7fcc0413e360 2023-11-24T08:05:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.426+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf4003520 con 0x7fcc0413e360 2023-11-24T08:05:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2438366110 0 0) 0x7fcbf4003520 con 0x7fcc0413e360 2023-11-24T08:05:32.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 >> v2:172.21.15.175:3300/0 conn(0x7fcc040cf9a0 msgr2=0x7fcc04166030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 --2- 172.21.15.161:0/2832819035 >> v2:172.21.15.175:3300/0 conn(0x7fcc040cf9a0 0x7fcc04166030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 >> v1:172.21.15.175:6789/0 conn(0x7fcc0413df80 legacy=0x7fcc0415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0406ca30 con 0x7fcc0413e360 2023-11-24T08:05:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fcbf0001670 con 0x7fcc0413e360 2023-11-24T08:05:32.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 >> v1:172.21.15.161:6789/0 conn(0x7fcc0413e360 legacy=0x7fcc040cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf40039c0 0x7fcbf4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbf40047c0 0x7fcbf4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4005180 0x7fcbf400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0406c750 con 0x7fcbf4005180 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf400c080 con 0x7fcbf40039c0 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf400c240 con 0x7fcbf40047c0 2023-11-24T08:05:32.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4005180 0x7fcbf400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.427+0000 7fcc08c9d640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf40039c0 0x7fcbf4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc03fff640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbf40047c0 0x7fcbf4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc0949e640 1 -- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbf40047c0 msgr2=0x7fcbf4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcbf40047c0 0x7fcbf4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc0949e640 1 -- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf40039c0 msgr2=0x7fcbf4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf40039c0 0x7fcbf4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc0949e640 1 -- 172.21.15.161:0/2832819035 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf4003520 con 0x7fcbf4005180 2023-11-24T08:05:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.428+0000 7fcc08c9d640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf40039c0 0x7fcbf4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:32.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.429+0000 7fcc0949e640 1 -- 172.21.15.161:0/2832819035 reap_dead start 2023-11-24T08:05:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.429+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4005180 0x7fcbf400b980 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009f90 tx=0x7fcbf40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835ecbd97bb98bab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.429+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc02cc20 con 0x7fcbf4005180 2023-11-24T08:05:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.429+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc00f040 con 0x7fcbf4005180 2023-11-24T08:05:32.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.429+0000 7fcc037fe640 1 -- 172.21.15.161:0/2832819035 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc003990 con 0x7fcbf4005180 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 -- 172.21.15.161:0/2832819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4005180 msgr2=0x7fcbf400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4005180 0x7fcbf400b980 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009f90 tx=0x7fcbf40057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 -- 172.21.15.161:0/2832819035 shutdown_connections 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 --2- 172.21.15.161:0/2832819035 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbf4005180 0x7fcbf400b980 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 -- 172.21.15.161:0/2832819035 >> 172.21.15.161:0/2832819035 conn(0x7fcc0406a800 msgr2=0x7fcc0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 -- 172.21.15.161:0/2832819035 shutdown_connections 2023-11-24T08:05:32.440 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.430+0000 7fcc0af01640 1 -- 172.21.15.161:0/2832819035 wait complete. 2023-11-24T08:05:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.432+0000 7fcc0af01640 1 Processor -- start 2023-11-24T08:05:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.432+0000 7fcc0af01640 1 -- start start 2023-11-24T08:05:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0af01640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf4005180 0x7fcc041f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.441 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0af01640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc0412ef00 0x7fcc040af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0af01640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc040af930 0x7fcc041f0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0af01640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc040afd90 con 0x7fcc040af930 2023-11-24T08:05:32.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0af01640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041f0a30 con 0x7fcbf4005180 2023-11-24T08:05:32.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0af01640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc041f4dd0 con 0x7fcc0412ef00 2023-11-24T08:05:32.442 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0949e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc040af930 0x7fcc041f0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0949e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc040af930 0x7fcc041f0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41872/0 (socket says 172.21.15.161:41872) 2023-11-24T08:05:32.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc0949e640 1 -- 172.21.15.161:0/2373710071 learned_addr learned my addr 172.21.15.161:0/2373710071 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:32.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc08c9d640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf4005180 0x7fcc041f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.443 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.433+0000 7fcc03fff640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc0412ef00 0x7fcc040af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0949e640 1 -- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc0412ef00 msgr2=0x7fcc040af3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc0412ef00 0x7fcc040af3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0949e640 1 -- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf4005180 msgr2=0x7fcc041f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcbf4005180 0x7fcc041f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0949e640 1 -- 172.21.15.161:0/2373710071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0412f4c0 con 0x7fcc040af930 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc03fff640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc0412ef00 0x7fcc040af3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0949e640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc040af930 0x7fcc041f0ec0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e200 tx=0x7fcbfc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.444 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc004230 con 0x7fcc040af930 2023-11-24T08:05:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbfc004390 con 0x7fcc040af930 2023-11-24T08:05:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc004740 con 0x7fcc040af930 2023-11-24T08:05:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0412f7a0 con 0x7fcc040af930 2023-11-24T08:05:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.434+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0412fd60 con 0x7fcc040af930 2023-11-24T08:05:32.445 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.435+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc0406cff0 con 0x7fcc040af930 2023-11-24T08:05:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.436+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fcbfc03f470 con 0x7fcc040af930 2023-11-24T08:05:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.437+0000 7fcc017fa640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcbe806b020 0x7fcbe806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.437+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcbfc0abe90 con 0x7fcc040af930 2023-11-24T08:05:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.438+0000 7fcc017fa640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fcbe8070e80 0x7fcbe80732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.438+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 --> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcbe8073950 con 0x7fcbe8070e80 2023-11-24T08:05:32.446 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.438+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbfc0ae530 con 0x7fcc040af930 2023-11-24T08:05:32.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.438+0000 7fcc08c9d640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcbe806b020 0x7fcbe806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.438+0000 7fcc03fff640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fcbe8070e80 0x7fcbe80732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.439+0000 7fcc08c9d640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcbe806b020 0x7fcbe806d4e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8000c00 tx=0x7fcbf8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.447 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.439+0000 7fcc03fff640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fcbe8070e80 0x7fcbe80732a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.448 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.441+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== osd.5 v2:172.21.15.175:6812/1039296029 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcbe8073950 con 0x7fcbe8070e80 2023-11-24T08:05:32.457 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.456+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 --> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcc041f0ba0 con 0x7fcbe8070e80 2023-11-24T08:05:32.458 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc017fa640 1 -- 172.21.15.161:0/2373710071 <== osd.5 v2:172.21.15.175:6812/1039296029 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcc041f0ba0 con 0x7fcbe8070e80 2023-11-24T08:05:32.458 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:32.458 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:32.459 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:32.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fcbe8070e80 msgr2=0x7fcbe80732a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0af01640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6812/1039296029,v1:172.21.15.175:6816/1039296029] conn(0x7fcbe8070e80 0x7fcbe80732a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcbe806b020 msgr2=0x7fcbe806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.460 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0af01640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fcbe806b020 0x7fcbe806d4e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8000c00 tx=0x7fcbf8009040 comp rx=0 tx=0).stop 2023-11-24T08:05:32.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc040af930 msgr2=0x7fcc041f0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0af01640 1 --2- 172.21.15.161:0/2373710071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcc040af930 0x7fcc041f0ec0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00e200 tx=0x7fcbfc009750 comp rx=0 tx=0).stop 2023-11-24T08:05:32.461 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.457+0000 7fcc0949e640 1 -- 172.21.15.161:0/2373710071 reap_dead start 2023-11-24T08:05:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.458+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 shutdown_connections 2023-11-24T08:05:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.458+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 >> 172.21.15.161:0/2373710071 conn(0x7fcc0406a800 msgr2=0x7fcc0415da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.458+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 shutdown_connections 2023-11-24T08:05:32.462 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.458+0000 7fcc0af01640 1 -- 172.21.15.161:0/2373710071 wait complete. 2023-11-24T08:05:32.476 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T08:05:32.682 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.681+0000 7fc484993640 1 Processor -- start 2023-11-24T08:05:32.683 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.682+0000 7fc484993640 1 -- start start 2023-11-24T08:05:32.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc484993640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc480160920 0x7fc4800b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc484993640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 0x7fc480161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.684 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc484993640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4800d0a10 con 0x7fc4800cf9f0 2023-11-24T08:05:32.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc484993640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4800d0330 con 0x7fc480160920 2023-11-24T08:05:32.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc484993640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800d1f50 con 0x7fc4800cfea0 2023-11-24T08:05:32.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc47effd640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc4800cf9f0 0x7fc480161010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39364/0 (socket says 172.21.15.161:39364) 2023-11-24T08:05:32.685 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.683+0000 7fc47effd640 1 -- 172.21.15.161:0/2136716461 learned_addr learned my addr 172.21.15.161:0/2136716461 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:32.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47ffff640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 0x7fc480161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.687 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82077143 0 0) 0x7fc4800d0a10 con 0x7fc4800cf9f0 2023-11-24T08:05:32.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc46c003520 con 0x7fc4800cf9f0 2023-11-24T08:05:32.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47f7fe640 1 --2- 172.21.15.161:0/2136716461 >> v2:172.21.15.175:3300/0 conn(0x7fc480160920 0x7fc4800b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3490568055 0 0) 0x7fc46c003520 con 0x7fc4800cf9f0 2023-11-24T08:05:32.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 msgr2=0x7fc480161720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.688 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 0x7fc480161720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 >> v2:172.21.15.175:3300/0 conn(0x7fc480160920 msgr2=0x7fc4800b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 --2- 172.21.15.161:0/2136716461 >> v2:172.21.15.175:3300/0 conn(0x7fc480160920 0x7fc4800b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800cf080 con 0x7fc4800cf9f0 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fc468001670 con 0x7fc4800cf9f0 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 >> v1:172.21.15.161:6789/0 conn(0x7fc4800cf9f0 legacy=0x7fc480161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c003970 0x7fc46c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.689 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc46c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.684+0000 7fc47e7fc640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 0x7fc46c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800d0330 con 0x7fc46c0047c0 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800d1f50 con 0x7fc46c003970 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c00b980 con 0x7fc4800cfea0 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47effd640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc46c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47f7fe640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c003970 0x7fc46c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.690 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47effd640 1 -- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 msgr2=0x7fc46c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47effd640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800cfea0 0x7fc46c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47effd640 1 -- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c003970 msgr2=0x7fc46c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:32.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47effd640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c003970 0x7fc46c003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.685+0000 7fc47effd640 1 -- 172.21.15.161:0/2136716461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c003520 con 0x7fc46c0047c0 2023-11-24T08:05:32.691 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.686+0000 7fc47effd640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc46c004c40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc46800c210 tx=0x7fc46c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd2dd65a640a8bc server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.686+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468005ad0 con 0x7fc46c0047c0 2023-11-24T08:05:32.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.686+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc468005c30 con 0x7fc46c0047c0 2023-11-24T08:05:32.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.686+0000 7fc47e7fc640 1 -- 172.21.15.161:0/2136716461 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46802c8d0 con 0x7fc46c0047c0 2023-11-24T08:05:32.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc484993640 1 -- 172.21.15.161:0/2136716461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 msgr2=0x7fc46c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc484993640 1 --2- 172.21.15.161:0/2136716461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc46c004c40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fc46800c210 tx=0x7fc46c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.694 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc47ffff640 1 -- 172.21.15.161:0/2136716461 reap_dead start 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc484993640 1 -- 172.21.15.161:0/2136716461 shutdown_connections 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc484993640 1 -- 172.21.15.161:0/2136716461 >> 172.21.15.161:0/2136716461 conn(0x7fc4800d3090 msgr2=0x7fc4800d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc484993640 1 -- 172.21.15.161:0/2136716461 shutdown_connections 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.687+0000 7fc484993640 1 -- 172.21.15.161:0/2136716461 wait complete. 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.689+0000 7fc484993640 1 Processor -- start 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.689+0000 7fc484993640 1 -- start start 2023-11-24T08:05:32.695 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc484993640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc4801f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc484993640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800b6660 0x7fc4800cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc484993640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4800c8910 0x7fc4800c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc484993640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800c92d0 con 0x7fc46c0047c0 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc484993640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc480157eb0 con 0x7fc4800c8910 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc484993640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4800b77e0 con 0x7fc4800b6660 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc47f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc4801f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc47f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc4801f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41878/0 (socket says 172.21.15.161:41878) 2023-11-24T08:05:32.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.690+0000 7fc47f7fe640 1 -- 172.21.15.161:0/3477326466 learned_addr learned my addr 172.21.15.161:0/3477326466 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47effd640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800b6660 0x7fc4800cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47ffff640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4800c8910 0x7fc4800c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47f7fe640 1 -- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800b6660 msgr2=0x7fc4800cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47f7fe640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800b6660 0x7fc4800cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47f7fe640 1 -- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4800c8910 msgr2=0x7fc4800c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47f7fe640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4800c8910 0x7fc4800c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.697 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47f7fe640 1 -- 172.21.15.161:0/3477326466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4800b6bd0 con 0x7fc46c0047c0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc47f7fe640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc4801f5ab0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc470007f20 tx=0x7fc47000f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700145f0 con 0x7fc46c0047c0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470014750 con 0x7fc46c0047c0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470014b00 con 0x7fc46c0047c0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4800b6eb0 con 0x7fc46c0047c0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.691+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4800b7470 con 0x7fc46c0047c0 2023-11-24T08:05:32.698 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.693+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4800b7630 con 0x7fc46c0047c0 2023-11-24T08:05:32.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.693+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fc470014c60 con 0x7fc46c0047c0 2023-11-24T08:05:32.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.694+0000 7fc477fff640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46006b020 0x7fc46006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:32.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.694+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc47008a670 con 0x7fc46c0047c0 2023-11-24T08:05:32.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.695+0000 7fc47effd640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46006b020 0x7fc46006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:32.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.696+0000 7fc47effd640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46006b020 0x7fc46006d4e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc468034000 tx=0x7fc468007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:32.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.699+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc470055560 con 0x7fc46c0047c0 2023-11-24T08:05:32.891 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.890+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4800ceac0 con 0x7fc46006b020 2023-11-24T08:05:32.892 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.891+0000 7fc477fff640 1 -- 172.21.15.161:0/3477326466 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc468001430 con 0x7fc46006b020 2023-11-24T08:05:32.892 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T08:05:32.894 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46006b020 msgr2=0x7fc46006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46006b020 0x7fc46006d4e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc468034000 tx=0x7fc468007000 comp rx=0 tx=0).stop 2023-11-24T08:05:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 msgr2=0x7fc4801f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc4801f5ab0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc470007f20 tx=0x7fc47000f5e0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.895 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 shutdown_connections 2023-11-24T08:05:32.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fc46006b020 0x7fc46006d4e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4800c8910 0x7fc4800c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800b6660 0x7fc4800cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.896 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 --2- 172.21.15.161:0/3477326466 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc46c0047c0 0x7fc4801f5ab0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:32.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.893+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 >> 172.21.15.161:0/3477326466 conn(0x7fc4800d3090 msgr2=0x7fc4800cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:32.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.894+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 shutdown_connections 2023-11-24T08:05:32.897 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:32.894+0000 7fc484993640 1 -- 172.21.15.161:0/3477326466 wait complete. 2023-11-24T08:05:32.914 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T08:05:32.996 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:33.224 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.223+0000 7fe5ef1ec640 1 Processor -- start 2023-11-24T08:05:33.225 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.223+0000 7fe5ef1ec640 1 -- start start 2023-11-24T08:05:33.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.225+0000 7fe5ef1ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.226 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.225+0000 7fe5ef1ec640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5e8070490 0x7fe5e8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.225+0000 7fe5ef1ec640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e80cfa70 con 0x7fe5e8099fa0 2023-11-24T08:05:33.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.225+0000 7fe5ef1ec640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e809a410 con 0x7fe5e8070490 2023-11-24T08:05:33.227 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.225+0000 7fe5ef1ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80cff00 con 0x7fe5e815e880 2023-11-24T08:05:33.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.226+0000 7fe5e7fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5e8070490 0x7fe5e8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.228 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.226+0000 7fe5ecf88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.226+0000 7fe5e7fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe5e8070490 0x7fe5e8099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:52584/0 (socket says 172.21.15.161:52584) 2023-11-24T08:05:33.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.226+0000 7fe5e7fff640 1 -- 172.21.15.161:0/129211215 learned_addr learned my addr 172.21.15.161:0/129211215 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:33.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.227+0000 7fe5e7fff640 1 -- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 msgr2=0x7fe5e806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.227+0000 7fe5e7fff640 1 --2- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.229 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.227+0000 7fe5e7fff640 1 -- 172.21.15.161:0/129211215 >> v1:172.21.15.175:6789/0 conn(0x7fe5e8099fa0 legacy=0x7fe5e80cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.230 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.227+0000 7fe5e7fff640 1 -- 172.21.15.161:0/129211215 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e806fc70 con 0x7fe5e8070490 2023-11-24T08:05:33.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.228+0000 7fe5e7fff640 1 --2- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8070490 0x7fe5e8099a60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009870 tx=0x7fe5d402ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98820caca21698fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5e77fe640 1 -- 172.21.15.161:0/129211215 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d402f830 con 0x7fe5e8070490 2023-11-24T08:05:33.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5e77fe640 1 -- 172.21.15.161:0/129211215 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d402f990 con 0x7fe5e8070490 2023-11-24T08:05:33.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5e77fe640 1 -- 172.21.15.161:0/129211215 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d402fd20 con 0x7fe5e8070490 2023-11-24T08:05:33.232 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8070490 msgr2=0x7fe5e8099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 --2- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8070490 0x7fe5e8099a60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009870 tx=0x7fe5d402ba10 comp rx=0 tx=0).stop 2023-11-24T08:05:33.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/129211215 shutdown_connections 2023-11-24T08:05:33.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 --2- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8070490 0x7fe5e8099a60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.233 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 --2- 172.21.15.161:0/129211215 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/129211215 >> 172.21.15.161:0/129211215 conn(0x7fe5e80b2d00 msgr2=0x7fe5e80b3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/129211215 shutdown_connections 2023-11-24T08:05:33.234 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.229+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/129211215 wait complete. 2023-11-24T08:05:33.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.231+0000 7fe5ef1ec640 1 Processor -- start 2023-11-24T08:05:33.239 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.231+0000 7fe5ef1ec640 1 -- start start 2023-11-24T08:05:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.232+0000 7fe5ef1ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5e8070490 0x7fe5e814ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.232+0000 7fe5ef1ec640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8099fa0 0x7fe5e809dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.232+0000 7fe5ef1ec640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e809e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.232+0000 7fe5ef1ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e814dce0 con 0x7fe5e8070490 2023-11-24T08:05:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.232+0000 7fe5ef1ec640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e814dfc0 con 0x7fe5e8099fa0 2023-11-24T08:05:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.232+0000 7fe5ef1ec640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e814e2a0 con 0x7fe5e815e880 2023-11-24T08:05:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5e8070490 0x7fe5e814ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5e8070490 0x7fe5e814ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41890/0 (socket says 172.21.15.161:41890) 2023-11-24T08:05:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 -- 172.21.15.161:0/2068585322 learned_addr learned my addr 172.21.15.161:0/2068585322 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5e7fff640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8099fa0 0x7fe5e809dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ed789640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e809e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 -- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 msgr2=0x7fe5e809e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e809e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 -- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8099fa0 msgr2=0x7fe5e809dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8099fa0 0x7fe5e809dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ecf88640 1 -- 172.21.15.161:0/2068585322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094d0 con 0x7fe5e8070490 2023-11-24T08:05:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5e7fff640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe5e8099fa0 0x7fe5e809dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.233+0000 7fe5ed789640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe5e815e880 0x7fe5e809e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.234+0000 7fe5ecf88640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5e8070490 0x7fe5e814ed80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00e870 tx=0x7fe5dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.234+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc0094f0 con 0x7fe5e8070490 2023-11-24T08:05:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.234+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc00c940 con 0x7fe5e8070490 2023-11-24T08:05:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.234+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e814e580 con 0x7fe5e8070490 2023-11-24T08:05:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.234+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc00ccf0 con 0x7fe5e8070490 2023-11-24T08:05:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.234+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e814f2c0 con 0x7fe5e8070490 2023-11-24T08:05:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.235+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5e814f540 con 0x7fe5e8070490 2023-11-24T08:05:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.236+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fe5dc013470 con 0x7fe5e8070490 2023-11-24T08:05:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.237+0000 7fe5e57fa640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe5cc06aff0 0x7fe5cc06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.237+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5dc0896f0 con 0x7fe5e8070490 2023-11-24T08:05:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.237+0000 7fe5e57fa640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7fe5cc070e50 0x7fe5cc073270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.237+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 --> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5cc073920 con 0x7fe5cc070e50 2023-11-24T08:05:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.237+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5dc08bcd0 con 0x7fe5e8070490 2023-11-24T08:05:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.238+0000 7fe5e7fff640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe5cc06aff0 0x7fe5cc06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.238+0000 7fe5ed789640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7fe5cc070e50 0x7fe5cc073270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.239+0000 7fe5e7fff640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe5cc06aff0 0x7fe5cc06d4b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4036000 tx=0x7fe5d4039040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.239+0000 7fe5ed789640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7fe5cc070e50 0x7fe5cc073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.241+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== osd.6 v2:172.21.15.175:6809/1496030978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fe5cc073920 con 0x7fe5cc070e50 2023-11-24T08:05:33.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.256+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 --> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe5e80c6e80 con 0x7fe5cc070e50 2023-11-24T08:05:33.257 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5e57fa640 1 -- 172.21.15.161:0/2068585322 <== osd.6 v2:172.21.15.175:6809/1496030978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe5e80c6e80 con 0x7fe5cc070e50 2023-11-24T08:05:33.258 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:33.258 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:33.258 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7fe5cc070e50 msgr2=0x7fe5cc073270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6809/1496030978,v1:172.21.15.175:6814/1496030978] conn(0x7fe5cc070e50 0x7fe5cc073270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe5cc06aff0 msgr2=0x7fe5cc06d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.259 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fe5cc06aff0 0x7fe5cc06d4b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4036000 tx=0x7fe5d4039040 comp rx=0 tx=0).stop 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5e8070490 msgr2=0x7fe5e814ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 --2- 172.21.15.161:0/2068585322 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe5e8070490 0x7fe5e814ed80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00e870 tx=0x7fe5dc00ed30 comp rx=0 tx=0).stop 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ed789640 1 -- 172.21.15.161:0/2068585322 reap_dead start 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 shutdown_connections 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 >> 172.21.15.161:0/2068585322 conn(0x7fe5e80b2d00 msgr2=0x7fe5e80c7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.257+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 shutdown_connections 2023-11-24T08:05:33.260 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.258+0000 7fe5ef1ec640 1 -- 172.21.15.161:0/2068585322 wait complete. 2023-11-24T08:05:33.278 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T08:05:33.491 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.490+0000 7f17bb0df640 1 Processor -- start 2023-11-24T08:05:33.492 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.490+0000 7f17bb0df640 1 -- start start 2023-11-24T08:05:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17bb0df640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17b40d0100 0x7f17b40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17bb0df640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17b40d0f40 0x7f17b40d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.493 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17bb0df640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b40d0a10 con 0x7f17b4160920 2023-11-24T08:05:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17bb0df640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b40cf080 con 0x7f17b40d0f40 2023-11-24T08:05:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17bb0df640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b40c6be0 con 0x7f17b40d0100 2023-11-24T08:05:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17ba8de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17b40d0f40 0x7f17b40d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17ba8de640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f17b40d0f40 0x7f17b40d1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41896/0 (socket says 172.21.15.161:41896) 2023-11-24T08:05:33.494 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.492+0000 7f17ba8de640 1 -- 172.21.15.161:0/2755671567 learned_addr learned my addr 172.21.15.161:0/2755671567 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:33.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.493+0000 7f17b98dc640 1 --2- 172.21.15.161:0/2755671567 >> v2:172.21.15.175:3300/0 conn(0x7f17b40d0100 0x7f17b40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.493+0000 7f17ba8de640 1 -- 172.21.15.161:0/2755671567 >> v2:172.21.15.175:3300/0 conn(0x7f17b40d0100 msgr2=0x7f17b40b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.495 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.493+0000 7f17ba8de640 1 --2- 172.21.15.161:0/2755671567 >> v2:172.21.15.175:3300/0 conn(0x7f17b40d0100 0x7f17b40b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.493+0000 7f17ba8de640 1 -- 172.21.15.161:0/2755671567 >> v1:172.21.15.175:6789/0 conn(0x7f17b4160920 legacy=0x7f17b40cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.493+0000 7f17ba8de640 1 -- 172.21.15.161:0/2755671567 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40ce7e0 con 0x7f17b40d0f40 2023-11-24T08:05:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.494+0000 7f17ba8de640 1 --2- 172.21.15.161:0/2755671567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0f40 0x7f17b40d1390 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f17b408c1f0 tx=0x7f17ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3667dd4ae16f9a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.494+0000 7f17b90db640 1 -- 172.21.15.161:0/2755671567 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac031870 con 0x7f17b40d0f40 2023-11-24T08:05:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.494+0000 7f17b90db640 1 -- 172.21.15.161:0/2755671567 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac0319d0 con 0x7f17b40d0f40 2023-11-24T08:05:33.496 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.494+0000 7f17b90db640 1 -- 172.21.15.161:0/2755671567 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac031d60 con 0x7f17b40d0f40 2023-11-24T08:05:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 -- 172.21.15.161:0/2755671567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0f40 msgr2=0x7f17b40d1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2755671567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0f40 0x7f17b40d1390 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f17b408c1f0 tx=0x7f17ac02b910 comp rx=0 tx=0).stop 2023-11-24T08:05:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 -- 172.21.15.161:0/2755671567 shutdown_connections 2023-11-24T08:05:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2755671567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0f40 0x7f17b40d1390 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.497 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2755671567 >> v2:172.21.15.175:3300/0 conn(0x7f17b40d0100 0x7f17b40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 -- 172.21.15.161:0/2755671567 >> 172.21.15.161:0/2755671567 conn(0x7f17b40d3090 msgr2=0x7f17b40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 -- 172.21.15.161:0/2755671567 shutdown_connections 2023-11-24T08:05:33.498 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.495+0000 7f17bb0df640 1 -- 172.21.15.161:0/2755671567 wait complete. 2023-11-24T08:05:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.497+0000 7f17bb0df640 1 Processor -- start 2023-11-24T08:05:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.497+0000 7f17bb0df640 1 -- start start 2023-11-24T08:05:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17bb0df640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 0x7f17b415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.499 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17bb0df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17b40d0f40 0x7f17b41f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17bb0df640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17b4160920 0x7f17b40b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17bb0df640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b41f3c60 con 0x7f17b40d0100 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17bb0df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40b88e0 con 0x7f17b40d0f40 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17bb0df640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40ca7b0 con 0x7f17b4160920 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17ba0dd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 0x7f17b415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17ba0dd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 0x7f17b415b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41898/0 (socket says 172.21.15.161:41898) 2023-11-24T08:05:33.500 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.498+0000 7f17ba0dd640 1 -- 172.21.15.161:0/2056193774 learned_addr learned my addr 172.21.15.161:0/2056193774 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17b98dc640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17b40d0f40 0x7f17b41f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba8de640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17b4160920 0x7f17b40b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba0dd640 1 -- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17b4160920 msgr2=0x7f17b40b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba0dd640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17b4160920 0x7f17b40b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.502 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba0dd640 1 -- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17b40d0f40 msgr2=0x7f17b41f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba0dd640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17b40d0f40 0x7f17b41f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba0dd640 1 -- 172.21.15.161:0/2056193774 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac0094d0 con 0x7f17b40d0100 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17ba0dd640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 0x7f17b415b480 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f17a800ba50 tx=0x7f17a800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800cbe0 con 0x7f17b40d0100 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a800cd80 con 0x7f17b40d0100 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8014680 con 0x7f17b40d0100 2023-11-24T08:05:33.503 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.499+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b40caa90 con 0x7f17b40d0100 2023-11-24T08:05:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.500+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b40b7a50 con 0x7f17b40d0100 2023-11-24T08:05:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.501+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b40cafb0 con 0x7f17b40d0100 2023-11-24T08:05:33.504 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.502+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f17a80147e0 con 0x7f17b40d0100 2023-11-24T08:05:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.502+0000 7f17b2ffd640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f179806b020 0x7f179806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.503+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17a80894c0 con 0x7f17b40d0100 2023-11-24T08:05:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.503+0000 7f17b98dc640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f179806b020 0x7f179806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.504+0000 7f17b98dc640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f179806b020 0x7f179806d4e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f17b4067b80 tx=0x7f17a0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.508 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.507+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17b40cafb0 con 0x7f17b40d0100 2023-11-24T08:05:33.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.694+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b4160d00 con 0x7f179806b020 2023-11-24T08:05:33.696 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.695+0000 7f17b2ffd640 1 -- 172.21.15.161:0/2056193774 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f17a000b200 con 0x7f179806b020 2023-11-24T08:05:33.697 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T08:05:33.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f179806b020 msgr2=0x7f179806d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f179806b020 0x7f179806d4e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f17b4067b80 tx=0x7f17a0008040 comp rx=0 tx=0).stop 2023-11-24T08:05:33.699 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 msgr2=0x7f17b415b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 0x7f17b415b480 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f17a800ba50 tx=0x7f17a800bf10 comp rx=0 tx=0).stop 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 shutdown_connections 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f179806b020 0x7f179806d4e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17b4160920 0x7f17b40b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17b40d0f40 0x7f17b41f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 --2- 172.21.15.161:0/2056193774 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f17b40d0100 0x7f17b415b480 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.700 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 >> 172.21.15.161:0/2056193774 conn(0x7f17b40d3090 msgr2=0x7f17b406aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 shutdown_connections 2023-11-24T08:05:33.701 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.698+0000 7f17bb0df640 1 -- 172.21.15.161:0/2056193774 wait complete. 2023-11-24T08:05:33.716 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T08:05:33.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T08:05:33.929 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.928+0000 7fb12fbbe640 1 Processor -- start 2023-11-24T08:05:33.930 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.929+0000 7fb12fbbe640 1 -- start start 2023-11-24T08:05:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12fbbe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb1280cf9a0 0x7fb12815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.933 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12fbbe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815e1e0 0x7fb1280702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12fbbe640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1280b1ee0 con 0x7fb128143ae0 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12fbbe640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1280b2780 con 0x7fb1280cf9a0 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12fbbe640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815e990 con 0x7fb12815e1e0 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12d95a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fb128143ae0 0x7fb1280cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:39374/0 (socket says 172.21.15.161:39374) 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.930+0000 7fb12d95a640 1 -- 172.21.15.161:0/3845731679 learned_addr learned my addr 172.21.15.161:0/3845731679 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013758626 0 0) 0x7fb1280b1ee0 con 0x7fb128143ae0 2023-11-24T08:05:33.934 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb114003520 con 0x7fb128143ae0 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12d159640 1 --2- 172.21.15.161:0/3845731679 >> v2:172.21.15.175:3300/0 conn(0x7fb1280cf9a0 0x7fb12815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12e15b640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815e1e0 0x7fb1280702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1815978562 0 0) 0x7fb114003520 con 0x7fb128143ae0 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815e1e0 msgr2=0x7fb1280702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815e1e0 0x7fb1280702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 >> v2:172.21.15.175:3300/0 conn(0x7fb1280cf9a0 msgr2=0x7fb12815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 --2- 172.21.15.161:0/3845731679 >> v2:172.21.15.175:3300/0 conn(0x7fb1280cf9a0 0x7fb12815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.935 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280b2130 con 0x7fb128143ae0 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7fb1240019f0 con 0x7fb128143ae0 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 >> v1:172.21.15.161:6789/0 conn(0x7fb128143ae0 legacy=0x7fb1280cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb114003970 0x7fb114003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1140047c0 0x7fb114004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb114005180 0x7fb11400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b2780 con 0x7fb114005180 2023-11-24T08:05:33.936 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12815e990 con 0x7fb1140047c0 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11400e1d0 con 0x7fb114003970 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.931+0000 7fb12e15b640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815e1e0 0x7fb1280702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12d159640 1 --2- 172.21.15.161:0/3845731679 >> v2:172.21.15.175:3300/0 conn(0x7fb1280cf9a0 0x7fb12815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12e15b640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb114005180 0x7fb11400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12e15b640 1 -- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb114003970 msgr2=0x7fb114003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12e15b640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb114003970 0x7fb114003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12d159640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1140047c0 0x7fb114004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.937 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12e15b640 1 -- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1140047c0 msgr2=0x7fb114004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:33.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12e15b640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb1140047c0 0x7fb114004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.938 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.932+0000 7fb12e15b640 1 -- 172.21.15.161:0/3845731679 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114003520 con 0x7fb114005180 2023-11-24T08:05:33.940 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.933+0000 7fb12e15b640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb114005180 0x7fb11400db90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb12815e5c0 tx=0x7fb1140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e818310d7b6eb5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120033600 con 0x7fb114005180 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12002f050 con 0x7fb114005180 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12c958640 1 -- 172.21.15.161:0/3845731679 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120033980 con 0x7fb114005180 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12fbbe640 1 -- 172.21.15.161:0/3845731679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb114005180 msgr2=0x7fb11400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12fbbe640 1 --2- 172.21.15.161:0/3845731679 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb114005180 0x7fb11400db90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb12815e5c0 tx=0x7fb1140057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12e15b640 1 -- 172.21.15.161:0/3845731679 reap_dead start 2023-11-24T08:05:33.941 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12fbbe640 1 -- 172.21.15.161:0/3845731679 shutdown_connections 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12fbbe640 1 -- 172.21.15.161:0/3845731679 >> 172.21.15.161:0/3845731679 conn(0x7fb12806a800 msgr2=0x7fb12806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12fbbe640 1 -- 172.21.15.161:0/3845731679 shutdown_connections 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.934+0000 7fb12fbbe640 1 -- 172.21.15.161:0/3845731679 wait complete. 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.936+0000 7fb12fbbe640 1 Processor -- start 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.936+0000 7fb12fbbe640 1 -- start start 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12fbbe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb114005180 0x7fb128159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.942 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12fbbe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815b9e0 0x7fb1280702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12fbbe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12815be60 0x7fb128070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12fbbe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280a8910 con 0x7fb12815be60 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12fbbe640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280a8bf0 con 0x7fb114005180 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12fbbe640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280a8ed0 con 0x7fb12815b9e0 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.937+0000 7fb12e15b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12815be60 0x7fb128070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12815be60 0x7fb128070800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41904/0 (socket says 172.21.15.161:41904) 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 -- 172.21.15.161:0/781726602 learned_addr learned my addr 172.21.15.161:0/781726602 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:33.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12d159640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815b9e0 0x7fb1280702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12d95a640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb114005180 0x7fb128159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 -- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815b9e0 msgr2=0x7fb1280702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815b9e0 0x7fb1280702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 -- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb114005180 msgr2=0x7fb128159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb114005180 0x7fb128159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 -- 172.21.15.161:0/781726602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280a91b0 con 0x7fb12815be60 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12d95a640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb114005180 0x7fb128159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.944 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12d159640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb12815b9e0 0x7fb1280702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.938+0000 7fb12e15b640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12815be60 0x7fb128070800 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb1200097f0 tx=0x7fb1200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.939+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12003d850 con 0x7fb12815be60 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.939+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12003d9d0 con 0x7fb12815be60 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.939+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280a9490 con 0x7fb12815be60 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.939+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12003dd80 con 0x7fb12815be60 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.939+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1280a86a0 con 0x7fb12815be60 2023-11-24T08:05:33.945 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.940+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb12815e670 con 0x7fb12815be60 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.941+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fb12004b460 con 0x7fb12815be60 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.942+0000 7fb11e7fc640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb10c06b020 0x7fb10c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.942+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb1200ab220 con 0x7fb12815be60 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.942+0000 7fb11e7fc640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7fb10c070e80 0x7fb10c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.942+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 --> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb10c073950 con 0x7fb10c070e80 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.942+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1200ad800 con 0x7fb12815be60 2023-11-24T08:05:33.947 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.942+0000 7fb12d95a640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb10c06b020 0x7fb10c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.943+0000 7fb12d159640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7fb10c070e80 0x7fb10c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.944+0000 7fb12d159640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7fb10c070e80 0x7fb10c0732a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.944+0000 7fb12d95a640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb10c06b020 0x7fb10c06d4e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb124001fe0 tx=0x7fb124009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:33.948 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.946+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== osd.7 v2:172.21.15.175:6806/296022395 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb10c073950 con 0x7fb10c070e80 2023-11-24T08:05:33.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.960+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 --> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1280675d0 con 0x7fb10c070e80 2023-11-24T08:05:33.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb11e7fc640 1 -- 172.21.15.161:0/781726602 <== osd.7 v2:172.21.15.175:6806/296022395 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb1280675d0 con 0x7fb10c070e80 2023-11-24T08:05:33.962 INFO:teuthology.orchestra.run.smithi161.stdout:{ 2023-11-24T08:05:33.962 INFO:teuthology.orchestra.run.smithi161.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T08:05:33.962 INFO:teuthology.orchestra.run.smithi161.stdout:} 2023-11-24T08:05:33.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7fb10c070e80 msgr2=0x7fb10c0732a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb12fbbe640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6806/296022395,v1:172.21.15.175:6808/296022395] conn(0x7fb10c070e80 0x7fb10c0732a0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb10c06b020 msgr2=0x7fb10c06d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb12fbbe640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fb10c06b020 0x7fb10c06d4e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb124001fe0 tx=0x7fb124009040 comp rx=0 tx=0).stop 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12815be60 msgr2=0x7fb128070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.961+0000 7fb12fbbe640 1 --2- 172.21.15.161:0/781726602 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb12815be60 0x7fb128070800 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb1200097f0 tx=0x7fb1200046c0 comp rx=0 tx=0).stop 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.962+0000 7fb12e15b640 1 -- 172.21.15.161:0/781726602 reap_dead start 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.962+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 shutdown_connections 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.962+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 >> 172.21.15.161:0/781726602 conn(0x7fb12806a800 msgr2=0x7fb12806ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:33.964 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.962+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 shutdown_connections 2023-11-24T08:05:33.965 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:33.962+0000 7fb12fbbe640 1 -- 172.21.15.161:0/781726602 wait complete. 2023-11-24T08:05:33.981 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T08:05:34.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.191+0000 7f108eae0640 1 Processor -- start 2023-11-24T08:05:34.193 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.192+0000 7f108eae0640 1 -- start start 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108eae0640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1088144090 0x7f10880cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108eae0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f10880b28a0 0x7f1088144470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108eae0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10881449b0 0x7f108806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108eae0640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10880ce980 con 0x7f1088144090 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108eae0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1088144eb0 con 0x7f10880b28a0 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108eae0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10880cebb0 con 0x7f10881449b0 2023-11-24T08:05:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108c87c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1088144090 0x7f10880cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108c87c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1088144090 0x7f10880cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41914/0 (socket says 172.21.15.161:41914) 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.193+0000 7f108c87c640 1 -- 172.21.15.161:0/1242598059 learned_addr learned my addr 172.21.15.161:0/1242598059 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108d07d640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10881449b0 0x7f108806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f1087fff640 1 --2- 172.21.15.161:0/1242598059 >> v2:172.21.15.175:3300/0 conn(0x7f10880b28a0 0x7f1088144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108c87c640 1 -- 172.21.15.161:0/1242598059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10881449b0 msgr2=0x7f108806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108c87c640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10881449b0 0x7f108806a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108c87c640 1 -- 172.21.15.161:0/1242598059 >> v2:172.21.15.175:3300/0 conn(0x7f10880b28a0 msgr2=0x7f1088144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108c87c640 1 --2- 172.21.15.161:0/1242598059 >> v2:172.21.15.175:3300/0 conn(0x7f10880b28a0 0x7f1088144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108c87c640 1 -- 172.21.15.161:0/1242598059 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880cee90 con 0x7f1088144090 2023-11-24T08:05:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f108d07d640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10881449b0 0x7f108806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.194+0000 7f1087fff640 1 --2- 172.21.15.161:0/1242598059 >> v2:172.21.15.175:3300/0 conn(0x7f10880b28a0 0x7f1088144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:34.198 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.195+0000 7f108c87c640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1088144090 0x7f10880cf970 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f108806c990 tx=0x7f107802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153edb52ce673670 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.195+0000 7f10877fe640 1 -- 172.21.15.161:0/1242598059 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107802ca80 con 0x7f1088144090 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.195+0000 7f10877fe640 1 -- 172.21.15.161:0/1242598059 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107802cbe0 con 0x7f1088144090 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.195+0000 7f10877fe640 1 -- 172.21.15.161:0/1242598059 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780343f0 con 0x7f1088144090 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 -- 172.21.15.161:0/1242598059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1088144090 msgr2=0x7f10880cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1088144090 0x7f10880cf970 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f108806c990 tx=0x7f107802bee0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 -- 172.21.15.161:0/1242598059 shutdown_connections 2023-11-24T08:05:34.199 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10881449b0 0x7f108806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 --2- 172.21.15.161:0/1242598059 >> v2:172.21.15.175:3300/0 conn(0x7f10880b28a0 0x7f1088144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 --2- 172.21.15.161:0/1242598059 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1088144090 0x7f10880cf970 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 -- 172.21.15.161:0/1242598059 >> 172.21.15.161:0/1242598059 conn(0x7f10880b1c60 msgr2=0x7f10880b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 -- 172.21.15.161:0/1242598059 shutdown_connections 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.196+0000 7f108eae0640 1 -- 172.21.15.161:0/1242598059 wait complete. 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.198+0000 7f108eae0640 1 Processor -- start 2023-11-24T08:05:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.198+0000 7f108eae0640 1 -- start start 2023-11-24T08:05:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108eae0640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 0x7f1088153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108eae0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1088144090 0x7f108813d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108eae0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10881449b0 0x7f10881410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108eae0640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108815b7d0 con 0x7f10880b28a0 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108eae0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108813d8a0 con 0x7f10881449b0 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108eae0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108815ba20 con 0x7f1088144090 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 0x7f1088153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 0x7f1088153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41918/0 (socket says 172.21.15.161:41918) 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 -- 172.21.15.161:0/2472061623 learned_addr learned my addr 172.21.15.161:0/2472061623 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 -- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1088144090 msgr2=0x7f108813d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f1087fff640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1088144090 0x7f108813d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108d07d640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10881449b0 0x7f10881410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1088144090 0x7f108813d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 -- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10881449b0 msgr2=0x7f10881410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10881449b0 0x7f10881410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108c87c640 1 -- 172.21.15.161:0/2472061623 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1078009b30 con 0x7f10880b28a0 2023-11-24T08:05:34.204 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.199+0000 7f108d07d640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10881449b0 0x7f10881410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.200+0000 7f108c87c640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 0x7f1088153c90 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1078000f80 tx=0x7f1078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.200+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107803e450 con 0x7f10880b28a0 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.200+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107803e5f0 con 0x7f10880b28a0 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.200+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108815bd00 con 0x7f10880b28a0 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.200+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107803e9a0 con 0x7f10880b28a0 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.200+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108813d550 con 0x7f10880b28a0 2023-11-24T08:05:34.205 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.201+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10880675d0 con 0x7f10880b28a0 2023-11-24T08:05:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.202+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f107802cd50 con 0x7f10880b28a0 2023-11-24T08:05:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.203+0000 7f10857fa640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f106806aff0 0x7f106806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.206 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.203+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f10780ac180 con 0x7f10880b28a0 2023-11-24T08:05:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.204+0000 7f1087fff640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f106806aff0 0x7f106806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.205+0000 7f1087fff640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f106806aff0 0x7f106806d4b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1070006fd0 tx=0x7f1070008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.207+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1078077340 con 0x7f10880b28a0 2023-11-24T08:05:34.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.396+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f1088066da0 con 0x7f106806aff0 2023-11-24T08:05:34.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.397+0000 7f10857fa640 1 -- 172.21.15.161:0/2472061623 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1088066da0 con 0x7f106806aff0 2023-11-24T08:05:34.399 INFO:teuthology.orchestra.run.smithi161.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T08:05:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f106806aff0 msgr2=0x7f106806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f106806aff0 0x7f106806d4b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1070006fd0 tx=0x7f1070008040 comp rx=0 tx=0).stop 2023-11-24T08:05:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 msgr2=0x7f1088153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 0x7f1088153c90 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f1078000f80 tx=0x7f1078004a40 comp rx=0 tx=0).stop 2023-11-24T08:05:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 shutdown_connections 2023-11-24T08:05:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f106806aff0 0x7f106806d4b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10881449b0 0x7f10881410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1088144090 0x7f108813d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 --2- 172.21.15.161:0/2472061623 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10880b28a0 0x7f1088153c90 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 >> 172.21.15.161:0/2472061623 conn(0x7f10880b1c60 msgr2=0x7f10880b0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 shutdown_connections 2023-11-24T08:05:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.400+0000 7f108eae0640 1 -- 172.21.15.161:0/2472061623 wait complete. 2023-11-24T08:05:34.420 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:34.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.630+0000 7fbe5ee3d640 1 Processor -- start 2023-11-24T08:05:34.632 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.631+0000 7fbe5ee3d640 1 -- start start 2023-11-24T08:05:34.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5ee3d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5813df80 0x7fbe5815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5ee3d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe5813e360 0x7fbe580cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5ee3d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe5815f9c0 0x7fbe580cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.638 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5ee3d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5806c470 con 0x7fbe5815f9c0 2023-11-24T08:05:34.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5ee3d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5806c750 con 0x7fbe5813e360 2023-11-24T08:05:34.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5ee3d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5806ca30 con 0x7fbe5813df80 2023-11-24T08:05:34.639 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5d3da640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe5815f9c0 0x7fbe580cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.640 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5d3da640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe5815f9c0 0x7fbe580cf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41924/0 (socket says 172.21.15.161:41924) 2023-11-24T08:05:34.641 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.632+0000 7fbe5d3da640 1 -- 172.21.15.161:0/1065818646 learned_addr learned my addr 172.21.15.161:0/1065818646 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:34.642 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5cbd9640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5813df80 0x7fbe5815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe57fff640 1 --2- 172.21.15.161:0/1065818646 >> v2:172.21.15.175:3300/0 conn(0x7fbe5813e360 0x7fbe580cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.643 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5d3da640 1 -- 172.21.15.161:0/1065818646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5813df80 msgr2=0x7fbe5815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5d3da640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5813df80 0x7fbe5815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5d3da640 1 -- 172.21.15.161:0/1065818646 >> v2:172.21.15.175:3300/0 conn(0x7fbe5813e360 msgr2=0x7fbe580cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5d3da640 1 --2- 172.21.15.161:0/1065818646 >> v2:172.21.15.175:3300/0 conn(0x7fbe5813e360 0x7fbe580cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5d3da640 1 -- 172.21.15.161:0/1065818646 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5806cd10 con 0x7fbe5815f9c0 2023-11-24T08:05:34.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe5cbd9640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5813df80 0x7fbe5815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:34.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.633+0000 7fbe57fff640 1 --2- 172.21.15.161:0/1065818646 >> v2:172.21.15.175:3300/0 conn(0x7fbe5813e360 0x7fbe580cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:34.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.634+0000 7fbe5d3da640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5815f9c0 0x7fbe580cf7d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbe580cfed0 tx=0x7fbe5002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d681410625af025 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.634+0000 7fbe577fe640 1 -- 172.21.15.161:0/1065818646 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50031880 con 0x7fbe5815f9c0 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.634+0000 7fbe577fe640 1 -- 172.21.15.161:0/1065818646 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe500319e0 con 0x7fbe5815f9c0 2023-11-24T08:05:34.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.634+0000 7fbe577fe640 1 -- 172.21.15.161:0/1065818646 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe50031d70 con 0x7fbe5815f9c0 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/1065818646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5815f9c0 msgr2=0x7fbe580cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5815f9c0 0x7fbe580cf7d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fbe580cfed0 tx=0x7fbe5002b920 comp rx=0 tx=0).stop 2023-11-24T08:05:34.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/1065818646 shutdown_connections 2023-11-24T08:05:34.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5815f9c0 0x7fbe580cf7d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/1065818646 >> v2:172.21.15.175:3300/0 conn(0x7fbe5813e360 0x7fbe580cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/1065818646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5813df80 0x7fbe5815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/1065818646 >> 172.21.15.161:0/1065818646 conn(0x7fbe5806a800 msgr2=0x7fbe5806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/1065818646 shutdown_connections 2023-11-24T08:05:34.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.635+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/1065818646 wait complete. 2023-11-24T08:05:34.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.637+0000 7fbe5ee3d640 1 Processor -- start 2023-11-24T08:05:34.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.637+0000 7fbe5ee3d640 1 -- start start 2023-11-24T08:05:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5ee3d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 0x7fbe580aa290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5ee3d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe5813e360 0x7fbe58154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5ee3d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5815f9c0 0x7fbe58071310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5ee3d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580a9e70 con 0x7fbe5813df80 2023-11-24T08:05:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5ee3d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580aa7d0 con 0x7fbe5813e360 2023-11-24T08:05:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5ee3d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58154c70 con 0x7fbe5815f9c0 2023-11-24T08:05:34.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 0x7fbe580aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 0x7fbe580aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:41930/0 (socket says 172.21.15.161:41930) 2023-11-24T08:05:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 -- 172.21.15.161:0/169718874 learned_addr learned my addr 172.21.15.161:0/169718874 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 -- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5815f9c0 msgr2=0x7fbe58071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5815f9c0 0x7fbe58071310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 -- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe5813e360 msgr2=0x7fbe58154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe5813e360 0x7fbe58154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.638+0000 7fbe5cbd9640 1 -- 172.21.15.161:0/169718874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe500094d0 con 0x7fbe5813df80 2023-11-24T08:05:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.639+0000 7fbe5cbd9640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 0x7fbe580aa290 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800ce00 tx=0x7fbe4800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.639+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800f890 con 0x7fbe5813df80 2023-11-24T08:05:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.639+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800f9f0 con 0x7fbe5813df80 2023-11-24T08:05:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.639+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800fdc0 con 0x7fbe5813df80 2023-11-24T08:05:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.639+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe580a91f0 con 0x7fbe5813df80 2023-11-24T08:05:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.639+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe580a97b0 con 0x7fbe5813df80 2023-11-24T08:05:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.640+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe580cd480 con 0x7fbe5813df80 2023-11-24T08:05:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.641+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fbe4800b040 con 0x7fbe5813df80 2023-11-24T08:05:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.642+0000 7fbe557fa640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbe3806aff0 0x7fbe3806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.642+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbe4808a250 con 0x7fbe5813df80 2023-11-24T08:05:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.642+0000 7fbe57fff640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbe3806aff0 0x7fbe3806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.644+0000 7fbe57fff640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbe3806aff0 0x7fbe3806d4b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbe581558c0 tx=0x7fbe40008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.646+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe48055140 con 0x7fbe5813df80 2023-11-24T08:05:34.831 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.830+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe581408d0 con 0x7fbe3806aff0 2023-11-24T08:05:34.837 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.836+0000 7fbe557fa640 1 -- 172.21.15.161:0/169718874 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48220 (secure 0 0 0) 0x7fbe4000a4a0 con 0x7fbe3806aff0 2023-11-24T08:05:34.838 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:34.839 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:34.840 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbe3806aff0 msgr2=0x7fbe3806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbe3806aff0 0x7fbe3806d4b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbe581558c0 tx=0x7fbe40008040 comp rx=0 tx=0).stop 2023-11-24T08:05:34.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 msgr2=0x7fbe580aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:34.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 0x7fbe580aa290 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800ce00 tx=0x7fbe4800a650 comp rx=0 tx=0).stop 2023-11-24T08:05:34.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 shutdown_connections 2023-11-24T08:05:34.841 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fbe3806aff0 0x7fbe3806d4b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe5815f9c0 0x7fbe58071310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe5813e360 0x7fbe58154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 --2- 172.21.15.161:0/169718874 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe5813df80 0x7fbe580aa290 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:34.842 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 >> 172.21.15.161:0/169718874 conn(0x7fbe5806a800 msgr2=0x7fbe580afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:34.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 shutdown_connections 2023-11-24T08:05:34.843 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:34.839+0000 7fbe5ee3d640 1 -- 172.21.15.161:0/169718874 wait complete. 2023-11-24T08:05:34.857 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2023-11-24T08:05:34.640603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248220,"kb_used_data":7080,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726500,"statfs":{"total":773094113280,"available":772839936000,"internally_reserved":0,"allocated":7249920,"data_stored":3695616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.999633"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":202,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-11-24T08:05:22.194566+0000","last_change":"2023-11-24T08:00:20.636014+0000","last_active":"2023-11-24T08:05:22.194566+0000","last_peered":"2023-11-24T08:05:22.194566+0000","last_clean":"2023-11-24T08:05:22.194566+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:05:22.194566+0000","last_undegraded":"2023-11-24T08:05:22.194566+0000","last_fullsized":"2023-11-24T08:05:22.194566+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T08:00:19.495427+0000","last_clean_scrub_stamp":"2023-11-24T08:00:19.495427+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:46:46.358402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509507,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.1359999999999999},"min":{"1min":0.75900000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.496,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.107,"15min":1.0609999999999999},"min":{"1min":0.69899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5189999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":0.752}]},{"osd":1,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.175,"15min":1.1659999999999999},"min":{"1min":0.85699999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.506,"5min":1.929,"15min":1.929},"last":1.369},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.143,"15min":1.181},"min":{"1min":0.73599999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.355,"5min":2.02,"15min":2.02},"last":0.90300000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2,"15min":1.1359999999999999},"min":{"1min":0.79600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.331,"5min":1.3660000000000001,"15min":1.3799999999999999},"min":{"1min":0.84899999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.605,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.276}]},{"osd":3,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.2849999999999999,"15min":1.1919999999999999},"min":{"1min":1.0169999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.859,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":0.87},{"interface":"front","average":{"1min":1.415,"5min":1.4199999999999999,"15min":1.4159999999999999},"min":{"1min":0.99299999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8129999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.4590000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.323,"15min":1.385},"min":{"1min":0.755,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5409999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.335},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":1.085,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.599,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":0.97699999999999998}]},{"osd":5,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.446,"15min":1.5249999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.738,"5min":2.504,"15min":2.504},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.472,"15min":1.5169999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.8240000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.413}]},{"osd":6,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.5569999999999999,"15min":1.589},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7889999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.222},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5129999999999999,"15min":1.5189999999999999},"min":{"1min":0.91300000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.925,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.0649999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509506,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.016,"15min":0.95499999999999996},"min":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.429,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.091,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.429,"5min":1.593,"15min":1.593},"last":1.391}]},{"osd":1,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2230000000000001,"15min":1.2030000000000001},"min":{"1min":0.753,"5min":0.622,"15min":0.622},"max":{"1min":1.6040000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.046},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.2430000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.597,"15min":2.597},"last":1.151}]},{"osd":2,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.157,"15min":1.2310000000000001},"min":{"1min":0.87,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.512,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2430000000000001,"15min":1.276},"min":{"1min":0.89700000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.502,"5min":2.831,"15min":2.831},"last":0.98699999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.222,"15min":1.2789999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6619999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.246},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2809999999999999,"15min":1.3},"min":{"1min":0.88300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.7689999999999999,"5min":1.974,"15min":1.974},"last":1.0700000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2709999999999999,"15min":1.345},"min":{"1min":0.82399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.72,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.27,"5min":1.3080000000000001,"15min":1.381},"min":{"1min":0.75,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8200000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.77600000000000002}]},{"osd":5,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4750000000000001,"15min":1.5569999999999999},"min":{"1min":0.80700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6319999999999999,"5min":2.105,"15min":2.105},"last":1.5600000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.47,"15min":1.514},"min":{"1min":0.81499999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8660000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.21}]},{"osd":7,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.496,"15min":1.5820000000000001},"min":{"1min":0.86099999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.964,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4970000000000001,"15min":1.5589999999999999},"min":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0310000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.1299999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.0800000000000001,"15min":1.0720000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6799999999999999,"5min":2.431,"15min":2.431},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0960000000000001,"15min":1.038},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3600000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.079}]},{"osd":1,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.71699999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.3149999999999999,"5min":1.653,"15min":1.653},"last":1.28},{"interface":"front","average":{"1min":1.208,"5min":1.1930000000000001,"15min":1.1899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.6819999999999999,"5min":1.768,"15min":1.768},"last":1.1919999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.587,"5min":1.75,"15min":1.75},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.163,"15min":1.2090000000000001},"min":{"1min":0.63600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4530000000000001,"5min":1.768,"15min":1.768},"last":0.996}]},{"osd":3,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.298,"15min":1.3380000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3620000000000001,"15min":1.3340000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.7849999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.335}]},{"osd":4,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.266,"15min":1.3480000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.7290000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.379},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3740000000000001,"15min":1.49},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.97,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.782}]},{"osd":6,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3939999999999999,"15min":1.4259999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.919,"5min":2.569,"15min":2.569},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.4470000000000001,"15min":1.516},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0049999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.627}]},{"osd":7,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5149999999999999,"15min":1.663},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.056,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.9019999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.5600000000000001,"15min":1.5760000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0150000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.726}]}]},{"osd":3,"up_from":15,"seq":64424509507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.39500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3380000000000001,"5min":1.476,"15min":1.476},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.87,"15min":0.79400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.411,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.83299999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.472,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.0069999999999999,"15min":0.97099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.46,"5min":1.871,"15min":1.871},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0609999999999999,"15min":1.036},"min":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5649999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0940000000000001,"15min":1.028},"min":{"1min":0.52500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5109999999999999,"5min":1.625,"15min":1.625},"last":1.2190000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.163,"15min":1.1220000000000001},"min":{"1min":0.64700000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6759999999999999,"5min":1.875,"15min":1.875},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2110000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.796,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.3380000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.323,"15min":1.2909999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.647,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.3180000000000001,"15min":1.268},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.758,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.044}]},{"osd":6,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.304,"15min":1.262},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.617,"5min":1.861,"15min":1.861},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7150000000000001,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.0720000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.397,"15min":1.327},"min":{"1min":0.79900000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.915,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.119},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3640000000000001,"15min":1.2929999999999999},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.821,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.02}]}]},{"osd":2,"up_from":15,"seq":64424509505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.97799999999999998},"min":{"1min":0.58699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4490000000000001,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.627,"5min":3.343,"15min":3.343},"last":0.76100000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.026,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.497,"15min":0.497},"max":{"1min":1.514,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.0329999999999999,"15min":1.111},"min":{"1min":0.70999999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5109999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0940000000000001,"15min":1.014},"min":{"1min":0.64300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.724,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1699999999999999,"15min":1.2090000000000001},"min":{"1min":0.622,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.629,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":0.85199999999999998}]},{"osd":4,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.458,"15min":1.506},"min":{"1min":0.90900000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7689999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.321,"5min":1.4550000000000001,"15min":1.55},"min":{"1min":0.98199999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.958,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":1.026}]},{"osd":5,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3740000000000001,"15min":1.4890000000000001},"min":{"1min":0.85099999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.897,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.454,"15min":1.3600000000000001},"min":{"1min":1.131,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.859,"5min":12.798,"15min":12.798},"last":1.425}]},{"osd":6,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4670000000000001,"15min":1.417},"min":{"1min":1.042,"5min":0.622,"15min":0.622},"max":{"1min":1.6919999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.403,"5min":1.4390000000000001,"15min":1.5700000000000001},"min":{"1min":1.0489999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.887,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.359}]},{"osd":7,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.492,"15min":1.427},"min":{"1min":0.879,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.766,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":1.5860000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.454,"15min":1.5669999999999999},"min":{"1min":0.999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.925,"5min":6.399,"15min":6.399},"last":1.2529999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0589999999999999,"15min":1.0880000000000001},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0740000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9319999999999999,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.145}]},{"osd":1,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.81799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.71,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.006},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8220000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":0.90400000000000003}]},{"osd":2,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.206,"15min":1.224},"min":{"1min":0.86199999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5600000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.369,"15min":1.427},"min":{"1min":0.93899999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.286}]},{"osd":3,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.85899999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.651,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.218},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3240000000000001,"15min":1.399},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6599999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3500000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.371,"15min":1.4670000000000001},"min":{"1min":0.71299999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.536,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5049999999999999,"15min":1.5109999999999999},"min":{"1min":1.117,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.972,"5min":2.073,"15min":2.073},"last":1.4870000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.407,"15min":1.5149999999999999},"min":{"1min":0.90000000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7729999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.417,"5min":1.466,"15min":1.5800000000000001},"min":{"1min":0.86399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.706,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":1.647}]},{"osd":7,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.52,"15min":1.583},"min":{"1min":1.0920000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.093,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.575,"15min":1.669},"min":{"1min":0.85099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0609999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.4490000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542209,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88400000000000001,"15min":0.93700000000000006},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.4450000000000001,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.466,"5min":3.266,"15min":3.266},"last":0.878}]},{"osd":2,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.874,"15min":0.89900000000000002},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.367,"5min":1.706,"15min":1.706},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.022,"15min":1.1040000000000001},"min":{"1min":0.45200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3380000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":1.105}]},{"osd":3,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1339999999999999,"15min":1.1799999999999999},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5840000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0760000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.137,"5min":1.976,"15min":1.976},"last":1.1830000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2549999999999999,"15min":1.4470000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.488,"5min":4.367,"15min":4.367},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.214,"5min":1.325,"15min":1.417},"min":{"1min":0.73999999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5509999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.4830000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3360000000000001,"15min":1.5189999999999999},"min":{"1min":0.76200000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7210000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":1.153},{"interface":"front","average":{"1min":1.349,"5min":1.427,"15min":1.484},"min":{"1min":0.93400000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.657,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.6140000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6619999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.526},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.47,"15min":1.619},"min":{"1min":0.86399999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7430000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.665}]},{"osd":7,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.768,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4490000000000001,"15min":1.635},"min":{"1min":0.73799999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8160000000000001,"5min":4.452,"15min":4.452},"last":1.7310000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542210,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.83899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.421,"5min":1.46,"15min":1.46},"last":0.83999999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.40400000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2929999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.03},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.391,"5min":1.752,"15min":1.752},"last":1.381}]},{"osd":3,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0629999999999999},"min":{"1min":0.57399999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.593,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.004},{"interface":"front","average":{"1min":1.073,"5min":1.1619999999999999,"15min":1.127},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.139}]},{"osd":4,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.222,"15min":1.226},"min":{"1min":0.72599999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4970000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3,"15min":1.3240000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.7170000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.484},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.9079999999999999,"5min":2.839,"15min":2.839},"last":1.607},{"interface":"front","average":{"1min":1.304,"5min":1.3420000000000001,"15min":1.3799999999999999},"min":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.871,"5min":2.823,"15min":2.823},"last":1.3640000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.304,"15min":1.341},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8500000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.327},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9850000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.8100000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4470000000000001,"15min":1.5049999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.105,"5min":2.875,"15min":2.875},"last":1.9079999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.347,"15min":1.357},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9570000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.429}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:34.861 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T08:00:19.495427+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=0, tm_sec=19, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=8, tm_min=5, tm_sec=27, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T08:05:34.861 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T08:05:40.275 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:40.284 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:05:54.862 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T08:05:55.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.074+0000 7f0455451640 1 Processor -- start 2023-11-24T08:05:55.076 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.074+0000 7f0455451640 1 -- start start 2023-11-24T08:05:55.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.076+0000 7f0455451640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04500ae5a0 0x7f045015e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.076+0000 7f0455451640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0450070c40 con 0x7f04500cf290 2023-11-24T08:05:55.078 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.076+0000 7f0455451640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045006c470 con 0x7f04500b3ae0 2023-11-24T08:05:55.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.076+0000 7f0455451640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0450071450 con 0x7f04500ae5a0 2023-11-24T08:05:55.079 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f04500cf290 0x7f04500b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:56440/0 (socket says 172.21.15.161:56440) 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044f7fe640 1 -- 172.21.15.161:0/2168166304 learned_addr learned my addr 172.21.15.161:0/2168166304 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044effd640 1 --2- 172.21.15.161:0/2168166304 >> v2:172.21.15.161:3300/0 conn(0x7f04500ae5a0 0x7f045015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044e7fc640 1 -- 172.21.15.161:0/2168166304 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112966565 0 0) 0x7f0450070c40 con 0x7f04500cf290 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044e7fc640 1 -- 172.21.15.161:0/2168166304 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f043c003520 con 0x7f04500cf290 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044effd640 1 -- 172.21.15.161:0/2168166304 >> v1:172.21.15.175:6789/0 conn(0x7f04500b3ae0 legacy=0x7f045006cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044effd640 1 -- 172.21.15.161:0/2168166304 >> v1:172.21.15.161:6789/0 conn(0x7f04500cf290 legacy=0x7f04500b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.077+0000 7f044effd640 1 -- 172.21.15.161:0/2168166304 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045006c750 con 0x7f04500ae5a0 2023-11-24T08:05:55.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.078+0000 7f044effd640 1 --2- 172.21.15.161:0/2168166304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f045015e430 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f04400097a0 tx=0x7f044002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e63682767459b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.078+0000 7f044e7fc640 1 -- 172.21.15.161:0/2168166304 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044002f810 con 0x7f04500ae5a0 2023-11-24T08:05:55.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f044e7fc640 1 -- 172.21.15.161:0/2168166304 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044002f970 con 0x7f04500ae5a0 2023-11-24T08:05:55.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f044e7fc640 1 -- 172.21.15.161:0/2168166304 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044002fd00 con 0x7f04500ae5a0 2023-11-24T08:05:55.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 -- 172.21.15.161:0/2168166304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 msgr2=0x7f045015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 --2- 172.21.15.161:0/2168166304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f045015e430 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f04400097a0 tx=0x7f044002b9f0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 -- 172.21.15.161:0/2168166304 shutdown_connections 2023-11-24T08:05:55.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 --2- 172.21.15.161:0/2168166304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f045015e430 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 -- 172.21.15.161:0/2168166304 >> 172.21.15.161:0/2168166304 conn(0x7f045006a800 msgr2=0x7f045006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 -- 172.21.15.161:0/2168166304 shutdown_connections 2023-11-24T08:05:55.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.079+0000 7f0455451640 1 -- 172.21.15.161:0/2168166304 wait complete. 2023-11-24T08:05:55.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.081+0000 7f0455451640 1 Processor -- start 2023-11-24T08:05:55.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.081+0000 7f0455451640 1 -- start start 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f0455451640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f04501f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f0455451640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04500b3ae0 0x7f045014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f0455451640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04500cf290 0x7f04500cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f0455451640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450156c70 con 0x7f04500ae5a0 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f0455451640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450156f50 con 0x7f04500cf290 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f0455451640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0450157230 con 0x7f04500b3ae0 2023-11-24T08:05:55.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f044effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f04501f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f044effd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f04501f2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:47996/0 (socket says 172.21.15.161:47996) 2023-11-24T08:05:55.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.082+0000 7f044effd640 1 -- 172.21.15.161:0/274576940 learned_addr learned my addr 172.21.15.161:0/274576940 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:55.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f044effd640 1 -- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04500b3ae0 msgr2=0x7f045014b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f044effd640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04500b3ae0 0x7f045014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f044effd640 1 -- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04500cf290 msgr2=0x7f04500cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f044effd640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04500cf290 0x7f04500cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f044effd640 1 -- 172.21.15.161:0/274576940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009400 con 0x7f04500ae5a0 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f044effd640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f04501f2ef0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f044002c000 tx=0x7f0440004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044003c040 con 0x7f04500ae5a0 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04400378f0 con 0x7f04500ae5a0 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440037ca0 con 0x7f04500ae5a0 2023-11-24T08:05:55.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.083+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0450157510 con 0x7f04500ae5a0 2023-11-24T08:05:55.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.084+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0450156900 con 0x7f04500ae5a0 2023-11-24T08:05:55.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.085+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0450157a30 con 0x7f04500ae5a0 2023-11-24T08:05:55.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.086+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f044002d3a0 con 0x7f04500ae5a0 2023-11-24T08:05:55.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.087+0000 7f04477fe640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f043006b020 0x7f043006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.087+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f04400ab4f0 con 0x7f04500ae5a0 2023-11-24T08:05:55.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.087+0000 7f0447fff640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f043006b020 0x7f043006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.088+0000 7f0447fff640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f043006b020 0x7f043006d4e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f60 tx=0x7f04380079b0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.093 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.091+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0450157a30 con 0x7f04500ae5a0 2023-11-24T08:05:55.279 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.277+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 --> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04501570c0 con 0x7f043006b020 2023-11-24T08:05:55.285 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.283+0000 7f04477fe640 1 -- 172.21.15.161:0/274576940 <== mgr.4106 v2:172.21.15.175:6800/3392875734 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48268 (secure 0 0 0) 0x7f04501570c0 con 0x7f043006b020 2023-11-24T08:05:55.286 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:55.286 INFO:teuthology.orchestra.run.smithi161.stderr:dumped all 2023-11-24T08:05:55.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f043006b020 msgr2=0x7f043006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f043006b020 0x7f043006d4e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0438000f60 tx=0x7f04380079b0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.288 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 msgr2=0x7f04501f2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f04501f2ef0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f044002c000 tx=0x7f0440004730 comp rx=0 tx=0).stop 2023-11-24T08:05:55.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 shutdown_connections 2023-11-24T08:05:55.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f043006b020 0x7f043006d4e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f04500cf290 0x7f04500cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04500b3ae0 0x7f045014b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.289 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 --2- 172.21.15.161:0/274576940 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04500ae5a0 0x7f04501f2ef0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 >> 172.21.15.161:0/274576940 conn(0x7f045006a800 msgr2=0x7f0450159c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 shutdown_connections 2023-11-24T08:05:55.290 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.286+0000 7f0455451640 1 -- 172.21.15.161:0/274576940 wait complete. 2023-11-24T08:05:55.306 INFO:teuthology.orchestra.run.smithi161.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2023-11-24T08:05:54.647002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":248212,"kb_used_data":7080,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726508,"statfs":{"total":773094113280,"available":772839944192,"internally_reserved":0,"allocated":7249920,"data_stored":3695616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":246795827},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004088"},"pg_stats":[{"pgid":"1.0","version":"63'119","reported_seq":213,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-11-24T08:05:36.381068+0000","last_change":"2023-11-24T08:05:36.381286+0000","last_active":"2023-11-24T08:05:36.381068+0000","last_peered":"2023-11-24T08:05:36.381068+0000","last_clean":"2023-11-24T08:05:36.381068+0000","last_became_active":"2023-11-24T08:00:20.633610+0000","last_became_peered":"2023-11-24T08:00:20.633610+0000","last_unstale":"2023-11-24T08:05:36.381068+0000","last_undegraded":"2023-11-24T08:05:36.381068+0000","last_fullsized":"2023-11-24T08:05:36.381068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'119","last_scrub_stamp":"2023-11-24T08:05:36.380823+0000","last_deep_scrub":"63'119","last_deep_scrub_stamp":"2023-11-24T08:05:36.380823+0000","last_clean_scrub_stamp":"2023-11-24T08:05:36.380823+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:42:50.048379+0000","scrub_duration":0.011352566999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509511,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1220000000000001,"15min":1.1359999999999999},"min":{"1min":0.75900000000000001,"5min":0.502,"15min":0.502},"max":{"1min":1.496,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.107,"15min":1.0609999999999999},"min":{"1min":0.69899999999999995,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5189999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.131}]},{"osd":1,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.175,"15min":1.1659999999999999},"min":{"1min":0.85699999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.506,"5min":1.929,"15min":1.929},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.143,"15min":1.181},"min":{"1min":0.73599999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.355,"5min":2.02,"15min":2.02},"last":1.26}]},{"osd":2,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2,"15min":1.1359999999999999},"min":{"1min":0.79600000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":1.458},{"interface":"front","average":{"1min":1.331,"5min":1.3660000000000001,"15min":1.3799999999999999},"min":{"1min":0.84899999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.605,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.3280000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.2849999999999999,"15min":1.1919999999999999},"min":{"1min":1.0169999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.859,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.415,"5min":1.4199999999999999,"15min":1.4159999999999999},"min":{"1min":0.99299999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8129999999999999,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":1.5629999999999999}]},{"osd":4,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.323,"15min":1.385},"min":{"1min":0.755,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.5409999999999999,"5min":2.9319999999999999,"15min":2.9319999999999999},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3680000000000001,"15min":1.3260000000000001},"min":{"1min":1.085,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.599,"5min":2.3620000000000001,"15min":2.3620000000000001},"last":1.73}]},{"osd":5,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.446,"15min":1.5249999999999999},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"max":{"1min":1.738,"5min":2.504,"15min":2.504},"last":1.6919999999999999},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.472,"15min":1.5169999999999999},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.8240000000000001,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":1.425}]},{"osd":6,"last update":"Fri Nov 24 08:05:27 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.5569999999999999,"15min":1.589},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.7889999999999999,"5min":2.7000000000000002,"15min":2.7000000000000002},"last":1.538},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5129999999999999,"15min":1.5189999999999999},"min":{"1min":0.91300000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.925,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.641}]}]},{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.016,"15min":0.95499999999999996},"min":{"1min":0.66500000000000004,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.429,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.091,"15min":1.0649999999999999},"min":{"1min":0.68999999999999995,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.429,"5min":1.593,"15min":1.593},"last":0.99099999999999999}]},{"osd":1,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.2230000000000001,"15min":1.2030000000000001},"min":{"1min":0.753,"5min":0.622,"15min":0.622},"max":{"1min":1.6040000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.056},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.234,"15min":1.2430000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5169999999999999,"5min":2.597,"15min":2.597},"last":1.1279999999999999}]},{"osd":2,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.157,"15min":1.2310000000000001},"min":{"1min":0.87,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.512,"5min":2.7589999999999999,"15min":2.7589999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.2430000000000001,"15min":1.276},"min":{"1min":0.89700000000000002,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.502,"5min":2.831,"15min":2.831},"last":1.5349999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.222,"15min":1.2789999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.6619999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2809999999999999,"15min":1.3},"min":{"1min":0.88300000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.7689999999999999,"5min":1.974,"15min":1.974},"last":1.3100000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2709999999999999,"15min":1.345},"min":{"1min":0.82399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.72,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":1.583},{"interface":"front","average":{"1min":1.27,"5min":1.3080000000000001,"15min":1.381},"min":{"1min":0.75,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8200000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.232}]},{"osd":5,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.4750000000000001,"15min":1.5569999999999999},"min":{"1min":0.80700000000000005,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.6319999999999999,"5min":2.105,"15min":2.105},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.47,"15min":1.514},"min":{"1min":0.81499999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.8660000000000001,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4299999999999999}]},{"osd":7,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4650000000000001,"5min":1.496,"15min":1.5820000000000001},"min":{"1min":0.86099999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.964,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4970000000000001,"15min":1.5589999999999999},"min":{"1min":0.65000000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":2.0310000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.661}]}]},{"osd":5,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":1.0800000000000001,"15min":1.0720000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6799999999999999,"5min":2.431,"15min":2.431},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0960000000000001,"15min":1.038},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3600000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.95799999999999996}]},{"osd":1,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0980000000000001,"15min":1.0669999999999999},"min":{"1min":0.71699999999999997,"5min":0.441,"15min":0.441},"max":{"1min":1.3149999999999999,"5min":1.653,"15min":1.653},"last":1.141},{"interface":"front","average":{"1min":1.208,"5min":1.1930000000000001,"15min":1.1899999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.6819999999999999,"5min":1.768,"15min":1.768},"last":1.226}]},{"osd":2,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.2270000000000001,"15min":1.2110000000000001},"min":{"1min":0.65900000000000003,"5min":0.623,"15min":0.623},"max":{"1min":1.587,"5min":1.75,"15min":1.75},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.163,"15min":1.2090000000000001},"min":{"1min":0.63600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.4530000000000001,"5min":1.768,"15min":1.768},"last":1.0149999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.298,"15min":1.3380000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.353},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3620000000000001,"15min":1.3340000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.7849999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.431}]},{"osd":4,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.266,"15min":1.3480000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.7290000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.3740000000000001,"15min":1.49},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.97,"5min":2.7189999999999999,"15min":2.7189999999999999},"last":1.5229999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.3939999999999999,"15min":1.4259999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.919,"5min":2.569,"15min":2.569},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.4470000000000001,"15min":1.516},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.0049999999999999,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.5700000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5149999999999999,"15min":1.663},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":2.056,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.667},{"interface":"front","average":{"1min":1.597,"5min":1.5600000000000001,"15min":1.5760000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":2.0150000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.7450000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.81599999999999995,"15min":0.76900000000000002},"min":{"1min":0.39500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.3380000000000001,"5min":1.476,"15min":1.476},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.87,"15min":0.79400000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.411,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.3360000000000001}]},{"osd":1,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.83299999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.472,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":1.0069999999999999,"15min":0.97099999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.46,"5min":1.871,"15min":1.871},"last":0.84399999999999997}]},{"osd":2,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0609999999999999,"15min":1.036},"min":{"1min":0.46999999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.5649999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.012},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.0940000000000001,"15min":1.028},"min":{"1min":0.52500000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.5109999999999999,"5min":1.625,"15min":1.625},"last":1.123}]},{"osd":4,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.163,"15min":1.1220000000000001},"min":{"1min":0.64700000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.6759999999999999,"5min":1.875,"15min":1.875},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2110000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.796,"5min":2.0630000000000002,"15min":2.0630000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.323,"15min":1.2909999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.647,"5min":2.2839999999999998,"15min":2.2839999999999998},"last":1.244},{"interface":"front","average":{"1min":1.222,"5min":1.3180000000000001,"15min":1.268},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.758,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.5249999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.304,"15min":1.262},"min":{"1min":0.74199999999999999,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.617,"5min":1.861,"15min":1.861},"last":1.466},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.7150000000000001,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.387}]},{"osd":7,"last update":"Fri Nov 24 08:05:25 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.397,"15min":1.327},"min":{"1min":0.79900000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.915,"5min":2.3300000000000001,"15min":2.3300000000000001},"last":1.292},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.3640000000000001,"15min":1.2929999999999999},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.821,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5629999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.85999999999999999,"15min":0.97799999999999998},"min":{"1min":0.58699999999999997,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4490000000000001,"5min":5.8040000000000003,"15min":5.8040000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.98199999999999998,"15min":0.89600000000000002},"min":{"1min":0.66300000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.627,"5min":3.343,"15min":3.343},"last":1.573}]},{"osd":1,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.026,"15min":1.1319999999999999},"min":{"1min":0.625,"5min":0.497,"15min":0.497},"max":{"1min":1.514,"5min":5.8460000000000001,"15min":5.8460000000000001},"last":1.101},{"interface":"front","average":{"1min":1.012,"5min":1.0329999999999999,"15min":1.111},"min":{"1min":0.70999999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.5109999999999999,"5min":6.0529999999999999,"15min":6.0529999999999999},"last":0.81699999999999995}]},{"osd":3,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.0940000000000001,"15min":1.014},"min":{"1min":0.64300000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.724,"5min":7.5670000000000002,"15min":7.5670000000000002},"last":1.216},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1699999999999999,"15min":1.2090000000000001},"min":{"1min":0.622,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.629,"5min":6.0899999999999999,"15min":6.0899999999999999},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.458,"15min":1.506},"min":{"1min":0.90900000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.7689999999999999,"5min":7.0119999999999996,"15min":7.0119999999999996},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.4550000000000001,"15min":1.55},"min":{"1min":0.98199999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.958,"5min":7.0609999999999999,"15min":7.0609999999999999},"last":1.4239999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.3740000000000001,"15min":1.4890000000000001},"min":{"1min":0.85099999999999998,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.897,"5min":6.2160000000000002,"15min":6.2160000000000002},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.454,"15min":1.3600000000000001},"min":{"1min":1.131,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.859,"5min":12.798,"15min":12.798},"last":1.6299999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4670000000000001,"15min":1.417},"min":{"1min":1.042,"5min":0.622,"15min":0.622},"max":{"1min":1.6919999999999999,"5min":7.6200000000000001,"15min":7.6200000000000001},"last":1.365},{"interface":"front","average":{"1min":1.403,"5min":1.4390000000000001,"15min":1.5700000000000001},"min":{"1min":1.0489999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.887,"5min":6.3470000000000004,"15min":6.3470000000000004},"last":1.524}]},{"osd":7,"last update":"Fri Nov 24 08:05:30 2023","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.492,"15min":1.427},"min":{"1min":0.879,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.766,"5min":7.4539999999999997,"15min":7.4539999999999997},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.454,"15min":1.5669999999999999},"min":{"1min":0.999,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.925,"5min":6.399,"15min":6.399},"last":1.325}]}]},{"osd":4,"up_from":14,"seq":60129542215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31924,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339916,"statfs":{"total":96636764160,"available":96604073984,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0589999999999999,"15min":1.0880000000000001},"min":{"1min":0.69199999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0740000000000001,"15min":1.1120000000000001},"min":{"1min":0.71599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.9319999999999999,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.878}]},{"osd":1,"last update":"Fri Nov 24 08:05:22 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1659999999999999,"15min":1.1599999999999999},"min":{"1min":0.81799999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.71,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.012},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.155,"15min":1.2170000000000001},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8220000000000001,"5min":2.1640000000000001,"15min":2.1640000000000001},"last":1.246}]},{"osd":2,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.206,"15min":1.224},"min":{"1min":0.86199999999999999,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.5600000000000001,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":1.325},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.369,"15min":1.427},"min":{"1min":0.93899999999999995,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.3740000000000001}]},{"osd":3,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.22,"15min":1.238},"min":{"1min":0.85899999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.651,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3240000000000001,"15min":1.399},"min":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.6599999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.4339999999999999}]},{"osd":5,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.371,"15min":1.4670000000000001},"min":{"1min":0.71299999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.536,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.5049999999999999,"15min":1.5109999999999999},"min":{"1min":1.117,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.972,"5min":2.073,"15min":2.073},"last":1.5660000000000001}]},{"osd":6,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.407,"15min":1.5149999999999999},"min":{"1min":0.90000000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.7729999999999999,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":1.536},{"interface":"front","average":{"1min":1.417,"5min":1.466,"15min":1.5800000000000001},"min":{"1min":0.86399999999999999,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.706,"5min":3.2799999999999998,"15min":3.2799999999999998},"last":0.97399999999999998}]},{"osd":7,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":1.52,"15min":1.583},"min":{"1min":1.0920000000000001,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.093,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.575,"15min":1.669},"min":{"1min":0.85099999999999998,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":2.0609999999999999,"5min":3.0920000000000001,"15min":3.0920000000000001},"last":1.5980000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27760,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":757760,"data_stored":314360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88400000000000001,"15min":0.93700000000000006},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.4450000000000001,"5min":3.3050000000000002,"15min":3.3050000000000002},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.90500000000000003,"15min":0.98699999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.466,"5min":3.266,"15min":3.266},"last":1.1000000000000001}]},{"osd":2,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.874,"15min":0.89900000000000002},"min":{"1min":0.48699999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.367,"5min":1.706,"15min":1.706},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.022,"15min":1.1040000000000001},"min":{"1min":0.45200000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.3380000000000001,"5min":3.3610000000000002,"15min":3.3610000000000002},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.1339999999999999,"15min":1.1799999999999999},"min":{"1min":0.48399999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.5840000000000001,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":1.0049999999999999,"15min":1.0760000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.137,"5min":1.976,"15min":1.976},"last":1.244}]},{"osd":4,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2549999999999999,"15min":1.4470000000000001},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.488,"5min":4.367,"15min":4.367},"last":1.375},{"interface":"front","average":{"1min":1.214,"5min":1.325,"15min":1.417},"min":{"1min":0.73999999999999999,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.5509999999999999,"5min":3.4420000000000002,"15min":3.4420000000000002},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.3360000000000001,"15min":1.5189999999999999},"min":{"1min":0.76200000000000001,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.7210000000000001,"5min":4.4900000000000002,"15min":4.4900000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.349,"5min":1.427,"15min":1.484},"min":{"1min":0.93400000000000005,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.657,"5min":3.4020000000000001,"15min":3.4020000000000001},"last":1.1539999999999999}]},{"osd":6,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.343,"15min":1.387},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.6619999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.47,"15min":1.619},"min":{"1min":0.86399999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7430000000000001,"5min":4.4109999999999996,"15min":4.4109999999999996},"last":1.284}]},{"osd":7,"last update":"Fri Nov 24 08:05:29 2023","interfaces":[{"interface":"back","average":{"1min":1.341,"5min":1.3759999999999999,"15min":1.4239999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.768,"5min":2.3140000000000001,"15min":2.3140000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4490000000000001,"15min":1.635},"min":{"1min":0.73799999999999999,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":1.8160000000000001,"5min":4.452,"15min":4.452},"last":1.1950000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542214,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32496,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339344,"statfs":{"total":96636764160,"available":96603488256,"internally_reserved":0,"allocated":1351680,"data_stored":904728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.83899999999999997},"min":{"1min":0.40799999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.499,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.421,"5min":1.46,"15min":1.46},"last":0.89300000000000002}]},{"osd":2,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81299999999999994,"15min":0.82799999999999996},"min":{"1min":0.40400000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.2929999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.99199999999999999,"15min":1.03},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.391,"5min":1.752,"15min":1.752},"last":1.216}]},{"osd":3,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":1.0900000000000001,"15min":1.0629999999999999},"min":{"1min":0.57399999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.593,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.1619999999999999,"15min":1.127},"min":{"1min":0.56599999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":1.3200000000000001}]},{"osd":4,"last update":"Fri Nov 24 08:05:21 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.222,"15min":1.226},"min":{"1min":0.72599999999999998,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.4970000000000001,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3,"15min":1.3240000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8340000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.444}]},{"osd":5,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4019999999999999,"15min":1.484},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.9079999999999999,"5min":2.839,"15min":2.839},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.3420000000000001,"15min":1.3799999999999999},"min":{"1min":0.85799999999999998,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.871,"5min":2.823,"15min":2.823},"last":1.657}]},{"osd":6,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.304,"15min":1.341},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.8500000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.427},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4219999999999999,"15min":1.4410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.9850000000000001,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.6160000000000001}]},{"osd":7,"last update":"Fri Nov 24 08:05:28 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.4470000000000001,"15min":1.5049999999999999},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.105,"5min":2.875,"15min":2.875},"last":1.7430000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.347,"15min":1.357},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9570000000000001,"5min":2.4140000000000001,"15min":2.4140000000000001},"last":1.77}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T08:05:55.310 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T08:05:55.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.517+0000 7fad44800640 1 Processor -- start 2023-11-24T08:05:55.520 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.518+0000 7fad44800640 1 -- start start 2023-11-24T08:05:55.521 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.519+0000 7fad44800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 0x7fad3c161360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.519+0000 7fad44800640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad3c0ced50 0x7fad3c0d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.519+0000 7fad44800640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c0cf1b0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.519+0000 7fad44800640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c1618a0 con 0x7fad3c0ced50 2023-11-24T08:05:55.522 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.519+0000 7fad44800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0d0de0 con 0x7fad3c160f80 2023-11-24T08:05:55.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.520+0000 7fad42d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad3c0ced50 0x7fad3c0d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.520+0000 7fad4259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 0x7fad3c161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.520+0000 7fad4259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 0x7fad3c161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.161:60556/0 (socket says 172.21.15.161:60556) 2023-11-24T08:05:55.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.520+0000 7fad42d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fad3c0ced50 0x7fad3c0d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.161:42860/0 (socket says 172.21.15.161:42860) 2023-11-24T08:05:55.523 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.520+0000 7fad4259c640 1 -- 172.21.15.161:0/650525746 learned_addr learned my addr 172.21.15.161:0/650525746 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:55.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.521+0000 7fad4259c640 1 -- 172.21.15.161:0/650525746 >> v2:172.21.15.175:3300/0 conn(0x7fad3c0ced50 msgr2=0x7fad3c0d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.521+0000 7fad4259c640 1 --2- 172.21.15.161:0/650525746 >> v2:172.21.15.175:3300/0 conn(0x7fad3c0ced50 0x7fad3c0d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.521+0000 7fad4259c640 1 -- 172.21.15.161:0/650525746 >> v1:172.21.15.175:6789/0 conn(0x7fad3c0ce8f0 legacy=0x7fad3c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.524 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.521+0000 7fad4259c640 1 -- 172.21.15.161:0/650525746 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0d10c0 con 0x7fad3c160f80 2023-11-24T08:05:55.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.522+0000 7fad4259c640 1 --2- 172.21.15.161:0/650525746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 0x7fad3c161360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad34009e50 tx=0x7fad3402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd3c25db7ac5133f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad4159a640 1 -- 172.21.15.161:0/650525746 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3402cb00 con 0x7fad3c160f80 2023-11-24T08:05:55.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad4159a640 1 -- 172.21.15.161:0/650525746 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3402cc60 con 0x7fad3c160f80 2023-11-24T08:05:55.525 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad4159a640 1 -- 172.21.15.161:0/650525746 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340343f0 con 0x7fad3c160f80 2023-11-24T08:05:55.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad44800640 1 -- 172.21.15.161:0/650525746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 msgr2=0x7fad3c161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad44800640 1 --2- 172.21.15.161:0/650525746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 0x7fad3c161360 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad34009e50 tx=0x7fad3402bf60 comp rx=0 tx=0).stop 2023-11-24T08:05:55.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad44800640 1 -- 172.21.15.161:0/650525746 shutdown_connections 2023-11-24T08:05:55.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad44800640 1 --2- 172.21.15.161:0/650525746 >> v2:172.21.15.175:3300/0 conn(0x7fad3c0ced50 0x7fad3c0d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad44800640 1 --2- 172.21.15.161:0/650525746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c160f80 0x7fad3c161360 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.523+0000 7fad44800640 1 -- 172.21.15.161:0/650525746 >> 172.21.15.161:0/650525746 conn(0x7fad3c09c550 msgr2=0x7fad3c0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.524+0000 7fad44800640 1 -- 172.21.15.161:0/650525746 shutdown_connections 2023-11-24T08:05:55.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.524+0000 7fad44800640 1 -- 172.21.15.161:0/650525746 wait complete. 2023-11-24T08:05:55.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.526+0000 7fad44800640 1 Processor -- start 2023-11-24T08:05:55.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.526+0000 7fad44800640 1 -- start start 2023-11-24T08:05:55.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad44800640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 0x7fad3c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad44800640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c0ced50 0x7fad3c0b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad44800640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad3c160f80 0x7fad3c0b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad44800640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0cad20 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad44800640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0c8750 con 0x7fad3c160f80 2023-11-24T08:05:55.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad44800640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0c8a30 con 0x7fad3c0ced50 2023-11-24T08:05:55.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.527+0000 7fad4259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 0x7fad3c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 0x7fad3c1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48000/0 (socket says 172.21.15.161:48000) 2023-11-24T08:05:55.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 -- 172.21.15.161:0/840275364 learned_addr learned my addr 172.21.15.161:0/840275364 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:55.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad42d9d640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad3c160f80 0x7fad3c0b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad41d9b640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c0ced50 0x7fad3c0b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 -- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c0ced50 msgr2=0x7fad3c0b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c0ced50 0x7fad3c0b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 -- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad3c160f80 msgr2=0x7fad3c0b85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad3c160f80 0x7fad3c0b85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 -- 172.21.15.161:0/840275364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34009b30 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.528+0000 7fad4259c640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 0x7fad3c1559f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fad34000f80 tx=0x7fad34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.529+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34040670 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.529+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340407d0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.529+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34040b80 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.529+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c0c8d10 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.529+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c0c92d0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.530+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c0cae90 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.534 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.531+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7fad34040ce0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.532+0000 7fad32ffd640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad2006aff0 0x7fad2006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.533+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad340ac670 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.535 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.533+0000 7fad41d9b640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad2006aff0 0x7fad2006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.536 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.534+0000 7fad41d9b640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad2006aff0 0x7fad2006d4b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad3c1f69a0 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.537+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad340778d0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.728 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.726+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fad3c0675d0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.733 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.731+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7fad34009510 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.734 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.733+0000 7fad32ffd640 1 -- 172.21.15.161:0/840275364 <== mon.0 v2:172.21.15.161:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad340778d0 con 0x7fad3c0ce8f0 2023-11-24T08:05:55.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad2006aff0 msgr2=0x7fad2006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad2006aff0 0x7fad2006d4b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fad3c1f69a0 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 msgr2=0x7fad3c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 0x7fad3c1559f0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fad34000f80 tx=0x7fad34004a40 comp rx=0 tx=0).stop 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 shutdown_connections 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7fad2006aff0 0x7fad2006d4b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad3c160f80 0x7fad3c0b85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad3c0ced50 0x7fad3c0b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 --2- 172.21.15.161:0/840275364 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad3c0ce8f0 0x7fad3c1559f0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 >> 172.21.15.161:0/840275364 conn(0x7fad3c09c550 msgr2=0x7fad3c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 shutdown_connections 2023-11-24T08:05:55.739 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.735+0000 7fad44800640 1 -- 172.21.15.161:0/840275364 wait complete. 2023-11-24T08:05:55.755 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T08:05:55.756 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T08:05:55.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.952+0000 7f8e854cf640 1 Processor -- start 2023-11-24T08:05:55.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.952+0000 7f8e854cf640 1 -- start start 2023-11-24T08:05:55.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.954+0000 7f8e854cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e8015bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.954+0000 7f8e854cf640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8006c470 con 0x7f8e800cf9a0 2023-11-24T08:05:55.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.954+0000 7f8e854cf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8006c750 con 0x7f8e8013e360 2023-11-24T08:05:55.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.954+0000 7f8e854cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8006ca30 con 0x7f8e8013df80 2023-11-24T08:05:55.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f8e800cf9a0 0x7f8e800cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:56444/0 (socket says 172.21.15.161:56444) 2023-11-24T08:05:55.957 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3773207222 learned_addr learned my addr 172.21.15.161:0/3773207222 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-11-24T08:05:55.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7effd640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e8015bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.959 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 <== mon.0 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679528003 0 0) 0x7f8e8006c470 con 0x7f8e800cf9a0 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e6c003520 con 0x7f8e800cf9a0 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 <== mon.0 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3138188704 0 0) 0x7f8e6c003520 con 0x7f8e800cf9a0 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 msgr2=0x7f8e8015bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e8015bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 >> v1:172.21.15.175:6789/0 conn(0x7f8e8013e360 legacy=0x7f8e800cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8006cd10 con 0x7f8e800cf9a0 2023-11-24T08:05:55.960 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.955+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 <== mon.0 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1305590864 0 0) 0x7f8e78001670 con 0x7f8e800cf9a0 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 >> v1:172.21.15.161:6789/0 conn(0x7f8e800cf9a0 legacy=0x7f8e800cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e6c0039a0 0x7f8e6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e6c004d00 0x7f8e6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8006ca30 con 0x7f8e6c004d00 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c00ba60 con 0x7f8e6c0039a0 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c00bc20 con 0x7f8e8013df80 2023-11-24T08:05:55.961 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e6c004d00 0x7f8e6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7effd640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e6c0039a0 0x7f8e6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7e7fc640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 msgr2=0x7f8e6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e6c0039a0 msgr2=0x7f8e6c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e6c0039a0 0x7f8e6c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.962 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3773207222 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c003520 con 0x7f8e6c004d00 2023-11-24T08:05:55.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7effd640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e6c0039a0 0x7f8e6c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:55.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.956+0000 7f8e7e7fc640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e8013df80 0x7f8e6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T08:05:55.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.957+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e6c004d00 0x7f8e6c005180 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8e78001eb0 tx=0x7f8e6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e0fbe05bed6f10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e78005ad0 con 0x7f8e6c004d00 2023-11-24T08:05:55.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8e78005c30 con 0x7f8e6c004d00 2023-11-24T08:05:55.963 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e7dffb640 1 -- 172.21.15.161:0/3773207222 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7802c7c0 con 0x7f8e6c004d00 2023-11-24T08:05:55.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e854cf640 1 -- 172.21.15.161:0/3773207222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e6c004d00 msgr2=0x7f8e6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3773207222 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e6c004d00 0x7f8e6c005180 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8e78001eb0 tx=0x7f8e6c0057f0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3773207222 reap_dead start 2023-11-24T08:05:55.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e854cf640 1 -- 172.21.15.161:0/3773207222 shutdown_connections 2023-11-24T08:05:55.966 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e854cf640 1 -- 172.21.15.161:0/3773207222 >> 172.21.15.161:0/3773207222 conn(0x7f8e8006a800 msgr2=0x7f8e8006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e854cf640 1 -- 172.21.15.161:0/3773207222 shutdown_connections 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.958+0000 7f8e854cf640 1 -- 172.21.15.161:0/3773207222 wait complete. 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.960+0000 7f8e854cf640 1 Processor -- start 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.960+0000 7f8e854cf640 1 -- start start 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e854cf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e6c004d00 0x7f8e801597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e854cf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e801561d0 0x7f8e8013d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e854cf640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 0x7f8e8015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.967 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e854cf640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80159d30 con 0x7f8e80157d70 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e854cf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80158750 con 0x7f8e801561d0 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e854cf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80158a30 con 0x7f8e6c004d00 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e7f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 0x7f8e8015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e7f7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 0x7f8e8015d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:48012/0 (socket says 172.21.15.161:48012) 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.961+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3480367485 learned_addr learned my addr 172.21.15.161:0/3480367485 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7effd640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e6c004d00 0x7f8e801597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7e7fc640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e801561d0 0x7f8e8013d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.968 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e6c004d00 msgr2=0x7f8e801597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e6c004d00 0x7f8e801597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e801561d0 msgr2=0x7f8e8013d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e801561d0 0x7f8e8013d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7f7fe640 1 -- 172.21.15.161:0/3480367485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e80158d10 con 0x7f8e80157d70 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e7f7fe640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 0x7f8e8015d8a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8e78001eb0 tx=0x7f8e7802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7803c040 con 0x7f8e80157d70 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8e7802c9e0 con 0x7f8e80157d70 2023-11-24T08:05:55.969 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e80158ff0 con 0x7f8e80157d70 2023-11-24T08:05:55.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7802cdb0 con 0x7f8e80157d70 2023-11-24T08:05:55.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.962+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8013dd10 con 0x7f8e80157d70 2023-11-24T08:05:55.970 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.963+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e80159510 con 0x7f8e80157d70 2023-11-24T08:05:55.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.964+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 9) v1 ==== 89384+0+0 (secure 0 0 0) 0x7f8e78032070 con 0x7f8e80157d70 2023-11-24T08:05:55.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.965+0000 7f8e777fe640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8e6006b020 0x7f8e6006d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T08:05:55.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.965+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e780a9f30 con 0x7f8e80157d70 2023-11-24T08:05:55.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.966+0000 7f8e7effd640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8e6006b020 0x7f8e6006d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T08:05:55.971 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.967+0000 7f8e7effd640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8e6006b020 0x7f8e6006d4e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8e70007440 tx=0x7f8e7000d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T08:05:55.972 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:55.970+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e80159510 con 0x7f8e80157d70 2023-11-24T08:05:56.181 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.179+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e80159510 con 0x7f8e80157d70 2023-11-24T08:05:56.182 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.180+0000 7f8e777fe640 1 -- 172.21.15.161:0/3480367485 <== mon.0 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f8e80159510 con 0x7f8e80157d70 2023-11-24T08:05:56.183 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-11-24T08:05:56.183 INFO:teuthology.orchestra.run.smithi161.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/1584604192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":1584604192},{"type":"v1","addr":"172.21.15.175:6835","nonce":1584604192}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6837/457230077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6836","nonce":457230077},{"type":"v1","addr":"172.21.15.175:6837","nonce":457230077}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6318,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6833/97308741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":97308741},{"type":"v1","addr":"172.21.15.161:6833","nonce":97308741}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6645,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/4218924225","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":4218924225},{"type":"v1","addr":"172.21.15.161:6835","nonce":4218924225}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-11-24T08:05:56.183 INFO:teuthology.orchestra.run.smithi161.stderr:dumped fsmap epoch 39 2023-11-24T08:05:56.185 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8e6006b020 msgr2=0x7f8e6006d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8e6006b020 0x7f8e6006d4e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8e70007440 tx=0x7f8e7000d040 comp rx=0 tx=0).stop 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 msgr2=0x7f8e8015d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 0x7f8e8015d8a0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f8e78001eb0 tx=0x7f8e7802e070 comp rx=0 tx=0).stop 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 shutdown_connections 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:6800/3392875734,v1:172.21.15.175:6801/3392875734] conn(0x7f8e6006b020 0x7f8e6006d4e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e80157d70 0x7f8e8015d8a0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.186 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8e801561d0 0x7f8e8013d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 --2- 172.21.15.161:0/3480367485 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8e6c004d00 0x7f8e801597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T08:05:56.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 >> 172.21.15.161:0/3480367485 conn(0x7f8e8006a800 msgr2=0x7f8e800b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T08:05:56.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.183+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 shutdown_connections 2023-11-24T08:05:56.187 INFO:teuthology.orchestra.run.smithi161.stderr:2023-11-24T08:05:56.184+0000 7f8e854cf640 1 -- 172.21.15.161:0/3480367485 wait complete. 2023-11-24T08:05:56.203 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T08:05:56.204 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T08:05:56.204 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T08:05:56.204 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.228 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T08:05:56.228 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T08:05:56.229 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.291 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T08:05:56.292 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T08:05:56.292 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.321 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T08:05:56.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T08:05:56.321 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.382 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T08:05:56.382 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T08:05:56.383 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T08:05:56.383 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.459 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T08:05:56.459 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T08:05:56.459 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.531 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T08:05:56.532 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T08:05:56.532 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.610 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T08:05:56.611 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T08:05:56.611 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.679 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T08:05:56.679 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T08:05:56.679 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.727 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T08:05:56.727 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T08:05:56.727 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.806 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T08:05:56.806 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T08:05:56.806 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.854 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T08:05:56.854 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T08:05:56.854 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.912 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T08:05:56.912 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T08:05:56.912 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T08:05:56.912 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:56.987 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T08:05:56.987 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T08:05:56.988 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:57.067 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T08:05:57.077 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T08:05:57.078 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T08:05:57.078 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:57.127 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T08:05:57.128 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T08:05:57.128 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:57.152 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T08:05:57.152 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T08:05:57.152 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T08:05:57.229 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T08:05:57.229 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T08:05:57.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T08:05:57.343 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:05:57.344 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T08:05:57.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:05:57.631 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T08:05:57.791 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:05:57.792 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T08:05:57.953 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:05:57.953 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T08:05:58.113 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:05:58.113 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T08:05:58.346 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:05:58.346 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T08:05:58.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:05:58.509 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T08:05:58.658 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:05:58.659 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T08:05:58.847 INFO:tasks.ceph:Archiving mon data... 2023-11-24T08:05:58.848 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/data/mon.a.tgz 2023-11-24T08:05:58.849 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2023-11-24T08:05:58.903 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.nuvHQG1wod 2023-11-24T08:05:58.904 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nuvHQG1wod 2023-11-24T08:05:59.100 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.nuvHQG1wod 2023-11-24T08:05:59.235 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.nuvHQG1wod is 546KB 2023-11-24T08:05:59.338 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.nuvHQG1wod 2023-11-24T08:05:59.392 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/data/mon.b.tgz 2023-11-24T08:05:59.392 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-11-24T08:05:59.452 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.KFatYXRcxJ 2023-11-24T08:05:59.452 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.KFatYXRcxJ 2023-11-24T08:05:59.714 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.KFatYXRcxJ 2023-11-24T08:05:59.870 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.KFatYXRcxJ is 731KB 2023-11-24T08:05:59.984 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.KFatYXRcxJ 2023-11-24T08:06:00.043 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/data/mon.c.tgz 2023-11-24T08:06:00.043 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2023-11-24T08:06:00.098 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.gBllunlZg8 2023-11-24T08:06:00.101 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.gBllunlZg8 2023-11-24T08:06:00.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.gBllunlZg8 2023-11-24T08:06:00.501 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.gBllunlZg8 is 731KB 2023-11-24T08:06:00.615 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.gBllunlZg8 2023-11-24T08:06:00.676 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T08:06:00.676 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:06:00.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T08:06:00.785 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T08:06:00.786 DEBUG:teuthology.orchestra.run.smithi161:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:06:00.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T08:06:00.893 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:06:00.903 INFO:teuthology.orchestra.run.smithi175.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T08:06:00.915 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T08:06:00.917 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/remote/smithi161/crash 2023-11-24T08:06:00.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:06:00.999 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/remote/smithi175/crash 2023-11-24T08:06:01.000 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T08:06:01.097 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T08:06:01.098 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:01.107 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:01.245 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:01.345 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T08:06:01.447 INFO:tasks.ceph:Compressing logs... 2023-11-24T08:06:01.448 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:06:01.457 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T08:06:01.547 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T08:06:01.548 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93295.log 2023-11-24T08:06:01.549 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103531.log 2023-11-24T08:06:01.549 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95893.log 2023-11-24T08:06:01.549 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93947.log 2023-11-24T08:06:01.550 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.95893.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:06:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93295.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93295.log.gz 2023-11-24T08:06:01.550 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110917.log 2023-11-24T08:06:01.552 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99271.log 2023-11-24T08:06:01.552 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103531.log.gz 2023-11-24T08:06:01.552 INFO:teuthology.orchestra.run.smithi175.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.1.95893.log.gz 2023-11-24T08:06:01.552 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.93947.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T08:06:01.553 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: 90.6% -- replaced with /var/log/ceph/ceph-client.1.93947.log.gz 2023-11-24T08:06:01.553 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T08:06:01.554 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107357.log 2023-11-24T08:06:01.554 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.110917.log.gz 2023-11-24T08:06:01.555 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97118.log 2023-11-24T08:06:01.555 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99271.log.gz 2023-11-24T08:06:01.555 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107357.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.107357.log.gz /var/log/ceph/ceph-client.admin.93244.log 2023-11-24T08:06:01.556 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-11-24T08:06:01.556 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89033.log 2023-11-24T08:06:01.556 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:06:01.557 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89073.log 2023-11-24T08:06:01.558 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.89033.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.89033.log.gz 2023-11-24T08:06:01.558 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T08:06:01.559 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98029.log 2023-11-24T08:06:01.559 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97118.log.gz 2023-11-24T08:06:01.559 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92821.log 87.5% 2023-11-24T08:06:01.559 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93244.log.gz 2023-11-24T08:06:01.559 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111368.log 2023-11-24T08:06:01.560 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98029.log.gz 2023-11-24T08:06:01.561 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.92821.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T08:06:01.561 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.92821.log.gz 2023-11-24T08:06:01.561 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.89073.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T08:06:01.562 INFO:teuthology.orchestra.run.smithi175.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.89073.log.gz 2023-11-24T08:06:01.562 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89211.log 2023-11-24T08:06:01.563 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.95179.log 2023-11-24T08:06:01.564 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94318.log 2023-11-24T08:06:01.564 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111368.log.gz 2023-11-24T08:06:01.564 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93759.log 2023-11-24T08:06:01.564 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105426.log 2023-11-24T08:06:01.564 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94318.log.gz 2023-11-24T08:06:01.565 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93759.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93759.log.gz 2023-11-24T08:06:01.565 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104506.log 2023-11-24T08:06:01.566 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.89211.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.89211.log.gz 2023-11-24T08:06:01.566 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T08:06:01.567 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.95179.log: 89.2% -- replaced with /var/log/ceph/ceph-client.1.95179.log.gz 2023-11-24T08:06:01.567 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93982.log 2023-11-24T08:06:01.568 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105426.log.gz 2023-11-24T08:06:01.568 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101261.log 2023-11-24T08:06:01.568 INFO:teuthology.orchestra.run.smithi161.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.104506.log.gz 2023-11-24T08:06:01.569 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106958.log 2023-11-24T08:06:01.569 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89113.log 2023-11-24T08:06:01.570 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93982.log.gz 2023-11-24T08:06:01.570 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104758.log 2023-11-24T08:06:01.570 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101261.log.gz 2023-11-24T08:06:01.571 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88953.log 2023-11-24T08:06:01.571 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106958.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106958.log.gz 2023-11-24T08:06:01.572 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100881.log 2023-11-24T08:06:01.572 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.89113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.89113.log.gz 2023-11-24T08:06:01.573 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111158.log 2023-11-24T08:06:01.573 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104758.log.gz 2023-11-24T08:06:01.574 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.88953.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.88953.log.gz 2023-11-24T08:06:01.574 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:06:01.575 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94655.log 2023-11-24T08:06:01.575 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100881.log.gz 2023-11-24T08:06:01.575 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111158.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111158.log.gz 2023-11-24T08:06:01.575 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105568.log 2023-11-24T08:06:01.577 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T08:06:01.577 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97370.log 2023-11-24T08:06:01.577 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94655.log.gz 2023-11-24T08:06:01.577 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106082.log 2023-11-24T08:06:01.578 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105568.log.gz 2023-11-24T08:06:01.578 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94314.log 2023-11-24T08:06:01.578 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97370.log.gz 2023-11-24T08:06:01.579 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-mon.b.log: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:06:01.579 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102153.log 2023-11-24T08:06:01.580 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106082.log.gz 2023-11-24T08:06:01.580 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89153.log 2023-11-24T08:06:01.581 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101177.log 2023-11-24T08:06:01.581 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94314.log.gz 2023-11-24T08:06:01.582 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110688.log 2023-11-24T08:06:01.582 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102153.log.gz 2023-11-24T08:06:01.583 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89051.log 2023-11-24T08:06:01.583 INFO:teuthology.orchestra.run.smithi161.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101177.log.gz 2023-11-24T08:06:01.583 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97016.log 2023-11-24T08:06:01.584 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.89153.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.89153.log.gz 2023-11-24T08:06:01.584 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110688.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110688.log.gz 2023-11-24T08:06:01.584 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110310.log 2023-11-24T08:06:01.585 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.89051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108600.log 2023-11-24T08:06:01.585 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.89051.log.gz 2023-11-24T08:06:01.586 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104296.log 2023-11-24T08:06:01.586 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110310.log.gz 2023-11-24T08:06:01.587 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88993.log 2023-11-24T08:06:01.587 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.97016.log: 88.9% -- replaced with /var/log/ceph/ceph-client.1.97016.log.gz 2023-11-24T08:06:01.587 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99817.log 2023-11-24T08:06:01.588 INFO:teuthology.orchestra.run.smithi161.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.108600.log.gz 2023-11-24T08:06:01.588 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94399.log 2023-11-24T08:06:01.589 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104296.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.102478.log 2023-11-24T08:06:01.589 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104296.log.gz 2023-11-24T08:06:01.589 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.88993.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.88993.log.gz 2023-11-24T08:06:01.590 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97286.log 2023-11-24T08:06:01.590 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99817.log.gz 2023-11-24T08:06:01.591 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89251.log 2023-11-24T08:06:01.591 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111662.log 2023-11-24T08:06:01.592 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102478.log.gz 2023-11-24T08:06:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97286.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97286.log.gz 2023-11-24T08:06:01.592 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104590.log 2023-11-24T08:06:01.593 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104170.log 2023-11-24T08:06:01.593 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111662.log.gz 2023-11-24T08:06:01.594 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.3.94399.log: 91.2% -- replaced with /var/log/ceph/ceph-client.3.94399.log.gz 2023-11-24T08:06:01.594 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94649.log 2023-11-24T08:06:01.594 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.104590.log.gz 2023-11-24T08:06:01.595 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111620.log 2023-11-24T08:06:01.595 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104170.log.gz 2023-11-24T08:06:01.597 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.89251.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.89251.log.gz 2023-11-24T08:06:01.597 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T08:06:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94649.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94649.log.gz 2023-11-24T08:06:01.597 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99901.log 2023-11-24T08:06:01.598 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99151.log 2023-11-24T08:06:01.598 INFO:teuthology.orchestra.run.smithi161.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111620.log.gz 2023-11-24T08:06:01.599 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T08:06:01.599 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103153.log 2023-11-24T08:06:01.599 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99901.log.gz 2023-11-24T08:06:01.600 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97019.log 2023-11-24T08:06:01.600 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99151.log.gz 2023-11-24T08:06:01.601 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106040.log 2023-11-24T08:06:01.601 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103153.log.gz 2023-11-24T08:06:01.602 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97019.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97019.log.gz 2023-11-24T08:06:01.602 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103998.log 2023-11-24T08:06:01.603 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106916.log 2023-11-24T08:06:01.603 INFO:teuthology.orchestra.run.smithi161.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.106040.log.gz 2023-11-24T08:06:01.604 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103111.log 2023-11-24T08:06:01.604 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.103998.log.gz 2023-11-24T08:06:01.605 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106916.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106916.log.gz -5 2023-11-24T08:06:01.606 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.98967.log 2023-11-24T08:06:01.607 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103111.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103111.log.gz 2023-11-24T08:06:01.607 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103657.log 2023-11-24T08:06:01.608 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93201.log 2023-11-24T08:06:01.608 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98967.log.gz 2023-11-24T08:06:01.609 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107963.log 2023-11-24T08:06:01.609 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103657.log.gz 2023-11-24T08:06:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93201.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.93201.log.gz 2023-11-24T08:06:01.610 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109887.log 2023-11-24T08:06:01.611 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107963.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.107963.log.gz 2023-11-24T08:06:01.611 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95163.log 2023-11-24T08:06:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109887.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109887.log.gz 2023-11-24T08:06:01.612 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100398.log 2023-11-24T08:06:01.613 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108822.log 2023-11-24T08:06:01.614 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95163.log.gz 2023-11-24T08:06:01.614 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100398.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100398.log.gz 2023-11-24T08:06:01.615 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111704.log 2023-11-24T08:06:01.615 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104884.log 2023-11-24T08:06:01.616 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108822.log.gz 2023-11-24T08:06:01.617 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107060.log 2023-11-24T08:06:01.617 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111704.log.gz 2023-11-24T08:06:01.617 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96699.log 2023-11-24T08:06:01.618 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104884.log.gz 2023-11-24T08:06:01.618 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107060.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107060.log.gz 2023-11-24T08:06:01.619 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94893.log 2023-11-24T08:06:01.620 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111746.log 2023-11-24T08:06:01.620 INFO:teuthology.orchestra.run.smithi161.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.96699.log.gz 2023-11-24T08:06:01.620 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94893.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94893.log.gz 2023-11-24T08:06:01.621 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104254.log 2023-11-24T08:06:01.622 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107669.log 2023-11-24T08:06:01.622 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111746.log.gz 2023-11-24T08:06:01.623 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104254.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104254.log.gz 2023-11-24T08:06:01.623 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111284.log 2023-11-24T08:06:01.624 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97244.log 2023-11-24T08:06:01.624 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T08:06:01.625 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107669.log.gz 2023-11-24T08:06:01.625 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111284.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111284.log.gz 2023-11-24T08:06:01.625 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93675.log 2023-11-24T08:06:01.626 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97076.log 2023-11-24T08:06:01.626 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97244.log.gz 2023-11-24T08:06:01.627 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93675.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93675.log.gz 2023-11-24T08:06:01.628 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97706.log 2023-11-24T08:06:01.628 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97076.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97076.log.gz 2023-11-24T08:06:01.629 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111410.log 2023-11-24T08:06:01.629 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101453.log 2023-11-24T08:06:01.630 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97706.log.gz 2023-11-24T08:06:01.630 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99193.log 2023-11-24T08:06:01.631 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111410.log.gz 2023-11-24T08:06:01.631 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108226.log 2023-11-24T08:06:01.632 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101453.log.gz 2023-11-24T08:06:01.632 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99193.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99193.log.gz 2023-11-24T08:06:01.633 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95079.log 2023-11-24T08:06:01.633 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97987.log 2023-11-24T08:06:01.634 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108226.log.gz 2023-11-24T08:06:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95079.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95079.log.gz 2023-11-24T08:06:01.635 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102883.log 2023-11-24T08:06:01.636 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93633.log 2023-11-24T08:06:01.636 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97987.log.gz 2023-11-24T08:06:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102883.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102883.log.gz 2023-11-24T08:06:01.637 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98459.log 2023-11-24T08:06:01.638 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93633.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.93633.log.gz -5 2023-11-24T08:06:01.638 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.101387.log 2023-11-24T08:06:01.639 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93159.log 2023-11-24T08:06:01.640 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98459.log.gz 2023-11-24T08:06:01.641 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98714.log 2023-11-24T08:06:01.641 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.101387.log.gz 2023-11-24T08:06:01.642 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109724.log 2023-11-24T08:06:01.642 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93159.log.gz 2023-11-24T08:06:01.643 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98714.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98714.log.gz 2023-11-24T08:06:01.643 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98171.log 2023-11-24T08:06:01.645 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109724.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109724.log.gz 2023-11-24T08:06:01.645 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99859.log 2023-11-24T08:06:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98171.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98171.log.gz 2023-11-24T08:06:01.647 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95373.log 2023-11-24T08:06:01.648 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99859.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99859.log.gz 2023-11-24T08:06:01.648 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101135.log 2023-11-24T08:06:01.649 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97766.log 2023-11-24T08:06:01.649 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95373.log.gz 2023-11-24T08:06:01.650 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101135.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101135.log.gz 2023-11-24T08:06:01.650 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94313.log 2023-11-24T08:06:01.652 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96893.log 2023-11-24T08:06:01.652 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.97766.log.gz 2023-11-24T08:06:01.652 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94313.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.94313.log.gz 2023-11-24T08:06:01.653 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111956.log 2023-11-24T08:06:01.654 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97664.log 2023-11-24T08:06:01.654 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96893.log.gz 2023-11-24T08:06:01.655 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111956.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111956.log.gz 2023-11-24T08:06:01.655 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100069.log 2023-11-24T08:06:01.657 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105956.log 2023-11-24T08:06:01.657 INFO:teuthology.orchestra.run.smithi161.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97664.log.gz 2023-11-24T08:06:01.657 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100069.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100069.log.gz 2023-11-24T08:06:01.658 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99313.log 2023-11-24T08:06:01.659 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108306.log 2023-11-24T08:06:01.659 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105956.log.gz 2023-11-24T08:06:01.660 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99313.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99313.log.gz 2023-11-24T08:06:01.660 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95415.log 2023-11-24T08:06:01.662 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105610.log 2023-11-24T08:06:01.662 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108306.log.gz 2023-11-24T08:06:01.662 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95415.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95415.log.gz 2023-11-24T08:06:01.663 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101219.log 2023-11-24T08:06:01.664 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94319.log 2023-11-24T08:06:01.664 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105610.log.gz 2023-11-24T08:06:01.665 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112098.log 2023-11-24T08:06:01.665 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101219.log.gz 2023-11-24T08:06:01.666 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94319.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94319.log.gz 2023-11-24T08:06:01.666 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110646.log 2023-11-24T08:06:01.667 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.112098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97903.log 2023-11-24T08:06:01.668 INFO:teuthology.orchestra.run.smithi161.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.112098.log.gz 2023-11-24T08:06:01.668 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106418.log 2023-11-24T08:06:01.669 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110646.log.gz 2023-11-24T08:06:01.670 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107879.log 2023-11-24T08:06:01.670 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97903.log.gz 2023-11-24T08:06:01.671 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106418.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106418.log.gz 2023-11-24T08:06:01.671 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106790.log 2023-11-24T08:06:01.672 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111578.log 2023-11-24T08:06:01.672 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107879.log.gz 2023-11-24T08:06:01.673 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98840.log 2023-11-24T08:06:01.673 INFO:teuthology.orchestra.run.smithi161.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106790.log.gz 2023-11-24T08:06:01.674 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111578.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.98501.log -- replaced with /var/log/ceph/ceph-client.admin.111578.log.gz 2023-11-24T08:06:01.674 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-11-24T08:06:01.675 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98840.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.98840.log.gz -5 2023-11-24T08:06:01.675 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.97202.log 2023-11-24T08:06:01.676 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100967.log 2023-11-24T08:06:01.677 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98501.log.gz 2023-11-24T08:06:01.677 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98375.log 2023-11-24T08:06:01.678 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97202.log.gz 2023-11-24T08:06:01.679 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100967.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100967.log.gz 2023-11-24T08:06:01.679 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94645.log 2023-11-24T08:06:01.680 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94642.log 2023-11-24T08:06:01.680 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98375.log.gz 2023-11-24T08:06:01.681 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110394.log 2023-11-24T08:06:01.681 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94645.log.gz 2023-11-24T08:06:01.682 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104802.log 2023-11-24T08:06:01.682 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94642.log.gz 2023-11-24T08:06:01.683 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110394.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110394.log.gz -5 2023-11-24T08:06:01.683 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93054.log 2023-11-24T08:06:01.684 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100027.log 2023-11-24T08:06:01.685 INFO:teuthology.orchestra.run.smithi161.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.104802.log.gz 2023-11-24T08:06:01.685 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98129.log 2023-11-24T08:06:01.686 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93054.log.gz 2023-11-24T08:06:01.687 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100027.log: gzip -5 --verbose 88.9% -- /var/log/ceph/ceph-client.admin.97861.log -- replaced with /var/log/ceph/ceph-client.admin.100027.log.gz 2023-11-24T08:06:01.687 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-11-24T08:06:01.688 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93978.log 2023-11-24T08:06:01.688 INFO:teuthology.orchestra.run.smithi161.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.98129.log.gz 2023-11-24T08:06:01.689 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93423.log 2023-11-24T08:06:01.689 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97861.log.gz 2023-11-24T08:06:01.690 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103237.log 2023-11-24T08:06:01.690 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93978.log.gz 2023-11-24T08:06:01.691 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106832.log 2023-11-24T08:06:01.691 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93423.log.gz 2023-11-24T08:06:01.692 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103237.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103237.log.gz -5 2023-11-24T08:06:01.692 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.110959.log 2023-11-24T08:06:01.693 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106832.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.106832.log.gz 2023-11-24T08:06:01.693 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T08:06:01.694 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104674.log 2023-11-24T08:06:01.694 INFO:teuthology.orchestra.run.smithi161.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110959.log.gz 2023-11-24T08:06:01.695 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106874.log 2023-11-24T08:06:01.696 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107441.log 2023-11-24T08:06:01.697 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104674.log.gz 2023-11-24T08:06:01.697 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T08:06:01.698 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111452.log 2023-11-24T08:06:01.698 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.106874.log.gz 2023-11-24T08:06:01.699 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104422.log 2023-11-24T08:06:01.699 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107441.log.gz 2023-11-24T08:06:01.700 INFO:teuthology.orchestra.run.smithi175.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T08:06:01.700 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111452.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111452.log.gz 2023-11-24T08:06:01.700 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107102.log 2023-11-24T08:06:01.701 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105484.log 2023-11-24T08:06:01.701 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104422.log.gz 2023-11-24T08:06:01.702 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109640.log 2023-11-24T08:06:01.702 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107102.log.gz 2023-11-24T08:06:01.703 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107399.log 2023-11-24T08:06:01.704 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.105484.log.gz 2023-11-24T08:06:01.705 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109640.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109640.log.gz 2023-11-24T08:06:01.705 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108990.log 2023-11-24T08:06:01.706 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99733.log 2023-11-24T08:06:01.706 INFO:teuthology.orchestra.run.smithi161.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107399.log.gz 2023-11-24T08:06:01.707 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111914.log 2023-11-24T08:06:01.707 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108990.log.gz 2023-11-24T08:06:01.708 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106730.log 2023-11-24T08:06:01.708 INFO:teuthology.orchestra.run.smithi161.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.99733.log.gz 2023-11-24T08:06:01.709 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94316.log 2023-11-24T08:06:01.709 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111914.log.gz 2023-11-24T08:06:01.710 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106730.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106730.log.gz 2023-11-24T08:06:01.710 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104380.log 2023-11-24T08:06:01.711 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93801.log 2023-11-24T08:06:01.711 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94316.log.gz 2023-11-24T08:06:01.712 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109803.log 2023-11-24T08:06:01.712 INFO:teuthology.orchestra.run.smithi161.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104380.log.gz 2023-11-24T08:06:01.713 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93801.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93801.log.gz 2023-11-24T08:06:01.714 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103069.log 2023-11-24T08:06:01.715 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111788.log 2023-11-24T08:06:01.715 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109803.log.gz 2023-11-24T08:06:01.716 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95121.log 2023-11-24T08:06:01.716 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103069.log.gz 2023-11-24T08:06:01.717 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109032.log 2023-11-24T08:06:01.717 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111788.log.gz 2023-11-24T08:06:01.718 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95121.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95121.log.gz 2023-11-24T08:06:01.718 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100153.log 2023-11-24T08:06:01.719 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96851.log 2023-11-24T08:06:01.720 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109032.log.gz 2023-11-24T08:06:01.720 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96935.log 2023-11-24T08:06:01.721 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.100153.log.gz 2023-11-24T08:06:01.722 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96851.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96851.log.gz 2023-11-24T08:06:01.722 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102682.log 2023-11-24T08:06:01.723 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93967.log 2023-11-24T08:06:01.723 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.96935.log.gz 2023-11-24T08:06:01.724 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102682.log: gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102682.log.gz -5 2023-11-24T08:06:01.724 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.104548.log 2023-11-24T08:06:01.725 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93967.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93967.log.gz -5 2023-11-24T08:06:01.725 INFO:teuthology.orchestra.run.smithi161.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108778.log 2023-11-24T08:06:01.726 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106604.log 2023-11-24T08:06:01.727 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.104548.log.gz 2023-11-24T08:06:01.727 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106646.log 2023-11-24T08:06:01.728 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108778.log.gz 2023-11-24T08:06:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106604.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.106604.log.gz 2023-11-24T08:06:01.729 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98333.log 2023-11-24T08:06:01.730 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99397.log 2023-11-24T08:06:01.730 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106646.log.gz 2023-11-24T08:06:01.731 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105710.log 2023-11-24T08:06:01.731 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98333.log.gz 2023-11-24T08:06:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99397.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99397.log.gz 2023-11-24T08:06:01.732 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111872.log 2023-11-24T08:06:01.733 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107483.log 2023-11-24T08:06:01.733 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105710.log.gz 2023-11-24T08:06:01.734 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103752.log 2023-11-24T08:06:01.734 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111872.log.gz 2023-11-24T08:06:01.738 INFO:teuthology.orchestra.run.smithi175.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T08:06:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107483.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107483.log.gz 2023-11-24T08:06:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95289.log 2023-11-24T08:06:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103752.log: gzip 87.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.103752.log.gz -- 2023-11-24T08:06:01.739 INFO:teuthology.orchestra.run.smithi161.stderr: /var/log/ceph/ceph-client.admin.97945.log 2023-11-24T08:06:01.739 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100837.log 2023-11-24T08:06:01.740 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95289.log.gz 2023-11-24T08:06:01.740 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107753.log 2023-11-24T08:06:01.741 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97945.log.gz 2023-11-24T08:06:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109598.log 2023-11-24T08:06:01.741 INFO:teuthology.orchestra.run.smithi161.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100837.log.gz 2023-11-24T08:06:01.741 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107753.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107753.log.gz 2023-11-24T08:06:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99025.log 2023-11-24T08:06:01.742 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99943.log 2023-11-24T08:06:01.742 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.109598.log.gz 2023-11-24T08:06:01.743 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96741.log 2023-11-24T08:06:01.744 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99025.log.gz 2023-11-24T08:06:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99943.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99943.log.gz 2023-11-24T08:06:01.745 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107018.log 2023-11-24T08:06:01.746 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106124.log 2023-11-24T08:06:01.746 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96741.log.gz 2023-11-24T08:06:01.747 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97622.log 2023-11-24T08:06:01.747 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.107018.log.gz 2023-11-24T08:06:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106124.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106124.log.gz 2023-11-24T08:06:01.748 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98255.log 2023-11-24T08:06:01.749 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110875.log 2023-11-24T08:06:01.750 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97622.log.gz 2023-11-24T08:06:01.750 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93980.log 2023-11-24T08:06:01.751 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98255.log.gz 2023-11-24T08:06:01.752 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110875.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110875.log.gz 2023-11-24T08:06:01.752 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112016.log 2023-11-24T08:06:01.753 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103573.log 2023-11-24T08:06:01.753 INFO:teuthology.orchestra.run.smithi161.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93980.log.gz 2023-11-24T08:06:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.112016.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112016.log.gz 2023-11-24T08:06:01.754 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T08:06:01.755 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96977.log 2023-11-24T08:06:01.756 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.103573.log.gz 2023-11-24T08:06:01.756 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93549.log 2023-11-24T08:06:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96977.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.96977.log.gz 2023-11-24T08:06:01.758 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98585.log 2023-11-24T08:06:01.759 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100237.log 2023-11-24T08:06:01.759 INFO:teuthology.orchestra.run.smithi161.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93549.log.gz 2023-11-24T08:06:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98585.log.gz 2023-11-24T08:06:01.760 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99067.log 2023-11-24T08:06:01.761 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100753.log 2023-11-24T08:06:01.761 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100237.log.gz 2023-11-24T08:06:01.762 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99067.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99067.log.gz 2023-11-24T08:06:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104338.log 2023-11-24T08:06:01.763 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109947.log 2023-11-24T08:06:01.764 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100753.log.gz 2023-11-24T08:06:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104338.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104338.log.gz 2023-11-24T08:06:01.765 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102214.log 2023-11-24T08:06:01.766 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105342.log 2023-11-24T08:06:01.766 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109947.log.gz 2023-11-24T08:06:01.767 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105300.log 2023-11-24T08:06:01.767 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102214.log.gz 2023-11-24T08:06:01.768 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93112.log 2023-11-24T08:06:01.768 INFO:teuthology.orchestra.run.smithi161.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105342.log.gz 2023-11-24T08:06:01.770 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107144.log 2023-11-24T08:06:01.770 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.105300.log.gz 2023-11-24T08:06:01.771 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96178.log 2023-11-24T08:06:01.771 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93112.log.gz 2023-11-24T08:06:01.772 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111116.log 2023-11-24T08:06:01.772 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107144.log.gz 2023-11-24T08:06:01.773 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.96178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104126.log 2023-11-24T08:06:01.773 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96178.log.gz 2023-11-24T08:06:01.774 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111116.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111116.log.gz 2023-11-24T08:06:01.775 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102985.log 2023-11-24T08:06:01.776 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94651.log 2023-11-24T08:06:01.776 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.104126.log.gz 2023-11-24T08:06:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102985.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.102985.log.gz 2023-11-24T08:06:01.777 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105794.log 2023-11-24T08:06:01.778 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93983.log 2023-11-24T08:06:01.778 INFO:teuthology.orchestra.run.smithi161.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94651.log.gz 2023-11-24T08:06:01.779 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105794.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.105794.log.gz --verbose 2023-11-24T08:06:01.779 INFO:teuthology.orchestra.run.smithi161.stderr: -- /var/log/ceph/ceph-client.admin.104082.log 2023-11-24T08:06:01.780 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100585.log 2023-11-24T08:06:01.781 INFO:teuthology.orchestra.run.smithi161.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93983.log.gz 2023-11-24T08:06:01.782 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97328.log 2023-11-24T08:06:01.782 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104082.log.gz 2023-11-24T08:06:01.783 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102724.log 2023-11-24T08:06:01.783 INFO:teuthology.orchestra.run.smithi161.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.100585.log.gz 2023-11-24T08:06:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97328.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.97328.log.gz 2023-11-24T08:06:01.784 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107315.log 2023-11-24T08:06:01.785 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109682.log 2023-11-24T08:06:01.785 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102724.log.gz 2023-11-24T08:06:01.786 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107315.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107315.log.gz 2023-11-24T08:06:01.786 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101051.log 2023-11-24T08:06:01.787 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98627.log 2023-11-24T08:06:01.787 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109682.log.gz 2023-11-24T08:06:01.788 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101051.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101051.log.gz 2023-11-24T08:06:01.789 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99523.log 2023-11-24T08:06:01.790 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103027.log 2023-11-24T08:06:01.790 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.98627.log.gz 2023-11-24T08:06:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99523.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99523.log.gz 2023-11-24T08:06:01.791 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107837.log 2023-11-24T08:06:01.793 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103615.log 2023-11-24T08:06:01.793 INFO:teuthology.orchestra.run.smithi161.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103027.log.gz 2023-11-24T08:06:01.794 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107837.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107837.log.gz 2023-11-24T08:06:01.794 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98543.log 2023-11-24T08:06:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105836.log 2023-11-24T08:06:01.796 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103615.log.gz 2023-11-24T08:06:01.796 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98543.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98543.log.gz 2023-11-24T08:06:01.797 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102943.log 2023-11-24T08:06:01.798 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100669.log 2023-11-24T08:06:01.799 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105836.log.gz 2023-11-24T08:06:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102943.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102943.log.gz 2023-11-24T08:06:01.800 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93465.log 2023-11-24T08:06:01.801 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99649.log 2023-11-24T08:06:01.801 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100669.log.gz 2023-11-24T08:06:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93465.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93465.log.gz 2023-11-24T08:06:01.802 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102598.log 2023-11-24T08:06:01.804 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99649.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T08:06:01.804 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99649.log.gz 2023-11-24T08:06:01.804 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102598.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102598.log.gz 2023-11-24T08:06:01.805 INFO:teuthology.orchestra.run.smithi175.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T08:06:01.805 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110193.log 2023-11-24T08:06:01.806 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100711.log 2023-11-24T08:06:01.807 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110193.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110193.log.gz 2023-11-24T08:06:01.808 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103321.log 2023-11-24T08:06:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100711.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100711.log.gz 2023-11-24T08:06:01.809 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101303.log 2023-11-24T08:06:01.810 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106334.log 2023-11-24T08:06:01.811 INFO:teuthology.orchestra.run.smithi161.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103321.log.gz 2023-11-24T08:06:01.812 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101303.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101303.log.gz 2023-11-24T08:06:01.812 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110790.log 2023-11-24T08:06:01.813 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106334.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.106334.log.gz 2023-11-24T08:06:01.814 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102841.log 2023-11-24T08:06:01.815 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110790.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110790.log.gz 2023-11-24T08:06:01.815 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110730.log 2023-11-24T08:06:01.816 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102841.log.gz 2023-11-24T08:06:01.816 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102520.log 2023-11-24T08:06:01.818 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97538.log 2023-11-24T08:06:01.818 INFO:teuthology.orchestra.run.smithi161.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110730.log.gz 2023-11-24T08:06:01.819 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102520.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102520.log.gz 2023-11-24T08:06:01.819 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98925.log 2023-11-24T08:06:01.821 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97538.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97538.log.gz 2023-11-24T08:06:01.821 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100925.log 2023-11-24T08:06:01.822 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98925.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98925.log.gz 2023-11-24T08:06:01.822 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108089.log 2023-11-24T08:06:01.823 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100925.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100925.log.gz 2023-11-24T08:06:01.824 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99985.log 2023-11-24T08:06:01.824 INFO:teuthology.orchestra.run.smithi175.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T08:06:01.825 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94639.log 2023-11-24T08:06:01.825 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108089.log.gz 2023-11-24T08:06:01.826 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99985.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99985.log.gz 2023-11-24T08:06:01.827 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102273.log 2023-11-24T08:06:01.827 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94639.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94639.log.gz 2023-11-24T08:06:01.828 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104040.log 2023-11-24T08:06:01.829 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110109.log 2023-11-24T08:06:01.830 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.102273.log.gz 2023-11-24T08:06:01.830 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104040.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104040.log.gz 2023-11-24T08:06:01.831 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105384.log 2023-11-24T08:06:01.832 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110109.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110109.log.gz 2023-11-24T08:06:01.832 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112056.log 2023-11-24T08:06:01.834 INFO:teuthology.orchestra.run.smithi175.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T08:06:01.834 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94977.log 2023-11-24T08:06:01.834 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105384.log.gz 2023-11-24T08:06:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.112056.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112056.log.gz 2023-11-24T08:06:01.835 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100627.log 2023-11-24T08:06:01.836 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T08:06:01.837 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94977.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.94977.log.gz 2023-11-24T08:06:01.837 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96021.log 2023-11-24T08:06:01.838 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100627.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100627.log.gz 2023-11-24T08:06:01.838 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108005.log 2023-11-24T08:06:01.839 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.96021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105526.log 2023-11-24T08:06:01.841 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108005.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.96021.log.gz 2023-11-24T08:06:01.841 INFO:teuthology.orchestra.run.smithi161.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.108005.log.gz 2023-11-24T08:06:01.841 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110478.log 2023-11-24T08:06:01.842 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105526.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105526.log.gz 2023-11-24T08:06:01.843 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105998.log 2023-11-24T08:06:01.843 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110478.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.110478.log.gz 2023-11-24T08:06:01.844 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103489.log 2023-11-24T08:06:01.845 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94851.log 2023-11-24T08:06:01.846 INFO:teuthology.orchestra.run.smithi161.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.105998.log.gz 2023-11-24T08:06:01.846 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103489.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103489.log.gz 2023-11-24T08:06:01.847 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94305.log 2023-11-24T08:06:01.848 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94851.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94851.log.gz 2023-11-24T08:06:01.848 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100795.log 2023-11-24T08:06:01.850 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101869.log 2023-11-24T08:06:01.850 INFO:teuthology.orchestra.run.smithi161.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.94305.log.gz 2023-11-24T08:06:01.851 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100795.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100795.log.gz 2023-11-24T08:06:01.851 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99691.log 2023-11-24T08:06:01.852 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101869.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101869.log.gz 2023-11-24T08:06:01.853 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108736.log 2023-11-24T08:06:01.854 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101995.log 2023-11-24T08:06:01.854 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99691.log.gz 2023-11-24T08:06:01.855 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108736.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108736.log.gz 2023-11-24T08:06:01.856 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88928.log 2023-11-24T08:06:01.857 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101995.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101995.log.gz 2023-11-24T08:06:01.857 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98087.log 2023-11-24T08:06:01.858 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.88928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.88928.log.gz 2023-11-24T08:06:01.859 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102766.log 2023-11-24T08:06:01.860 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97454.log 2023-11-24T08:06:01.860 INFO:teuthology.orchestra.run.smithi161.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98087.log.gz 2023-11-24T08:06:01.861 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102766.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102766.log.gz 2023-11-24T08:06:01.861 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108556.log 2023-11-24T08:06:01.862 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97454.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.97454.log.gz 2023-11-24T08:06:01.863 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107186.log 2023-11-24T08:06:01.864 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88640.log 2023-11-24T08:06:01.864 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107186.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108556.log.gz 2023-11-24T08:06:01.865 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107186.log.gz 2023-11-24T08:06:01.866 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111830.log 2023-11-24T08:06:01.867 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.88640.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.88640.log.gz 2023-11-24T08:06:01.867 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106208.log 2023-11-24T08:06:01.868 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98417.log 2023-11-24T08:06:01.869 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111830.log.gz 2023-11-24T08:06:01.870 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106208.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106208.log.gz 2023-11-24T08:06:01.870 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102394.log 2023-11-24T08:06:01.871 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98417.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98417.log.gz 2023-11-24T08:06:01.871 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.96595.log 2023-11-24T08:06:01.873 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100111.log 2023-11-24T08:06:01.873 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102394.log.gz 2023-11-24T08:06:01.874 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.2.96595.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T08:06:01.875 INFO:teuthology.orchestra.run.smithi161.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.2.96595.log.gz 2023-11-24T08:06:01.876 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100111.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100111.log.gz 2023-11-24T08:06:01.876 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110520.log 2023-11-24T08:06:01.877 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101953.log 2023-11-24T08:06:01.878 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110520.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110520.log.gz 2023-11-24T08:06:01.879 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.82566.log 2023-11-24T08:06:01.880 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101953.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101953.log.gz 2023-11-24T08:06:01.880 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110151.log 2023-11-24T08:06:01.881 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.tmp-client.admin.82566.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.82566.log.gz 2023-11-24T08:06:01.881 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95499.log 2023-11-24T08:06:01.883 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110151.log.gz 2023-11-24T08:06:01.883 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106463.log 2023-11-24T08:06:01.884 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95499.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T08:06:01.885 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107711.log 2023-11-24T08:06:01.885 INFO:teuthology.orchestra.run.smithi161.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.95499.log.gz 2023-11-24T08:06:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106463.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.106463.log.gz 2023-11-24T08:06:01.886 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95205.log 2023-11-24T08:06:01.887 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98796.log 2023-11-24T08:06:01.888 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107711.log.gz 2023-11-24T08:06:01.888 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95205.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95205.log.gz 2023-11-24T08:06:01.889 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103363.log 2023-11-24T08:06:01.890 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.109459.log 2023-11-24T08:06:01.890 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98796.log.gz 2023-11-24T08:06:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103363.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103363.log.gz 2023-11-24T08:06:01.892 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105652.log 2023-11-24T08:06:01.893 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.109459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94650.log 2023-11-24T08:06:01.894 INFO:teuthology.orchestra.run.smithi161.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.109459.log.gz 2023-11-24T08:06:01.894 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105652.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.105652.log.gz 2023-11-24T08:06:01.895 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99607.log 2023-11-24T08:06:01.896 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99481.log 2023-11-24T08:06:01.897 INFO:teuthology.orchestra.run.smithi161.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94650.log.gz 2023-11-24T08:06:01.897 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99607.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.99607.log.gz 2023-11-24T08:06:01.898 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108472.log 2023-11-24T08:06:01.898 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99481.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.99481.log.gz 2023-11-24T08:06:01.899 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98213.log 2023-11-24T08:06:01.900 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99565.log 2023-11-24T08:06:01.901 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.108472.log.gz 2023-11-24T08:06:01.901 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98213.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98213.log.gz 2023-11-24T08:06:01.902 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100317.log 2023-11-24T08:06:01.902 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T08:06:01.903 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99565.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99565.log.gz 2023-11-24T08:06:01.904 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103956.log 2023-11-24T08:06:01.905 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100317.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100317.log.gz 2023-11-24T08:06:01.905 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107585.log 2023-11-24T08:06:01.907 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103956.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.103956.log.gz 2023-11-24T08:06:01.907 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98670.log 2023-11-24T08:06:01.908 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107585.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107585.log.gz 2023-11-24T08:06:01.908 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110833.log 2023-11-24T08:06:01.909 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108694.log 2023-11-24T08:06:01.910 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98670.log.gz 2023-11-24T08:06:01.911 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110833.log: gzip -5 --verbose -- 87.9% /var/log/ceph/ceph-client.admin.107921.log 2023-11-24T08:06:01.911 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.admin.110833.log.gz 2023-11-24T08:06:01.912 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108694.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T08:06:01.913 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108694.log.gz 2023-11-24T08:06:01.914 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107921.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107921.log.gz 2023-11-24T08:06:01.914 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98883.log 2023-11-24T08:06:01.915 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106562.log 2023-11-24T08:06:01.916 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.98883.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98883.log.gz 2023-11-24T08:06:01.917 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99109.log 2023-11-24T08:06:01.918 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106562.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106562.log.gz 2023-11-24T08:06:01.918 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108644.log 2023-11-24T08:06:01.920 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99109.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.99109.log.gz 2023-11-24T08:06:01.920 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.105161.log 2023-11-24T08:06:01.921 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108644.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108644.log.gz 2023-11-24T08:06:01.921 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105752.log 2023-11-24T08:06:01.923 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.105161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93000.log 2023-11-24T08:06:01.924 INFO:teuthology.orchestra.run.smithi161.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.105161.log.gz 2023-11-24T08:06:01.924 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105752.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.105752.log.gz 2023-11-24T08:06:01.924 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95457.log 2023-11-24T08:06:01.925 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99439.log 2023-11-24T08:06:01.926 INFO:teuthology.orchestra.run.smithi161.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93000.log.gz 2023-11-24T08:06:01.927 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95457.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95457.log.gz 2023-11-24T08:06:01.927 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110067.log 2023-11-24T08:06:01.928 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99439.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99439.log.gz 2023-11-24T08:06:01.928 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108948.log 2023-11-24T08:06:01.929 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94310.log 2023-11-24T08:06:01.930 INFO:teuthology.orchestra.run.smithi161.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.110067.log.gz 2023-11-24T08:06:01.930 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108948.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.108948.log.gz 2023-11-24T08:06:01.931 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110562.log 2023-11-24T08:06:01.932 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104632.log 2023-11-24T08:06:01.933 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94310.log.gz 2023-11-24T08:06:01.933 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110562.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110562.log.gz 2023-11-24T08:06:01.934 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108514.log 2023-11-24T08:06:01.935 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106250.log 2023-11-24T08:06:01.935 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104632.log.gz 2023-11-24T08:06:01.936 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108514.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108514.log.gz 2023-11-24T08:06:01.936 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108864.log 2023-11-24T08:06:01.938 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106250.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T08:06:01.938 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.106250.log.gz 2023-11-24T08:06:01.942 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108864.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108864.log.gz 2023-11-24T08:06:01.942 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107795.log 2023-11-24T08:06:01.942 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100543.log 2023-11-24T08:06:01.942 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109074.log 2023-11-24T08:06:01.942 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107795.log.gz 2023-11-24T08:06:01.942 INFO:teuthology.orchestra.run.smithi161.stderr: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T08:06:01.943 INFO:teuthology.orchestra.run.smithi175.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T08:06:01.944 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100543.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100543.log.gz 2023-11-24T08:06:01.944 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110352.log 2023-11-24T08:06:01.944 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93977.log 2023-11-24T08:06:01.945 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.109074.log.gz 2023-11-24T08:06:01.945 INFO:teuthology.orchestra.run.smithi175.stderr: 2023-11-24T08:06:01.945 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m0.437s 2023-11-24T08:06:01.945 INFO:teuthology.orchestra.run.smithi175.stderr:user 0m1.925s 2023-11-24T08:06:01.945 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m0.279s 2023-11-24T08:06:01.947 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110352.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.110352.log.gz 2023-11-24T08:06:01.947 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101911.log 2023-11-24T08:06:01.947 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93977.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.93977.log.gz 2023-11-24T08:06:01.948 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103914.log 2023-11-24T08:06:01.948 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95601.log 2023-11-24T08:06:01.949 INFO:teuthology.orchestra.run.smithi161.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101911.log.gz 2023-11-24T08:06:01.950 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103914.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103914.log.gz 2023-11-24T08:06:01.950 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T08:06:01.951 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95601.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95601.log.gz 2023-11-24T08:06:01.951 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102352.log 2023-11-24T08:06:01.952 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107627.log 2023-11-24T08:06:01.954 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102352.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102352.log.gz 2023-11-24T08:06:01.954 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111200.log 2023-11-24T08:06:01.956 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107627.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111326.log 2023-11-24T08:06:01.956 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107627.log.gz 2023-11-24T08:06:01.957 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109845.log 2023-11-24T08:06:01.958 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111200.log.gz 2023-11-24T08:06:01.959 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111326.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111326.log.gz 2023-11-24T08:06:01.959 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T08:06:01.960 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109845.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.109845.log.gz 2023-11-24T08:06:01.961 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97412.log 2023-11-24T08:06:01.962 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93507.log 2023-11-24T08:06:01.964 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97412.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97412.log.gz 2023-11-24T08:06:01.965 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100195.log 2023-11-24T08:06:01.965 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93507.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93507.log.gz 2023-11-24T08:06:01.966 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103447.log 2023-11-24T08:06:01.968 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100195.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100195.log.gz 2023-11-24T08:06:01.969 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104212.log 2023-11-24T08:06:01.969 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103447.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103447.log.gz 2023-11-24T08:06:01.970 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T08:06:01.971 INFO:teuthology.orchestra.run.smithi161.stderr: -- /var/log/ceph/ceph-client.admin.109182.log 2023-11-24T08:06:01.971 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104212.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.104212.log.gz 2023-11-24T08:06:01.973 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106520.log 2023-11-24T08:06:01.974 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100501.log 2023-11-24T08:06:01.975 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109182.log.gz 2023-11-24T08:06:01.976 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108047.log 2023-11-24T08:06:01.976 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106520.log.gz 2023-11-24T08:06:01.977 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100501.log: gzip 90.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T08:06:01.977 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.100501.log.gz -- 2023-11-24T08:06:01.977 INFO:teuthology.orchestra.run.smithi161.stderr: /var/log/ceph/ceph-client.admin.101093.log 2023-11-24T08:06:01.978 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102436.log 2023-11-24T08:06:01.978 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108047.log.gz 2023-11-24T08:06:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101093.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101093.log.gz 2023-11-24T08:06:01.981 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106376.log 2023-11-24T08:06:01.982 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100440.log 2023-11-24T08:06:01.982 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102436.log.gz 2023-11-24T08:06:01.982 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106376.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106376.log.gz 2023-11-24T08:06:01.982 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.101730.log 2023-11-24T08:06:01.984 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.100440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101345.log 2023-11-24T08:06:01.984 INFO:teuthology.orchestra.run.smithi161.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.100440.log.gz 2023-11-24T08:06:01.985 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.101730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108386.log 2023-11-24T08:06:01.987 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93381.log 2023-11-24T08:06:01.987 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101345.log.gz 2023-11-24T08:06:01.988 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109116.log 2023-11-24T08:06:01.988 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108386.log.gz 2023-11-24T08:06:01.990 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110235.log 2023-11-24T08:06:01.990 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93381.log.gz 2023-11-24T08:06:01.990 INFO:teuthology.orchestra.run.smithi161.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.0.101730.log.gz 2023-11-24T08:06:01.991 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110436.log 2023-11-24T08:06:01.992 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.109116.log.gz 2023-11-24T08:06:01.992 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110235.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110235.log.gz 2023-11-24T08:06:01.992 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93717.log 2023-11-24T08:06:01.993 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93963.log 2023-11-24T08:06:01.994 INFO:teuthology.orchestra.run.smithi161.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110436.log.gz 2023-11-24T08:06:01.994 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93717.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93717.log.gz 2023-11-24T08:06:01.995 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104716.log 2023-11-24T08:06:01.996 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103195.log 2023-11-24T08:06:01.996 INFO:teuthology.orchestra.run.smithi161.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93963.log.gz 2023-11-24T08:06:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.104716.log.gz 2023-11-24T08:06:01.997 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94935.log 2023-11-24T08:06:01.998 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108428.log 2023-11-24T08:06:01.999 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94935.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.103195.log.gz 2023-11-24T08:06:02.000 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94935.log.gz 2023-11-24T08:06:02.000 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111536.log 2023-11-24T08:06:02.001 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93968.log 2023-11-24T08:06:02.002 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108428.log.gz 2023-11-24T08:06:02.002 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111536.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111536.log.gz 2023-11-24T08:06:02.003 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101009.log 2023-11-24T08:06:02.004 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95247.log 2023-11-24T08:06:02.004 INFO:teuthology.orchestra.run.smithi161.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93968.log.gz 2023-11-24T08:06:02.005 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.101009.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101009.log.gz 2023-11-24T08:06:02.005 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105878.log 2023-11-24T08:06:02.007 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111242.log 2023-11-24T08:06:02.007 INFO:teuthology.orchestra.run.smithi161.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.95247.log.gz 2023-11-24T08:06:02.008 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.105878.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105878.log.gz 2023-11-24T08:06:02.008 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97160.log 2023-11-24T08:06:02.009 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102111.log 2023-11-24T08:06:02.010 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111242.log.gz 2023-11-24T08:06:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97160.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97160.log.gz 2023-11-24T08:06:02.011 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93591.log 2023-11-24T08:06:02.012 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103279.log 2023-11-24T08:06:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102111.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102111.log.gz 2023-11-24T08:06:02.013 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93591.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93591.log.gz 2023-11-24T08:06:02.014 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104464.log 2023-11-24T08:06:02.015 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106166.log 2023-11-24T08:06:02.015 INFO:teuthology.orchestra.run.smithi161.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.103279.log.gz 2023-11-24T08:06:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.104464.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.104464.log.gz 2023-11-24T08:06:02.016 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110604.log 2023-11-24T08:06:02.017 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94299.log 2023-11-24T08:06:02.018 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106166.log.gz 2023-11-24T08:06:02.019 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.110604.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110604.log.gz 2023-11-24T08:06:02.019 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92917.log 2023-11-24T08:06:02.020 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106688.log 2023-11-24T08:06:02.020 INFO:teuthology.orchestra.run.smithi161.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94299.log.gz 2023-11-24T08:06:02.020 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.92917.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.92917.log.gz 2023-11-24T08:06:02.021 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93339.log 2023-11-24T08:06:02.022 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103405.log 2023-11-24T08:06:02.022 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106688.log.gz 2023-11-24T08:06:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.93339.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93339.log.gz 2023-11-24T08:06:02.023 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95019.log 2023-11-24T08:06:02.024 INFO:teuthology.orchestra.run.smithi161.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T08:06:02.025 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99775.log 2023-11-24T08:06:02.025 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103405.log.gz 2023-11-24T08:06:02.026 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95331.log 2023-11-24T08:06:02.026 INFO:teuthology.orchestra.run.smithi161.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.95019.log.gz 2023-11-24T08:06:02.027 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99775.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.99775.log.gz 2023-11-24T08:06:02.027 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94603.log 2023-11-24T08:06:02.028 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.95331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108131.log 2023-11-24T08:06:02.028 INFO:teuthology.orchestra.run.smithi161.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95331.log.gz 2023-11-24T08:06:02.029 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.94603.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.94603.log.gz --verbose 2023-11-24T08:06:02.029 INFO:teuthology.orchestra.run.smithi161.stderr: -- /var/log/ceph/ceph-client.admin.97580.log 2023-11-24T08:06:02.030 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111494.log 2023-11-24T08:06:02.031 INFO:teuthology.orchestra.run.smithi161.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108131.log.gz 2023-11-24T08:06:02.031 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97580.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.97580.log.gz 2023-11-24T08:06:02.032 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106292.log 2023-11-24T08:06:02.033 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.111494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107526.log 2023-11-24T08:06:02.033 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.111494.log.gz 2023-11-24T08:06:02.034 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.106292.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106292.log.gz 2023-11-24T08:06:02.034 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-24T08:06:02.035 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.107526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102640.log 2023-11-24T08:06:02.035 INFO:teuthology.orchestra.run.smithi161.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107526.log.gz 2023-11-24T08:06:02.036 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108906.log 2023-11-24T08:06:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.102640.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102640.log.gz 2023-11-24T08:06:02.038 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109989.log 2023-11-24T08:06:02.038 INFO:teuthology.orchestra.run.smithi161.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-24T08:06:02.039 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.108906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103832.log 2023-11-24T08:06:02.039 INFO:teuthology.orchestra.run.smithi161.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.108906.log.gz 2023-11-24T08:06:02.040 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.109989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99355.log 2023-11-24T08:06:02.040 INFO:teuthology.orchestra.run.smithi161.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109989.log.gz 2023-11-24T08:06:02.041 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.103832.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103832.log.gz 2023-11-24T08:06:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97496.log 2023-11-24T08:06:02.042 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.99355.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99355.log.gz 2023-11-24T08:06:02.043 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.97496.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97496.log.gz 2023-11-24T08:06:02.153 INFO:teuthology.orchestra.run.smithi161.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T08:06:02.190 INFO:teuthology.orchestra.run.smithi161.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T08:06:02.199 INFO:teuthology.orchestra.run.smithi161.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T08:06:02.204 INFO:teuthology.orchestra.run.smithi161.stderr: 2023-11-24T08:06:02.205 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m0.699s 2023-11-24T08:06:02.205 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m1.629s 2023-11-24T08:06:02.205 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m1.162s 2023-11-24T08:06:02.206 INFO:tasks.ceph:Archiving logs... 2023-11-24T08:06:02.206 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/remote/smithi161/log 2023-11-24T08:06:02.213 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:06:03.790 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/remote/smithi175/log 2023-11-24T08:06:03.791 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T08:06:04.119 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T08:06:04.129 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T08:06:04.130 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:06:04.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T08:06:04.300 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T08:06:04.310 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T08:06:04.310 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:06:04.320 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T08:06:04.368 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2023-11-24T08:06:04.377 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:06:04.377 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2023-11-24T08:06:04.377 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 +2489us[+2381us] +/- 76ms 2023-11-24T08:06:04.377 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -841us[ -949us] +/- 54ms 2023-11-24T08:06:04.377 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv03.front.sepia.ceph.com 3 6 377 13 -1322us[-1430us] +/- 81ms 2023-11-24T08:06:04.378 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:06:04.378 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2023-11-24T08:06:04.387 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T08:06:04.387 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2023-11-24T08:06:04.387 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 +2496us[+2496us] +/- 76ms 2023-11-24T08:06:04.387 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -820us[ -901us] +/- 54ms 2023-11-24T08:06:04.388 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -1323us[-1323us] +/- 81ms 2023-11-24T08:06:04.388 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T08:06:04.389 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T08:06:04.398 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T08:06:04.398 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T08:06:04.407 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T08:06:04.627 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T08:06:04.889 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T08:06:05.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:06:05.001 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T08:06:05.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:06:05.110 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T08:06:05.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T08:06:05.130 INFO:teuthology.task.internal:Duration was 1143.006374 seconds 2023-11-24T08:06:05.130 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T08:06:05.140 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T08:06:05.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:06:05.149 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T08:06:05.301 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T08:06:05.323 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T08:06:05.654 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T08:06:05.654 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2023-11-24T08:06:05.655 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:06:05.731 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2023-11-24T08:06:05.731 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T08:06:05.817 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T08:06:05.818 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:06:05.826 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T08:06:05.922 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T08:06:05.922 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:06:05.930 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T08:06:06.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T08:06:06.124 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T08:06:06.125 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:06:06.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T08:06:06.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T08:06:06.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:06:06.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:06:06.447 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2023-11-24T08:06:06.451 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2023-11-24T08:06:06.504 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:06:06.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:06:06.553 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T08:06:06.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T08:06:06.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T08:06:06.622 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T08:06:06.622 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/remote/smithi161 2023-11-24T08:06:06.623 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:06:06.736 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574/remote/smithi175 2023-11-24T08:06:06.736 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T08:06:06.847 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T08:06:06.847 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:06:06.859 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T08:06:06.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T08:06:06.929 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T08:06:06.929 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T08:06:06.939 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T08:06:06.940 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:06:06.949 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T08:06:07.001 INFO:teuthology.orchestra.run.smithi161.stdout: 393944 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:06 /home/ubuntu/cephtest 2023-11-24T08:06:07.007 INFO:teuthology.orchestra.run.smithi175.stdout: 524899 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 08:06 /home/ubuntu/cephtest 2023-11-24T08:06:07.010 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T08:06:07.021 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T08:06:07.041 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T08:06:07.068 DEBUG:teuthology.nuke:shortname: smithi161 2023-11-24T08:06:07.068 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:06:07.096 DEBUG:teuthology.nuke:shortname: smithi175 2023-11-24T08:06:07.097 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T08:06:07.100 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:37:53.634779', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB9rBWDJYPE9yZQLLjcjH5h/SMQD+VIcu5fTVxOHU0ujqeR3HV/q1aWOXSbNnn5BoiuA7jUUBlHINzO6FMXKvXA='} 2023-11-24T08:06:07.122 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_07:31:48-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465574', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 07:37:53.636920', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW/wDml/gXEudHmG4LjrgrhKTGbD8SdKwcdLWYRDpRJmvRO48Eol3SYWzYqC4KifslRR4uoSyfjg0+HMn5w14I='} 2023-11-24T08:06:07.158 INFO:teuthology.orchestra.console.smithi161:Power off 2023-11-24T08:06:07.159 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:06:07.186 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-11-24T08:06:07.186 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:07.203 INFO:teuthology.orchestra.console.smithi175:Power off 2023-11-24T08:06:07.203 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T08:06:07.214 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-24T08:06:07.226 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-11-24T08:06:07.226 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:07.249 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-11-24T08:06:11.215 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:11.251 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:11.326 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-11-24T08:06:11.361 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-11-24T08:06:15.330 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:15.362 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:15.441 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-11-24T08:06:15.473 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-11-24T08:06:15.543 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-11-24T08:06:19.478 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T08:06:19.999 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-11-24T08:06:20.100 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-11-24T08:06:20.205 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/misc}} duration: 1143.0063741207123 failure_reason: 'Test failure: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc)' flavor: default mon.a-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 mon.b-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=05e36c0efe9d45da964d44280b10191f status: fail success: false 2023-11-24T08:06:20.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T08:06:20.288 INFO:teuthology.run:FAIL